[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:00:11.686195  7271 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.25.254:37199
I20260709 13:00:11.687788  7271 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:00:11.688884  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:11.706132  7277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:11.706357  7280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:11.707515  7271 server_base.cc:1061] running on GCE node
W20260709 13:00:11.706143  7278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:12.903530  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:12.903792  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:12.904064  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602012904023 us; error 0 us; skew 500 ppm
I20260709 13:00:12.904961  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:12.911861  7271 webserver.cc:533] Webserver started at http://127.7.25.254:42547/ using document root <none> and password file <none>
I20260709 13:00:12.912820  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:12.913066  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:12.913604  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:12.919395  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602011513864-7271-0/minicluster-data/master-0-root/instance:
uuid: "b3b1e412fde249f79ac201c7a42c1bc1"
format_stamp: "Formatted at 2026-07-09 13:00:12 on dist-test-slave-z1zn"
I20260709 13:00:12.927197  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:00:12.932374  7286 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:12.933740  7271 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:00:12.934158  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602011513864-7271-0/minicluster-data/master-0-root
uuid: "b3b1e412fde249f79ac201c7a42c1bc1"
format_stamp: "Formatted at 2026-07-09 13:00:12 on dist-test-slave-z1zn"
I20260709 13:00:12.934520  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602011513864-7271-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602011513864-7271-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602011513864-7271-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:12.989732  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:12.991336  7271 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:00:12.991830  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:13.065711  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.254:37199
I20260709 13:00:13.065778  7337 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.254:37199 every 8 connection(s)
I20260709 13:00:13.073871  7338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:13.095500  7338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1: Bootstrap starting.
I20260709 13:00:13.101612  7338 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.103570  7338 log.cc:826] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1: Log is configured to *not* fsync() on all Append() calls
I20260709 13:00:13.108688  7338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1: No bootstrap required, opened a new log
I20260709 13:00:13.129946  7338 raft_consensus.cc:359] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3b1e412fde249f79ac201c7a42c1bc1" member_type: VOTER }
I20260709 13:00:13.130533  7338 raft_consensus.cc:385] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.130810  7338 raft_consensus.cc:740] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3b1e412fde249f79ac201c7a42c1bc1, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.131811  7338 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3b1e412fde249f79ac201c7a42c1bc1" member_type: VOTER }
I20260709 13:00:13.132311  7338 raft_consensus.cc:399] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:00:13.132601  7338 raft_consensus.cc:493] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:00:13.132956  7338 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.137894  7338 raft_consensus.cc:515] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3b1e412fde249f79ac201c7a42c1bc1" member_type: VOTER }
I20260709 13:00:13.138664  7338 leader_election.cc:304] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3b1e412fde249f79ac201c7a42c1bc1; no voters: 
I20260709 13:00:13.140497  7338 leader_election.cc:290] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:00:13.140848  7341 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:13.143671  7341 raft_consensus.cc:697] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1 [term 1 LEADER]: Becoming Leader. State: Replica: b3b1e412fde249f79ac201c7a42c1bc1, State: Running, Role: LEADER
I20260709 13:00:13.144673  7341 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3b1e412fde249f79ac201c7a42c1bc1" member_type: VOTER }
I20260709 13:00:13.145820  7338 sys_catalog.cc:565] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:00:13.157322  7342 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3b1e412fde249f79ac201c7a42c1bc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3b1e412fde249f79ac201c7a42c1bc1" member_type: VOTER } }
I20260709 13:00:13.157672  7343 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3b1e412fde249f79ac201c7a42c1bc1. Latest consensus state: current_term: 1 leader_uuid: "b3b1e412fde249f79ac201c7a42c1bc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3b1e412fde249f79ac201c7a42c1bc1" member_type: VOTER } }
I20260709 13:00:13.158097  7342 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:13.158286  7343 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:13.161448  7351 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:00:13.173375  7351 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:00:13.175753  7271 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:00:13.190724  7351 catalog_manager.cc:1383] Generated new cluster ID: 8970c1d9874043ecbfeedb6e53eddf31
I20260709 13:00:13.191053  7351 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:00:13.217012  7351 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:00:13.218676  7351 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:00:13.237233  7351 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1: Generated new TSK 0
I20260709 13:00:13.238476  7351 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:00:13.306493  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:13.314843  7360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:13.316257  7361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:13.319717  7271 server_base.cc:1061] running on GCE node
W20260709 13:00:13.320195  7363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:13.321233  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:13.321445  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:13.321635  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602013321612 us; error 0 us; skew 500 ppm
I20260709 13:00:13.322260  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:13.326646  7271 webserver.cc:533] Webserver started at http://127.7.25.193:40489/ using document root <none> and password file <none>
I20260709 13:00:13.327191  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:13.327446  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:13.327734  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:13.328814  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602011513864-7271-0/minicluster-data/ts-0-root/instance:
uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
format_stamp: "Formatted at 2026-07-09 13:00:13 on dist-test-slave-z1zn"
I20260709 13:00:13.334444  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:00:13.338896  7368 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:13.339802  7271 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:00:13.340106  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602011513864-7271-0/minicluster-data/ts-0-root
uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
format_stamp: "Formatted at 2026-07-09 13:00:13 on dist-test-slave-z1zn"
I20260709 13:00:13.340380  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602011513864-7271-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602011513864-7271-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602011513864-7271-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:13.357007  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:13.358424  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:13.361179  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:13.365881  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:13.366150  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:13.366431  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:13.366627  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:13.469877  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.193:44995
I20260709 13:00:13.469961  7430 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.193:44995 every 8 connection(s)
I20260709 13:00:13.477326  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:13.491472  7435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:13.501567  7436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:13.502825  7271 server_base.cc:1061] running on GCE node
W20260709 13:00:13.503226  7438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:13.504318  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:13.504558  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:13.504751  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602013504733 us; error 0 us; skew 500 ppm
I20260709 13:00:13.505424  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:13.508122  7271 webserver.cc:533] Webserver started at http://127.7.25.194:35063/ using document root <none> and password file <none>
I20260709 13:00:13.508761  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:13.509019  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:13.509382  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:13.510655  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602011513864-7271-0/minicluster-data/ts-1-root/instance:
uuid: "9a6b4120316346919c83497e8d331037"
format_stamp: "Formatted at 2026-07-09 13:00:13 on dist-test-slave-z1zn"
I20260709 13:00:13.514904  7431 heartbeater.cc:344] Connected to a master server at 127.7.25.254:37199
I20260709 13:00:13.515383  7431 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:13.516556  7431 heartbeater.cc:507] Master 127.7.25.254:37199 requested a full tablet report, sending...
I20260709 13:00:13.517577  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:00:13.520217  7303 ts_manager.cc:194] Registered new tserver with Master: c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995)
I20260709 13:00:13.522619  7443 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:13.523216  7303 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54214
I20260709 13:00:13.524235  7271 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:00:13.524617  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602011513864-7271-0/minicluster-data/ts-1-root
uuid: "9a6b4120316346919c83497e8d331037"
format_stamp: "Formatted at 2026-07-09 13:00:13 on dist-test-slave-z1zn"
I20260709 13:00:13.525064  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602011513864-7271-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602011513864-7271-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602011513864-7271-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:13.547439  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:13.548775  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:13.550959  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:13.554337  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:13.554570  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:13.554808  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:13.554993  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:13.651579  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.194:36003
I20260709 13:00:13.651822  7505 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.194:36003 every 8 connection(s)
I20260709 13:00:13.658420  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:13.664717  7509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:13.667723  7510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:13.672974  7506 heartbeater.cc:344] Connected to a master server at 127.7.25.254:37199
I20260709 13:00:13.673413  7506 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:13.674073  7271 server_base.cc:1061] running on GCE node
I20260709 13:00:13.674636  7506 heartbeater.cc:507] Master 127.7.25.254:37199 requested a full tablet report, sending...
W20260709 13:00:13.675419  7512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:13.676946  7303 ts_manager.cc:194] Registered new tserver with Master: 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
I20260709 13:00:13.677044  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:13.677374  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:13.677578  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602013677562 us; error 0 us; skew 500 ppm
I20260709 13:00:13.678309  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:13.678653  7303 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54216
I20260709 13:00:13.681349  7271 webserver.cc:533] Webserver started at http://127.7.25.195:42991/ using document root <none> and password file <none>
I20260709 13:00:13.681979  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:13.682242  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:13.682564  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:13.683874  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602011513864-7271-0/minicluster-data/ts-2-root/instance:
uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
format_stamp: "Formatted at 2026-07-09 13:00:13 on dist-test-slave-z1zn"
I20260709 13:00:13.689736  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.004s
I20260709 13:00:13.694124  7517 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:13.694964  7271 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:00:13.695322  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602011513864-7271-0/minicluster-data/ts-2-root
uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
format_stamp: "Formatted at 2026-07-09 13:00:13 on dist-test-slave-z1zn"
I20260709 13:00:13.695681  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602011513864-7271-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602011513864-7271-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602011513864-7271-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:13.716511  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:13.718104  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:13.720568  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:13.724184  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:13.724431  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:13.724676  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:13.724854  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:13.813944  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.195:37985
I20260709 13:00:13.814119  7579 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.195:37985 every 8 connection(s)
I20260709 13:00:13.831851  7580 heartbeater.cc:344] Connected to a master server at 127.7.25.254:37199
I20260709 13:00:13.832279  7580 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:13.833295  7580 heartbeater.cc:507] Master 127.7.25.254:37199 requested a full tablet report, sending...
I20260709 13:00:13.835529  7303 ts_manager.cc:194] Registered new tserver with Master: a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:13.835637  7271 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014041777s
I20260709 13:00:13.837610  7303 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54230
I20260709 13:00:13.897994  7303 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54246:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:00:13.901715  7303 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:00:14.010879  7396 tablet_service.cc:1511] Processing CreateTablet for tablet adcea9028f904eb7943ac75ca583bb7b (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:00:14.010674  7394 tablet_service.cc:1511] Processing CreateTablet for tablet 90cf45c1a8864fbe9e17420f24f2e4d7 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:14.012486  7396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adcea9028f904eb7943ac75ca583bb7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.013456  7394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90cf45c1a8864fbe9e17420f24f2e4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.014295  7395 tablet_service.cc:1511] Processing CreateTablet for tablet dfa0689b0b834be3b8b62cf7199646d5 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:14.015607  7395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa0689b0b834be3b8b62cf7199646d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.018488  7393 tablet_service.cc:1511] Processing CreateTablet for tablet 2b99613be8a2472fa7bdd5bf37a52904 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:00:14.019776  7392 tablet_service.cc:1511] Processing CreateTablet for tablet b93d082ce398446194dfbf3cf3165c54 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:00:14.021441  7393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b99613be8a2472fa7bdd5bf37a52904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.022742  7391 tablet_service.cc:1511] Processing CreateTablet for tablet bcb2ed2e803c4d3192166fe697e7d95c (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:14.024096  7391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcb2ed2e803c4d3192166fe697e7d95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.027205  7392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b93d082ce398446194dfbf3cf3165c54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.057113  7394 tablet_service.cc:1511] Processing CreateTablet for tablet 5aa04a27d4d8478a9a09fd5d7943ada5 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:14.075417  7390 tablet_service.cc:1511] Processing CreateTablet for tablet 4a9cafa0d7f84c5fa0742bd9bba972f9 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:14.083357  7394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa04a27d4d8478a9a09fd5d7943ada5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.084760  7390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a9cafa0d7f84c5fa0742bd9bba972f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.089448  7395 tablet_service.cc:1511] Processing CreateTablet for tablet afe1b4d2b5d34052a5c831c1912775f2 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:14.090703  7395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe1b4d2b5d34052a5c831c1912775f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.098289  7545 tablet_service.cc:1511] Processing CreateTablet for tablet adcea9028f904eb7943ac75ca583bb7b (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:00:14.107188  7597 tablet_bootstrap.cc:492] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca: Bootstrap starting.
I20260709 13:00:14.107885  7543 tablet_service.cc:1511] Processing CreateTablet for tablet 90cf45c1a8864fbe9e17420f24f2e4d7 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:14.109953  7542 tablet_service.cc:1511] Processing CreateTablet for tablet 2b99613be8a2472fa7bdd5bf37a52904 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:00:14.104710  7544 tablet_service.cc:1511] Processing CreateTablet for tablet dfa0689b0b834be3b8b62cf7199646d5 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:14.119438  7545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adcea9028f904eb7943ac75ca583bb7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.109203  7541 tablet_service.cc:1511] Processing CreateTablet for tablet b93d082ce398446194dfbf3cf3165c54 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:00:14.121742  7539 tablet_service.cc:1511] Processing CreateTablet for tablet 5aa04a27d4d8478a9a09fd5d7943ada5 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:14.120042  7540 tablet_service.cc:1511] Processing CreateTablet for tablet bcb2ed2e803c4d3192166fe697e7d95c (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:14.124861  7538 tablet_service.cc:1511] Processing CreateTablet for tablet 4a9cafa0d7f84c5fa0742bd9bba972f9 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:14.127281  7542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b99613be8a2472fa7bdd5bf37a52904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.128563  7540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcb2ed2e803c4d3192166fe697e7d95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.129972  7544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa0689b0b834be3b8b62cf7199646d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.144481  7543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90cf45c1a8864fbe9e17420f24f2e4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.144106  7471 tablet_service.cc:1511] Processing CreateTablet for tablet adcea9028f904eb7943ac75ca583bb7b (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:00:14.147698  7468 tablet_service.cc:1511] Processing CreateTablet for tablet 2b99613be8a2472fa7bdd5bf37a52904 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:00:14.154662  7538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a9cafa0d7f84c5fa0742bd9bba972f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.154542  7470 tablet_service.cc:1511] Processing CreateTablet for tablet dfa0689b0b834be3b8b62cf7199646d5 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:14.159238  7471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adcea9028f904eb7943ac75ca583bb7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.163574  7467 tablet_service.cc:1511] Processing CreateTablet for tablet b93d082ce398446194dfbf3cf3165c54 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
W20260709 13:00:14.169068  7350 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:14.165482  7539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa04a27d4d8478a9a09fd5d7943ada5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.169327  7465 tablet_service.cc:1511] Processing CreateTablet for tablet 5aa04a27d4d8478a9a09fd5d7943ada5 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:14.172559  7466 tablet_service.cc:1511] Processing CreateTablet for tablet bcb2ed2e803c4d3192166fe697e7d95c (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:14.176335  7468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b99613be8a2472fa7bdd5bf37a52904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.159631  7469 tablet_service.cc:1511] Processing CreateTablet for tablet 90cf45c1a8864fbe9e17420f24f2e4d7 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:14.177783  7470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa0689b0b834be3b8b62cf7199646d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.179730  7541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b93d082ce398446194dfbf3cf3165c54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.181630  7467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b93d082ce398446194dfbf3cf3165c54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.183718  7464 tablet_service.cc:1511] Processing CreateTablet for tablet 4a9cafa0d7f84c5fa0742bd9bba972f9 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:14.181008  7537 tablet_service.cc:1511] Processing CreateTablet for tablet afe1b4d2b5d34052a5c831c1912775f2 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:14.185670  7463 tablet_service.cc:1511] Processing CreateTablet for tablet afe1b4d2b5d34052a5c831c1912775f2 (DEFAULT_TABLE table=test-workload [id=84df77a6e2c64f9e9ac42229333868ef]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:14.188633  7466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcb2ed2e803c4d3192166fe697e7d95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.189736  7464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a9cafa0d7f84c5fa0742bd9bba972f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.190122  7537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe1b4d2b5d34052a5c831c1912775f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.194854  7469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90cf45c1a8864fbe9e17420f24f2e4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.196677  7463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe1b4d2b5d34052a5c831c1912775f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.208778  7465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa04a27d4d8478a9a09fd5d7943ada5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.252071  7597 tablet_bootstrap.cc:654] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.367439  7597 tablet_bootstrap.cc:492] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca: No bootstrap required, opened a new log
I20260709 13:00:14.368430  7597 ts_tablet_manager.cc:1403] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca: Time spent bootstrapping tablet: real 0.288s	user 0.005s	sys 0.015s
I20260709 13:00:14.391669  7600 tablet_bootstrap.cc:492] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a: Bootstrap starting.
I20260709 13:00:14.404047  7597 raft_consensus.cc:359] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.413976  7601 tablet_bootstrap.cc:492] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037: Bootstrap starting.
I20260709 13:00:14.411396  7597 raft_consensus.cc:385] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.422926  7597 raft_consensus.cc:740] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.434768  7597 consensus_queue.cc:260] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.439873  7601 tablet_bootstrap.cc:654] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.447021  7600 tablet_bootstrap.cc:654] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.448638  7431 heartbeater.cc:499] Master 127.7.25.254:37199 was elected leader, sending a full tablet report...
I20260709 13:00:14.449052  7597 ts_tablet_manager.cc:1434] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca: Time spent starting tablet: real 0.074s	user 0.005s	sys 0.002s
I20260709 13:00:14.450162  7597 tablet_bootstrap.cc:492] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca: Bootstrap starting.
I20260709 13:00:14.460773  7597 tablet_bootstrap.cc:654] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.464228  7601 tablet_bootstrap.cc:492] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037: No bootstrap required, opened a new log
I20260709 13:00:14.464744  7601 ts_tablet_manager.cc:1403] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.005s
I20260709 13:00:14.467250  7600 tablet_bootstrap.cc:492] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a: No bootstrap required, opened a new log
I20260709 13:00:14.467788  7600 ts_tablet_manager.cc:1403] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a: Time spent bootstrapping tablet: real 0.077s	user 0.004s	sys 0.016s
I20260709 13:00:14.467859  7601 raft_consensus.cc:359] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.468703  7601 raft_consensus.cc:385] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.469015  7601 raft_consensus.cc:740] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6b4120316346919c83497e8d331037, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.469779  7601 consensus_queue.cc:260] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.471129  7600 raft_consensus.cc:359] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.472070  7600 raft_consensus.cc:385] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.472434  7600 raft_consensus.cc:740] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a529ce0f6abe4903be95c8259b0f1c2a, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.473214  7600 consensus_queue.cc:260] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.481397  7601 ts_tablet_manager.cc:1434] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037: Time spent starting tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:00:14.482246  7601 tablet_bootstrap.cc:492] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037: Bootstrap starting.
I20260709 13:00:14.483007  7506 heartbeater.cc:499] Master 127.7.25.254:37199 was elected leader, sending a full tablet report...
I20260709 13:00:14.487299  7597 tablet_bootstrap.cc:492] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca: No bootstrap required, opened a new log
W20260709 13:00:14.487344  7432 tablet.cc:2406] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:00:14.487776  7601 tablet_bootstrap.cc:654] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.487859  7597 ts_tablet_manager.cc:1403] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.004s
I20260709 13:00:14.490942  7597 raft_consensus.cc:359] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.491870  7597 raft_consensus.cc:385] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.492266  7597 raft_consensus.cc:740] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.493454  7597 consensus_queue.cc:260] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.500802  7597 ts_tablet_manager.cc:1434] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 13:00:14.502138  7597 tablet_bootstrap.cc:492] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca: Bootstrap starting.
I20260709 13:00:14.502370  7580 heartbeater.cc:499] Master 127.7.25.254:37199 was elected leader, sending a full tablet report...
I20260709 13:00:14.503460  7600 ts_tablet_manager.cc:1434] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.005s
I20260709 13:00:14.506927  7600 tablet_bootstrap.cc:492] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a: Bootstrap starting.
I20260709 13:00:14.520553  7600 tablet_bootstrap.cc:654] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.526388  7601 tablet_bootstrap.cc:492] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037: No bootstrap required, opened a new log
I20260709 13:00:14.526891  7601 ts_tablet_manager.cc:1403] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.022s
I20260709 13:00:14.529865  7601 raft_consensus.cc:359] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.530591  7601 raft_consensus.cc:385] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.530898  7601 raft_consensus.cc:740] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6b4120316346919c83497e8d331037, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.531637  7600 tablet_bootstrap.cc:492] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a: No bootstrap required, opened a new log
I20260709 13:00:14.531599  7601 consensus_queue.cc:260] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.532122  7600 ts_tablet_manager.cc:1403] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.005s
I20260709 13:00:14.532807  7597 tablet_bootstrap.cc:654] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.534118  7601 ts_tablet_manager.cc:1434] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:00:14.535092  7601 tablet_bootstrap.cc:492] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037: Bootstrap starting.
I20260709 13:00:14.537603  7600 raft_consensus.cc:359] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.538337  7600 raft_consensus.cc:385] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.538607  7600 raft_consensus.cc:740] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a529ce0f6abe4903be95c8259b0f1c2a, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.543820  7601 tablet_bootstrap.cc:654] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.539263  7600 consensus_queue.cc:260] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.549278  7600 ts_tablet_manager.cc:1434] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.005s
I20260709 13:00:14.550346  7600 tablet_bootstrap.cc:492] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a: Bootstrap starting.
I20260709 13:00:14.559162  7597 tablet_bootstrap.cc:492] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca: No bootstrap required, opened a new log
I20260709 13:00:14.559798  7597 ts_tablet_manager.cc:1403] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.008s
I20260709 13:00:14.562788  7600 tablet_bootstrap.cc:654] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.563664  7597 raft_consensus.cc:359] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.564633  7597 raft_consensus.cc:385] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.564991  7597 raft_consensus.cc:740] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.566231  7597 consensus_queue.cc:260] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.568192  7601 tablet_bootstrap.cc:492] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037: No bootstrap required, opened a new log
I20260709 13:00:14.568881  7601 ts_tablet_manager.cc:1403] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037: Time spent bootstrapping tablet: real 0.034s	user 0.022s	sys 0.008s
I20260709 13:00:14.572871  7601 raft_consensus.cc:359] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.573945  7601 raft_consensus.cc:385] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.574394  7597 ts_tablet_manager.cc:1434] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.005s
I20260709 13:00:14.574389  7601 raft_consensus.cc:740] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6b4120316346919c83497e8d331037, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.575620  7601 consensus_queue.cc:260] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.577672  7601 ts_tablet_manager.cc:1434] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:00:14.578065  7600 tablet_bootstrap.cc:492] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a: No bootstrap required, opened a new log
I20260709 13:00:14.578536  7601 tablet_bootstrap.cc:492] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037: Bootstrap starting.
I20260709 13:00:14.578573  7600 ts_tablet_manager.cc:1403] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.011s
I20260709 13:00:14.581699  7600 raft_consensus.cc:359] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.582440  7600 raft_consensus.cc:385] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.582778  7600 raft_consensus.cc:740] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a529ce0f6abe4903be95c8259b0f1c2a, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.584431  7597 tablet_bootstrap.cc:492] T bcb2ed2e803c4d3192166fe697e7d95c P c447b4d2e3f84b02baeeb875f55ec8ca: Bootstrap starting.
I20260709 13:00:14.583571  7600 consensus_queue.cc:260] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.591415  7600 ts_tablet_manager.cc:1434] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.004s
I20260709 13:00:14.591887  7597 tablet_bootstrap.cc:654] T bcb2ed2e803c4d3192166fe697e7d95c P c447b4d2e3f84b02baeeb875f55ec8ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.592563  7600 tablet_bootstrap.cc:492] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a: Bootstrap starting.
I20260709 13:00:14.597895  7601 tablet_bootstrap.cc:654] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.601220  7607 raft_consensus.cc:493] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.601747  7607 raft_consensus.cc:515] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.602509  7597 tablet_bootstrap.cc:492] T bcb2ed2e803c4d3192166fe697e7d95c P c447b4d2e3f84b02baeeb875f55ec8ca: No bootstrap required, opened a new log
I20260709 13:00:14.602933  7597 ts_tablet_manager.cc:1403] T bcb2ed2e803c4d3192166fe697e7d95c P c447b4d2e3f84b02baeeb875f55ec8ca: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.003s
I20260709 13:00:14.604025  7607 leader_election.cc:290] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
I20260709 13:00:14.604779  7600 tablet_bootstrap.cc:654] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.606312  7597 raft_consensus.cc:359] T bcb2ed2e803c4d3192166fe697e7d95c P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.607095  7597 raft_consensus.cc:385] T bcb2ed2e803c4d3192166fe697e7d95c P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.607380  7597 raft_consensus.cc:740] T bcb2ed2e803c4d3192166fe697e7d95c P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.608042  7597 consensus_queue.cc:260] T bcb2ed2e803c4d3192166fe697e7d95c P c447b4d2e3f84b02baeeb875f55ec8ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.610555  7597 ts_tablet_manager.cc:1434] T bcb2ed2e803c4d3192166fe697e7d95c P c447b4d2e3f84b02baeeb875f55ec8ca: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:00:14.611454  7597 tablet_bootstrap.cc:492] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca: Bootstrap starting.
I20260709 13:00:14.617427  7597 tablet_bootstrap.cc:654] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.629108  7600 tablet_bootstrap.cc:492] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a: No bootstrap required, opened a new log
I20260709 13:00:14.629850  7600 ts_tablet_manager.cc:1403] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.012s
I20260709 13:00:14.633574  7600 raft_consensus.cc:359] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.634518  7600 raft_consensus.cc:385] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.634940  7600 raft_consensus.cc:740] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a529ce0f6abe4903be95c8259b0f1c2a, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.635739  7601 tablet_bootstrap.cc:492] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037: No bootstrap required, opened a new log
I20260709 13:00:14.636201  7601 ts_tablet_manager.cc:1403] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037: Time spent bootstrapping tablet: real 0.058s	user 0.006s	sys 0.004s
I20260709 13:00:14.635943  7600 consensus_queue.cc:260] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.639042  7600 ts_tablet_manager.cc:1434] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:00:14.639040  7601 raft_consensus.cc:359] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.639930  7601 raft_consensus.cc:385] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.640244  7601 raft_consensus.cc:740] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6b4120316346919c83497e8d331037, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.640470  7600 tablet_bootstrap.cc:492] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a: Bootstrap starting.
I20260709 13:00:14.640957  7601 consensus_queue.cc:260] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.643484  7601 ts_tablet_manager.cc:1434] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:00:14.644392  7601 tablet_bootstrap.cc:492] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037: Bootstrap starting.
I20260709 13:00:14.651998  7601 tablet_bootstrap.cc:654] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.659619  7600 tablet_bootstrap.cc:654] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.665459  7605 raft_consensus.cc:493] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.666163  7605 raft_consensus.cc:515] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.669467  7605 leader_election.cc:290] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:14.670372  7597 tablet_bootstrap.cc:492] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca: No bootstrap required, opened a new log
I20260709 13:00:14.670833  7597 ts_tablet_manager.cc:1403] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca: Time spent bootstrapping tablet: real 0.060s	user 0.027s	sys 0.006s
I20260709 13:00:14.673833  7597 raft_consensus.cc:359] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } }
I20260709 13:00:14.674574  7597 raft_consensus.cc:385] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.674841  7597 raft_consensus.cc:740] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.675627  7597 consensus_queue.cc:260] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } }
I20260709 13:00:14.678331  7481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0689b0b834be3b8b62cf7199646d5" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6b4120316346919c83497e8d331037" is_pre_election: true
I20260709 13:00:14.678949  7597 ts_tablet_manager.cc:1434] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:14.679998  7597 tablet_bootstrap.cc:492] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca: Bootstrap starting.
W20260709 13:00:14.680694  7521 leader_election.cc:343] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.687278  7601 tablet_bootstrap.cc:492] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037: No bootstrap required, opened a new log
I20260709 13:00:14.687772  7601 ts_tablet_manager.cc:1403] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.004s
I20260709 13:00:14.690577  7601 raft_consensus.cc:359] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.691293  7601 raft_consensus.cc:385] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.691584  7601 raft_consensus.cc:740] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6b4120316346919c83497e8d331037, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.692252  7601 consensus_queue.cc:260] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.693583  7406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0689b0b834be3b8b62cf7199646d5" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" is_pre_election: true
I20260709 13:00:14.694360  7406 raft_consensus.cc:2468] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a529ce0f6abe4903be95c8259b0f1c2a in term 0.
I20260709 13:00:14.695691  7519 leader_election.cc:304] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 9a6b4120316346919c83497e8d331037
I20260709 13:00:14.696749  7601 ts_tablet_manager.cc:1434] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:00:14.697315  7607 raft_consensus.cc:2804] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.697746  7607 raft_consensus.cc:493] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.698108  7607 raft_consensus.cc:3060] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.698734  7597 tablet_bootstrap.cc:654] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.703356  7602 raft_consensus.cc:493] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.703866  7602 raft_consensus.cc:515] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.697754  7601 tablet_bootstrap.cc:492] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037: Bootstrap starting.
I20260709 13:00:14.712859  7602 leader_election.cc:290] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:14.708061  7607 raft_consensus.cc:515] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.720628  7607 leader_election.cc:290] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 1 election: Requested vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
I20260709 13:00:14.720872  7605 raft_consensus.cc:493] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.721825  7481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0689b0b834be3b8b62cf7199646d5" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6b4120316346919c83497e8d331037"
I20260709 13:00:14.721535  7605 raft_consensus.cc:515] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.722412  7481 raft_consensus.cc:3060] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.724694  7406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0689b0b834be3b8b62cf7199646d5" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
I20260709 13:00:14.725492  7406 raft_consensus.cc:3060] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.735522  7605 leader_election.cc:290] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:14.756219  7405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" is_pre_election: true
I20260709 13:00:14.758183  7405 raft_consensus.cc:2468] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 0.
I20260709 13:00:14.761677  7445 leader_election.cc:304] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:14.764065  7607 raft_consensus.cc:493] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.764676  7405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb2ed2e803c4d3192166fe697e7d95c" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" is_pre_election: true
I20260709 13:00:14.765885  7405 raft_consensus.cc:2468] T bcb2ed2e803c4d3192166fe697e7d95c P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 0.
I20260709 13:00:14.764658  7607 raft_consensus.cc:515] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.767815  7445 leader_election.cc:304] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:14.768464  7607 leader_election.cc:290] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
I20260709 13:00:14.764201  7605 raft_consensus.cc:2804] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.770259  7405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" is_pre_election: true
I20260709 13:00:14.769387  7605 raft_consensus.cc:493] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.773120  7405 raft_consensus.cc:2468] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a529ce0f6abe4903be95c8259b0f1c2a in term 0.
I20260709 13:00:14.773195  7480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6b4120316346919c83497e8d331037" is_pre_election: true
I20260709 13:00:14.776221  7600 tablet_bootstrap.cc:492] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a: No bootstrap required, opened a new log
I20260709 13:00:14.776062  7519 leader_election.cc:304] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:14.776722  7600 ts_tablet_manager.cc:1403] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a: Time spent bootstrapping tablet: real 0.137s	user 0.017s	sys 0.016s
I20260709 13:00:14.773746  7605 raft_consensus.cc:3060] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.777568  7607 raft_consensus.cc:2804] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.774122  7601 tablet_bootstrap.cc:654] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.778264  7607 raft_consensus.cc:493] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.783864  7607 raft_consensus.cc:3060] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.787470  7600 raft_consensus.cc:359] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.788367  7600 raft_consensus.cc:385] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.788774  7600 raft_consensus.cc:740] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a529ce0f6abe4903be95c8259b0f1c2a, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.788975  7605 raft_consensus.cc:515] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.784602  7406 raft_consensus.cc:2468] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a529ce0f6abe4903be95c8259b0f1c2a in term 1.
I20260709 13:00:14.792467  7628 raft_consensus.cc:2804] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.795019  7480 raft_consensus.cc:2393] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a529ce0f6abe4903be95c8259b0f1c2a in current term 1: Already voted for candidate 9a6b4120316346919c83497e8d331037 in this term.
I20260709 13:00:14.794903  7481 raft_consensus.cc:2468] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a529ce0f6abe4903be95c8259b0f1c2a in term 1.
I20260709 13:00:14.795055  7628 raft_consensus.cc:493] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.796795  7519 leader_election.cc:304] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:14.797433  7628 raft_consensus.cc:3060] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.797938  7600 consensus_queue.cc:260] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.804502  7605 leader_election.cc:290] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 1 election: Requested vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:14.809409  7597 tablet_bootstrap.cc:492] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca: No bootstrap required, opened a new log
I20260709 13:00:14.804899  7607 raft_consensus.cc:515] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.811408  7597 ts_tablet_manager.cc:1403] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca: Time spent bootstrapping tablet: real 0.132s	user 0.034s	sys 0.046s
I20260709 13:00:14.817546  7406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
I20260709 13:00:14.825217  7406 raft_consensus.cc:3060] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.831789  7597 raft_consensus.cc:359] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.832921  7597 raft_consensus.cc:385] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.833400  7597 raft_consensus.cc:740] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.836383  7607 leader_election.cc:290] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 1 election: Requested vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
I20260709 13:00:14.837157  7607 raft_consensus.cc:2804] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:14.837714  7607 raft_consensus.cc:697] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 LEADER]: Becoming Leader. State: Replica: a529ce0f6abe4903be95c8259b0f1c2a, State: Running, Role: LEADER
I20260709 13:00:14.838328  7480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6b4120316346919c83497e8d331037"
I20260709 13:00:14.838753  7607 consensus_queue.cc:237] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.839504  7480 raft_consensus.cc:2393] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a529ce0f6abe4903be95c8259b0f1c2a in current term 1: Already voted for candidate 9a6b4120316346919c83497e8d331037 in this term.
I20260709 13:00:14.843535  7597 consensus_queue.cc:260] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.849473  7597 ts_tablet_manager.cc:1434] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:00:14.865872  7597 tablet_bootstrap.cc:492] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca: Bootstrap starting.
I20260709 13:00:14.870666  7605 raft_consensus.cc:493] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.872337  7605 raft_consensus.cc:515] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.873615  7601 tablet_bootstrap.cc:492] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037: No bootstrap required, opened a new log
I20260709 13:00:14.874080  7601 ts_tablet_manager.cc:1403] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037: Time spent bootstrapping tablet: real 0.177s	user 0.014s	sys 0.009s
I20260709 13:00:14.874428  7406 raft_consensus.cc:2468] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 1.
I20260709 13:00:14.877997  7602 raft_consensus.cc:493] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.878433  7602 raft_consensus.cc:515] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } }
I20260709 13:00:14.880228  7602 leader_election.cc:290] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985), 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
I20260709 13:00:14.874439  7605 leader_election.cc:290] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:14.881131  7445 leader_election.cc:304] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
W20260709 13:00:14.854238  7519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:44995, user_credentials={real_user=slave}} blocked reactor thread for 57542us
I20260709 13:00:14.882858  7605 raft_consensus.cc:2804] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:14.883651  7600 ts_tablet_manager.cc:1434] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a: Time spent starting tablet: real 0.107s	user 0.009s	sys 0.025s
I20260709 13:00:14.884570  7600 tablet_bootstrap.cc:492] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a: Bootstrap starting.
I20260709 13:00:14.884727  7601 raft_consensus.cc:359] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } }
I20260709 13:00:14.885455  7601 raft_consensus.cc:385] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.885748  7601 raft_consensus.cc:740] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6b4120316346919c83497e8d331037, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.886500  7601 consensus_queue.cc:260] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } }
I20260709 13:00:14.888743  7602 raft_consensus.cc:493] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.889384  7406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf45c1a8864fbe9e17420f24f2e4d7" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" is_pre_election: true
I20260709 13:00:14.889225  7602 raft_consensus.cc:515] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.891525  7406 raft_consensus.cc:2468] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 0.
I20260709 13:00:14.893785  7445 leader_election.cc:304] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:14.898253  7602 leader_election.cc:290] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:14.898205  7406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
I20260709 13:00:14.900753  7406 raft_consensus.cc:2393] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a529ce0f6abe4903be95c8259b0f1c2a in current term 1: Already voted for candidate 9a6b4120316346919c83497e8d331037 in this term.
I20260709 13:00:14.901803  7519 leader_election.cc:304] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a; no voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca
I20260709 13:00:14.902571  7601 ts_tablet_manager.cc:1434] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.007s
I20260709 13:00:14.903874  7632 raft_consensus.cc:2749] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.907878  7605 raft_consensus.cc:697] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 1 LEADER]: Becoming Leader. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:14.909186  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" is_pre_election: true
I20260709 13:00:14.909585  7480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6b4120316346919c83497e8d331037" is_pre_election: true
I20260709 13:00:14.923774  7605 consensus_queue.cc:237] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.935737  7600 tablet_bootstrap.cc:654] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.936777  7601 tablet_bootstrap.cc:492] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037: Bootstrap starting.
I20260709 13:00:14.938578  7632 raft_consensus.cc:493] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.939105  7632 raft_consensus.cc:515] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.941665  7634 raft_consensus.cc:493] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.941772  7480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf45c1a8864fbe9e17420f24f2e4d7" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6b4120316346919c83497e8d331037" is_pre_election: true
I20260709 13:00:14.944419  7555 raft_consensus.cc:2393] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a6b4120316346919c83497e8d331037 in current term 1: Already voted for candidate a529ce0f6abe4903be95c8259b0f1c2a in this term.
I20260709 13:00:14.942425  7554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb2ed2e803c4d3192166fe697e7d95c" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" is_pre_election: true
I20260709 13:00:14.943121  7481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcea9028f904eb7943ac75ca583bb7b" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6b4120316346919c83497e8d331037" is_pre_election: true
I20260709 13:00:14.946898  7481 raft_consensus.cc:2468] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 0.
I20260709 13:00:14.946843  7554 raft_consensus.cc:2468] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 0.
I20260709 13:00:14.924222  7628 raft_consensus.cc:515] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.953795  7372 leader_election.cc:304] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:14.957202  7602 raft_consensus.cc:2804] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.958999  7602 raft_consensus.cc:493] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:14.955359  7445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:44995, user_credentials={real_user=slave}} blocked reactor thread for 61405.3us
I20260709 13:00:14.959409  7602 raft_consensus.cc:3060] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.955475  7554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:14.942751  7634 raft_consensus.cc:515] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:14.960774  7406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" is_pre_election: true
I20260709 13:00:14.958316  7635 raft_consensus.cc:2804] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.962333  7554 raft_consensus.cc:2393] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a6b4120316346919c83497e8d331037 in current term 1: Already voted for candidate a529ce0f6abe4903be95c8259b0f1c2a in this term.
W20260709 13:00:14.964867  7519 leader_election.cc:343] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.964954  7481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6b4120316346919c83497e8d331037" is_pre_election: true
W20260709 13:00:14.966905  7521 leader_election.cc:343] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.967303  7521 leader_election.cc:304] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a; no voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca
I20260709 13:00:14.967789  7597 tablet_bootstrap.cc:654] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.965767  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf45c1a8864fbe9e17420f24f2e4d7" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" is_pre_election: true
I20260709 13:00:14.962154  7632 leader_election.cc:290] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
I20260709 13:00:14.971122  7406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb2ed2e803c4d3192166fe697e7d95c" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
I20260709 13:00:14.971732  7406 raft_consensus.cc:3060] T bcb2ed2e803c4d3192166fe697e7d95c P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.972775  7634 leader_election.cc:290] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:14.968822  7628 leader_election.cc:290] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 1 election: Requested vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:14.973112  7607 raft_consensus.cc:2749] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.966603  7635 raft_consensus.cc:493] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.973526  7302 catalog_manager.cc:5697] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a reported cstate change: term changed from 0 to 1, leader changed from <none> to a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195). New cstate: current_term: 1 leader_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:14.985868  7601 tablet_bootstrap.cc:654] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.980436  7635 raft_consensus.cc:3060] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.015276  7602 raft_consensus.cc:515] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } }
I20260709 13:00:15.015767  7405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe1b4d2b5d34052a5c831c1912775f2" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" is_pre_election: true
I20260709 13:00:15.023723  7406 raft_consensus.cc:2468] T bcb2ed2e803c4d3192166fe697e7d95c P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 1.
W20260709 13:00:15.034052  7445 leader_election.cc:343] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.036710  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" is_pre_election: true
I20260709 13:00:15.036736  7445 leader_election.cc:304] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:15.039213  7555 raft_consensus.cc:2393] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c447b4d2e3f84b02baeeb875f55ec8ca in current term 1: Already voted for candidate a529ce0f6abe4903be95c8259b0f1c2a in this term.
I20260709 13:00:15.039417  7554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcea9028f904eb7943ac75ca583bb7b" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" is_pre_election: true
I20260709 13:00:15.040103  7605 raft_consensus.cc:2804] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.040850  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf45c1a8864fbe9e17420f24f2e4d7" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" is_pre_election: true
I20260709 13:00:15.041266  7605 raft_consensus.cc:697] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [term 1 LEADER]: Becoming Leader. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:15.041796  7602 leader_election.cc:290] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 election: Requested vote from peers a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985), 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
I20260709 13:00:15.042603  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcea9028f904eb7943ac75ca583bb7b" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:15.042488  7605 consensus_queue.cc:237] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.043017  7554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb2ed2e803c4d3192166fe697e7d95c" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:15.043541  7554 raft_consensus.cc:3060] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.044816  7600 tablet_bootstrap.cc:492] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a: No bootstrap required, opened a new log
I20260709 13:00:15.045444  7600 ts_tablet_manager.cc:1403] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a: Time spent bootstrapping tablet: real 0.161s	user 0.019s	sys 0.016s
W20260709 13:00:15.038991  7447 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:37985, user_credentials={real_user=slave}} blocked reactor thread for 50953.4us
I20260709 13:00:15.049453  7555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe1b4d2b5d34052a5c831c1912775f2" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" is_pre_election: true
I20260709 13:00:15.053861  7372 leader_election.cc:304] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 9a6b4120316346919c83497e8d331037, a529ce0f6abe4903be95c8259b0f1c2a
I20260709 13:00:15.053925  7555 raft_consensus.cc:2468] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 0.
W20260709 13:00:15.055141  7372 leader_election.cc:343] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.055549  7597 tablet_bootstrap.cc:492] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca: No bootstrap required, opened a new log
I20260709 13:00:15.056061  7597 ts_tablet_manager.cc:1403] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca: Time spent bootstrapping tablet: real 0.206s	user 0.019s	sys 0.009s
W20260709 13:00:15.055990  7372 leader_election.cc:343] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:15.057248  7372 leader_election.cc:343] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.060905  7601 tablet_bootstrap.cc:492] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037: No bootstrap required, opened a new log
I20260709 13:00:15.061493  7601 ts_tablet_manager.cc:1403] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037: Time spent bootstrapping tablet: real 0.139s	user 0.011s	sys 0.012s
I20260709 13:00:15.058218  7602 raft_consensus.cc:2749] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.057610  7635 raft_consensus.cc:515] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.065229  7481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcea9028f904eb7943ac75ca583bb7b" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6b4120316346919c83497e8d331037"
I20260709 13:00:15.066051  7481 raft_consensus.cc:3060] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.071234  7554 raft_consensus.cc:2468] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 1.
W20260709 13:00:15.066862  7447 leader_election.cc:343] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.072660  7597 raft_consensus.cc:359] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.073451  7597 raft_consensus.cc:385] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.073776  7597 raft_consensus.cc:740] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.073736  7447 leader_election.cc:304] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a6b4120316346919c83497e8d331037, a529ce0f6abe4903be95c8259b0f1c2a; no voters: c447b4d2e3f84b02baeeb875f55ec8ca
I20260709 13:00:15.075104  7597 consensus_queue.cc:260] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.076421  7480 raft_consensus.cc:2393] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c447b4d2e3f84b02baeeb875f55ec8ca in current term 1: Already voted for candidate 9a6b4120316346919c83497e8d331037 in this term.
I20260709 13:00:15.077389  7628 raft_consensus.cc:2804] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:15.077885  7628 raft_consensus.cc:493] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.078701  7628 raft_consensus.cc:3060] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.080027  7597 ts_tablet_manager.cc:1434] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 13:00:15.081059  7597 tablet_bootstrap.cc:492] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca: Bootstrap starting.
I20260709 13:00:15.087334  7601 raft_consensus.cc:359] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.088466  7601 raft_consensus.cc:385] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.088862  7601 raft_consensus.cc:740] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6b4120316346919c83497e8d331037, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.088878  7406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf45c1a8864fbe9e17420f24f2e4d7" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
I20260709 13:00:15.090725  7406 raft_consensus.cc:3060] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.090925  7600 raft_consensus.cc:359] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.093451  7635 leader_election.cc:290] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 1 election: Requested vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:15.094465  7600 raft_consensus.cc:385] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.095636  7600 raft_consensus.cc:740] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a529ce0f6abe4903be95c8259b0f1c2a, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.096227  7554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf45c1a8864fbe9e17420f24f2e4d7" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:15.096465  7600 consensus_queue.cc:260] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
W20260709 13:00:15.097803  7447 leader_election.cc:343] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.097970  7628 raft_consensus.cc:515] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.099036  7600 ts_tablet_manager.cc:1434] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.002s
I20260709 13:00:15.100018  7600 tablet_bootstrap.cc:492] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a: Bootstrap starting.
I20260709 13:00:15.100461  7406 raft_consensus.cc:2468] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 1.
I20260709 13:00:15.100839  7405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe1b4d2b5d34052a5c831c1912775f2" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
I20260709 13:00:15.092607  7601 consensus_queue.cc:260] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.102984  7481 raft_consensus.cc:2468] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 1.
I20260709 13:00:15.100042  7628 leader_election.cc:290] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 1 election: Requested vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:15.103305  7445 leader_election.cc:304] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: a529ce0f6abe4903be95c8259b0f1c2a
I20260709 13:00:15.104660  7628 raft_consensus.cc:2804] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.105013  7554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe1b4d2b5d34052a5c831c1912775f2" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:15.105113  7601 ts_tablet_manager.cc:1434] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.002s
W20260709 13:00:15.105072  7445 leader_election.cc:343] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.105345  7628 raft_consensus.cc:697] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 1 LEADER]: Becoming Leader. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:15.105957  7554 raft_consensus.cc:3060] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.106207  7372 leader_election.cc:304] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: a529ce0f6abe4903be95c8259b0f1c2a
I20260709 13:00:15.106540  7628 consensus_queue.cc:237] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.107298  7602 raft_consensus.cc:2804] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.107980  7597 tablet_bootstrap.cc:654] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.115713  7602 raft_consensus.cc:697] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 LEADER]: Becoming Leader. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Running, Role: LEADER
I20260709 13:00:15.117564  7602 consensus_queue.cc:237] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } }
I20260709 13:00:15.125599  7600 tablet_bootstrap.cc:654] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.130363  7554 raft_consensus.cc:2468] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 1.
I20260709 13:00:15.133550  7447 leader_election.cc:304] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a6b4120316346919c83497e8d331037, a529ce0f6abe4903be95c8259b0f1c2a; no voters: c447b4d2e3f84b02baeeb875f55ec8ca
I20260709 13:00:15.138279  7628 raft_consensus.cc:2804] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.138777  7628 raft_consensus.cc:697] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [term 1 LEADER]: Becoming Leader. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:15.140081  7628 consensus_queue.cc:237] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.142810  7597 tablet_bootstrap.cc:492] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca: No bootstrap required, opened a new log
I20260709 13:00:15.143239  7597 ts_tablet_manager.cc:1403] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.009s
I20260709 13:00:15.146222  7597 raft_consensus.cc:359] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.147089  7597 raft_consensus.cc:385] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.147410  7600 tablet_bootstrap.cc:492] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a: No bootstrap required, opened a new log
I20260709 13:00:15.147408  7597 raft_consensus.cc:740] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.148080  7600 ts_tablet_manager.cc:1403] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.012s
I20260709 13:00:15.148289  7597 consensus_queue.cc:260] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.151763  7601 tablet_bootstrap.cc:492] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037: Bootstrap starting.
I20260709 13:00:15.153285  7301 catalog_manager.cc:5697] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a6b4120316346919c83497e8d331037 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "9a6b4120316346919c83497e8d331037" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.158877  7600 raft_consensus.cc:359] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.159615  7600 raft_consensus.cc:385] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.159910  7600 raft_consensus.cc:740] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a529ce0f6abe4903be95c8259b0f1c2a, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.160636  7600 consensus_queue.cc:260] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.162730  7597 ts_tablet_manager.cc:1434] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 13:00:15.163597  7597 tablet_bootstrap.cc:492] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca: Bootstrap starting.
I20260709 13:00:15.166191  7372 leader_election.cc:304] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 9a6b4120316346919c83497e8d331037, a529ce0f6abe4903be95c8259b0f1c2a
I20260709 13:00:15.167321  7602 raft_consensus.cc:2749] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.169272  7597 tablet_bootstrap.cc:654] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.173671  7600 ts_tablet_manager.cc:1434] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
W20260709 13:00:15.173866  7350 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:15.174690  7600 tablet_bootstrap.cc:492] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a: Bootstrap starting.
I20260709 13:00:15.178572  7601 tablet_bootstrap.cc:654] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.186986  7600 tablet_bootstrap.cc:654] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.187865  7601 tablet_bootstrap.cc:492] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037: No bootstrap required, opened a new log
I20260709 13:00:15.188347  7601 ts_tablet_manager.cc:1403] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.003s
I20260709 13:00:15.182770  7302 catalog_manager.cc:5697] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca reported cstate change: term changed from 0 to 1, leader changed from <none> to c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193). New cstate: current_term: 1 leader_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.191398  7597 tablet_bootstrap.cc:492] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca: No bootstrap required, opened a new log
I20260709 13:00:15.191828  7597 ts_tablet_manager.cc:1403] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca: Time spent bootstrapping tablet: real 0.028s	user 0.004s	sys 0.004s
I20260709 13:00:15.194386  7597 raft_consensus.cc:359] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.195057  7597 raft_consensus.cc:385] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.195389  7597 raft_consensus.cc:740] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.196221  7597 consensus_queue.cc:260] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.197006  7602 raft_consensus.cc:493] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.197479  7602 raft_consensus.cc:515] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.198993  7600 tablet_bootstrap.cc:492] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a: No bootstrap required, opened a new log
I20260709 13:00:15.199471  7600 ts_tablet_manager.cc:1403] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.002s
I20260709 13:00:15.201969  7600 raft_consensus.cc:359] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } }
I20260709 13:00:15.202636  7600 raft_consensus.cc:385] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.202950  7600 raft_consensus.cc:740] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a529ce0f6abe4903be95c8259b0f1c2a, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.203609  7600 consensus_queue.cc:260] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } }
I20260709 13:00:15.205574  7600 ts_tablet_manager.cc:1434] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:00:15.206082  7480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9cafa0d7f84c5fa0742bd9bba972f9" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6b4120316346919c83497e8d331037" is_pre_election: true
I20260709 13:00:15.206465  7600 tablet_bootstrap.cc:492] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a: Bootstrap starting.
I20260709 13:00:15.206732  7480 raft_consensus.cc:2468] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 0.
I20260709 13:00:15.207489  7301 catalog_manager.cc:5697] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a6b4120316346919c83497e8d331037 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "9a6b4120316346919c83497e8d331037" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.208266  7372 leader_election.cc:304] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:15.209208  7647 raft_consensus.cc:2804] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:15.209702  7647 raft_consensus.cc:493] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.210081  7647 raft_consensus.cc:3060] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.209280  7301 catalog_manager.cc:5697] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a6b4120316346919c83497e8d331037 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "9a6b4120316346919c83497e8d331037" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.210422  7602 leader_election.cc:290] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:15.211150  7301 catalog_manager.cc:5697] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a6b4120316346919c83497e8d331037 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "9a6b4120316346919c83497e8d331037" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.213301  7600 tablet_bootstrap.cc:654] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.214954  7601 raft_consensus.cc:359] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.215616  7601 raft_consensus.cc:385] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.215885  7601 raft_consensus.cc:740] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6b4120316346919c83497e8d331037, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.217344  7602 raft_consensus.cc:493] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.217458  7554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9cafa0d7f84c5fa0742bd9bba972f9" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" is_pre_election: true
I20260709 13:00:15.217873  7602 raft_consensus.cc:515] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.218261  7554 raft_consensus.cc:2468] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 0.
I20260709 13:00:15.219959  7602 leader_election.cc:290] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:15.216523  7601 consensus_queue.cc:260] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.222325  7601 ts_tablet_manager.cc:1434] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
I20260709 13:00:15.221975  7480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe1b4d2b5d34052a5c831c1912775f2" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6b4120316346919c83497e8d331037" is_pre_election: true
I20260709 13:00:15.223237  7601 tablet_bootstrap.cc:492] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037: Bootstrap starting.
I20260709 13:00:15.224563  7554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe1b4d2b5d34052a5c831c1912775f2" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" is_pre_election: true
I20260709 13:00:15.225423  7554 raft_consensus.cc:2393] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c447b4d2e3f84b02baeeb875f55ec8ca in current term 1: Already voted for candidate 9a6b4120316346919c83497e8d331037 in this term.
I20260709 13:00:15.227088  7600 tablet_bootstrap.cc:492] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a: No bootstrap required, opened a new log
I20260709 13:00:15.227566  7600 ts_tablet_manager.cc:1403] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:00:15.228067  7647 raft_consensus.cc:515] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.227371  7372 leader_election.cc:304] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 9a6b4120316346919c83497e8d331037, a529ce0f6abe4903be95c8259b0f1c2a
I20260709 13:00:15.229193  7602 raft_consensus.cc:3060] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.229815  7601 tablet_bootstrap.cc:654] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.236996  7602 raft_consensus.cc:2749] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.238606  7597 ts_tablet_manager.cc:1434] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.004s
I20260709 13:00:15.240651  7480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9cafa0d7f84c5fa0742bd9bba972f9" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6b4120316346919c83497e8d331037"
I20260709 13:00:15.241261  7480 raft_consensus.cc:3060] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.246171  7554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9cafa0d7f84c5fa0742bd9bba972f9" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:15.246755  7554 raft_consensus.cc:3060] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.241022  7647 leader_election.cc:290] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 election: Requested vote from peers 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:15.239253  7600 raft_consensus.cc:359] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.259724  7600 raft_consensus.cc:385] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.260028  7600 raft_consensus.cc:740] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a529ce0f6abe4903be95c8259b0f1c2a, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.260680  7600 consensus_queue.cc:260] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.261391  7601 tablet_bootstrap.cc:492] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037: No bootstrap required, opened a new log
I20260709 13:00:15.261843  7601 ts_tablet_manager.cc:1403] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.009s
I20260709 13:00:15.259001  7480 raft_consensus.cc:2468] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 1.
I20260709 13:00:15.262658  7600 ts_tablet_manager.cc:1434] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.001s
I20260709 13:00:15.263620  7554 raft_consensus.cc:2468] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 1.
I20260709 13:00:15.264308  7372 leader_election.cc:304] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:15.265748  7647 raft_consensus.cc:2804] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.266418  7647 raft_consensus.cc:697] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 LEADER]: Becoming Leader. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Running, Role: LEADER
I20260709 13:00:15.267043  7601 raft_consensus.cc:359] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.267232  7647 consensus_queue.cc:237] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.267743  7601 raft_consensus.cc:385] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.268083  7601 raft_consensus.cc:740] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6b4120316346919c83497e8d331037, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.268893  7601 consensus_queue.cc:260] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.271198  7601 ts_tablet_manager.cc:1434] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:00:15.287163  7300 catalog_manager.cc:5697] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca reported cstate change: term changed from 0 to 1, leader changed from <none> to c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193). New cstate: current_term: 1 leader_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.295146  7607 raft_consensus.cc:493] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.295681  7607 raft_consensus.cc:515] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } }
I20260709 13:00:15.297760  7607 leader_election.cc:290] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
I20260709 13:00:15.298686  7405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcea9028f904eb7943ac75ca583bb7b" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" is_pre_election: true
I20260709 13:00:15.298704  7480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcea9028f904eb7943ac75ca583bb7b" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6b4120316346919c83497e8d331037" is_pre_election: true
I20260709 13:00:15.299592  7480 raft_consensus.cc:2393] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a529ce0f6abe4903be95c8259b0f1c2a in current term 1: Already voted for candidate c447b4d2e3f84b02baeeb875f55ec8ca in this term.
I20260709 13:00:15.300505  7521 leader_election.cc:304] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a; no voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca
I20260709 13:00:15.301158  7607 raft_consensus.cc:3060] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.307009  7647 raft_consensus.cc:493] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.307459  7647 raft_consensus.cc:515] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.307823  7607 raft_consensus.cc:2749] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.309358  7647 leader_election.cc:290] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:15.310089  7480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa04a27d4d8478a9a09fd5d7943ada5" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6b4120316346919c83497e8d331037" is_pre_election: true
I20260709 13:00:15.310380  7554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa04a27d4d8478a9a09fd5d7943ada5" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" is_pre_election: true
I20260709 13:00:15.310740  7480 raft_consensus.cc:2468] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 0.
I20260709 13:00:15.310935  7554 raft_consensus.cc:2468] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 0.
I20260709 13:00:15.311833  7372 leader_election.cc:304] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:15.312582  7647 raft_consensus.cc:2804] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:15.312934  7647 raft_consensus.cc:493] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.313257  7647 raft_consensus.cc:3060] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.317478  7647 raft_consensus.cc:515] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.319133  7647 leader_election.cc:290] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 election: Requested vote from peers 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:15.319981  7480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa04a27d4d8478a9a09fd5d7943ada5" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6b4120316346919c83497e8d331037"
I20260709 13:00:15.320269  7554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa04a27d4d8478a9a09fd5d7943ada5" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:15.320575  7480 raft_consensus.cc:3060] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.320797  7554 raft_consensus.cc:3060] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.327399  7480 raft_consensus.cc:2468] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 1.
I20260709 13:00:15.327399  7554 raft_consensus.cc:2468] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 1.
I20260709 13:00:15.328711  7372 leader_election.cc:304] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:15.329444  7647 raft_consensus.cc:2804] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.329929  7647 raft_consensus.cc:697] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 LEADER]: Becoming Leader. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Running, Role: LEADER
I20260709 13:00:15.330724  7647 consensus_queue.cc:237] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.338469  7300 catalog_manager.cc:5697] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca reported cstate change: term changed from 0 to 1, leader changed from <none> to c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193). New cstate: current_term: 1 leader_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.433310  7607 consensus_queue.cc:1048] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:15.434937  7628 consensus_queue.cc:1048] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.462893  7607 consensus_queue.cc:1048] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.470592  7647 raft_consensus.cc:493] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.471102  7647 raft_consensus.cc:515] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.473737  7647 leader_election.cc:290] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:15.474417  7481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6b4120316346919c83497e8d331037" is_pre_election: true
I20260709 13:00:15.474292  7605 consensus_queue.cc:1048] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:15.475299  7481 raft_consensus.cc:2468] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 0.
I20260709 13:00:15.479202  7372 leader_election.cc:304] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:15.480039  7647 raft_consensus.cc:2804] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:15.480415  7647 raft_consensus.cc:493] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.480749  7647 raft_consensus.cc:3060] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.480803  7554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" is_pre_election: true
I20260709 13:00:15.482345  7554 raft_consensus.cc:2468] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 0.
I20260709 13:00:15.488979  7647 raft_consensus.cc:515] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.489281  7605 consensus_queue.cc:1048] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:15.492065  7481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6b4120316346919c83497e8d331037"
I20260709 13:00:15.492630  7481 raft_consensus.cc:3060] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.502007  7481 raft_consensus.cc:2468] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 1.
I20260709 13:00:15.503186  7372 leader_election.cc:304] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:15.504017  7658 raft_consensus.cc:2804] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.504657  7658 raft_consensus.cc:697] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 LEADER]: Becoming Leader. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Running, Role: LEADER
I20260709 13:00:15.505302  7647 leader_election.cc:290] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 1 election: Requested vote from peers 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:15.505775  7658 consensus_queue.cc:237] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.512933  7553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:15.513659  7553 raft_consensus.cc:3060] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.518417  7635 consensus_queue.cc:1048] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.526005  7553 raft_consensus.cc:2468] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 1.
W20260709 13:00:15.536499  7519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:44995, user_credentials={real_user=slave}} blocked reactor thread for 78340.3us
I20260709 13:00:15.545693  7607 raft_consensus.cc:493] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.546185  7607 raft_consensus.cc:515] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.548729  7607 leader_election.cc:290] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
I20260709 13:00:15.550575  7404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf45c1a8864fbe9e17420f24f2e4d7" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" is_pre_election: true
I20260709 13:00:15.551437  7404 raft_consensus.cc:2393] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a529ce0f6abe4903be95c8259b0f1c2a in current term 1: Already voted for candidate 9a6b4120316346919c83497e8d331037 in this term.
I20260709 13:00:15.551550  7480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf45c1a8864fbe9e17420f24f2e4d7" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6b4120316346919c83497e8d331037" is_pre_election: true
I20260709 13:00:15.553594  7521 leader_election.cc:304] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a; no voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca
I20260709 13:00:15.554500  7607 raft_consensus.cc:3060] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.556453  7300 catalog_manager.cc:5697] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca reported cstate change: term changed from 0 to 1, leader changed from <none> to c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193). New cstate: current_term: 1 leader_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.560935  7607 raft_consensus.cc:2749] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.593643  7605 consensus_queue.cc:1048] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.605067  7672 consensus_queue.cc:1048] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:15.634832  7672 consensus_queue.cc:1048] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.646056  7605 consensus_queue.cc:1048] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.679286  7647 consensus_queue.cc:1048] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.690364  7602 consensus_queue.cc:1048] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.726104  7658 consensus_queue.cc:1048] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.736187  7647 consensus_queue.cc:1048] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.784950  7554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfa0689b0b834be3b8b62cf7199646d5"
dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
mode: GRACEFUL
new_leader_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
 from {username='slave'} at 127.0.0.1:36984
I20260709 13:00:15.785754  7554 raft_consensus.cc:606] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 LEADER]: Received request to transfer leadership to TS c447b4d2e3f84b02baeeb875f55ec8ca
I20260709 13:00:15.800028  7480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90cf45c1a8864fbe9e17420f24f2e4d7"
dest_uuid: "9a6b4120316346919c83497e8d331037"
mode: GRACEFUL
new_leader_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
 from {username='slave'} at 127.0.0.1:43616
I20260709 13:00:15.800562  7480 raft_consensus.cc:606] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 1 LEADER]: Received request to transfer leadership to TS c447b4d2e3f84b02baeeb875f55ec8ca
I20260709 13:00:15.805807  7480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904"
dest_uuid: "9a6b4120316346919c83497e8d331037"
mode: GRACEFUL
new_leader_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
 from {username='slave'} at 127.0.0.1:43616
I20260709 13:00:15.806421  7480 raft_consensus.cc:606] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 1 LEADER]: Received request to transfer leadership to TS c447b4d2e3f84b02baeeb875f55ec8ca
I20260709 13:00:15.819613  7405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54"
dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
mode: GRACEFUL
new_leader_uuid: "9a6b4120316346919c83497e8d331037"
 from {username='slave'} at 127.0.0.1:36074
I20260709 13:00:15.820130  7405 raft_consensus.cc:606] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 LEADER]: Received request to transfer leadership to TS 9a6b4120316346919c83497e8d331037
I20260709 13:00:15.828821  7405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5aa04a27d4d8478a9a09fd5d7943ada5"
dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
mode: GRACEFUL
new_leader_uuid: "9a6b4120316346919c83497e8d331037"
 from {username='slave'} at 127.0.0.1:36074
I20260709 13:00:15.829470  7405 raft_consensus.cc:606] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 LEADER]: Received request to transfer leadership to TS 9a6b4120316346919c83497e8d331037
I20260709 13:00:15.829167  7658 consensus_queue.cc:1048] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.836304  7405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a9cafa0d7f84c5fa0742bd9bba972f9"
dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
mode: GRACEFUL
new_leader_uuid: "9a6b4120316346919c83497e8d331037"
 from {username='slave'} at 127.0.0.1:36074
I20260709 13:00:15.836915  7405 raft_consensus.cc:606] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 LEADER]: Received request to transfer leadership to TS 9a6b4120316346919c83497e8d331037
I20260709 13:00:15.838238  7658 raft_consensus.cc:993] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca: : Instructing follower 9a6b4120316346919c83497e8d331037 to start an election
I20260709 13:00:15.838591  7658 raft_consensus.cc:1081] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 LEADER]: Signalling peer 9a6b4120316346919c83497e8d331037 to start an election
I20260709 13:00:15.844871  7481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5aa04a27d4d8478a9a09fd5d7943ada5"
dest_uuid: "9a6b4120316346919c83497e8d331037"
 from {username='slave'} at 127.0.0.1:43600
I20260709 13:00:15.845507  7481 raft_consensus.cc:493] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:15.845870  7481 raft_consensus.cc:3060] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.850124  7647 consensus_queue.cc:1048] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.854830  7480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afe1b4d2b5d34052a5c831c1912775f2"
dest_uuid: "9a6b4120316346919c83497e8d331037"
mode: GRACEFUL
new_leader_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
 from {username='slave'} at 127.0.0.1:43616
I20260709 13:00:15.855460  7480 raft_consensus.cc:606] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [term 1 LEADER]: Received request to transfer leadership to TS a529ce0f6abe4903be95c8259b0f1c2a
I20260709 13:00:15.855722  7481 raft_consensus.cc:515] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.860374  7553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa04a27d4d8478a9a09fd5d7943ada5" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:15.860445  7405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa04a27d4d8478a9a09fd5d7943ada5" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
I20260709 13:00:15.861296  7405 raft_consensus.cc:3055] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:15.861799  7405 raft_consensus.cc:740] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Running, Role: LEADER
I20260709 13:00:15.862506  7481 leader_election.cc:290] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 2 election: Requested vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:15.862921  7405 consensus_queue.cc:260] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.864681  7405 raft_consensus.cc:3060] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.872684  7405 raft_consensus.cc:2468] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 2.
I20260709 13:00:15.873911  7445 leader_election.cc:304] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: a529ce0f6abe4903be95c8259b0f1c2a
I20260709 13:00:15.874662  7605 raft_consensus.cc:2804] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:15.875795  7605 raft_consensus.cc:697] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [term 2 LEADER]: Becoming Leader. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:15.876708  7605 consensus_queue.cc:237] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.883822  7301 catalog_manager.cc:5697] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 reported cstate change: term changed from 1 to 2, leader changed from c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193) to 9a6b4120316346919c83497e8d331037 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "9a6b4120316346919c83497e8d331037" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.930788  7647 consensus_queue.cc:1048] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.939728  7602 raft_consensus.cc:993] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca: : Instructing follower 9a6b4120316346919c83497e8d331037 to start an election
I20260709 13:00:15.940167  7602 raft_consensus.cc:1081] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 LEADER]: Signalling peer 9a6b4120316346919c83497e8d331037 to start an election
I20260709 13:00:15.942396  7480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54"
dest_uuid: "9a6b4120316346919c83497e8d331037"
 from {username='slave'} at 127.0.0.1:43600
I20260709 13:00:15.943706  7480 raft_consensus.cc:493] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:15.944116  7480 raft_consensus.cc:3060] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.945998  7658 consensus_queue.cc:1048] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.955521  7480 raft_consensus.cc:515] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.958309  7480 leader_election.cc:290] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 2 election: Requested vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:15.958905  7553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:15.965830  7405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
I20260709 13:00:15.966431  7405 raft_consensus.cc:3055] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:15.966760  7405 raft_consensus.cc:740] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Running, Role: LEADER
I20260709 13:00:15.967549  7405 consensus_queue.cc:260] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.968806  7405 raft_consensus.cc:3060] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.973238  7607 raft_consensus.cc:993] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a: : Instructing follower c447b4d2e3f84b02baeeb875f55ec8ca to start an election
I20260709 13:00:15.973685  7670 raft_consensus.cc:1081] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 LEADER]: Signalling peer c447b4d2e3f84b02baeeb875f55ec8ca to start an election
I20260709 13:00:15.975391  7406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfa0689b0b834be3b8b62cf7199646d5"
dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
 from {username='slave'} at 127.0.0.1:36064
I20260709 13:00:15.975912  7406 raft_consensus.cc:493] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:15.976207  7406 raft_consensus.cc:3060] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.981916  7406 raft_consensus.cc:515] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.983573  7405 raft_consensus.cc:2468] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 2.
I20260709 13:00:15.983775  7406 leader_election.cc:290] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 2 election: Requested vote from peers 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:15.984958  7445 leader_election.cc:304] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: a529ce0f6abe4903be95c8259b0f1c2a
I20260709 13:00:15.985407  7480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0689b0b834be3b8b62cf7199646d5" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a6b4120316346919c83497e8d331037"
I20260709 13:00:15.985605  7554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0689b0b834be3b8b62cf7199646d5" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:15.985954  7480 raft_consensus.cc:3060] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.986100  7605 raft_consensus.cc:2804] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:15.986177  7554 raft_consensus.cc:3055] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:15.986636  7605 raft_consensus.cc:697] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 2 LEADER]: Becoming Leader. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:15.986619  7554 raft_consensus.cc:740] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a529ce0f6abe4903be95c8259b0f1c2a, State: Running, Role: LEADER
I20260709 13:00:15.987596  7605 consensus_queue.cc:237] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.988181  7554 consensus_queue.cc:260] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.989403  7554 raft_consensus.cc:3060] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.992166  7480 raft_consensus.cc:2468] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 2.
I20260709 13:00:15.993402  7372 leader_election.cc:304] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:15.994297  7658 raft_consensus.cc:2804] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:15.994782  7658 raft_consensus.cc:697] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 LEADER]: Becoming Leader. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Running, Role: LEADER
I20260709 13:00:15.995697  7658 consensus_queue.cc:237] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:15.995741  7301 catalog_manager.cc:5697] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 reported cstate change: term changed from 1 to 2, leader changed from c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193) to 9a6b4120316346919c83497e8d331037 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "9a6b4120316346919c83497e8d331037" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.999188  7554 raft_consensus.cc:2468] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 2.
I20260709 13:00:16.005491  7302 catalog_manager.cc:5697] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca reported cstate change: term changed from 1 to 2, leader changed from a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195) to c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193). New cstate: current_term: 2 leader_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.116420  7635 raft_consensus.cc:993] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037: : Instructing follower c447b4d2e3f84b02baeeb875f55ec8ca to start an election
I20260709 13:00:16.116897  7605 raft_consensus.cc:1081] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 1 LEADER]: Signalling peer c447b4d2e3f84b02baeeb875f55ec8ca to start an election
I20260709 13:00:16.118311  7406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904"
dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
 from {username='slave'} at 127.0.0.1:36070
I20260709 13:00:16.118791  7406 raft_consensus.cc:493] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:16.119082  7406 raft_consensus.cc:3060] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.123402  7406 raft_consensus.cc:515] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:16.125057  7406 leader_election.cc:290] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 2 election: Requested vote from peers 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:16.125946  7480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a6b4120316346919c83497e8d331037"
I20260709 13:00:16.126157  7554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:16.126746  7554 raft_consensus.cc:3060] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.126708  7480 raft_consensus.cc:3055] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:16.127254  7480 raft_consensus.cc:740] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:16.128067  7480 consensus_queue.cc:260] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:16.129262  7480 raft_consensus.cc:3060] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.134758  7554 raft_consensus.cc:2468] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 2.
I20260709 13:00:16.136078  7372 leader_election.cc:304] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:16.137030  7658 raft_consensus.cc:2804] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:16.137549  7658 raft_consensus.cc:697] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 LEADER]: Becoming Leader. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Running, Role: LEADER
I20260709 13:00:16.137843  7480 raft_consensus.cc:2468] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 2.
I20260709 13:00:16.138481  7658 consensus_queue.cc:237] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:16.146615  7302 catalog_manager.cc:5697] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca reported cstate change: term changed from 1 to 2, leader changed from 9a6b4120316346919c83497e8d331037 (127.7.25.194) to c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193). New cstate: current_term: 2 leader_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.172757  7647 raft_consensus.cc:993] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca: : Instructing follower 9a6b4120316346919c83497e8d331037 to start an election
I20260709 13:00:16.173329  7658 raft_consensus.cc:1081] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 LEADER]: Signalling peer 9a6b4120316346919c83497e8d331037 to start an election
I20260709 13:00:16.175530  7480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a9cafa0d7f84c5fa0742bd9bba972f9"
dest_uuid: "9a6b4120316346919c83497e8d331037"
 from {username='slave'} at 127.0.0.1:43600
I20260709 13:00:16.176268  7480 raft_consensus.cc:493] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:16.176661  7480 raft_consensus.cc:3060] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.181336  7480 raft_consensus.cc:515] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:16.183053  7480 leader_election.cc:290] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 2 election: Requested vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:16.183837  7406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9cafa0d7f84c5fa0742bd9bba972f9" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
I20260709 13:00:16.184480  7406 raft_consensus.cc:3055] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:16.185039  7554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9cafa0d7f84c5fa0742bd9bba972f9" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:16.184818  7406 raft_consensus.cc:740] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Running, Role: LEADER
I20260709 13:00:16.185643  7554 raft_consensus.cc:3060] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.186165  7406 consensus_queue.cc:260] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:16.188648  7406 raft_consensus.cc:3060] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.193199  7554 raft_consensus.cc:2468] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 2.
I20260709 13:00:16.194522  7447 leader_election.cc:304] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6b4120316346919c83497e8d331037, a529ce0f6abe4903be95c8259b0f1c2a; no voters: 
I20260709 13:00:16.195398  7605 raft_consensus.cc:2804] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:16.195825  7406 raft_consensus.cc:2468] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 2.
I20260709 13:00:16.195917  7605 raft_consensus.cc:697] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [term 2 LEADER]: Becoming Leader. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:16.197520  7605 consensus_queue.cc:237] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:16.205003  7672 raft_consensus.cc:993] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037: : Instructing follower c447b4d2e3f84b02baeeb875f55ec8ca to start an election
I20260709 13:00:16.205519  7605 raft_consensus.cc:1081] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 1 LEADER]: Signalling peer c447b4d2e3f84b02baeeb875f55ec8ca to start an election
I20260709 13:00:16.205384  7302 catalog_manager.cc:5697] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 reported cstate change: term changed from 1 to 2, leader changed from c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193) to 9a6b4120316346919c83497e8d331037 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "9a6b4120316346919c83497e8d331037" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.206940  7406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90cf45c1a8864fbe9e17420f24f2e4d7"
dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
 from {username='slave'} at 127.0.0.1:36070
I20260709 13:00:16.207404  7406 raft_consensus.cc:493] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:16.207707  7406 raft_consensus.cc:3060] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.214006  7406 raft_consensus.cc:515] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:16.215845  7406 leader_election.cc:290] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 2 election: Requested vote from peers 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:16.217288  7554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf45c1a8864fbe9e17420f24f2e4d7" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:16.217635  7480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf45c1a8864fbe9e17420f24f2e4d7" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a6b4120316346919c83497e8d331037"
I20260709 13:00:16.217926  7554 raft_consensus.cc:3060] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.218365  7480 raft_consensus.cc:3055] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:16.218741  7480 raft_consensus.cc:740] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:16.219700  7480 consensus_queue.cc:260] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:16.220980  7480 raft_consensus.cc:3060] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.225903  7554 raft_consensus.cc:2468] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 2.
I20260709 13:00:16.227257  7372 leader_election.cc:304] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:16.228096  7658 raft_consensus.cc:2804] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:16.228533  7658 raft_consensus.cc:697] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 LEADER]: Becoming Leader. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Running, Role: LEADER
I20260709 13:00:16.229265  7658 consensus_queue.cc:237] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:16.230377  7480 raft_consensus.cc:2468] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 2.
I20260709 13:00:16.236415  7302 catalog_manager.cc:5697] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca reported cstate change: term changed from 1 to 2, leader changed from 9a6b4120316346919c83497e8d331037 (127.7.25.194) to c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193). New cstate: current_term: 2 leader_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.260152  7672 raft_consensus.cc:993] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037: : Instructing follower a529ce0f6abe4903be95c8259b0f1c2a to start an election
I20260709 13:00:16.260604  7605 raft_consensus.cc:1081] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [term 1 LEADER]: Signalling peer a529ce0f6abe4903be95c8259b0f1c2a to start an election
I20260709 13:00:16.262436  7554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afe1b4d2b5d34052a5c831c1912775f2"
dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
 from {username='slave'} at 127.0.0.1:36966
I20260709 13:00:16.263010  7554 raft_consensus.cc:493] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:16.263403  7554 raft_consensus.cc:3060] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.269690  7554 raft_consensus.cc:515] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:16.271816  7554 leader_election.cc:290] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 2 election: Requested vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
I20260709 13:00:16.272101  7406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe1b4d2b5d34052a5c831c1912775f2" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
I20260709 13:00:16.272477  7480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe1b4d2b5d34052a5c831c1912775f2" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a6b4120316346919c83497e8d331037"
I20260709 13:00:16.272715  7406 raft_consensus.cc:3060] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.273128  7480 raft_consensus.cc:3055] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:16.273456  7480 raft_consensus.cc:740] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:16.274317  7480 consensus_queue.cc:260] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:16.275519  7480 raft_consensus.cc:3060] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.279559  7405 raft_consensus.cc:1275] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Refusing update from remote peer 9a6b4120316346919c83497e8d331037: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.281118  7605 consensus_queue.cc:1048] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:16.280679  7406 raft_consensus.cc:2468] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a529ce0f6abe4903be95c8259b0f1c2a in term 2.
I20260709 13:00:16.282087  7480 raft_consensus.cc:2468] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a529ce0f6abe4903be95c8259b0f1c2a in term 2.
I20260709 13:00:16.282998  7519 leader_election.cc:304] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:16.284044  7670 raft_consensus.cc:2804] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:16.284492  7670 raft_consensus.cc:697] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 LEADER]: Becoming Leader. State: Replica: a529ce0f6abe4903be95c8259b0f1c2a, State: Running, Role: LEADER
I20260709 13:00:16.285445  7670 consensus_queue.cc:237] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:16.294340  7554 raft_consensus.cc:3060] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.297436  7301 catalog_manager.cc:5697] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a reported cstate change: term changed from 1 to 2, leader changed from 9a6b4120316346919c83497e8d331037 (127.7.25.194) to a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195). New cstate: current_term: 2 leader_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:16.303565  7554 raft_consensus.cc:1275] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Refusing update from remote peer 9a6b4120316346919c83497e8d331037: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.306195  7635 consensus_queue.cc:1048] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:16.472890  7554 raft_consensus.cc:3060] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.477617  7554 raft_consensus.cc:1275] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Refusing update from remote peer 9a6b4120316346919c83497e8d331037: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.479020  7635 consensus_queue.cc:1048] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:16.486697  7405 raft_consensus.cc:1275] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Refusing update from remote peer 9a6b4120316346919c83497e8d331037: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.488562  7605 consensus_queue.cc:1048] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:16.536648  7480 raft_consensus.cc:1275] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Refusing update from remote peer c447b4d2e3f84b02baeeb875f55ec8ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.537895  7658 consensus_queue.cc:1048] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:16.547700  7554 raft_consensus.cc:1275] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Refusing update from remote peer c447b4d2e3f84b02baeeb875f55ec8ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.547729  7553 raft_consensus.cc:1275] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Refusing update from remote peer c447b4d2e3f84b02baeeb875f55ec8ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.549860  7602 consensus_queue.cc:1048] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:16.550135  7658 consensus_queue.cc:1048] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:16.562404  7480 raft_consensus.cc:1275] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Refusing update from remote peer c447b4d2e3f84b02baeeb875f55ec8ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.563834  7658 consensus_queue.cc:1048] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:16.603196  7405 raft_consensus.cc:1275] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Refusing update from remote peer 9a6b4120316346919c83497e8d331037: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.604341  7605 consensus_queue.cc:1048] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:16.611279  7554 raft_consensus.cc:1275] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Refusing update from remote peer 9a6b4120316346919c83497e8d331037: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.612524  7635 consensus_queue.cc:1048] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:16.741856  7405 raft_consensus.cc:1275] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Refusing update from remote peer a529ce0f6abe4903be95c8259b0f1c2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.743048  7670 consensus_queue.cc:1048] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:16.751612  7480 raft_consensus.cc:1275] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Refusing update from remote peer a529ce0f6abe4903be95c8259b0f1c2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.753783  7698 consensus_queue.cc:1048] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:16.796130  7480 raft_consensus.cc:1275] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Refusing update from remote peer c447b4d2e3f84b02baeeb875f55ec8ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.797336  7658 consensus_queue.cc:1048] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:16.805843  7554 raft_consensus.cc:1275] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Refusing update from remote peer c447b4d2e3f84b02baeeb875f55ec8ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:16.807626  7658 consensus_queue.cc:1048] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:18.919428  7271 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:00:18.920233  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:18.942250  7405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904"
dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
mode: GRACEFUL
new_leader_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
 from {username='slave'} at 127.0.0.1:36078
I20260709 13:00:18.942819  7405 raft_consensus.cc:606] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 LEADER]: Received request to transfer leadership to TS a529ce0f6abe4903be95c8259b0f1c2a
I20260709 13:00:18.954247  7481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54"
dest_uuid: "9a6b4120316346919c83497e8d331037"
mode: GRACEFUL
new_leader_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
 from {username='slave'} at 127.0.0.1:43628
I20260709 13:00:18.954821  7481 raft_consensus.cc:606] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 2 LEADER]: Received request to transfer leadership to TS a529ce0f6abe4903be95c8259b0f1c2a
I20260709 13:00:18.955899  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:18.956458  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:19.023531  7707 raft_consensus.cc:993] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca: : Instructing follower a529ce0f6abe4903be95c8259b0f1c2a to start an election
I20260709 13:00:19.024016  7703 raft_consensus.cc:1081] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 LEADER]: Signalling peer a529ce0f6abe4903be95c8259b0f1c2a to start an election
I20260709 13:00:19.025498  7553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904"
dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
 from {username='slave'} at 127.0.0.1:36972
I20260709 13:00:19.026005  7553 raft_consensus.cc:493] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:19.026301  7553 raft_consensus.cc:3060] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:19.030997  7553 raft_consensus.cc:515] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:19.032671  7553 leader_election.cc:290] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 3 election: Requested vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
I20260709 13:00:19.033679  7481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a6b4120316346919c83497e8d331037"
I20260709 13:00:19.033632  7405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
I20260709 13:00:19.034337  7481 raft_consensus.cc:3060] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:19.034466  7405 raft_consensus.cc:3055] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:19.034878  7405 raft_consensus.cc:740] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Running, Role: LEADER
I20260709 13:00:19.035627  7405 consensus_queue.cc:260] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:19.036583  7405 raft_consensus.cc:3060] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:19.039153  7481 raft_consensus.cc:2468] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a529ce0f6abe4903be95c8259b0f1c2a in term 3.
I20260709 13:00:19.040343  7521 leader_election.cc:304] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6b4120316346919c83497e8d331037, a529ce0f6abe4903be95c8259b0f1c2a; no voters: 
I20260709 13:00:19.041009  7698 raft_consensus.cc:2804] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:19.042357  7698 raft_consensus.cc:697] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 LEADER]: Becoming Leader. State: Replica: a529ce0f6abe4903be95c8259b0f1c2a, State: Running, Role: LEADER
I20260709 13:00:19.043023  7405 raft_consensus.cc:2468] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a529ce0f6abe4903be95c8259b0f1c2a in term 3.
I20260709 13:00:19.043164  7698 consensus_queue.cc:237] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:19.053792  7301 catalog_manager.cc:5697] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a reported cstate change: term changed from 2 to 3, leader changed from c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193) to a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195). New cstate: current_term: 3 leader_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:19.188524  7576 debug-util.cc:398] Leaking SignalData structure 0x7b080016f060 after lost signal to thread 7274
W20260709 13:00:19.189302  7576 debug-util.cc:398] Leaking SignalData structure 0x7b080016f740 after lost signal to thread 7337
W20260709 13:00:19.190907  7576 debug-util.cc:398] Leaking SignalData structure 0x7b08001d0e40 after lost signal to thread 7579
I20260709 13:00:19.468461  7405 raft_consensus.cc:1275] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 FOLLOWER]: Refusing update from remote peer a529ce0f6abe4903be95c8259b0f1c2a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:19.469833  7698 consensus_queue.cc:1048] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:19.484305  7481 raft_consensus.cc:1275] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Refusing update from remote peer a529ce0f6abe4903be95c8259b0f1c2a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:19.486367  7698 consensus_queue.cc:1048] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:19.528299  7719 raft_consensus.cc:993] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037: : Instructing follower a529ce0f6abe4903be95c8259b0f1c2a to start an election
I20260709 13:00:19.528748  7605 raft_consensus.cc:1081] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 2 LEADER]: Signalling peer a529ce0f6abe4903be95c8259b0f1c2a to start an election
I20260709 13:00:19.530330  7553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54"
dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
 from {username='slave'} at 127.0.0.1:36966
I20260709 13:00:19.530794  7553 raft_consensus.cc:493] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:19.531095  7553 raft_consensus.cc:3060] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:19.535542  7553 raft_consensus.cc:515] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:19.537201  7553 leader_election.cc:290] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 3 election: Requested vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
I20260709 13:00:19.537968  7405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
I20260709 13:00:19.538381  7481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a6b4120316346919c83497e8d331037"
I20260709 13:00:19.538601  7405 raft_consensus.cc:3060] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:19.539003  7481 raft_consensus.cc:3055] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:19.539294  7481 raft_consensus.cc:740] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:19.539975  7481 consensus_queue.cc:260] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:19.540825  7481 raft_consensus.cc:3060] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:19.545320  7481 raft_consensus.cc:2468] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a529ce0f6abe4903be95c8259b0f1c2a in term 3.
I20260709 13:00:19.546308  7521 leader_election.cc:304] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6b4120316346919c83497e8d331037, a529ce0f6abe4903be95c8259b0f1c2a; no voters: 
I20260709 13:00:19.546355  7405 raft_consensus.cc:2468] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a529ce0f6abe4903be95c8259b0f1c2a in term 3.
I20260709 13:00:19.547066  7716 raft_consensus.cc:2804] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:19.547506  7716 raft_consensus.cc:697] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 LEADER]: Becoming Leader. State: Replica: a529ce0f6abe4903be95c8259b0f1c2a, State: Running, Role: LEADER
I20260709 13:00:19.548283  7716 consensus_queue.cc:237] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:19.555986  7300 catalog_manager.cc:5697] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a reported cstate change: term changed from 2 to 3, leader changed from 9a6b4120316346919c83497e8d331037 (127.7.25.194) to a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195). New cstate: current_term: 3 leader_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:19.957242  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:19.967106  7405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adcea9028f904eb7943ac75ca583bb7b"
dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
mode: GRACEFUL
new_leader_uuid: "9a6b4120316346919c83497e8d331037"
 from {username='slave'} at 127.0.0.1:36074
I20260709 13:00:19.967753  7405 raft_consensus.cc:606] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 LEADER]: Received request to transfer leadership to TS 9a6b4120316346919c83497e8d331037
I20260709 13:00:19.972761  7405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfa0689b0b834be3b8b62cf7199646d5"
dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
mode: GRACEFUL
new_leader_uuid: "9a6b4120316346919c83497e8d331037"
 from {username='slave'} at 127.0.0.1:36074
I20260709 13:00:19.973558  7405 raft_consensus.cc:606] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 LEADER]: Received request to transfer leadership to TS 9a6b4120316346919c83497e8d331037
I20260709 13:00:19.981154  7405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90cf45c1a8864fbe9e17420f24f2e4d7"
dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
mode: GRACEFUL
new_leader_uuid: "9a6b4120316346919c83497e8d331037"
 from {username='slave'} at 127.0.0.1:36074
I20260709 13:00:19.981556  7722 raft_consensus.cc:993] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca: : Instructing follower 9a6b4120316346919c83497e8d331037 to start an election
I20260709 13:00:19.982080  7703 raft_consensus.cc:1081] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 LEADER]: Signalling peer 9a6b4120316346919c83497e8d331037 to start an election
I20260709 13:00:19.982591  7405 raft_consensus.cc:606] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 LEADER]: Received request to transfer leadership to TS 9a6b4120316346919c83497e8d331037
I20260709 13:00:19.983808  7480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "adcea9028f904eb7943ac75ca583bb7b"
dest_uuid: "9a6b4120316346919c83497e8d331037"
 from {username='slave'} at 127.0.0.1:43600
I20260709 13:00:19.984308  7480 raft_consensus.cc:493] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:19.984640  7480 raft_consensus.cc:3060] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.988862  7553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904"
dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
mode: GRACEFUL
new_leader_uuid: "9a6b4120316346919c83497e8d331037"
 from {username='slave'} at 127.0.0.1:36984
I20260709 13:00:19.989599  7553 raft_consensus.cc:606] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 LEADER]: Received request to transfer leadership to TS 9a6b4120316346919c83497e8d331037
I20260709 13:00:19.989624  7480 raft_consensus.cc:515] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } }
I20260709 13:00:19.992491  7405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcea9028f904eb7943ac75ca583bb7b" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
I20260709 13:00:19.994043  7405 raft_consensus.cc:3055] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:19.994434  7405 raft_consensus.cc:740] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Running, Role: LEADER
I20260709 13:00:19.995755  7722 raft_consensus.cc:993] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca: : Instructing follower 9a6b4120316346919c83497e8d331037 to start an election
I20260709 13:00:19.996176  7722 raft_consensus.cc:1081] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 LEADER]: Signalling peer 9a6b4120316346919c83497e8d331037 to start an election
I20260709 13:00:19.996176  7405 consensus_queue.cc:260] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } }
I20260709 13:00:19.997622  7405 raft_consensus.cc:3060] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.998306  7554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54"
dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
mode: GRACEFUL
new_leader_uuid: "9a6b4120316346919c83497e8d331037"
 from {username='slave'} at 127.0.0.1:36984
I20260709 13:00:19.998942  7554 raft_consensus.cc:606] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 LEADER]: Received request to transfer leadership to TS 9a6b4120316346919c83497e8d331037
I20260709 13:00:19.996244  7480 leader_election.cc:290] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 2 election: Requested vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:20.002476  7481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfa0689b0b834be3b8b62cf7199646d5"
dest_uuid: "9a6b4120316346919c83497e8d331037"
 from {username='slave'} at 127.0.0.1:43600
I20260709 13:00:20.003216  7481 raft_consensus.cc:493] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:20.003726  7481 raft_consensus.cc:3060] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:19.993180  7553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcea9028f904eb7943ac75ca583bb7b" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:20.005532  7553 raft_consensus.cc:3060] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.011225  7553 raft_consensus.cc:2468] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 2.
I20260709 13:00:20.012346  7447 leader_election.cc:304] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6b4120316346919c83497e8d331037, a529ce0f6abe4903be95c8259b0f1c2a; no voters: 
I20260709 13:00:20.013249  7605 raft_consensus.cc:2804] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:20.013710  7605 raft_consensus.cc:697] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 [term 2 LEADER]: Becoming Leader. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:20.014544  7405 raft_consensus.cc:2468] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 2.
I20260709 13:00:20.014533  7605 consensus_queue.cc:237] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } }
I20260709 13:00:20.018102  7406 raft_consensus.cc:1275] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 FOLLOWER]: Refusing update from remote peer a529ce0f6abe4903be95c8259b0f1c2a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:20.020138  7708 consensus_queue.cc:1048] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:20.025172  7481 raft_consensus.cc:515] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:20.028036  7481 leader_election.cc:290] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 3 election: Requested vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:20.029201  7406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0689b0b834be3b8b62cf7199646d5" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
I20260709 13:00:20.029882  7406 raft_consensus.cc:3055] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:20.030350  7406 raft_consensus.cc:740] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Running, Role: LEADER
I20260709 13:00:20.031273  7406 consensus_queue.cc:260] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:20.034113  7406 raft_consensus.cc:3060] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:20.032037  7553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0689b0b834be3b8b62cf7199646d5" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:20.037894  7553 raft_consensus.cc:3060] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:20.041417  7300 catalog_manager.cc:5697] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 reported cstate change: term changed from 1 to 2, leader changed from c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193) to 9a6b4120316346919c83497e8d331037 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "9a6b4120316346919c83497e8d331037" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:20.046586  7406 raft_consensus.cc:2468] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 3.
I20260709 13:00:20.053032  7553 raft_consensus.cc:2468] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 3.
I20260709 13:00:20.053306  7445 leader_election.cc:304] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:20.054302  7605 raft_consensus.cc:2804] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:20.055009  7605 raft_consensus.cc:697] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 3 LEADER]: Becoming Leader. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:20.055799  7605 consensus_queue.cc:237] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:20.062088  7481 raft_consensus.cc:1275] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Refusing update from remote peer a529ce0f6abe4903be95c8259b0f1c2a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:20.063496  7698 consensus_queue.cc:1048] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:20.076678  7708 raft_consensus.cc:993] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a: : Instructing follower 9a6b4120316346919c83497e8d331037 to start an election
I20260709 13:00:20.077230  7728 raft_consensus.cc:1081] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 LEADER]: Signalling peer 9a6b4120316346919c83497e8d331037 to start an election
I20260709 13:00:20.078936  7481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54"
dest_uuid: "9a6b4120316346919c83497e8d331037"
 from {username='slave'} at 127.0.0.1:43592
I20260709 13:00:20.079556  7481 raft_consensus.cc:493] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:20.080108  7481 raft_consensus.cc:3060] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:20.079548  7301 catalog_manager.cc:5697] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 reported cstate change: term changed from 2 to 3, leader changed from c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193) to 9a6b4120316346919c83497e8d331037 (127.7.25.194). New cstate: current_term: 3 leader_uuid: "9a6b4120316346919c83497e8d331037" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:20.086994  7481 raft_consensus.cc:515] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:20.090332  7553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:20.090539  7404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
I20260709 13:00:20.090961  7553 raft_consensus.cc:3055] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:20.091384  7553 raft_consensus.cc:740] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a529ce0f6abe4903be95c8259b0f1c2a, State: Running, Role: LEADER
I20260709 13:00:20.092168  7553 consensus_queue.cc:260] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:20.091030  7404 raft_consensus.cc:3060] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:20.093247  7553 raft_consensus.cc:3060] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:20.099757  7553 raft_consensus.cc:2468] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 4.
I20260709 13:00:20.100950  7481 leader_election.cc:290] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 4 election: Requested vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:20.101300  7447 leader_election.cc:304] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6b4120316346919c83497e8d331037, a529ce0f6abe4903be95c8259b0f1c2a; no voters: 
I20260709 13:00:20.102125  7719 raft_consensus.cc:2804] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:20.102574  7719 raft_consensus.cc:697] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 4 LEADER]: Becoming Leader. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:20.103444  7719 consensus_queue.cc:237] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:20.104542  7404 raft_consensus.cc:2468] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 4.
I20260709 13:00:20.111439  7301 catalog_manager.cc:5697] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 reported cstate change: term changed from 3 to 4, leader changed from a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195) to 9a6b4120316346919c83497e8d331037 (127.7.25.194). New cstate: current_term: 4 leader_uuid: "9a6b4120316346919c83497e8d331037" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:20.146857  7703 raft_consensus.cc:993] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca: : Instructing follower 9a6b4120316346919c83497e8d331037 to start an election
I20260709 13:00:20.147449  7722 raft_consensus.cc:1081] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 LEADER]: Signalling peer 9a6b4120316346919c83497e8d331037 to start an election
I20260709 13:00:20.149343  7481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90cf45c1a8864fbe9e17420f24f2e4d7"
dest_uuid: "9a6b4120316346919c83497e8d331037"
 from {username='slave'} at 127.0.0.1:43600
I20260709 13:00:20.149832  7481 raft_consensus.cc:493] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:20.150131  7481 raft_consensus.cc:3060] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:20.154567  7481 raft_consensus.cc:515] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:20.156132  7481 leader_election.cc:290] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 3 election: Requested vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:20.157203  7553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf45c1a8864fbe9e17420f24f2e4d7" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:20.157315  7404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf45c1a8864fbe9e17420f24f2e4d7" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
I20260709 13:00:20.157816  7553 raft_consensus.cc:3060] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:20.158002  7404 raft_consensus.cc:3055] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:20.158416  7404 raft_consensus.cc:740] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Running, Role: LEADER
I20260709 13:00:20.159503  7404 consensus_queue.cc:260] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:20.160907  7404 raft_consensus.cc:3060] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:20.167446  7553 raft_consensus.cc:2468] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 3.
I20260709 13:00:20.169277  7404 raft_consensus.cc:2468] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 3.
I20260709 13:00:20.169348  7447 leader_election.cc:304] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6b4120316346919c83497e8d331037, a529ce0f6abe4903be95c8259b0f1c2a; no voters: 
I20260709 13:00:20.170418  7719 raft_consensus.cc:2804] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:20.170972  7719 raft_consensus.cc:697] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 3 LEADER]: Becoming Leader. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:20.171927  7719 consensus_queue.cc:237] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:20.182964  7301 catalog_manager.cc:5697] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 reported cstate change: term changed from 2 to 3, leader changed from c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193) to 9a6b4120316346919c83497e8d331037 (127.7.25.194). New cstate: current_term: 3 leader_uuid: "9a6b4120316346919c83497e8d331037" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:20.484724  7708 raft_consensus.cc:993] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a: : Instructing follower 9a6b4120316346919c83497e8d331037 to start an election
I20260709 13:00:20.485260  7728 raft_consensus.cc:1081] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 LEADER]: Signalling peer 9a6b4120316346919c83497e8d331037 to start an election
I20260709 13:00:20.486819  7481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904"
dest_uuid: "9a6b4120316346919c83497e8d331037"
 from {username='slave'} at 127.0.0.1:43592
I20260709 13:00:20.487512  7481 raft_consensus.cc:493] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:20.487943  7481 raft_consensus.cc:3060] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:20.496163  7481 raft_consensus.cc:515] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:20.498988  7481 leader_election.cc:290] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 4 election: Requested vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:20.499046  7406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
I20260709 13:00:20.499733  7406 raft_consensus.cc:3060] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:20.500263  7553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b99613be8a2472fa7bdd5bf37a52904" candidate_uuid: "9a6b4120316346919c83497e8d331037" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:20.500921  7553 raft_consensus.cc:3055] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:20.501315  7553 raft_consensus.cc:740] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a529ce0f6abe4903be95c8259b0f1c2a, State: Running, Role: LEADER
I20260709 13:00:20.502242  7553 consensus_queue.cc:260] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:20.503669  7553 raft_consensus.cc:3060] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:20.505301  7406 raft_consensus.cc:2468] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 4.
I20260709 13:00:20.506281  7445 leader_election.cc:304] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:20.506947  7719 raft_consensus.cc:2804] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:20.507371  7719 raft_consensus.cc:697] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 4 LEADER]: Becoming Leader. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:20.508188  7719 consensus_queue.cc:237] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:20.511806  7553 raft_consensus.cc:2468] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6b4120316346919c83497e8d331037 in term 4.
I20260709 13:00:20.516415  7301 catalog_manager.cc:5697] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 reported cstate change: term changed from 3 to 4, leader changed from a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195) to 9a6b4120316346919c83497e8d331037 (127.7.25.194). New cstate: current_term: 4 leader_uuid: "9a6b4120316346919c83497e8d331037" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:20.538220  7406 raft_consensus.cc:1275] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Refusing update from remote peer 9a6b4120316346919c83497e8d331037: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.539460  7719 consensus_queue.cc:1048] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:20.544973  7553 raft_consensus.cc:1275] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Refusing update from remote peer 9a6b4120316346919c83497e8d331037: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.547878  7732 consensus_queue.cc:1048] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:20.563512  7554 raft_consensus.cc:1275] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 FOLLOWER]: Refusing update from remote peer 9a6b4120316346919c83497e8d331037: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:20.564970  7719 consensus_queue.cc:1048] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:20.596735  7406 raft_consensus.cc:1275] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 4 FOLLOWER]: Refusing update from remote peer 9a6b4120316346919c83497e8d331037: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:20.598611  7738 consensus_queue.cc:1048] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:20.635468  7553 raft_consensus.cc:1275] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Refusing update from remote peer 9a6b4120316346919c83497e8d331037: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:20.636878  7732 consensus_queue.cc:1048] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:20.647241  7406 raft_consensus.cc:1275] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 FOLLOWER]: Refusing update from remote peer 9a6b4120316346919c83497e8d331037: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:20.648762  7732 consensus_queue.cc:1048] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:20.723944  7553 raft_consensus.cc:1275] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Refusing update from remote peer 9a6b4120316346919c83497e8d331037: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:20.725337  7732 consensus_queue.cc:1048] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:20.734645  7406 raft_consensus.cc:1275] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 FOLLOWER]: Refusing update from remote peer 9a6b4120316346919c83497e8d331037: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:20.736604  7738 consensus_queue.cc:1048] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:21.015942  7553 raft_consensus.cc:1275] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 FOLLOWER]: Refusing update from remote peer 9a6b4120316346919c83497e8d331037: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:21.017395  7738 consensus_queue.cc:1048] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:21.026654  7406 raft_consensus.cc:1275] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 4 FOLLOWER]: Refusing update from remote peer 9a6b4120316346919c83497e8d331037: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:21.028154  7732 consensus_queue.cc:1048] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:23.098218  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:23.106199  7481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a9cafa0d7f84c5fa0742bd9bba972f9"
dest_uuid: "9a6b4120316346919c83497e8d331037"
mode: GRACEFUL
new_leader_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
 from {username='slave'} at 127.0.0.1:43628
I20260709 13:00:23.106858  7481 raft_consensus.cc:606] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [term 2 LEADER]: Received request to transfer leadership to TS c447b4d2e3f84b02baeeb875f55ec8ca
I20260709 13:00:23.109428  7481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5aa04a27d4d8478a9a09fd5d7943ada5"
dest_uuid: "9a6b4120316346919c83497e8d331037"
mode: GRACEFUL
new_leader_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
 from {username='slave'} at 127.0.0.1:43628
I20260709 13:00:23.109861  7481 raft_consensus.cc:606] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [term 2 LEADER]: Received request to transfer leadership to TS a529ce0f6abe4903be95c8259b0f1c2a
I20260709 13:00:23.111979  7481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90cf45c1a8864fbe9e17420f24f2e4d7"
dest_uuid: "9a6b4120316346919c83497e8d331037"
mode: GRACEFUL
new_leader_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
 from {username='slave'} at 127.0.0.1:43628
I20260709 13:00:23.112380  7481 raft_consensus.cc:606] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 3 LEADER]: Received request to transfer leadership to TS c447b4d2e3f84b02baeeb875f55ec8ca
I20260709 13:00:23.114616  7481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54"
dest_uuid: "9a6b4120316346919c83497e8d331037"
mode: GRACEFUL
new_leader_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
 from {username='slave'} at 127.0.0.1:43628
I20260709 13:00:23.115020  7481 raft_consensus.cc:606] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 4 LEADER]: Received request to transfer leadership to TS c447b4d2e3f84b02baeeb875f55ec8ca
I20260709 13:00:23.117151  7481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfa0689b0b834be3b8b62cf7199646d5"
dest_uuid: "9a6b4120316346919c83497e8d331037"
mode: GRACEFUL
new_leader_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
 from {username='slave'} at 127.0.0.1:43628
I20260709 13:00:23.117533  7481 raft_consensus.cc:606] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 3 LEADER]: Received request to transfer leadership to TS a529ce0f6abe4903be95c8259b0f1c2a
I20260709 13:00:23.118484  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:23.118841  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:23.157697  7737 raft_consensus.cc:993] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037: : Instructing follower c447b4d2e3f84b02baeeb875f55ec8ca to start an election
I20260709 13:00:23.158231  7747 raft_consensus.cc:1081] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [term 2 LEADER]: Signalling peer c447b4d2e3f84b02baeeb875f55ec8ca to start an election
I20260709 13:00:23.159637  7406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a9cafa0d7f84c5fa0742bd9bba972f9"
dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
 from {username='slave'} at 127.0.0.1:36070
I20260709 13:00:23.160112  7406 raft_consensus.cc:493] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:23.160404  7406 raft_consensus.cc:3060] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.165093  7406 raft_consensus.cc:515] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:23.166725  7406 leader_election.cc:290] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 3 election: Requested vote from peers 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:23.168040  7481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9cafa0d7f84c5fa0742bd9bba972f9" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a6b4120316346919c83497e8d331037"
I20260709 13:00:23.168277  7553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9cafa0d7f84c5fa0742bd9bba972f9" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:23.168808  7481 raft_consensus.cc:3055] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:23.168853  7553 raft_consensus.cc:3060] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.169363  7481 raft_consensus.cc:740] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:23.170394  7481 consensus_queue.cc:260] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:23.171787  7481 raft_consensus.cc:3060] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.176153  7553 raft_consensus.cc:2468] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 3.
I20260709 13:00:23.177724  7372 leader_election.cc:304] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:23.178481  7481 raft_consensus.cc:2468] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 3.
I20260709 13:00:23.179332  7748 raft_consensus.cc:2804] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:23.180217  7748 raft_consensus.cc:697] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 LEADER]: Becoming Leader. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Running, Role: LEADER
I20260709 13:00:23.181066  7748 consensus_queue.cc:237] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:23.190006  7300 catalog_manager.cc:5697] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca reported cstate change: term changed from 2 to 3, leader changed from 9a6b4120316346919c83497e8d331037 (127.7.25.194) to c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193). New cstate: current_term: 3 leader_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:23.258914  7737 raft_consensus.cc:993] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037: : Instructing follower c447b4d2e3f84b02baeeb875f55ec8ca to start an election
I20260709 13:00:23.259343  7747 raft_consensus.cc:1081] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 3 LEADER]: Signalling peer c447b4d2e3f84b02baeeb875f55ec8ca to start an election
I20260709 13:00:23.260668  7406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90cf45c1a8864fbe9e17420f24f2e4d7"
dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
 from {username='slave'} at 127.0.0.1:36070
I20260709 13:00:23.261112  7406 raft_consensus.cc:493] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:23.261376  7406 raft_consensus.cc:3060] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:23.265183  7406 raft_consensus.cc:515] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:23.266673  7406 leader_election.cc:290] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 4 election: Requested vote from peers 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:23.267429  7481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf45c1a8864fbe9e17420f24f2e4d7" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9a6b4120316346919c83497e8d331037"
I20260709 13:00:23.267747  7553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf45c1a8864fbe9e17420f24f2e4d7" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:23.267982  7481 raft_consensus.cc:3055] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:23.268314  7553 raft_consensus.cc:3060] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:23.268307  7481 raft_consensus.cc:740] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:23.269369  7481 consensus_queue.cc:260] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:23.270495  7481 raft_consensus.cc:3060] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:23.274705  7553 raft_consensus.cc:2468] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 4.
I20260709 13:00:23.275882  7372 leader_election.cc:304] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:23.276551  7748 raft_consensus.cc:2804] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:23.276651  7481 raft_consensus.cc:2468] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 4.
I20260709 13:00:23.277127  7748 raft_consensus.cc:697] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 4 LEADER]: Becoming Leader. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Running, Role: LEADER
I20260709 13:00:23.278126  7748 consensus_queue.cc:237] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:23.284821  7300 catalog_manager.cc:5697] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca reported cstate change: term changed from 3 to 4, leader changed from 9a6b4120316346919c83497e8d331037 (127.7.25.194) to c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193). New cstate: current_term: 4 leader_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:23.362444  7737 raft_consensus.cc:993] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037: : Instructing follower c447b4d2e3f84b02baeeb875f55ec8ca to start an election
I20260709 13:00:23.362915  7747 raft_consensus.cc:1081] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 4 LEADER]: Signalling peer c447b4d2e3f84b02baeeb875f55ec8ca to start an election
I20260709 13:00:23.364248  7406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54"
dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
 from {username='slave'} at 127.0.0.1:36070
I20260709 13:00:23.364630  7406 raft_consensus.cc:493] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:23.364843  7406 raft_consensus.cc:3060] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:23.368621  7406 raft_consensus.cc:515] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:23.370101  7406 leader_election.cc:290] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 5 election: Requested vote from peers 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003), a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195:37985)
I20260709 13:00:23.370942  7481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "9a6b4120316346919c83497e8d331037"
I20260709 13:00:23.371165  7553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93d082ce398446194dfbf3cf3165c54" candidate_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
I20260709 13:00:23.371423  7481 raft_consensus.cc:3055] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:23.371649  7553 raft_consensus.cc:3060] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:23.371747  7481 raft_consensus.cc:740] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:23.372467  7481 consensus_queue.cc:260] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:23.373399  7481 raft_consensus.cc:3060] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:23.375914  7553 raft_consensus.cc:2468] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 5.
I20260709 13:00:23.376866  7372 leader_election.cc:304] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:23.377444  7481 raft_consensus.cc:2468] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c447b4d2e3f84b02baeeb875f55ec8ca in term 5.
I20260709 13:00:23.377681  7748 raft_consensus.cc:2804] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:23.378518  7748 raft_consensus.cc:697] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 5 LEADER]: Becoming Leader. State: Replica: c447b4d2e3f84b02baeeb875f55ec8ca, State: Running, Role: LEADER
I20260709 13:00:23.379256  7748 consensus_queue.cc:237] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:23.386129  7300 catalog_manager.cc:5697] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca reported cstate change: term changed from 4 to 5, leader changed from 9a6b4120316346919c83497e8d331037 (127.7.25.194) to c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193). New cstate: current_term: 5 leader_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:23.501132  7737 raft_consensus.cc:993] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037: : Instructing follower a529ce0f6abe4903be95c8259b0f1c2a to start an election
I20260709 13:00:23.501638  7747 raft_consensus.cc:1081] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 3 LEADER]: Signalling peer a529ce0f6abe4903be95c8259b0f1c2a to start an election
I20260709 13:00:23.503295  7553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfa0689b0b834be3b8b62cf7199646d5"
dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
 from {username='slave'} at 127.0.0.1:36966
I20260709 13:00:23.503721  7553 raft_consensus.cc:493] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:23.504026  7553 raft_consensus.cc:3060] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:23.508591  7553 raft_consensus.cc:515] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:23.510125  7553 leader_election.cc:290] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 4 election: Requested vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
I20260709 13:00:23.510977  7406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0689b0b834be3b8b62cf7199646d5" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
I20260709 13:00:23.511209  7481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0689b0b834be3b8b62cf7199646d5" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9a6b4120316346919c83497e8d331037"
I20260709 13:00:23.511543  7406 raft_consensus.cc:3060] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:23.511682  7481 raft_consensus.cc:3055] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:23.512022  7481 raft_consensus.cc:740] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:23.512530  7481 consensus_queue.cc:260] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:23.513381  7481 raft_consensus.cc:3060] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:23.515664  7406 raft_consensus.cc:2468] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a529ce0f6abe4903be95c8259b0f1c2a in term 4.
I20260709 13:00:23.516736  7519 leader_election.cc:304] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:23.517387  7481 raft_consensus.cc:2468] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a529ce0f6abe4903be95c8259b0f1c2a in term 4.
I20260709 13:00:23.517552  7728 raft_consensus.cc:2804] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:23.518872  7728 raft_consensus.cc:697] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 LEADER]: Becoming Leader. State: Replica: a529ce0f6abe4903be95c8259b0f1c2a, State: Running, Role: LEADER
I20260709 13:00:23.519651  7728 consensus_queue.cc:237] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:23.526216  7300 catalog_manager.cc:5697] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a reported cstate change: term changed from 3 to 4, leader changed from 9a6b4120316346919c83497e8d331037 (127.7.25.194) to a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195). New cstate: current_term: 4 leader_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:23.540680  7737 raft_consensus.cc:993] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037: : Instructing follower a529ce0f6abe4903be95c8259b0f1c2a to start an election
I20260709 13:00:23.541239  7737 raft_consensus.cc:1081] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [term 2 LEADER]: Signalling peer a529ce0f6abe4903be95c8259b0f1c2a to start an election
I20260709 13:00:23.542909  7553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5aa04a27d4d8478a9a09fd5d7943ada5"
dest_uuid: "a529ce0f6abe4903be95c8259b0f1c2a"
 from {username='slave'} at 127.0.0.1:36966
I20260709 13:00:23.543414  7553 raft_consensus.cc:493] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:23.543780  7553 raft_consensus.cc:3060] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.547955  7553 raft_consensus.cc:515] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:23.549434  7553 leader_election.cc:290] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 3 election: Requested vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
I20260709 13:00:23.550232  7406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa04a27d4d8478a9a09fd5d7943ada5" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca"
I20260709 13:00:23.550388  7481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa04a27d4d8478a9a09fd5d7943ada5" candidate_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a6b4120316346919c83497e8d331037"
I20260709 13:00:23.550803  7406 raft_consensus.cc:3060] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.550813  7481 raft_consensus.cc:3055] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:23.551299  7481 raft_consensus.cc:740] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a6b4120316346919c83497e8d331037, State: Running, Role: LEADER
I20260709 13:00:23.551980  7481 consensus_queue.cc:260] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:23.552999  7481 raft_consensus.cc:3060] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.556850  7406 raft_consensus.cc:2468] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a529ce0f6abe4903be95c8259b0f1c2a in term 3.
I20260709 13:00:23.557964  7519 leader_election.cc:304] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a, c447b4d2e3f84b02baeeb875f55ec8ca; no voters: 
I20260709 13:00:23.558706  7728 raft_consensus.cc:2804] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:23.558830  7481 raft_consensus.cc:2468] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a529ce0f6abe4903be95c8259b0f1c2a in term 3.
I20260709 13:00:23.559238  7728 raft_consensus.cc:697] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 LEADER]: Becoming Leader. State: Replica: a529ce0f6abe4903be95c8259b0f1c2a, State: Running, Role: LEADER
I20260709 13:00:23.560105  7728 consensus_queue.cc:237] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:23.566322  7300 catalog_manager.cc:5697] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a reported cstate change: term changed from 2 to 3, leader changed from 9a6b4120316346919c83497e8d331037 (127.7.25.194) to a529ce0f6abe4903be95c8259b0f1c2a (127.7.25.195). New cstate: current_term: 3 leader_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:23.742816  7553 raft_consensus.cc:1275] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 FOLLOWER]: Refusing update from remote peer c447b4d2e3f84b02baeeb875f55ec8ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:23.744006  7748 consensus_queue.cc:1048] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:23.754701  7481 raft_consensus.cc:1275] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 4 FOLLOWER]: Refusing update from remote peer c447b4d2e3f84b02baeeb875f55ec8ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:23.756335  7748 consensus_queue.cc:1048] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:23.786916  7553 raft_consensus.cc:1275] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 5 FOLLOWER]: Refusing update from remote peer c447b4d2e3f84b02baeeb875f55ec8ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:23.788071  7748 consensus_queue.cc:1048] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:23.795240  7553 raft_consensus.cc:1275] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Refusing update from remote peer c447b4d2e3f84b02baeeb875f55ec8ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:23.797379  7481 raft_consensus.cc:1275] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 5 FOLLOWER]: Refusing update from remote peer c447b4d2e3f84b02baeeb875f55ec8ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:23.797734  7748 consensus_queue.cc:1048] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:23.799124  7748 consensus_queue.cc:1048] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:00:23.815867  7481 raft_consensus.cc:1275] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Refusing update from remote peer c447b4d2e3f84b02baeeb875f55ec8ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:23.818148  7762 consensus_queue.cc:1048] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:00:23.844640  7502 debug-util.cc:398] Leaking SignalData structure 0x7b080012d060 after lost signal to thread 7274
W20260709 13:00:23.845422  7502 debug-util.cc:398] Leaking SignalData structure 0x7b080012d740 after lost signal to thread 7337
W20260709 13:00:23.846158  7502 debug-util.cc:398] Leaking SignalData structure 0x7b08000abbe0 after lost signal to thread 7430
W20260709 13:00:23.846836  7502 debug-util.cc:398] Leaking SignalData structure 0x7b08000ab960 after lost signal to thread 7505
W20260709 13:00:23.847504  7502 debug-util.cc:398] Leaking SignalData structure 0x7b08001e12c0 after lost signal to thread 7579
I20260709 13:00:23.929376  7481 raft_consensus.cc:1275] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 4 FOLLOWER]: Refusing update from remote peer a529ce0f6abe4903be95c8259b0f1c2a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:23.930663  7728 consensus_queue.cc:1048] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:23.940905  7406 raft_consensus.cc:1275] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 4 FOLLOWER]: Refusing update from remote peer a529ce0f6abe4903be95c8259b0f1c2a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:23.942996  7728 consensus_queue.cc:1048] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:23.960362  7481 raft_consensus.cc:1275] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Refusing update from remote peer a529ce0f6abe4903be95c8259b0f1c2a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:23.961777  7757 consensus_queue.cc:1048] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:23.977924  7406 raft_consensus.cc:1275] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 FOLLOWER]: Refusing update from remote peer a529ce0f6abe4903be95c8259b0f1c2a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:23.979679  7728 consensus_queue.cc:1048] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:24.119673  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:24.125306  7271 tablet_server.cc:179] TabletServer@127.7.25.193:0 shutting down...
I20260709 13:00:24.161726  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:24.162518  7271 tablet_replica.cc:333] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca: stopping tablet replica
I20260709 13:00:24.163290  7271 raft_consensus.cc:2243] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:24.164220  7271 raft_consensus.cc:2272] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.167380  7271 tablet_replica.cc:333] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca: stopping tablet replica
I20260709 13:00:24.167955  7271 raft_consensus.cc:2243] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:00:24.168691  7271 raft_consensus.cc:2272] T b93d082ce398446194dfbf3cf3165c54 P c447b4d2e3f84b02baeeb875f55ec8ca [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.170711  7271 tablet_replica.cc:333] T bcb2ed2e803c4d3192166fe697e7d95c P c447b4d2e3f84b02baeeb875f55ec8ca: stopping tablet replica
I20260709 13:00:24.171275  7271 raft_consensus.cc:2243] T bcb2ed2e803c4d3192166fe697e7d95c P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:24.171761  7271 raft_consensus.cc:2272] T bcb2ed2e803c4d3192166fe697e7d95c P c447b4d2e3f84b02baeeb875f55ec8ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.174657  7271 tablet_replica.cc:333] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca: stopping tablet replica
W20260709 13:00:24.174829  7445 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:24.175182  7271 raft_consensus.cc:2243] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:24.175722  7271 raft_consensus.cc:2272] T dfa0689b0b834be3b8b62cf7199646d5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.178525  7271 tablet_replica.cc:333] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca: stopping tablet replica
W20260709 13:00:24.178617  7445 consensus_peers.cc:597] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 -> Peer c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995): Couldn't send request to peer c447b4d2e3f84b02baeeb875f55ec8ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:24.179124  7271 raft_consensus.cc:2243] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:24.179593  7271 raft_consensus.cc:2272] T 5aa04a27d4d8478a9a09fd5d7943ada5 P c447b4d2e3f84b02baeeb875f55ec8ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.181699  7271 tablet_replica.cc:333] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca: stopping tablet replica
I20260709 13:00:24.182185  7271 raft_consensus.cc:2243] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:24.182905  7271 raft_consensus.cc:2272] T 90cf45c1a8864fbe9e17420f24f2e4d7 P c447b4d2e3f84b02baeeb875f55ec8ca [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.184892  7271 tablet_replica.cc:333] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca: stopping tablet replica
I20260709 13:00:24.185555  7271 raft_consensus.cc:2243] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:24.186064  7271 raft_consensus.cc:2272] T afe1b4d2b5d34052a5c831c1912775f2 P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.188334  7271 tablet_replica.cc:333] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca: stopping tablet replica
I20260709 13:00:24.188937  7271 raft_consensus.cc:2243] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:24.189570  7271 raft_consensus.cc:2272] T adcea9028f904eb7943ac75ca583bb7b P c447b4d2e3f84b02baeeb875f55ec8ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.191730  7271 tablet_replica.cc:333] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca: stopping tablet replica
I20260709 13:00:24.192226  7271 raft_consensus.cc:2243] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:24.192656  7271 raft_consensus.cc:2272] T 2b99613be8a2472fa7bdd5bf37a52904 P c447b4d2e3f84b02baeeb875f55ec8ca [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.293952  7271 tablet_server.cc:196] TabletServer@127.7.25.193:0 shutdown complete.
I20260709 13:00:24.318455  7271 tablet_server.cc:179] TabletServer@127.7.25.194:0 shutting down...
I20260709 13:00:24.343271  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:24.344029  7271 tablet_replica.cc:333] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037: stopping tablet replica
I20260709 13:00:24.344672  7271 raft_consensus.cc:2243] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:24.345211  7271 raft_consensus.cc:2272] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.347867  7271 tablet_replica.cc:333] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037: stopping tablet replica
I20260709 13:00:24.348416  7271 raft_consensus.cc:2243] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:24.348839  7271 raft_consensus.cc:2272] T dfa0689b0b834be3b8b62cf7199646d5 P 9a6b4120316346919c83497e8d331037 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.351619  7271 tablet_replica.cc:333] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037: stopping tablet replica
I20260709 13:00:24.352135  7271 raft_consensus.cc:2243] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:24.352559  7271 raft_consensus.cc:2272] T b93d082ce398446194dfbf3cf3165c54 P 9a6b4120316346919c83497e8d331037 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.354642  7271 tablet_replica.cc:333] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037: stopping tablet replica
I20260709 13:00:24.355144  7271 raft_consensus.cc:2243] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:24.356052  7271 raft_consensus.cc:2272] T bcb2ed2e803c4d3192166fe697e7d95c P 9a6b4120316346919c83497e8d331037 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.358803  7271 tablet_replica.cc:333] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037: stopping tablet replica
I20260709 13:00:24.359704  7271 raft_consensus.cc:2243] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:24.360219  7271 raft_consensus.cc:2272] T 5aa04a27d4d8478a9a09fd5d7943ada5 P 9a6b4120316346919c83497e8d331037 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.362576  7271 tablet_replica.cc:333] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037: stopping tablet replica
I20260709 13:00:24.363266  7271 raft_consensus.cc:2243] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:24.363684  7271 raft_consensus.cc:2272] T 90cf45c1a8864fbe9e17420f24f2e4d7 P 9a6b4120316346919c83497e8d331037 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:24.364063  7445 consensus_peers.cc:597] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 -> Peer c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995): Couldn't send request to peer c447b4d2e3f84b02baeeb875f55ec8ca. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:24.365921  7271 tablet_replica.cc:333] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037: stopping tablet replica
I20260709 13:00:24.366433  7271 raft_consensus.cc:2243] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:24.367164  7271 raft_consensus.cc:2272] T adcea9028f904eb7943ac75ca583bb7b P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.368824  7271 tablet_replica.cc:333] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037: stopping tablet replica
I20260709 13:00:24.369396  7271 raft_consensus.cc:2243] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:24.369796  7271 raft_consensus.cc:2272] T afe1b4d2b5d34052a5c831c1912775f2 P 9a6b4120316346919c83497e8d331037 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.371661  7271 tablet_replica.cc:333] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037: stopping tablet replica
I20260709 13:00:24.372216  7271 raft_consensus.cc:2243] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:24.373238  7271 raft_consensus.cc:2272] T 2b99613be8a2472fa7bdd5bf37a52904 P 9a6b4120316346919c83497e8d331037 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:24.399864  7519 consensus_peers.cc:597] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a -> Peer c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995): Couldn't send request to peer c447b4d2e3f84b02baeeb875f55ec8ca. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:24.412262  7521 consensus_peers.cc:597] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a -> Peer 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003): Couldn't send request to peer 9a6b4120316346919c83497e8d331037. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:24.519383  7519 consensus_peers.cc:597] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a -> Peer c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995): Couldn't send request to peer c447b4d2e3f84b02baeeb875f55ec8ca. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:24.523408  7519 consensus_peers.cc:597] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a -> Peer c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995): Couldn't send request to peer c447b4d2e3f84b02baeeb875f55ec8ca. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:24.558713  7521 consensus_peers.cc:597] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a -> Peer 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003): Couldn't send request to peer 9a6b4120316346919c83497e8d331037. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:24.588090  7521 consensus_peers.cc:597] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a -> Peer 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003): Couldn't send request to peer 9a6b4120316346919c83497e8d331037. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:25.252889  7773 raft_consensus.cc:493] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c447b4d2e3f84b02baeeb875f55ec8ca)
I20260709 13:00:25.253607  7773 raft_consensus.cc:515] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:25.256141  7773 leader_election.cc:290] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
W20260709 13:00:25.260206  7519 leader_election.cc:336] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44995: connect: Connection refused (error 111)
W20260709 13:00:25.260764  7521 leader_election.cc:336] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36003: connect: Connection refused (error 111)
I20260709 13:00:25.261229  7521 leader_election.cc:304] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a; no voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca
I20260709 13:00:25.261983  7773 raft_consensus.cc:2749] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:25.297276  7773 raft_consensus.cc:493] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c447b4d2e3f84b02baeeb875f55ec8ca)
I20260709 13:00:25.297804  7773 raft_consensus.cc:515] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:25.299857  7773 leader_election.cc:290] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
W20260709 13:00:25.304008  7521 leader_election.cc:336] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36003: connect: Connection refused (error 111)
W20260709 13:00:25.304636  7519 leader_election.cc:336] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44995: connect: Connection refused (error 111)
I20260709 13:00:25.304996  7519 leader_election.cc:304] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a; no voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca
I20260709 13:00:25.305771  7773 raft_consensus.cc:2749] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:25.310724  7773 raft_consensus.cc:493] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c447b4d2e3f84b02baeeb875f55ec8ca)
I20260709 13:00:25.311558  7728 raft_consensus.cc:493] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a6b4120316346919c83497e8d331037)
I20260709 13:00:25.311357  7773 raft_consensus.cc:515] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:25.312077  7728 raft_consensus.cc:515] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:25.313637  7773 leader_election.cc:290] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
I20260709 13:00:25.313822  7728 leader_election.cc:290] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
W20260709 13:00:25.318539  7521 leader_election.cc:336] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36003: connect: Connection refused (error 111)
W20260709 13:00:25.319069  7521 leader_election.cc:336] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36003: connect: Connection refused (error 111)
W20260709 13:00:25.319039  7519 leader_election.cc:336] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44995: connect: Connection refused (error 111)
I20260709 13:00:25.319660  7519 leader_election.cc:304] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a; no voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca
I20260709 13:00:25.320474  7728 raft_consensus.cc:2749] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:25.320657  7519 leader_election.cc:336] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44995: connect: Connection refused (error 111)
I20260709 13:00:25.321146  7519 leader_election.cc:304] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a; no voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca
I20260709 13:00:25.321934  7728 raft_consensus.cc:2749] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:25.406092  7271 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 7502)
I20260709 13:00:25.416150  7728 raft_consensus.cc:493] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a6b4120316346919c83497e8d331037)
I20260709 13:00:25.416766  7728 raft_consensus.cc:515] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } }
I20260709 13:00:25.419152  7728 leader_election.cc:290] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
W20260709 13:00:25.423130  7519 leader_election.cc:336] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44995: connect: Connection refused (error 111)
W20260709 13:00:25.423599  7521 leader_election.cc:336] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36003: connect: Connection refused (error 111)
I20260709 13:00:25.424072  7521 leader_election.cc:304] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a; no voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca
I20260709 13:00:25.424886  7728 raft_consensus.cc:2749] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.691709  7728 raft_consensus.cc:493] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a6b4120316346919c83497e8d331037)
I20260709 13:00:25.692189  7728 raft_consensus.cc:515] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c447b4d2e3f84b02baeeb875f55ec8ca" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44995 } } peers { permanent_uuid: "9a6b4120316346919c83497e8d331037" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36003 } } peers { permanent_uuid: "a529ce0f6abe4903be95c8259b0f1c2a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37985 } }
I20260709 13:00:25.694084  7728 leader_election.cc:290] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995), 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003)
W20260709 13:00:25.698001  7519 leader_election.cc:336] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c447b4d2e3f84b02baeeb875f55ec8ca (127.7.25.193:44995): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44995: connect: Connection refused (error 111)
W20260709 13:00:25.698555  7521 leader_election.cc:336] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9a6b4120316346919c83497e8d331037 (127.7.25.194:36003): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36003: connect: Connection refused (error 111)
I20260709 13:00:25.698923  7521 leader_election.cc:304] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a529ce0f6abe4903be95c8259b0f1c2a; no voters: 9a6b4120316346919c83497e8d331037, c447b4d2e3f84b02baeeb875f55ec8ca
I20260709 13:00:25.699561  7728 raft_consensus.cc:2749] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:25.996860  7271 tablet_server.cc:196] TabletServer@127.7.25.194:0 shutdown complete.
I20260709 13:00:26.014446  7271 tablet_server.cc:179] TabletServer@127.7.25.195:0 shutting down...
I20260709 13:00:26.034162  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:26.034922  7271 tablet_replica.cc:333] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a: stopping tablet replica
I20260709 13:00:26.035794  7271 raft_consensus.cc:2243] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:26.036756  7271 raft_consensus.cc:2272] T 5aa04a27d4d8478a9a09fd5d7943ada5 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.038411  7271 tablet_replica.cc:333] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a: stopping tablet replica
I20260709 13:00:26.038837  7271 raft_consensus.cc:2243] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:26.039215  7271 raft_consensus.cc:2272] T 90cf45c1a8864fbe9e17420f24f2e4d7 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.040668  7271 tablet_replica.cc:333] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a: stopping tablet replica
I20260709 13:00:26.041281  7271 raft_consensus.cc:2243] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:26.041628  7271 raft_consensus.cc:2272] T 4a9cafa0d7f84c5fa0742bd9bba972f9 P a529ce0f6abe4903be95c8259b0f1c2a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.043046  7271 tablet_replica.cc:333] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a: stopping tablet replica
I20260709 13:00:26.043489  7271 raft_consensus.cc:2243] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:26.043797  7271 raft_consensus.cc:2272] T adcea9028f904eb7943ac75ca583bb7b P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.045255  7271 tablet_replica.cc:333] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a: stopping tablet replica
I20260709 13:00:26.045660  7271 raft_consensus.cc:2243] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:26.046005  7271 raft_consensus.cc:2272] T 2b99613be8a2472fa7bdd5bf37a52904 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.047561  7271 tablet_replica.cc:333] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a: stopping tablet replica
I20260709 13:00:26.048167  7271 raft_consensus.cc:2243] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:26.048837  7271 raft_consensus.cc:2272] T afe1b4d2b5d34052a5c831c1912775f2 P a529ce0f6abe4903be95c8259b0f1c2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.050688  7271 tablet_replica.cc:333] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a: stopping tablet replica
I20260709 13:00:26.051184  7271 raft_consensus.cc:2243] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:26.051578  7271 raft_consensus.cc:2272] T bcb2ed2e803c4d3192166fe697e7d95c P a529ce0f6abe4903be95c8259b0f1c2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.053248  7271 tablet_replica.cc:333] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a: stopping tablet replica
I20260709 13:00:26.053686  7271 raft_consensus.cc:2243] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:26.054103  7271 raft_consensus.cc:2272] T b93d082ce398446194dfbf3cf3165c54 P a529ce0f6abe4903be95c8259b0f1c2a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.055546  7271 tablet_replica.cc:333] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a: stopping tablet replica
I20260709 13:00:26.055970  7271 raft_consensus.cc:2243] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:26.056638  7271 raft_consensus.cc:2272] T dfa0689b0b834be3b8b62cf7199646d5 P a529ce0f6abe4903be95c8259b0f1c2a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.099910  7271 tablet_server.cc:196] TabletServer@127.7.25.195:0 shutdown complete.
I20260709 13:00:26.119489  7271 master.cc:562] Master@127.7.25.254:37199 shutting down...
I20260709 13:00:26.211346  7358 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:00:26.239060  7271 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:26.239638  7271 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.240011  7271 tablet_replica.cc:333] T 00000000000000000000000000000000 P b3b1e412fde249f79ac201c7a42c1bc1: stopping tablet replica
I20260709 13:00:26.259274  7271 master.cc:584] Master@127.7.25.254:37199 shutdown complete.
9a6b4120316346919c83497e8d331037  4
a529ce0f6abe4903be95c8259b0f1c2a  1
c447b4d2e3f84b02baeeb875f55ec8ca  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (14614 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:00:26.297801  7271 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.25.254:34173
I20260709 13:00:26.298945  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:26.304426  7782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:26.304605  7783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:26.305544  7785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:26.305944  7271 server_base.cc:1061] running on GCE node
I20260709 13:00:26.306946  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:26.307125  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:26.307325  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602026307292 us; error 0 us; skew 500 ppm
I20260709 13:00:26.307873  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:26.310598  7271 webserver.cc:533] Webserver started at http://127.7.25.254:46697/ using document root <none> and password file <none>
I20260709 13:00:26.311126  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:26.311292  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:26.311637  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:26.312742  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602011513864-7271-0/minicluster-data/master-0-root/instance:
uuid: "47f2322cd4204fe6baa1bd4fd61fe4dd"
format_stamp: "Formatted at 2026-07-09 13:00:26 on dist-test-slave-z1zn"
I20260709 13:00:26.317046  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:00:26.320308  7790 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:26.321017  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:00:26.321359  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602011513864-7271-0/minicluster-data/master-0-root
uuid: "47f2322cd4204fe6baa1bd4fd61fe4dd"
format_stamp: "Formatted at 2026-07-09 13:00:26 on dist-test-slave-z1zn"
I20260709 13:00:26.321646  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602011513864-7271-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602011513864-7271-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602011513864-7271-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:26.340255  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:26.341539  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:26.378499  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.254:34173
I20260709 13:00:26.378602  7841 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.254:34173 every 8 connection(s)
I20260709 13:00:26.382344  7842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.391577  7842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd: Bootstrap starting.
I20260709 13:00:26.396271  7842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:26.400650  7842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd: No bootstrap required, opened a new log
I20260709 13:00:26.402817  7842 raft_consensus.cc:359] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47f2322cd4204fe6baa1bd4fd61fe4dd" member_type: VOTER }
I20260709 13:00:26.403203  7842 raft_consensus.cc:385] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:26.403484  7842 raft_consensus.cc:740] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47f2322cd4204fe6baa1bd4fd61fe4dd, State: Initialized, Role: FOLLOWER
I20260709 13:00:26.404047  7842 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47f2322cd4204fe6baa1bd4fd61fe4dd" member_type: VOTER }
I20260709 13:00:26.404497  7842 raft_consensus.cc:399] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:00:26.404719  7842 raft_consensus.cc:493] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:00:26.404997  7842 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:26.409029  7842 raft_consensus.cc:515] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47f2322cd4204fe6baa1bd4fd61fe4dd" member_type: VOTER }
I20260709 13:00:26.409614  7842 leader_election.cc:304] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47f2322cd4204fe6baa1bd4fd61fe4dd; no voters: 
I20260709 13:00:26.410794  7842 leader_election.cc:290] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:00:26.411147  7845 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:26.412700  7845 raft_consensus.cc:697] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd [term 1 LEADER]: Becoming Leader. State: Replica: 47f2322cd4204fe6baa1bd4fd61fe4dd, State: Running, Role: LEADER
I20260709 13:00:26.413429  7845 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47f2322cd4204fe6baa1bd4fd61fe4dd" member_type: VOTER }
I20260709 13:00:26.414055  7842 sys_catalog.cc:565] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:00:26.417976  7846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47f2322cd4204fe6baa1bd4fd61fe4dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47f2322cd4204fe6baa1bd4fd61fe4dd" member_type: VOTER } }
I20260709 13:00:26.418339  7847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47f2322cd4204fe6baa1bd4fd61fe4dd. Latest consensus state: current_term: 1 leader_uuid: "47f2322cd4204fe6baa1bd4fd61fe4dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47f2322cd4204fe6baa1bd4fd61fe4dd" member_type: VOTER } }
I20260709 13:00:26.418905  7846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:26.419055  7847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:26.426445  7851 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:00:26.434634  7851 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:00:26.435667  7271 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:00:26.444020  7851 catalog_manager.cc:1383] Generated new cluster ID: bcd85368a4654005b4a88abee3d992f8
I20260709 13:00:26.444347  7851 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:00:26.469919  7851 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:00:26.471159  7851 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:00:26.489274  7851 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd: Generated new TSK 0
I20260709 13:00:26.489849  7851 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:00:26.502071  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:26.507840  7863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:26.508834  7864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:26.511022  7271 server_base.cc:1061] running on GCE node
W20260709 13:00:26.511355  7866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:26.512406  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:26.512594  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:26.512712  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602026512701 us; error 0 us; skew 500 ppm
I20260709 13:00:26.513244  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:26.515432  7271 webserver.cc:533] Webserver started at http://127.7.25.193:39211/ using document root <none> and password file <none>
I20260709 13:00:26.515938  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:26.516100  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:26.516314  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:26.517457  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602011513864-7271-0/minicluster-data/ts-0-root/instance:
uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
format_stamp: "Formatted at 2026-07-09 13:00:26 on dist-test-slave-z1zn"
I20260709 13:00:26.521916  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:00:26.525121  7871 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:26.525942  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:00:26.526341  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602011513864-7271-0/minicluster-data/ts-0-root
uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
format_stamp: "Formatted at 2026-07-09 13:00:26 on dist-test-slave-z1zn"
I20260709 13:00:26.526758  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602011513864-7271-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602011513864-7271-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602011513864-7271-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:26.542802  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:26.544050  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:26.545486  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:26.547648  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:26.547871  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:26.548125  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:26.548312  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:26.587330  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.193:34835
I20260709 13:00:26.587431  7933 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.193:34835 every 8 connection(s)
I20260709 13:00:26.592417  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:26.599538  7938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:26.601711  7939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:26.605334  7271 server_base.cc:1061] running on GCE node
W20260709 13:00:26.605453  7941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:26.606741  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:26.607024  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:26.607226  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602026607185 us; error 0 us; skew 500 ppm
I20260709 13:00:26.607908  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:26.610212  7934 heartbeater.cc:344] Connected to a master server at 127.7.25.254:34173
I20260709 13:00:26.610561  7934 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:26.610908  7271 webserver.cc:533] Webserver started at http://127.7.25.194:36017/ using document root <none> and password file <none>
I20260709 13:00:26.611294  7934 heartbeater.cc:507] Master 127.7.25.254:34173 requested a full tablet report, sending...
I20260709 13:00:26.611387  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:26.611701  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:26.611974  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:26.613261  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602011513864-7271-0/minicluster-data/ts-1-root/instance:
uuid: "c3a92256a04846e8aa4032c63cda2b74"
format_stamp: "Formatted at 2026-07-09 13:00:26 on dist-test-slave-z1zn"
I20260709 13:00:26.613484  7807 ts_manager.cc:194] Registered new tserver with Master: 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835)
I20260709 13:00:26.615198  7807 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60882
I20260709 13:00:26.618085  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:00:26.621238  7946 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:26.622040  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:00:26.622334  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602011513864-7271-0/minicluster-data/ts-1-root
uuid: "c3a92256a04846e8aa4032c63cda2b74"
format_stamp: "Formatted at 2026-07-09 13:00:26 on dist-test-slave-z1zn"
I20260709 13:00:26.622628  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602011513864-7271-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602011513864-7271-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602011513864-7271-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:26.641280  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:26.642439  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:26.643887  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:26.646037  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:26.646257  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:26.646495  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:26.646664  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:26.685900  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.194:39925
I20260709 13:00:26.686004  8008 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.194:39925 every 8 connection(s)
I20260709 13:00:26.690501  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:26.697293  8012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:26.699061  8013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:26.702302  7271 server_base.cc:1061] running on GCE node
W20260709 13:00:26.702401  8015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:26.703158  8009 heartbeater.cc:344] Connected to a master server at 127.7.25.254:34173
I20260709 13:00:26.703540  8009 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:26.703558  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:26.703919  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:26.704121  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602026704104 us; error 0 us; skew 500 ppm
I20260709 13:00:26.704521  8009 heartbeater.cc:507] Master 127.7.25.254:34173 requested a full tablet report, sending...
I20260709 13:00:26.704864  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:26.706696  7807 ts_manager.cc:194] Registered new tserver with Master: c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925)
I20260709 13:00:26.707653  7271 webserver.cc:533] Webserver started at http://127.7.25.195:42289/ using document root <none> and password file <none>
I20260709 13:00:26.708202  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:26.708209  7807 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60890
I20260709 13:00:26.708490  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:26.708839  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:26.710139  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602011513864-7271-0/minicluster-data/ts-2-root/instance:
uuid: "c0e23fd9887848f08151cb92c9719d1c"
format_stamp: "Formatted at 2026-07-09 13:00:26 on dist-test-slave-z1zn"
I20260709 13:00:26.714584  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:00:26.718034  8020 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:26.718957  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:00:26.719209  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602011513864-7271-0/minicluster-data/ts-2-root
uuid: "c0e23fd9887848f08151cb92c9719d1c"
format_stamp: "Formatted at 2026-07-09 13:00:26 on dist-test-slave-z1zn"
I20260709 13:00:26.719444  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602011513864-7271-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602011513864-7271-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602011513864-7271-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:26.745038  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:26.746196  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:26.747589  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:26.749897  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:26.750141  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:26.750402  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:26.750586  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:26.789995  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.195:34777
I20260709 13:00:26.790098  8082 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.195:34777 every 8 connection(s)
I20260709 13:00:26.803543  8083 heartbeater.cc:344] Connected to a master server at 127.7.25.254:34173
I20260709 13:00:26.803925  8083 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:26.804685  8083 heartbeater.cc:507] Master 127.7.25.254:34173 requested a full tablet report, sending...
I20260709 13:00:26.806605  7807 ts_manager.cc:194] Registered new tserver with Master: c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:26.807618  7271 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014390984s
I20260709 13:00:26.807834  7807 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60894
I20260709 13:00:26.832952  7807 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60904:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:00:26.835884  7807 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:00:26.898870  7899 tablet_service.cc:1511] Processing CreateTablet for tablet 5ca06f71d27247e1bde39bb8da315c69 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:00:26.900300  7899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ca06f71d27247e1bde39bb8da315c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.902288  7898 tablet_service.cc:1511] Processing CreateTablet for tablet 554ffaa6916b461590a35a2317295d11 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:00:26.903755  7898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 554ffaa6916b461590a35a2317295d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.906247  7897 tablet_service.cc:1511] Processing CreateTablet for tablet afb6b567d4804e9e8a4b91e398f5f397 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:00:26.907615  7897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb6b567d4804e9e8a4b91e398f5f397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.915114  7974 tablet_service.cc:1511] Processing CreateTablet for tablet 5ca06f71d27247e1bde39bb8da315c69 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:00:26.916546  7974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ca06f71d27247e1bde39bb8da315c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.919237  7896 tablet_service.cc:1511] Processing CreateTablet for tablet b8b9e47b501f42d99ae6fa8b888ae1b5 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:00:26.920595  7896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b9e47b501f42d99ae6fa8b888ae1b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.922225  7895 tablet_service.cc:1511] Processing CreateTablet for tablet 111b72e6bd9d4b27b18c4325456efb7f (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:00:26.923568  7895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 111b72e6bd9d4b27b18c4325456efb7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.926136  7894 tablet_service.cc:1511] Processing CreateTablet for tablet a35f1257fc174173a9fc519308f1afa8 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:00:26.926405  7973 tablet_service.cc:1511] Processing CreateTablet for tablet 554ffaa6916b461590a35a2317295d11 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:00:26.927506  7894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a35f1257fc174173a9fc519308f1afa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.928339  7973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 554ffaa6916b461590a35a2317295d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.930599  7893 tablet_service.cc:1511] Processing CreateTablet for tablet 0abf7f11b5014b72b4e98b0d646fe426 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:00:26.931876  7893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0abf7f11b5014b72b4e98b0d646fe426. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.939275  7972 tablet_service.cc:1511] Processing CreateTablet for tablet afb6b567d4804e9e8a4b91e398f5f397 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:00:26.941071  7972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb6b567d4804e9e8a4b91e398f5f397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.941704  7892 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4f5c50563e43a6b4600dfb7f0fc575 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:00:26.942965  7892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4f5c50563e43a6b4600dfb7f0fc575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.946691  7891 tablet_service.cc:1511] Processing CreateTablet for tablet 4703ad43d75e489f8aff35739026419e (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:00:26.947999  7891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4703ad43d75e489f8aff35739026419e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.950663  7890 tablet_service.cc:1511] Processing CreateTablet for tablet f1330727d2c94cca98bada1d0b01ad24 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:00:26.951959  7890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1330727d2c94cca98bada1d0b01ad24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.954480  7971 tablet_service.cc:1511] Processing CreateTablet for tablet b8b9e47b501f42d99ae6fa8b888ae1b5 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:00:26.955775  7971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b9e47b501f42d99ae6fa8b888ae1b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.961741  7969 tablet_service.cc:1511] Processing CreateTablet for tablet a35f1257fc174173a9fc519308f1afa8 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:00:26.963091  7969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a35f1257fc174173a9fc519308f1afa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.965948  7967 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4f5c50563e43a6b4600dfb7f0fc575 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:00:26.967749  7967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4f5c50563e43a6b4600dfb7f0fc575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.967908  7970 tablet_service.cc:1511] Processing CreateTablet for tablet 111b72e6bd9d4b27b18c4325456efb7f (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:00:26.969194  7970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 111b72e6bd9d4b27b18c4325456efb7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.966163  7968 tablet_service.cc:1511] Processing CreateTablet for tablet 0abf7f11b5014b72b4e98b0d646fe426 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:00:26.974073  7968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0abf7f11b5014b72b4e98b0d646fe426. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.977034  7966 tablet_service.cc:1511] Processing CreateTablet for tablet 4703ad43d75e489f8aff35739026419e (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:00:26.979067  7966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4703ad43d75e489f8aff35739026419e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:27.039631  7970 tablet_service.cc:1511] Processing CreateTablet for tablet f1330727d2c94cca98bada1d0b01ad24 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:00:27.043862  8099 tablet_bootstrap.cc:492] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74: Bootstrap starting.
I20260709 13:00:27.052526  8048 tablet_service.cc:1511] Processing CreateTablet for tablet 5ca06f71d27247e1bde39bb8da315c69 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:00:27.053225  7970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1330727d2c94cca98bada1d0b01ad24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:27.053879  8048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ca06f71d27247e1bde39bb8da315c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:27.059731  8047 tablet_service.cc:1511] Processing CreateTablet for tablet 554ffaa6916b461590a35a2317295d11 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:00:27.061043  8047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 554ffaa6916b461590a35a2317295d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:27.065954  8099 tablet_bootstrap.cc:654] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.066926  8046 tablet_service.cc:1511] Processing CreateTablet for tablet afb6b567d4804e9e8a4b91e398f5f397 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:00:27.068259  8046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb6b567d4804e9e8a4b91e398f5f397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:27.072755  8101 tablet_bootstrap.cc:492] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c: Bootstrap starting.
I20260709 13:00:27.074221  8098 tablet_bootstrap.cc:492] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Bootstrap starting.
I20260709 13:00:27.080287  8098 tablet_bootstrap.cc:654] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.083277  8045 tablet_service.cc:1511] Processing CreateTablet for tablet b8b9e47b501f42d99ae6fa8b888ae1b5 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:00:27.084622  8045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b9e47b501f42d99ae6fa8b888ae1b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:27.084721  8044 tablet_service.cc:1511] Processing CreateTablet for tablet 111b72e6bd9d4b27b18c4325456efb7f (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:00:27.088825  8043 tablet_service.cc:1511] Processing CreateTablet for tablet 0abf7f11b5014b72b4e98b0d646fe426 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:00:27.091060  8042 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4f5c50563e43a6b4600dfb7f0fc575 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:00:27.093659  8044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 111b72e6bd9d4b27b18c4325456efb7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:27.094262  8040 tablet_service.cc:1511] Processing CreateTablet for tablet f1330727d2c94cca98bada1d0b01ad24 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:00:27.094440  8041 tablet_service.cc:1511] Processing CreateTablet for tablet 4703ad43d75e489f8aff35739026419e (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:00:27.095140  8043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0abf7f11b5014b72b4e98b0d646fe426. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:27.095891  8041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4703ad43d75e489f8aff35739026419e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:27.096791  8042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4f5c50563e43a6b4600dfb7f0fc575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:27.101378  8040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1330727d2c94cca98bada1d0b01ad24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:27.106397  8048 tablet_service.cc:1511] Processing CreateTablet for tablet a35f1257fc174173a9fc519308f1afa8 (DEFAULT_TABLE table=test-workload [id=0048b7e4e8654bf69abb4ca00c0bc799]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:00:27.107435  8101 tablet_bootstrap.cc:654] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.107688  8048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a35f1257fc174173a9fc519308f1afa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:27.129035  8099 tablet_bootstrap.cc:492] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74: No bootstrap required, opened a new log
I20260709 13:00:27.141567  8099 ts_tablet_manager.cc:1403] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74: Time spent bootstrapping tablet: real 0.098s	user 0.025s	sys 0.000s
I20260709 13:00:27.144429  8099 raft_consensus.cc:359] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.145288  8099 raft_consensus.cc:385] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.145607  8099 raft_consensus.cc:740] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.146829  8098 tablet_bootstrap.cc:492] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8: No bootstrap required, opened a new log
I20260709 13:00:27.146425  8099 consensus_queue.cc:260] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.147251  8101 tablet_bootstrap.cc:492] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c: No bootstrap required, opened a new log
I20260709 13:00:27.147720  8101 ts_tablet_manager.cc:1403] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.008s
I20260709 13:00:27.147284  8098 ts_tablet_manager.cc:1403] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.005s
I20260709 13:00:27.151578  8101 raft_consensus.cc:359] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.153017  8101 raft_consensus.cc:385] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.153368  8009 heartbeater.cc:499] Master 127.7.25.254:34173 was elected leader, sending a full tablet report...
I20260709 13:00:27.153378  8101 raft_consensus.cc:740] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.154305  8099 ts_tablet_manager.cc:1434] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 13:00:27.154338  8101 consensus_queue.cc:260] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.155616  8099 tablet_bootstrap.cc:492] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74: Bootstrap starting.
I20260709 13:00:27.156075  8098 raft_consensus.cc:359] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.156800  8098 raft_consensus.cc:385] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.157131  8098 raft_consensus.cc:740] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.157850  8098 consensus_queue.cc:260] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.164050  8101 ts_tablet_manager.cc:1434] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 13:00:27.164954  8083 heartbeater.cc:499] Master 127.7.25.254:34173 was elected leader, sending a full tablet report...
I20260709 13:00:27.170043  8099 tablet_bootstrap.cc:654] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.174501  8101 tablet_bootstrap.cc:492] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c: Bootstrap starting.
I20260709 13:00:27.179730  8104 raft_consensus.cc:493] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.180341  7934 heartbeater.cc:499] Master 127.7.25.254:34173 was elected leader, sending a full tablet report...
I20260709 13:00:27.180374  8104 raft_consensus.cc:515] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.186625  8107 raft_consensus.cc:493] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.187263  8107 raft_consensus.cc:515] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.203729  8098 ts_tablet_manager.cc:1434] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Time spent starting tablet: real 0.052s	user 0.029s	sys 0.020s
I20260709 13:00:27.204815  8098 tablet_bootstrap.cc:492] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Bootstrap starting.
I20260709 13:00:27.210822  8104 leader_election.cc:290] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:27.211081  7909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf7f11b5014b72b4e98b0d646fe426" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" is_pre_election: true
I20260709 13:00:27.212921  8107 leader_election.cc:290] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
W20260709 13:00:27.213025  7950 leader_election.cc:343] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:27.211410  8098 tablet_bootstrap.cc:654] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.218631  8101 tablet_bootstrap.cc:654] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.228371  8099 tablet_bootstrap.cc:492] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74: No bootstrap required, opened a new log
I20260709 13:00:27.229116  8099 ts_tablet_manager.cc:1403] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.038s
I20260709 13:00:27.229635  8098 tablet_bootstrap.cc:492] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8: No bootstrap required, opened a new log
I20260709 13:00:27.230170  8098 ts_tablet_manager.cc:1403] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.002s
I20260709 13:00:27.233213  8099 raft_consensus.cc:359] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.239392  7984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca06f71d27247e1bde39bb8da315c69" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3a92256a04846e8aa4032c63cda2b74" is_pre_election: true
I20260709 13:00:27.235458  8098 raft_consensus.cc:359] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.240113  8098 raft_consensus.cc:385] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.236604  8058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf7f11b5014b72b4e98b0d646fe426" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e23fd9887848f08151cb92c9719d1c" is_pre_election: true
I20260709 13:00:27.239801  8099 raft_consensus.cc:385] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.240531  8057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca06f71d27247e1bde39bb8da315c69" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e23fd9887848f08151cb92c9719d1c" is_pre_election: true
I20260709 13:00:27.240976  8099 raft_consensus.cc:740] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.241288  8057 raft_consensus.cc:2468] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 0.
W20260709 13:00:27.241690  7947 leader_election.cc:343] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:27.242166  7947 leader_election.cc:304] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3a92256a04846e8aa4032c63cda2b74; no voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c0e23fd9887848f08151cb92c9719d1c
I20260709 13:00:27.241909  8099 consensus_queue.cc:260] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.242578  7872 leader_election.cc:304] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c0e23fd9887848f08151cb92c9719d1c; no voters: 
W20260709 13:00:27.243635  7872 leader_election.cc:343] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:27.244357  8107 raft_consensus.cc:2804] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:27.244915  8107 raft_consensus.cc:493] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.245365  8107 raft_consensus.cc:3060] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.245862  8104 raft_consensus.cc:2749] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:27.251628  8099 ts_tablet_manager.cc:1434] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.005s
I20260709 13:00:27.252573  8099 tablet_bootstrap.cc:492] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c3a92256a04846e8aa4032c63cda2b74: Bootstrap starting.
I20260709 13:00:27.240556  8098 raft_consensus.cc:740] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.257292  8107 raft_consensus.cc:515] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.257623  8098 consensus_queue.cc:260] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.259800  8098 ts_tablet_manager.cc:1434] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.003s
I20260709 13:00:27.260670  7984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca06f71d27247e1bde39bb8da315c69" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
I20260709 13:00:27.260977  8099 tablet_bootstrap.cc:654] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c3a92256a04846e8aa4032c63cda2b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.261546  8101 tablet_bootstrap.cc:492] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c: No bootstrap required, opened a new log
I20260709 13:00:27.261703  8107 leader_election.cc:290] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 1 election: Requested vote from peers c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:27.262006  8101 ts_tablet_manager.cc:1403] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c: Time spent bootstrapping tablet: real 0.088s	user 0.017s	sys 0.009s
W20260709 13:00:27.262187  7872 leader_election.cc:343] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:27.263260  8057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca06f71d27247e1bde39bb8da315c69" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
I20260709 13:00:27.263827  8057 raft_consensus.cc:3060] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.260667  8098 tablet_bootstrap.cc:492] T 4703ad43d75e489f8aff35739026419e P 37ddb2d1ba0d4c97b81d9f9804b130c8: Bootstrap starting.
I20260709 13:00:27.264814  8101 raft_consensus.cc:359] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.265523  8101 raft_consensus.cc:385] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.265805  8101 raft_consensus.cc:740] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.266657  8101 consensus_queue.cc:260] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.268867  8101 ts_tablet_manager.cc:1434] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:27.269272  8115 raft_consensus.cc:493] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.269801  8115 raft_consensus.cc:515] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.271723  8101 tablet_bootstrap.cc:492] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c: Bootstrap starting.
I20260709 13:00:27.272607  8115 leader_election.cc:290] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:27.274191  7909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111b72e6bd9d4b27b18c4325456efb7f" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" is_pre_election: true
I20260709 13:00:27.274621  8098 tablet_bootstrap.cc:654] T 4703ad43d75e489f8aff35739026419e P 37ddb2d1ba0d4c97b81d9f9804b130c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.274209  8058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111b72e6bd9d4b27b18c4325456efb7f" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e23fd9887848f08151cb92c9719d1c" is_pre_election: true
W20260709 13:00:27.275579  7950 leader_election.cc:343] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:27.276192  7947 leader_election.cc:343] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:27.276626  7947 leader_election.cc:304] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3a92256a04846e8aa4032c63cda2b74; no voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c0e23fd9887848f08151cb92c9719d1c
I20260709 13:00:27.278955  8057 raft_consensus.cc:2468] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 1.
I20260709 13:00:27.280524  7872 leader_election.cc:304] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c0e23fd9887848f08151cb92c9719d1c; no voters: c3a92256a04846e8aa4032c63cda2b74
I20260709 13:00:27.281787  8107 raft_consensus.cc:2804] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:27.283090  8101 tablet_bootstrap.cc:654] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.282977  8107 raft_consensus.cc:697] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 LEADER]: Becoming Leader. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Running, Role: LEADER
I20260709 13:00:27.284574  8107 consensus_queue.cc:237] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.286943  8115 raft_consensus.cc:2749] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:27.290400  8098 tablet_bootstrap.cc:492] T 4703ad43d75e489f8aff35739026419e P 37ddb2d1ba0d4c97b81d9f9804b130c8: No bootstrap required, opened a new log
I20260709 13:00:27.290802  8098 ts_tablet_manager.cc:1403] T 4703ad43d75e489f8aff35739026419e P 37ddb2d1ba0d4c97b81d9f9804b130c8: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.010s
I20260709 13:00:27.291002  8099 tablet_bootstrap.cc:492] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c3a92256a04846e8aa4032c63cda2b74: No bootstrap required, opened a new log
I20260709 13:00:27.291574  8099 ts_tablet_manager.cc:1403] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c3a92256a04846e8aa4032c63cda2b74: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.004s
I20260709 13:00:27.292948  8098 raft_consensus.cc:359] T 4703ad43d75e489f8aff35739026419e P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.293740  8098 raft_consensus.cc:385] T 4703ad43d75e489f8aff35739026419e P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.295171  8101 tablet_bootstrap.cc:492] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c: No bootstrap required, opened a new log
I20260709 13:00:27.295111  8098 raft_consensus.cc:740] T 4703ad43d75e489f8aff35739026419e P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.295774  8101 ts_tablet_manager.cc:1403] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.007s
I20260709 13:00:27.295240  8099 raft_consensus.cc:359] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.296315  8099 raft_consensus.cc:385] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.296135  8098 consensus_queue.cc:260] T 4703ad43d75e489f8aff35739026419e P 37ddb2d1ba0d4c97b81d9f9804b130c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.296800  8099 raft_consensus.cc:740] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.298347  8098 ts_tablet_manager.cc:1434] T 4703ad43d75e489f8aff35739026419e P 37ddb2d1ba0d4c97b81d9f9804b130c8: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:00:27.298025  8099 consensus_queue.cc:260] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c3a92256a04846e8aa4032c63cda2b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.298580  8101 raft_consensus.cc:359] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.299320  8098 tablet_bootstrap.cc:492] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Bootstrap starting.
I20260709 13:00:27.301151  8099 ts_tablet_manager.cc:1434] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c3a92256a04846e8aa4032c63cda2b74: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:00:27.299319  8101 raft_consensus.cc:385] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.302088  8101 raft_consensus.cc:740] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.302268  8099 tablet_bootstrap.cc:492] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74: Bootstrap starting.
I20260709 13:00:27.303047  8101 consensus_queue.cc:260] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.305332  8101 ts_tablet_manager.cc:1434] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:00:27.306097  8098 tablet_bootstrap.cc:654] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.306311  8101 tablet_bootstrap.cc:492] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c: Bootstrap starting.
I20260709 13:00:27.316118  8099 tablet_bootstrap.cc:654] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.318936  7804 catalog_manager.cc:5697] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:27.321861  8099 tablet_bootstrap.cc:492] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74: No bootstrap required, opened a new log
I20260709 13:00:27.322312  8099 ts_tablet_manager.cc:1403] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 13:00:27.322393  8101 tablet_bootstrap.cc:654] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.325690  8099 raft_consensus.cc:359] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.326463  8099 raft_consensus.cc:385] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.327227  8099 raft_consensus.cc:740] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.328092  8099 consensus_queue.cc:260] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.328974  8098 tablet_bootstrap.cc:492] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8: No bootstrap required, opened a new log
I20260709 13:00:27.329465  8098 ts_tablet_manager.cc:1403] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.007s
I20260709 13:00:27.330340  8099 ts_tablet_manager.cc:1434] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:00:27.331241  8099 tablet_bootstrap.cc:492] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74: Bootstrap starting.
I20260709 13:00:27.332118  8098 raft_consensus.cc:359] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.332816  8098 raft_consensus.cc:385] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.333148  8098 raft_consensus.cc:740] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.334005  8098 consensus_queue.cc:260] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.336457  8098 ts_tablet_manager.cc:1434] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:27.337357  8098 tablet_bootstrap.cc:492] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Bootstrap starting.
I20260709 13:00:27.337786  8099 tablet_bootstrap.cc:654] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.340476  8101 tablet_bootstrap.cc:492] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c: No bootstrap required, opened a new log
I20260709 13:00:27.340991  8101 ts_tablet_manager.cc:1403] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.005s
I20260709 13:00:27.344399  8098 tablet_bootstrap.cc:654] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.346807  8101 raft_consensus.cc:359] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.347590  8101 raft_consensus.cc:385] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.347940  8101 raft_consensus.cc:740] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.348851  8101 consensus_queue.cc:260] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.353655  8101 ts_tablet_manager.cc:1434] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:00:27.354768  8101 tablet_bootstrap.cc:492] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c: Bootstrap starting.
I20260709 13:00:27.361184  8101 tablet_bootstrap.cc:654] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.365267  8099 tablet_bootstrap.cc:492] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74: No bootstrap required, opened a new log
I20260709 13:00:27.365803  8099 ts_tablet_manager.cc:1403] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.011s
I20260709 13:00:27.366758  8098 tablet_bootstrap.cc:492] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8: No bootstrap required, opened a new log
I20260709 13:00:27.367209  8098 ts_tablet_manager.cc:1403] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.009s
I20260709 13:00:27.368639  8099 raft_consensus.cc:359] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.369390  8099 raft_consensus.cc:385] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.369690  8099 raft_consensus.cc:740] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.369964  8098 raft_consensus.cc:359] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.370656  8098 raft_consensus.cc:385] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.370397  8099 consensus_queue.cc:260] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.370942  8098 raft_consensus.cc:740] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.371753  8098 consensus_queue.cc:260] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.372674  8099 ts_tablet_manager.cc:1434] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:27.373651  8099 tablet_bootstrap.cc:492] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74: Bootstrap starting.
I20260709 13:00:27.376251  8098 ts_tablet_manager.cc:1434] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:00:27.377350  8098 tablet_bootstrap.cc:492] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Bootstrap starting.
I20260709 13:00:27.379971  8099 tablet_bootstrap.cc:654] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.383889  8098 tablet_bootstrap.cc:654] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.388942  8115 raft_consensus.cc:493] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.389648  8115 raft_consensus.cc:515] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.392685  8099 tablet_bootstrap.cc:492] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74: No bootstrap required, opened a new log
I20260709 13:00:27.393463  8099 ts_tablet_manager.cc:1403] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.005s
I20260709 13:00:27.393815  7909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4703ad43d75e489f8aff35739026419e" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" is_pre_election: true
I20260709 13:00:27.394721  7909 raft_consensus.cc:2468] T 4703ad43d75e489f8aff35739026419e P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3a92256a04846e8aa4032c63cda2b74 in term 0.
I20260709 13:00:27.397696  8099 raft_consensus.cc:359] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.398056  8057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4703ad43d75e489f8aff35739026419e" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e23fd9887848f08151cb92c9719d1c" is_pre_election: true
I20260709 13:00:27.399431  7950 leader_election.cc:304] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:27.400628  8104 raft_consensus.cc:2804] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:00:27.401067  7947 leader_election.cc:343] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:27.401386  8098 tablet_bootstrap.cc:492] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8: No bootstrap required, opened a new log
I20260709 13:00:27.401193  8104 raft_consensus.cc:493] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.401707  8115 leader_election.cc:290] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:27.401755  8104 raft_consensus.cc:3060] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.402045  8098 ts_tablet_manager.cc:1403] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.008s
I20260709 13:00:27.406096  8098 raft_consensus.cc:359] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.406872  8098 raft_consensus.cc:385] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.407212  8098 raft_consensus.cc:740] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.408069  8098 consensus_queue.cc:260] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.410207  8104 raft_consensus.cc:515] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.410585  8098 ts_tablet_manager.cc:1434] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:27.411851  8098 tablet_bootstrap.cc:492] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8: Bootstrap starting.
I20260709 13:00:27.401742  8099 raft_consensus.cc:385] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.412904  8099 raft_consensus.cc:740] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.413600  7909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4703ad43d75e489f8aff35739026419e" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
I20260709 13:00:27.413836  8099 consensus_queue.cc:260] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.414410  7909 raft_consensus.cc:3060] T 4703ad43d75e489f8aff35739026419e P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.416225  8099 ts_tablet_manager.cc:1434] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.003s
I20260709 13:00:27.417280  8099 tablet_bootstrap.cc:492] T 554ffaa6916b461590a35a2317295d11 P c3a92256a04846e8aa4032c63cda2b74: Bootstrap starting.
I20260709 13:00:27.418792  8098 tablet_bootstrap.cc:654] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.422894  8057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4703ad43d75e489f8aff35739026419e" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
W20260709 13:00:27.424808  7947 leader_election.cc:343] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:27.425509  8104 leader_election.cc:290] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 1 election: Requested vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:27.430534  8099 tablet_bootstrap.cc:654] T 554ffaa6916b461590a35a2317295d11 P c3a92256a04846e8aa4032c63cda2b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.432540  8107 raft_consensus.cc:493] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.433290  8107 raft_consensus.cc:515] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.433753  7909 raft_consensus.cc:2468] T 4703ad43d75e489f8aff35739026419e P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3a92256a04846e8aa4032c63cda2b74 in term 1.
I20260709 13:00:27.435314  7950 leader_election.cc:304] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c3a92256a04846e8aa4032c63cda2b74; no voters: c0e23fd9887848f08151cb92c9719d1c
I20260709 13:00:27.437175  7984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b9e47b501f42d99ae6fa8b888ae1b5" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3a92256a04846e8aa4032c63cda2b74" is_pre_election: true
I20260709 13:00:27.438048  7984 raft_consensus.cc:2468] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 0.
I20260709 13:00:27.438448  8098 tablet_bootstrap.cc:492] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8: No bootstrap required, opened a new log
I20260709 13:00:27.439224  8098 ts_tablet_manager.cc:1403] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.008s
I20260709 13:00:27.439782  7872 leader_election.cc:304] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:27.441048  8106 raft_consensus.cc:2804] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:27.441568  8106 raft_consensus.cc:493] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.442004  8106 raft_consensus.cc:3060] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.443007  8098 raft_consensus.cc:359] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.443472  8099 tablet_bootstrap.cc:492] T 554ffaa6916b461590a35a2317295d11 P c3a92256a04846e8aa4032c63cda2b74: No bootstrap required, opened a new log
I20260709 13:00:27.443873  8098 raft_consensus.cc:385] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.444079  8099 ts_tablet_manager.cc:1403] T 554ffaa6916b461590a35a2317295d11 P c3a92256a04846e8aa4032c63cda2b74: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.005s
I20260709 13:00:27.444242  8098 raft_consensus.cc:740] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.445326  8098 consensus_queue.cc:260] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.450649  8057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b9e47b501f42d99ae6fa8b888ae1b5" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e23fd9887848f08151cb92c9719d1c" is_pre_election: true
W20260709 13:00:27.452448  7872 leader_election.cc:343] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:27.453302  8115 raft_consensus.cc:2804] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:27.454169  8115 raft_consensus.cc:697] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [term 1 LEADER]: Becoming Leader. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Running, Role: LEADER
I20260709 13:00:27.455022  8115 consensus_queue.cc:237] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.448707  8107 leader_election.cc:290] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:27.458702  8099 raft_consensus.cc:359] T 554ffaa6916b461590a35a2317295d11 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.459417  8099 raft_consensus.cc:385] T 554ffaa6916b461590a35a2317295d11 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.459906  8098 ts_tablet_manager.cc:1434] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.006s
I20260709 13:00:27.459744  8099 raft_consensus.cc:740] T 554ffaa6916b461590a35a2317295d11 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.461043  8098 tablet_bootstrap.cc:492] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Bootstrap starting.
I20260709 13:00:27.460843  8099 consensus_queue.cc:260] T 554ffaa6916b461590a35a2317295d11 P c3a92256a04846e8aa4032c63cda2b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.463310  8099 ts_tablet_manager.cc:1434] T 554ffaa6916b461590a35a2317295d11 P c3a92256a04846e8aa4032c63cda2b74: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:00:27.464241  8099 tablet_bootstrap.cc:492] T afb6b567d4804e9e8a4b91e398f5f397 P c3a92256a04846e8aa4032c63cda2b74: Bootstrap starting.
I20260709 13:00:27.467787  8098 tablet_bootstrap.cc:654] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.468174  8106 raft_consensus.cc:515] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.471329  7984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b9e47b501f42d99ae6fa8b888ae1b5" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
I20260709 13:00:27.471942  7984 raft_consensus.cc:3060] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:27.474246  7855 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:27.475445  8099 tablet_bootstrap.cc:654] T afb6b567d4804e9e8a4b91e398f5f397 P c3a92256a04846e8aa4032c63cda2b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.479764  8098 tablet_bootstrap.cc:492] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8: No bootstrap required, opened a new log
I20260709 13:00:27.480417  8098 ts_tablet_manager.cc:1403] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:00:27.483707  8098 raft_consensus.cc:359] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.484719  8098 raft_consensus.cc:385] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.484939  7984 raft_consensus.cc:2468] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 1.
I20260709 13:00:27.485107  8098 raft_consensus.cc:740] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.486121  7872 leader_election.cc:304] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:27.486917  8107 raft_consensus.cc:2804] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:27.487272  8099 tablet_bootstrap.cc:492] T afb6b567d4804e9e8a4b91e398f5f397 P c3a92256a04846e8aa4032c63cda2b74: No bootstrap required, opened a new log
I20260709 13:00:27.487053  8098 consensus_queue.cc:260] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.487689  8099 ts_tablet_manager.cc:1403] T afb6b567d4804e9e8a4b91e398f5f397 P c3a92256a04846e8aa4032c63cda2b74: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 13:00:27.487602  8107 raft_consensus.cc:697] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 LEADER]: Becoming Leader. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Running, Role: LEADER
I20260709 13:00:27.489326  8098 ts_tablet_manager.cc:1434] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:00:27.490216  8098 tablet_bootstrap.cc:492] T f1330727d2c94cca98bada1d0b01ad24 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Bootstrap starting.
I20260709 13:00:27.488873  8107 consensus_queue.cc:237] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.490221  8099 raft_consensus.cc:359] T afb6b567d4804e9e8a4b91e398f5f397 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.491009  8099 raft_consensus.cc:385] T afb6b567d4804e9e8a4b91e398f5f397 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.491282  8099 raft_consensus.cc:740] T afb6b567d4804e9e8a4b91e398f5f397 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.491405  8130 raft_consensus.cc:493] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.492071  8099 consensus_queue.cc:260] T afb6b567d4804e9e8a4b91e398f5f397 P c3a92256a04846e8aa4032c63cda2b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.491999  8130 raft_consensus.cc:515] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.495292  8130 leader_election.cc:290] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:27.496080  8057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf7f11b5014b72b4e98b0d646fe426" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e23fd9887848f08151cb92c9719d1c" is_pre_election: true
I20260709 13:00:27.496739  8098 tablet_bootstrap.cc:654] T f1330727d2c94cca98bada1d0b01ad24 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.496873  8057 raft_consensus.cc:2468] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 0.
I20260709 13:00:27.497280  8099 ts_tablet_manager.cc:1434] T afb6b567d4804e9e8a4b91e398f5f397 P c3a92256a04846e8aa4032c63cda2b74: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:00:27.498272  8099 tablet_bootstrap.cc:492] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74: Bootstrap starting.
I20260709 13:00:27.498543  7872 leader_election.cc:304] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c0e23fd9887848f08151cb92c9719d1c; no voters: 
I20260709 13:00:27.499611  8130 raft_consensus.cc:2804] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:27.500068  8130 raft_consensus.cc:493] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.500504  8130 raft_consensus.cc:3060] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.504959  8099 tablet_bootstrap.cc:654] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.513638  8130 raft_consensus.cc:515] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.516028  7984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf7f11b5014b72b4e98b0d646fe426" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3a92256a04846e8aa4032c63cda2b74" is_pre_election: true
I20260709 13:00:27.518569  7984 raft_consensus.cc:2468] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 0.
I20260709 13:00:27.526721  7983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf7f11b5014b72b4e98b0d646fe426" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
I20260709 13:00:27.527629  7983 raft_consensus.cc:3060] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.533007  8106 leader_election.cc:290] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 1 election: Requested vote from peers c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:27.534101  8098 tablet_bootstrap.cc:492] T f1330727d2c94cca98bada1d0b01ad24 P 37ddb2d1ba0d4c97b81d9f9804b130c8: No bootstrap required, opened a new log
I20260709 13:00:27.534353  8057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b9e47b501f42d99ae6fa8b888ae1b5" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
I20260709 13:00:27.534641  8098 ts_tablet_manager.cc:1403] T f1330727d2c94cca98bada1d0b01ad24 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.000s
I20260709 13:00:27.534849  8130 leader_election.cc:290] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 1 election: Requested vote from peers c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
W20260709 13:00:27.536173  7872 leader_election.cc:343] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:27.536162  7805 catalog_manager.cc:5697] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:27.537628  8057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf7f11b5014b72b4e98b0d646fe426" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
I20260709 13:00:27.538280  8057 raft_consensus.cc:3060] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.537648  8098 raft_consensus.cc:359] T f1330727d2c94cca98bada1d0b01ad24 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.538782  8098 raft_consensus.cc:385] T f1330727d2c94cca98bada1d0b01ad24 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.539182  8099 tablet_bootstrap.cc:492] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74: No bootstrap required, opened a new log
I20260709 13:00:27.539117  8098 raft_consensus.cc:740] T f1330727d2c94cca98bada1d0b01ad24 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.539676  8099 ts_tablet_manager.cc:1403] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.008s
I20260709 13:00:27.540119  8098 consensus_queue.cc:260] T f1330727d2c94cca98bada1d0b01ad24 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.542309  8098 ts_tablet_manager.cc:1434] T f1330727d2c94cca98bada1d0b01ad24 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:27.542140  8099 raft_consensus.cc:359] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.542788  8099 raft_consensus.cc:385] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.543058  8099 raft_consensus.cc:740] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.543383  8098 tablet_bootstrap.cc:492] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Bootstrap starting.
I20260709 13:00:27.543680  8099 consensus_queue.cc:260] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.545547  8099 ts_tablet_manager.cc:1434] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:00:27.546355  8099 tablet_bootstrap.cc:492] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74: Bootstrap starting.
I20260709 13:00:27.548707  8101 tablet_bootstrap.cc:492] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c: No bootstrap required, opened a new log
I20260709 13:00:27.549197  8101 ts_tablet_manager.cc:1403] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c: Time spent bootstrapping tablet: real 0.195s	user 0.074s	sys 0.079s
I20260709 13:00:27.549858  8098 tablet_bootstrap.cc:654] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.552103  8099 tablet_bootstrap.cc:654] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.552060  8101 raft_consensus.cc:359] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.552938  8101 raft_consensus.cc:385] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.553259  8101 raft_consensus.cc:740] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.554006  8101 consensus_queue.cc:260] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.548136  7807 catalog_manager.cc:5697] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "c3a92256a04846e8aa4032c63cda2b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:27.564143  8057 raft_consensus.cc:2468] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 1.
I20260709 13:00:27.565382  7872 leader_election.cc:304] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c0e23fd9887848f08151cb92c9719d1c; no voters: 
I20260709 13:00:27.566485  8101 ts_tablet_manager.cc:1434] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.004s
I20260709 13:00:27.566548  8130 raft_consensus.cc:2804] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:27.567250  8130 raft_consensus.cc:697] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 LEADER]: Becoming Leader. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Running, Role: LEADER
I20260709 13:00:27.567555  8101 tablet_bootstrap.cc:492] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c: Bootstrap starting.
I20260709 13:00:27.568365  8130 consensus_queue.cc:237] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.569540  7983 raft_consensus.cc:2468] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 1.
I20260709 13:00:27.575412  8101 tablet_bootstrap.cc:654] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.581714  8099 tablet_bootstrap.cc:492] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74: No bootstrap required, opened a new log
I20260709 13:00:27.582130  8099 ts_tablet_manager.cc:1403] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74: Time spent bootstrapping tablet: real 0.036s	user 0.022s	sys 0.012s
I20260709 13:00:27.584041  8098 tablet_bootstrap.cc:492] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8: No bootstrap required, opened a new log
I20260709 13:00:27.584527  8098 ts_tablet_manager.cc:1403] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.011s
I20260709 13:00:27.584728  8099 raft_consensus.cc:359] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.585438  8099 raft_consensus.cc:385] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.585701  8099 raft_consensus.cc:740] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.592368  8099 consensus_queue.cc:260] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.593715  8098 raft_consensus.cc:359] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.593562  7805 catalog_manager.cc:5697] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:27.594444  8098 raft_consensus.cc:385] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.594671  8099 ts_tablet_manager.cc:1434] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 13:00:27.594904  8098 raft_consensus.cc:740] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.595715  8098 consensus_queue.cc:260] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.598260  8098 ts_tablet_manager.cc:1434] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.004s
I20260709 13:00:27.603410  8105 raft_consensus.cc:493] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.603826  8105 raft_consensus.cc:515] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.605959  8105 leader_election.cc:290] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925)
I20260709 13:00:27.610549  8101 tablet_bootstrap.cc:492] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c: No bootstrap required, opened a new log
I20260709 13:00:27.611091  8101 ts_tablet_manager.cc:1403] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c: Time spent bootstrapping tablet: real 0.044s	user 0.029s	sys 0.006s
I20260709 13:00:27.614257  8101 raft_consensus.cc:359] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.615100  8101 raft_consensus.cc:385] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.615479  8101 raft_consensus.cc:740] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.616513  8101 consensus_queue.cc:260] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.618748  8101 ts_tablet_manager.cc:1434] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:00:27.619738  8101 tablet_bootstrap.cc:492] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c: Bootstrap starting.
I20260709 13:00:27.621253  7909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554ffaa6916b461590a35a2317295d11" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" is_pre_election: true
I20260709 13:00:27.621881  7909 raft_consensus.cc:2468] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 0.
I20260709 13:00:27.623212  8024 leader_election.cc:304] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c0e23fd9887848f08151cb92c9719d1c; no voters: 
I20260709 13:00:27.624116  8105 raft_consensus.cc:2804] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:27.624508  8105 raft_consensus.cc:493] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.624855  8105 raft_consensus.cc:3060] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.626647  8101 tablet_bootstrap.cc:654] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.634239  8101 tablet_bootstrap.cc:492] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c: No bootstrap required, opened a new log
I20260709 13:00:27.634155  7983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554ffaa6916b461590a35a2317295d11" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3a92256a04846e8aa4032c63cda2b74" is_pre_election: true
I20260709 13:00:27.634809  7983 raft_consensus.cc:2468] T 554ffaa6916b461590a35a2317295d11 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 0.
I20260709 13:00:27.633404  8105 raft_consensus.cc:515] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.634812  8101 ts_tablet_manager.cc:1403] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.008s
I20260709 13:00:27.636852  8105 leader_election.cc:290] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 1 election: Requested vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925)
I20260709 13:00:27.637555  7909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554ffaa6916b461590a35a2317295d11" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
I20260709 13:00:27.637755  7983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554ffaa6916b461590a35a2317295d11" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
I20260709 13:00:27.638118  7909 raft_consensus.cc:3060] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.638315  7983 raft_consensus.cc:3060] T 554ffaa6916b461590a35a2317295d11 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.638212  8101 raft_consensus.cc:359] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.639010  8101 raft_consensus.cc:385] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.639320  8101 raft_consensus.cc:740] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.640038  8101 consensus_queue.cc:260] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.642191  8101 ts_tablet_manager.cc:1434] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:00:27.643080  8101 tablet_bootstrap.cc:492] T 4703ad43d75e489f8aff35739026419e P c0e23fd9887848f08151cb92c9719d1c: Bootstrap starting.
I20260709 13:00:27.644171  7983 raft_consensus.cc:2468] T 554ffaa6916b461590a35a2317295d11 P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 1.
I20260709 13:00:27.644690  7909 raft_consensus.cc:2468] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 1.
I20260709 13:00:27.645411  8021 leader_election.cc:304] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0e23fd9887848f08151cb92c9719d1c, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:27.646656  8105 raft_consensus.cc:2804] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:27.647746  8105 raft_consensus.cc:697] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [term 1 LEADER]: Becoming Leader. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Running, Role: LEADER
I20260709 13:00:27.648566  8105 consensus_queue.cc:237] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.649394  8101 tablet_bootstrap.cc:654] T 4703ad43d75e489f8aff35739026419e P c0e23fd9887848f08151cb92c9719d1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.654681  8101 tablet_bootstrap.cc:492] T 4703ad43d75e489f8aff35739026419e P c0e23fd9887848f08151cb92c9719d1c: No bootstrap required, opened a new log
I20260709 13:00:27.655047  8101 ts_tablet_manager.cc:1403] T 4703ad43d75e489f8aff35739026419e P c0e23fd9887848f08151cb92c9719d1c: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.005s
I20260709 13:00:27.656750  8101 raft_consensus.cc:359] T 4703ad43d75e489f8aff35739026419e P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.657325  8101 raft_consensus.cc:385] T 4703ad43d75e489f8aff35739026419e P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.657559  8101 raft_consensus.cc:740] T 4703ad43d75e489f8aff35739026419e P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.657052  7805 catalog_manager.cc:5697] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c reported cstate change: term changed from 0 to 1, leader changed from <none> to c0e23fd9887848f08151cb92c9719d1c (127.7.25.195). New cstate: current_term: 1 leader_uuid: "c0e23fd9887848f08151cb92c9719d1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:27.658162  8101 consensus_queue.cc:260] T 4703ad43d75e489f8aff35739026419e P c0e23fd9887848f08151cb92c9719d1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.659614  8101 ts_tablet_manager.cc:1434] T 4703ad43d75e489f8aff35739026419e P c0e23fd9887848f08151cb92c9719d1c: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:00:27.660284  8101 tablet_bootstrap.cc:492] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c: Bootstrap starting.
I20260709 13:00:27.664778  8101 tablet_bootstrap.cc:654] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.669634  8101 tablet_bootstrap.cc:492] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c: No bootstrap required, opened a new log
I20260709 13:00:27.670048  8101 ts_tablet_manager.cc:1403] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:00:27.672279  8101 raft_consensus.cc:359] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.672787  8101 raft_consensus.cc:385] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.672967  8101 raft_consensus.cc:740] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.673566  8101 consensus_queue.cc:260] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.674973  8101 ts_tablet_manager.cc:1434] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:00:27.675756  8101 tablet_bootstrap.cc:492] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c: Bootstrap starting.
I20260709 13:00:27.675815  8105 raft_consensus.cc:493] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.676285  8105 raft_consensus.cc:515] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.679386  7909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35f1257fc174173a9fc519308f1afa8" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" is_pre_election: true
I20260709 13:00:27.679392  7983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35f1257fc174173a9fc519308f1afa8" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3a92256a04846e8aa4032c63cda2b74" is_pre_election: true
I20260709 13:00:27.680083  7909 raft_consensus.cc:2468] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 0.
I20260709 13:00:27.680140  7983 raft_consensus.cc:2468] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 0.
I20260709 13:00:27.681326  8101 tablet_bootstrap.cc:654] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:27.681367  8021 leader_election.cc:304] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0e23fd9887848f08151cb92c9719d1c, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:27.682344  8144 raft_consensus.cc:2804] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:27.682688  8144 raft_consensus.cc:493] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.682736  8105 leader_election.cc:290] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925)
I20260709 13:00:27.683106  8144 raft_consensus.cc:3060] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.687137  8101 tablet_bootstrap.cc:492] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c: No bootstrap required, opened a new log
I20260709 13:00:27.687582  8101 ts_tablet_manager.cc:1403] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.005s
I20260709 13:00:27.689119  8105 raft_consensus.cc:493] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.689517  8105 raft_consensus.cc:515] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.690066  8101 raft_consensus.cc:359] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.690729  8101 raft_consensus.cc:385] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:27.690618  8144 raft_consensus.cc:515] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.691176  8105 leader_election.cc:290] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925)
I20260709 13:00:27.691006  8101 raft_consensus.cc:740] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Initialized, Role: FOLLOWER
I20260709 13:00:27.691861  7909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb6b567d4804e9e8a4b91e398f5f397" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" is_pre_election: true
I20260709 13:00:27.692165  8101 consensus_queue.cc:260] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.692488  7909 raft_consensus.cc:2468] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 0.
I20260709 13:00:27.693570  7908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35f1257fc174173a9fc519308f1afa8" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
I20260709 13:00:27.693881  7984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35f1257fc174173a9fc519308f1afa8" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
I20260709 13:00:27.694211  7908 raft_consensus.cc:3060] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.694437  7984 raft_consensus.cc:3060] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.693063  8144 leader_election.cc:290] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 1 election: Requested vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925)
I20260709 13:00:27.695087  8024 leader_election.cc:304] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c0e23fd9887848f08151cb92c9719d1c; no voters: 
I20260709 13:00:27.694303  7983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb6b567d4804e9e8a4b91e398f5f397" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3a92256a04846e8aa4032c63cda2b74" is_pre_election: true
I20260709 13:00:27.696262  7983 raft_consensus.cc:2468] T afb6b567d4804e9e8a4b91e398f5f397 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 0.
I20260709 13:00:27.697362  8144 raft_consensus.cc:2804] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:27.697780  8144 raft_consensus.cc:493] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.698379  8144 raft_consensus.cc:3060] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.701709  7908 raft_consensus.cc:2468] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 1.
I20260709 13:00:27.694211  8101 ts_tablet_manager.cc:1434] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.005s
I20260709 13:00:27.704594  8144 raft_consensus.cc:515] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.704947  8024 leader_election.cc:304] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c0e23fd9887848f08151cb92c9719d1c; no voters: 
I20260709 13:00:27.705765  8105 raft_consensus.cc:2804] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:27.706719  8144 leader_election.cc:290] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 1 election: Requested vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925)
I20260709 13:00:27.707839  7908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb6b567d4804e9e8a4b91e398f5f397" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
I20260709 13:00:27.708107  7983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb6b567d4804e9e8a4b91e398f5f397" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
I20260709 13:00:27.708506  7908 raft_consensus.cc:3060] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.708673  7983 raft_consensus.cc:3060] T afb6b567d4804e9e8a4b91e398f5f397 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.704912  7984 raft_consensus.cc:2468] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 1.
I20260709 13:00:27.714986  8105 raft_consensus.cc:697] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 1 LEADER]: Becoming Leader. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Running, Role: LEADER
I20260709 13:00:27.715597  7984 raft_consensus.cc:3060] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.716053  7983 raft_consensus.cc:2468] T afb6b567d4804e9e8a4b91e398f5f397 P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 1.
I20260709 13:00:27.716074  8105 consensus_queue.cc:237] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.717471  8021 leader_election.cc:304] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0e23fd9887848f08151cb92c9719d1c, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:27.717584  7908 raft_consensus.cc:2468] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 1.
I20260709 13:00:27.719383  8149 raft_consensus.cc:2804] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:27.720070  8149 raft_consensus.cc:697] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [term 1 LEADER]: Becoming Leader. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Running, Role: LEADER
I20260709 13:00:27.721601  8144 raft_consensus.cc:493] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.722084  8144 raft_consensus.cc:515] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.724108  8144 leader_election.cc:290] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925)
I20260709 13:00:27.724113  8130 consensus_queue.cc:1048] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:27.725561  7908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f5c50563e43a6b4600dfb7f0fc575" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" is_pre_election: true
I20260709 13:00:27.726178  7908 raft_consensus.cc:2468] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 0.
I20260709 13:00:27.726672  7983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f5c50563e43a6b4600dfb7f0fc575" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3a92256a04846e8aa4032c63cda2b74" is_pre_election: true
I20260709 13:00:27.727274  7983 raft_consensus.cc:2468] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 0.
I20260709 13:00:27.727362  8024 leader_election.cc:304] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c0e23fd9887848f08151cb92c9719d1c; no voters: 
I20260709 13:00:27.726868  7805 catalog_manager.cc:5697] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c reported cstate change: term changed from 0 to 1, leader changed from <none> to c0e23fd9887848f08151cb92c9719d1c (127.7.25.195). New cstate: current_term: 1 leader_uuid: "c0e23fd9887848f08151cb92c9719d1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:27.728355  8105 raft_consensus.cc:2804] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:27.720999  8149 consensus_queue.cc:237] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.730862  8105 raft_consensus.cc:493] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.731156  8105 raft_consensus.cc:3060] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.740625  8105 raft_consensus.cc:515] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.743711  8105 leader_election.cc:290] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 1 election: Requested vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925)
I20260709 13:00:27.744503  7983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f5c50563e43a6b4600dfb7f0fc575" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
I20260709 13:00:27.745280  7983 raft_consensus.cc:3060] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.745190  7908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f5c50563e43a6b4600dfb7f0fc575" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
I20260709 13:00:27.746100  7908 raft_consensus.cc:3060] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.753666  8106 consensus_queue.cc:1048] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:27.755766  7908 raft_consensus.cc:2468] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 1.
I20260709 13:00:27.758831  8024 leader_election.cc:304] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c0e23fd9887848f08151cb92c9719d1c; no voters: 
I20260709 13:00:27.759698  8105 raft_consensus.cc:2804] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:27.760157  8105 raft_consensus.cc:697] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 1 LEADER]: Becoming Leader. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Running, Role: LEADER
I20260709 13:00:27.760970  8105 consensus_queue.cc:237] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.762895  7805 catalog_manager.cc:5697] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c reported cstate change: term changed from 0 to 1, leader changed from <none> to c0e23fd9887848f08151cb92c9719d1c (127.7.25.195). New cstate: current_term: 1 leader_uuid: "c0e23fd9887848f08151cb92c9719d1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:27.763670  8115 raft_consensus.cc:493] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.763367  7983 raft_consensus.cc:2468] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 1.
I20260709 13:00:27.764225  8115 raft_consensus.cc:515] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.766307  8115 leader_election.cc:290] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:27.767102  7908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1330727d2c94cca98bada1d0b01ad24" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" is_pre_election: true
I20260709 13:00:27.767896  7908 raft_consensus.cc:2468] T f1330727d2c94cca98bada1d0b01ad24 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3a92256a04846e8aa4032c63cda2b74 in term 0.
I20260709 13:00:27.769320  7950 leader_election.cc:304] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:27.771395  8058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1330727d2c94cca98bada1d0b01ad24" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e23fd9887848f08151cb92c9719d1c" is_pre_election: true
I20260709 13:00:27.772256  8058 raft_consensus.cc:2468] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3a92256a04846e8aa4032c63cda2b74 in term 0.
I20260709 13:00:27.771226  8115 raft_consensus.cc:2804] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:27.773976  8115 raft_consensus.cc:493] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.774400  8115 raft_consensus.cc:3060] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.775341  8144 raft_consensus.cc:493] T 4703ad43d75e489f8aff35739026419e P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.775978  8144 raft_consensus.cc:515] T 4703ad43d75e489f8aff35739026419e P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.778730  8144 leader_election.cc:290] T 4703ad43d75e489f8aff35739026419e P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925)
I20260709 13:00:27.781247  7908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4703ad43d75e489f8aff35739026419e" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" is_pre_election: true
I20260709 13:00:27.783041  7908 raft_consensus.cc:2393] T 4703ad43d75e489f8aff35739026419e P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0e23fd9887848f08151cb92c9719d1c in current term 1: Already voted for candidate c3a92256a04846e8aa4032c63cda2b74 in this term.
I20260709 13:00:27.783128  8115 raft_consensus.cc:515] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.783584  7983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4703ad43d75e489f8aff35739026419e" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3a92256a04846e8aa4032c63cda2b74" is_pre_election: true
I20260709 13:00:27.785030  8021 leader_election.cc:304] T 4703ad43d75e489f8aff35739026419e P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e23fd9887848f08151cb92c9719d1c; no voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c3a92256a04846e8aa4032c63cda2b74
I20260709 13:00:27.786170  7908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1330727d2c94cca98bada1d0b01ad24" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
I20260709 13:00:27.786433  8115 leader_election.cc:290] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 1 election: Requested vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:27.786780  7908 raft_consensus.cc:3060] T f1330727d2c94cca98bada1d0b01ad24 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.787465  8058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1330727d2c94cca98bada1d0b01ad24" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
I20260709 13:00:27.787937  8058 raft_consensus.cc:3060] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.786198  8144 raft_consensus.cc:3060] T 4703ad43d75e489f8aff35739026419e P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.794167  8058 raft_consensus.cc:2468] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3a92256a04846e8aa4032c63cda2b74 in term 1.
I20260709 13:00:27.795728  7947 leader_election.cc:304] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0e23fd9887848f08151cb92c9719d1c, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:27.796748  8115 raft_consensus.cc:2804] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:27.798007  8115 raft_consensus.cc:697] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [term 1 LEADER]: Becoming Leader. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Running, Role: LEADER
I20260709 13:00:27.798835  8115 consensus_queue.cc:237] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.801739  7908 raft_consensus.cc:2468] T f1330727d2c94cca98bada1d0b01ad24 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3a92256a04846e8aa4032c63cda2b74 in term 1.
I20260709 13:00:27.805380  8105 raft_consensus.cc:493] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.805876  8105 raft_consensus.cc:515] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.806968  8144 raft_consensus.cc:2749] T 4703ad43d75e489f8aff35739026419e P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:27.809118  7983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b9e47b501f42d99ae6fa8b888ae1b5" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3a92256a04846e8aa4032c63cda2b74" is_pre_election: true
I20260709 13:00:27.809514  7908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b9e47b501f42d99ae6fa8b888ae1b5" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" is_pre_election: true
I20260709 13:00:27.809926  7983 raft_consensus.cc:2393] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0e23fd9887848f08151cb92c9719d1c in current term 1: Already voted for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in this term.
I20260709 13:00:27.811199  8105 leader_election.cc:290] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925)
I20260709 13:00:27.811476  8024 leader_election.cc:304] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e23fd9887848f08151cb92c9719d1c; no voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c3a92256a04846e8aa4032c63cda2b74
I20260709 13:00:27.812286  8105 raft_consensus.cc:3060] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.814595  7805 catalog_manager.cc:5697] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c reported cstate change: term changed from 0 to 1, leader changed from <none> to c0e23fd9887848f08151cb92c9719d1c (127.7.25.195). New cstate: current_term: 1 leader_uuid: "c0e23fd9887848f08151cb92c9719d1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:27.814523  7807 catalog_manager.cc:5697] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "c3a92256a04846e8aa4032c63cda2b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:27.818792  8105 raft_consensus.cc:2749] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:27.847615  8115 consensus_queue.cc:1048] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:27.857313  8160 consensus_queue.cc:1048] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:27.907404  8107 consensus_queue.cc:1048] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:27.918741  8163 consensus_queue.cc:1048] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:27.921985  8163 raft_consensus.cc:493] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.922506  8163 raft_consensus.cc:515] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.925058  8163 leader_election.cc:290] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:27.926532  8058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111b72e6bd9d4b27b18c4325456efb7f" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e23fd9887848f08151cb92c9719d1c" is_pre_election: true
I20260709 13:00:27.927150  8058 raft_consensus.cc:2468] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 0.
I20260709 13:00:27.926075  7983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111b72e6bd9d4b27b18c4325456efb7f" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3a92256a04846e8aa4032c63cda2b74" is_pre_election: true
I20260709 13:00:27.928278  7983 raft_consensus.cc:2468] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 0.
I20260709 13:00:27.928319  7872 leader_election.cc:304] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c0e23fd9887848f08151cb92c9719d1c; no voters: 
I20260709 13:00:27.929973  8163 raft_consensus.cc:2804] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:27.930276  8163 raft_consensus.cc:493] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.930552  8163 raft_consensus.cc:3060] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.935658  8163 raft_consensus.cc:515] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.937356  8163 leader_election.cc:290] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 1 election: Requested vote from peers c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:27.938079  7983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111b72e6bd9d4b27b18c4325456efb7f" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
I20260709 13:00:27.938287  8057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111b72e6bd9d4b27b18c4325456efb7f" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
I20260709 13:00:27.938678  7983 raft_consensus.cc:3060] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.938763  8057 raft_consensus.cc:3060] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:27.945310  8057 raft_consensus.cc:2468] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 1.
I20260709 13:00:27.945310  7983 raft_consensus.cc:2468] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 1.
I20260709 13:00:27.946529  7872 leader_election.cc:304] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:27.947276  8163 raft_consensus.cc:2804] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:27.947698  8163 raft_consensus.cc:697] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 LEADER]: Becoming Leader. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Running, Role: LEADER
I20260709 13:00:27.948400  8163 consensus_queue.cc:237] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:27.955145  7807 catalog_manager.cc:5697] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:28.041339  8057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "554ffaa6916b461590a35a2317295d11"
dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
mode: GRACEFUL
new_leader_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
 from {username='slave'} at 127.0.0.1:33386
I20260709 13:00:28.041808  8057 raft_consensus.cc:606] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [term 1 LEADER]: Received request to transfer leadership to TS 37ddb2d1ba0d4c97b81d9f9804b130c8
I20260709 13:00:28.046574  8057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afb6b567d4804e9e8a4b91e398f5f397"
dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
mode: GRACEFUL
new_leader_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
 from {username='slave'} at 127.0.0.1:33386
I20260709 13:00:28.047057  8057 raft_consensus.cc:606] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [term 1 LEADER]: Received request to transfer leadership to TS 37ddb2d1ba0d4c97b81d9f9804b130c8
I20260709 13:00:28.056517  8057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a35f1257fc174173a9fc519308f1afa8"
dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
mode: GRACEFUL
new_leader_uuid: "c3a92256a04846e8aa4032c63cda2b74"
 from {username='slave'} at 127.0.0.1:33386
I20260709 13:00:28.057024  8057 raft_consensus.cc:606] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 1 LEADER]: Received request to transfer leadership to TS c3a92256a04846e8aa4032c63cda2b74
I20260709 13:00:28.068660  7908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0abf7f11b5014b72b4e98b0d646fe426"
dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
mode: GRACEFUL
new_leader_uuid: "c3a92256a04846e8aa4032c63cda2b74"
 from {username='slave'} at 127.0.0.1:58432
I20260709 13:00:28.069227  7908 raft_consensus.cc:606] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 LEADER]: Received request to transfer leadership to TS c3a92256a04846e8aa4032c63cda2b74
I20260709 13:00:28.074127  8057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c4f5c50563e43a6b4600dfb7f0fc575"
dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
mode: GRACEFUL
new_leader_uuid: "c3a92256a04846e8aa4032c63cda2b74"
 from {username='slave'} at 127.0.0.1:33386
I20260709 13:00:28.074623  8057 raft_consensus.cc:606] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 1 LEADER]: Received request to transfer leadership to TS c3a92256a04846e8aa4032c63cda2b74
I20260709 13:00:28.089169  7983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1330727d2c94cca98bada1d0b01ad24"
dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
mode: GRACEFUL
new_leader_uuid: "c0e23fd9887848f08151cb92c9719d1c"
 from {username='slave'} at 127.0.0.1:58400
I20260709 13:00:28.089664  7983 raft_consensus.cc:606] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [term 1 LEADER]: Received request to transfer leadership to TS c0e23fd9887848f08151cb92c9719d1c
I20260709 13:00:28.133697  8105 consensus_queue.cc:1048] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:28.140460  8144 raft_consensus.cc:993] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c: : Instructing follower c3a92256a04846e8aa4032c63cda2b74 to start an election
I20260709 13:00:28.140900  8144 raft_consensus.cc:1081] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 1 LEADER]: Signalling peer c3a92256a04846e8aa4032c63cda2b74 to start an election
I20260709 13:00:28.142474  7984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a35f1257fc174173a9fc519308f1afa8"
dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
 from {username='slave'} at 127.0.0.1:58394
I20260709 13:00:28.143056  7984 raft_consensus.cc:493] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:28.143357  7984 raft_consensus.cc:3060] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:28.147398  8105 consensus_queue.cc:1048] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:28.149711  7984 raft_consensus.cc:515] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:28.151314  8105 consensus_queue.cc:1048] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:28.151686  8149 consensus_queue.cc:1048] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:28.152774  7983 raft_consensus.cc:1240] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Rejecting Update request from peer c0e23fd9887848f08151cb92c9719d1c for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:28.152843  8057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35f1257fc174173a9fc519308f1afa8" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
I20260709 13:00:28.153280  7909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35f1257fc174173a9fc519308f1afa8" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
I20260709 13:00:28.153520  8057 raft_consensus.cc:3055] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:28.153930  8057 raft_consensus.cc:740] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Running, Role: LEADER
I20260709 13:00:28.154189  7984 leader_election.cc:290] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 2 election: Requested vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:28.153930  7909 raft_consensus.cc:3060] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:28.154812  8057 consensus_queue.cc:260] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:28.155651  8057 raft_consensus.cc:3060] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:28.159790  7909 raft_consensus.cc:2468] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3a92256a04846e8aa4032c63cda2b74 in term 2.
I20260709 13:00:28.160652  7908 raft_consensus.cc:1240] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Rejecting Update request from peer c0e23fd9887848f08151cb92c9719d1c for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:00:28.163493  7950 leader_election.cc:304] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:28.164847  8160 raft_consensus.cc:2804] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:28.165426  8160 raft_consensus.cc:697] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 2 LEADER]: Becoming Leader. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Running, Role: LEADER
I20260709 13:00:28.166316  8160 consensus_queue.cc:237] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
W20260709 13:00:28.157195  8144 consensus_queue.cc:1175] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c3a92256a04846e8aa4032c63cda2b74" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c0e23fd9887848f08151cb92c9719d1c for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:28.171092  8130 consensus_queue.cc:1048] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:28.173633  8144 raft_consensus.cc:993] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c: : Instructing follower 37ddb2d1ba0d4c97b81d9f9804b130c8 to start an election
I20260709 13:00:28.174175  8144 raft_consensus.cc:1081] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [term 1 LEADER]: Signalling peer 37ddb2d1ba0d4c97b81d9f9804b130c8 to start an election
I20260709 13:00:28.173754  8057 raft_consensus.cc:2468] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3a92256a04846e8aa4032c63cda2b74 in term 2.
I20260709 13:00:28.183214  8149 consensus_queue.cc:1048] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:28.191629  7909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afb6b567d4804e9e8a4b91e398f5f397"
dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
 from {username='slave'} at 127.0.0.1:58416
I20260709 13:00:28.192227  7909 raft_consensus.cc:493] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:28.192625  7909 raft_consensus.cc:3060] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:28.187016  8144 consensus_queue.cc:1048] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:00:28.195986  8160 consensus_queue.cc:1048] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:28.196751  8144 raft_consensus.cc:993] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c: : Instructing follower 37ddb2d1ba0d4c97b81d9f9804b130c8 to start an election
I20260709 13:00:28.197232  8144 raft_consensus.cc:1081] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [term 1 LEADER]: Signalling peer 37ddb2d1ba0d4c97b81d9f9804b130c8 to start an election
I20260709 13:00:28.201438  8163 consensus_queue.cc:1048] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:28.200519  7807 catalog_manager.cc:5697] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 reported cstate change: term changed from 1 to 2, leader changed from c0e23fd9887848f08151cb92c9719d1c (127.7.25.195) to c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "c3a92256a04846e8aa4032c63cda2b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:28.200748  7909 raft_consensus.cc:515] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:28.216086  8163 raft_consensus.cc:993] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8: : Instructing follower c3a92256a04846e8aa4032c63cda2b74 to start an election
I20260709 13:00:28.216539  8163 raft_consensus.cc:1081] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 LEADER]: Signalling peer c3a92256a04846e8aa4032c63cda2b74 to start an election
I20260709 13:00:28.219508  7909 leader_election.cc:290] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 2 election: Requested vote from peers c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:28.219532  7984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0abf7f11b5014b72b4e98b0d646fe426"
dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
 from {username='slave'} at 127.0.0.1:58382
I20260709 13:00:28.220184  7984 raft_consensus.cc:493] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:28.220690  7984 raft_consensus.cc:3060] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:28.230603  7984 raft_consensus.cc:515] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:28.235132  7982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb6b567d4804e9e8a4b91e398f5f397" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
I20260709 13:00:28.235793  7982 raft_consensus.cc:3060] T afb6b567d4804e9e8a4b91e398f5f397 P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:28.236861  8058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb6b567d4804e9e8a4b91e398f5f397" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
I20260709 13:00:28.237670  8058 raft_consensus.cc:3055] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:28.238083  8058 raft_consensus.cc:740] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Running, Role: LEADER
I20260709 13:00:28.239113  8058 consensus_queue.cc:260] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:28.241535  7909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf7f11b5014b72b4e98b0d646fe426" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
I20260709 13:00:28.242098  7909 raft_consensus.cc:3055] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:28.242444  7909 raft_consensus.cc:740] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Running, Role: LEADER
W20260709 13:00:28.242497  8024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:34835, user_credentials={real_user=slave}} blocked reactor thread for 47429.1us
I20260709 13:00:28.243305  7909 consensus_queue.cc:260] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:28.244434  7909 raft_consensus.cc:3060] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:28.246165  7984 leader_election.cc:290] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 2 election: Requested vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:28.248746  8058 raft_consensus.cc:3060] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:28.249329  8021 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:39925, user_credentials={real_user=slave}} blocked reactor thread for 56341us
I20260709 13:00:28.250038  7982 raft_consensus.cc:2468] T afb6b567d4804e9e8a4b91e398f5f397 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 2.
I20260709 13:00:28.252090  7909 raft_consensus.cc:2468] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3a92256a04846e8aa4032c63cda2b74 in term 2.
I20260709 13:00:28.252620  8056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf7f11b5014b72b4e98b0d646fe426" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
I20260709 13:00:28.253243  8056 raft_consensus.cc:3060] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:28.253538  8160 consensus_queue.cc:1048] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:28.260689  8056 raft_consensus.cc:2468] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3a92256a04846e8aa4032c63cda2b74 in term 2.
I20260709 13:00:28.260823  7950 leader_election.cc:304] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:28.261346  8105 consensus_queue.cc:1048] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:28.261656  8160 raft_consensus.cc:2804] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:28.261723  8058 raft_consensus.cc:2468] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 2.
I20260709 13:00:28.262255  8160 raft_consensus.cc:697] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 2 LEADER]: Becoming Leader. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Running, Role: LEADER
I20260709 13:00:28.263190  8160 consensus_queue.cc:237] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:28.265858  7872 leader_election.cc:304] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:28.266999  8107 raft_consensus.cc:2804] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:28.267462  8107 raft_consensus.cc:697] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 LEADER]: Becoming Leader. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Running, Role: LEADER
I20260709 13:00:28.268213  8107 consensus_queue.cc:237] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:28.269852  7909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "554ffaa6916b461590a35a2317295d11"
dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
 from {username='slave'} at 127.0.0.1:58416
I20260709 13:00:28.270399  7909 raft_consensus.cc:493] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:28.270774  7909 raft_consensus.cc:3060] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:28.274199  8105 raft_consensus.cc:993] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c: : Instructing follower c3a92256a04846e8aa4032c63cda2b74 to start an election
I20260709 13:00:28.274633  8105 raft_consensus.cc:1081] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 1 LEADER]: Signalling peer c3a92256a04846e8aa4032c63cda2b74 to start an election
I20260709 13:00:28.281239  7909 raft_consensus.cc:515] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:28.288050  7804 catalog_manager.cc:5697] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8 reported cstate change: term changed from 1 to 2, leader changed from c0e23fd9887848f08151cb92c9719d1c (127.7.25.195) to 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:28.290522  8160 raft_consensus.cc:993] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74: : Instructing follower c0e23fd9887848f08151cb92c9719d1c to start an election
I20260709 13:00:28.290959  8160 raft_consensus.cc:1081] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [term 1 LEADER]: Signalling peer c0e23fd9887848f08151cb92c9719d1c to start an election
I20260709 13:00:28.291000  7983 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c4f5c50563e43a6b4600dfb7f0fc575"
dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
 from {username='slave'} at 127.0.0.1:58394
I20260709 13:00:28.293183  7983 raft_consensus.cc:493] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:28.293040  8144 consensus_queue.cc:1048] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:28.294186  7983 raft_consensus.cc:3060] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:28.294667  8058 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1330727d2c94cca98bada1d0b01ad24"
dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
 from {username='slave'} at 127.0.0.1:33372
I20260709 13:00:28.296573  8058 raft_consensus.cc:493] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:28.296991  8058 raft_consensus.cc:3060] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:28.303666  8058 raft_consensus.cc:515] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:28.306583  7983 raft_consensus.cc:515] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:28.307459  7909 leader_election.cc:290] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 2 election: Requested vote from peers c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:28.307945  7807 catalog_manager.cc:5697] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 reported cstate change: term changed from 1 to 2, leader changed from 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193) to c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "c3a92256a04846e8aa4032c63cda2b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:28.308799  7984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554ffaa6916b461590a35a2317295d11" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
I20260709 13:00:28.309688  8057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f5c50563e43a6b4600dfb7f0fc575" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
I20260709 13:00:28.309930  7984 raft_consensus.cc:3060] T 554ffaa6916b461590a35a2317295d11 P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:28.310271  8057 raft_consensus.cc:3055] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:28.310638  8057 raft_consensus.cc:740] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Running, Role: LEADER
I20260709 13:00:28.311496  8057 consensus_queue.cc:260] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:28.312662  8057 raft_consensus.cc:3060] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:28.313438  8056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554ffaa6916b461590a35a2317295d11" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
I20260709 13:00:28.313715  8058 leader_election.cc:290] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 2 election: Requested vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925)
I20260709 13:00:28.314064  8056 raft_consensus.cc:3055] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:28.314379  8056 raft_consensus.cc:740] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Running, Role: LEADER
I20260709 13:00:28.314734  7909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f5c50563e43a6b4600dfb7f0fc575" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
I20260709 13:00:28.315271  7909 raft_consensus.cc:3060] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:28.316742  7982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1330727d2c94cca98bada1d0b01ad24" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
I20260709 13:00:28.316984  7984 raft_consensus.cc:2468] T 554ffaa6916b461590a35a2317295d11 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 2.
I20260709 13:00:28.317339  7982 raft_consensus.cc:3055] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:28.317693  7982 raft_consensus.cc:740] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Running, Role: LEADER
I20260709 13:00:28.318529  7982 consensus_queue.cc:260] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:28.319671  7982 raft_consensus.cc:3060] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:28.319478  7872 leader_election.cc:304] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:28.320859  8107 raft_consensus.cc:2804] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:28.321338  8107 raft_consensus.cc:697] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 LEADER]: Becoming Leader. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Running, Role: LEADER
I20260709 13:00:28.322043  7909 raft_consensus.cc:2468] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3a92256a04846e8aa4032c63cda2b74 in term 2.
I20260709 13:00:28.322100  8107 consensus_queue.cc:237] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:28.323607  7950 leader_election.cc:304] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:28.324467  8160 raft_consensus.cc:2804] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:28.324961  8160 raft_consensus.cc:697] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [term 2 LEADER]: Becoming Leader. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Running, Role: LEADER
I20260709 13:00:28.315167  8056 consensus_queue.cc:260] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:28.325874  8056 raft_consensus.cc:3060] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:28.325736  8160 consensus_queue.cc:237] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:28.334463  8056 raft_consensus.cc:2468] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 2.
I20260709 13:00:28.334594  8057 raft_consensus.cc:2468] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3a92256a04846e8aa4032c63cda2b74 in term 2.
I20260709 13:00:28.334977  7983 leader_election.cc:290] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 2 election: Requested vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:28.336158  7982 raft_consensus.cc:2468] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 2.
I20260709 13:00:28.336522  7909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1330727d2c94cca98bada1d0b01ad24" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
I20260709 13:00:28.337250  7909 raft_consensus.cc:3060] T f1330727d2c94cca98bada1d0b01ad24 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:28.337527  8021 leader_election.cc:304] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0e23fd9887848f08151cb92c9719d1c, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:28.338356  8174 raft_consensus.cc:2804] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:28.338807  8174 raft_consensus.cc:697] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c [term 2 LEADER]: Becoming Leader. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Running, Role: LEADER
I20260709 13:00:28.339632  8174 consensus_queue.cc:237] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:28.340277  7807 catalog_manager.cc:5697] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8 reported cstate change: term changed from 1 to 2, leader changed from c0e23fd9887848f08151cb92c9719d1c (127.7.25.195) to 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:28.344506  7909 raft_consensus.cc:2468] T f1330727d2c94cca98bada1d0b01ad24 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 2.
I20260709 13:00:28.348503  7804 catalog_manager.cc:5697] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c reported cstate change: term changed from 1 to 2, leader changed from c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194) to c0e23fd9887848f08151cb92c9719d1c (127.7.25.195). New cstate: current_term: 2 leader_uuid: "c0e23fd9887848f08151cb92c9719d1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:28.357514  7805 catalog_manager.cc:5697] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 reported cstate change: term changed from 1 to 2, leader changed from c0e23fd9887848f08151cb92c9719d1c (127.7.25.195) to c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "c3a92256a04846e8aa4032c63cda2b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:28.412115  8106 consensus_queue.cc:1048] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:28.422655  8163 consensus_queue.cc:1048] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:28.559731  7909 raft_consensus.cc:1275] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Refusing update from remote peer c3a92256a04846e8aa4032c63cda2b74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:28.560918  8160 consensus_queue.cc:1048] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:28.572028  8057 raft_consensus.cc:1275] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Refusing update from remote peer c3a92256a04846e8aa4032c63cda2b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:28.573920  8104 consensus_queue.cc:1048] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:28.703194  7982 raft_consensus.cc:1275] T 554ffaa6916b461590a35a2317295d11 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Refusing update from remote peer 37ddb2d1ba0d4c97b81d9f9804b130c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:28.704453  8163 consensus_queue.cc:1048] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:28.714134  8057 raft_consensus.cc:1275] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Refusing update from remote peer 37ddb2d1ba0d4c97b81d9f9804b130c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:28.714684  7909 raft_consensus.cc:1275] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Refusing update from remote peer c3a92256a04846e8aa4032c63cda2b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:28.716215  8104 consensus_queue.cc:1048] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:28.717401  7909 raft_consensus.cc:1275] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Refusing update from remote peer c3a92256a04846e8aa4032c63cda2b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:28.718183  8130 consensus_queue.cc:1048] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:28.720072  8104 consensus_queue.cc:1048] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:28.726560  8056 raft_consensus.cc:1275] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Refusing update from remote peer c3a92256a04846e8aa4032c63cda2b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:28.734612  8160 consensus_queue.cc:1048] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:28.743222  8057 raft_consensus.cc:1275] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Refusing update from remote peer c3a92256a04846e8aa4032c63cda2b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:28.746060  8160 consensus_queue.cc:1048] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:28.812538  8057 raft_consensus.cc:1275] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Refusing update from remote peer 37ddb2d1ba0d4c97b81d9f9804b130c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:28.813846  8106 consensus_queue.cc:1048] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:28.821573  7982 raft_consensus.cc:1275] T afb6b567d4804e9e8a4b91e398f5f397 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Refusing update from remote peer 37ddb2d1ba0d4c97b81d9f9804b130c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:28.823503  8106 consensus_queue.cc:1048] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:28.931332  7906 raft_consensus.cc:1275] T f1330727d2c94cca98bada1d0b01ad24 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Refusing update from remote peer c0e23fd9887848f08151cb92c9719d1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:28.932551  8174 consensus_queue.cc:1048] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:28.940955  7982 raft_consensus.cc:1275] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Refusing update from remote peer c0e23fd9887848f08151cb92c9719d1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:28.943568  8174 consensus_queue.cc:1048] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:31.120743  7271 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:00:31.121556  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:31.138818  7906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "111b72e6bd9d4b27b18c4325456efb7f"
dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
mode: GRACEFUL
new_leader_uuid: "c0e23fd9887848f08151cb92c9719d1c"
 from {username='slave'} at 127.0.0.1:58446
I20260709 13:00:31.139315  7906 raft_consensus.cc:606] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 LEADER]: Received request to transfer leadership to TS c0e23fd9887848f08151cb92c9719d1c
I20260709 13:00:31.141812  7906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ca06f71d27247e1bde39bb8da315c69"
dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
mode: GRACEFUL
new_leader_uuid: "c0e23fd9887848f08151cb92c9719d1c"
 from {username='slave'} at 127.0.0.1:58446
I20260709 13:00:31.142305  7906 raft_consensus.cc:606] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 LEADER]: Received request to transfer leadership to TS c0e23fd9887848f08151cb92c9719d1c
I20260709 13:00:31.143421  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:31.143803  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:31.336588  8192 raft_consensus.cc:993] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8: : Instructing follower c0e23fd9887848f08151cb92c9719d1c to start an election
I20260709 13:00:31.338272  8192 raft_consensus.cc:1081] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 LEADER]: Signalling peer c0e23fd9887848f08151cb92c9719d1c to start an election
I20260709 13:00:31.339799  8057 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "111b72e6bd9d4b27b18c4325456efb7f"
dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
 from {username='slave'} at 127.0.0.1:33378
I20260709 13:00:31.340284  8057 raft_consensus.cc:493] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:31.340585  8057 raft_consensus.cc:3060] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.345743  8057 raft_consensus.cc:515] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:31.347477  8057 leader_election.cc:290] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 2 election: Requested vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925)
I20260709 13:00:31.348028  7906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111b72e6bd9d4b27b18c4325456efb7f" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
I20260709 13:00:31.348645  7906 raft_consensus.cc:3055] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:31.348785  7983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111b72e6bd9d4b27b18c4325456efb7f" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
I20260709 13:00:31.348912  7906 raft_consensus.cc:740] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Running, Role: LEADER
I20260709 13:00:31.349536  7983 raft_consensus.cc:3060] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.349897  7906 consensus_queue.cc:260] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:31.350813  7906 raft_consensus.cc:3060] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.354880  7983 raft_consensus.cc:2468] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 2.
I20260709 13:00:31.355381  7906 raft_consensus.cc:2468] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 2.
I20260709 13:00:31.356079  8021 leader_election.cc:304] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0e23fd9887848f08151cb92c9719d1c, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:31.356782  8188 raft_consensus.cc:2804] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:31.357954  8188 raft_consensus.cc:697] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [term 2 LEADER]: Becoming Leader. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Running, Role: LEADER
I20260709 13:00:31.358718  8188 consensus_queue.cc:237] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:31.365630  7804 catalog_manager.cc:5697] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c reported cstate change: term changed from 1 to 2, leader changed from 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193) to c0e23fd9887848f08151cb92c9719d1c (127.7.25.195). New cstate: current_term: 2 leader_uuid: "c0e23fd9887848f08151cb92c9719d1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:31.412099  8106 raft_consensus.cc:993] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8: : Instructing follower c0e23fd9887848f08151cb92c9719d1c to start an election
I20260709 13:00:31.412573  8192 raft_consensus.cc:1081] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 LEADER]: Signalling peer c0e23fd9887848f08151cb92c9719d1c to start an election
I20260709 13:00:31.414160  8057 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ca06f71d27247e1bde39bb8da315c69"
dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
 from {username='slave'} at 127.0.0.1:33378
I20260709 13:00:31.414661  8057 raft_consensus.cc:493] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:31.414995  8057 raft_consensus.cc:3060] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.419327  8057 raft_consensus.cc:515] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:31.420704  8057 leader_election.cc:290] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 2 election: Requested vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925)
I20260709 13:00:31.421638  7906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca06f71d27247e1bde39bb8da315c69" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
I20260709 13:00:31.422008  7983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca06f71d27247e1bde39bb8da315c69" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
I20260709 13:00:31.422235  7906 raft_consensus.cc:3055] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:31.422561  7906 raft_consensus.cc:740] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Running, Role: LEADER
I20260709 13:00:31.422566  7983 raft_consensus.cc:3060] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.423482  7906 consensus_queue.cc:260] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:31.424722  7906 raft_consensus.cc:3060] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.429736  7983 raft_consensus.cc:2468] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 2.
I20260709 13:00:31.430908  8021 leader_election.cc:304] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0e23fd9887848f08151cb92c9719d1c, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:31.431515  7906 raft_consensus.cc:2468] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 2.
I20260709 13:00:31.431774  8188 raft_consensus.cc:2804] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:31.432353  8188 raft_consensus.cc:697] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 2 LEADER]: Becoming Leader. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Running, Role: LEADER
I20260709 13:00:31.433161  8188 consensus_queue.cc:237] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:31.439572  7804 catalog_manager.cc:5697] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c reported cstate change: term changed from 1 to 2, leader changed from 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193) to c0e23fd9887848f08151cb92c9719d1c (127.7.25.195). New cstate: current_term: 2 leader_uuid: "c0e23fd9887848f08151cb92c9719d1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:31.823573  7906 raft_consensus.cc:1275] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Refusing update from remote peer c0e23fd9887848f08151cb92c9719d1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:31.825248  8188 consensus_queue.cc:1048] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:31.846645  7983 raft_consensus.cc:1275] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Refusing update from remote peer c0e23fd9887848f08151cb92c9719d1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:31.848424  8188 consensus_queue.cc:1048] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:31.913352  7909 raft_consensus.cc:1275] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Refusing update from remote peer c0e23fd9887848f08151cb92c9719d1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:31.914961  8188 consensus_queue.cc:1048] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:31.925405  7983 raft_consensus.cc:1275] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Refusing update from remote peer c0e23fd9887848f08151cb92c9719d1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:31.927373  8188 consensus_queue.cc:1048] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:32.144663  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:32.156760  8057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ca06f71d27247e1bde39bb8da315c69"
dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
mode: GRACEFUL
new_leader_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
 from {username='slave'} at 127.0.0.1:33386
I20260709 13:00:32.157354  8057 raft_consensus.cc:606] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 2 LEADER]: Received request to transfer leadership to TS 37ddb2d1ba0d4c97b81d9f9804b130c8
I20260709 13:00:32.168985  8057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "111b72e6bd9d4b27b18c4325456efb7f"
dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
mode: GRACEFUL
new_leader_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
 from {username='slave'} at 127.0.0.1:33386
I20260709 13:00:32.169463  8057 raft_consensus.cc:606] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [term 2 LEADER]: Received request to transfer leadership to TS 37ddb2d1ba0d4c97b81d9f9804b130c8
I20260709 13:00:32.174342  7983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a35f1257fc174173a9fc519308f1afa8"
dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
mode: GRACEFUL
new_leader_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
 from {username='slave'} at 127.0.0.1:58400
I20260709 13:00:32.174824  7983 raft_consensus.cc:606] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 2 LEADER]: Received request to transfer leadership to TS 37ddb2d1ba0d4c97b81d9f9804b130c8
I20260709 13:00:32.179167  7983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0abf7f11b5014b72b4e98b0d646fe426"
dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
mode: GRACEFUL
new_leader_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
 from {username='slave'} at 127.0.0.1:58400
I20260709 13:00:32.179612  7983 raft_consensus.cc:606] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 2 LEADER]: Received request to transfer leadership to TS 37ddb2d1ba0d4c97b81d9f9804b130c8
I20260709 13:00:32.183964  7983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c4f5c50563e43a6b4600dfb7f0fc575"
dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
mode: GRACEFUL
new_leader_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
 from {username='slave'} at 127.0.0.1:58400
I20260709 13:00:32.184531  7983 raft_consensus.cc:606] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [term 2 LEADER]: Received request to transfer leadership to TS 37ddb2d1ba0d4c97b81d9f9804b130c8
I20260709 13:00:32.288388  8210 raft_consensus.cc:993] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74: : Instructing follower 37ddb2d1ba0d4c97b81d9f9804b130c8 to start an election
I20260709 13:00:32.288915  8189 raft_consensus.cc:1081] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 2 LEADER]: Signalling peer 37ddb2d1ba0d4c97b81d9f9804b130c8 to start an election
I20260709 13:00:32.290505  7909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0abf7f11b5014b72b4e98b0d646fe426"
dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
 from {username='slave'} at 127.0.0.1:58414
I20260709 13:00:32.291057  7909 raft_consensus.cc:493] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:32.291348  7909 raft_consensus.cc:3060] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.296862  7909 raft_consensus.cc:515] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:32.298621  7909 leader_election.cc:290] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 3 election: Requested vote from peers c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:32.299368  7983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf7f11b5014b72b4e98b0d646fe426" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
I20260709 13:00:32.299801  8057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf7f11b5014b72b4e98b0d646fe426" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
I20260709 13:00:32.300009  7983 raft_consensus.cc:3055] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:32.300269  8057 raft_consensus.cc:3060] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.300335  7983 raft_consensus.cc:740] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Running, Role: LEADER
I20260709 13:00:32.301218  7983 consensus_queue.cc:260] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:32.302094  7983 raft_consensus.cc:3060] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.304899  8057 raft_consensus.cc:2468] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 3.
I20260709 13:00:32.306159  7872 leader_election.cc:304] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c0e23fd9887848f08151cb92c9719d1c; no voters: 
I20260709 13:00:32.306699  7983 raft_consensus.cc:2468] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 3.
I20260709 13:00:32.307205  8106 raft_consensus.cc:2804] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:32.307644  8106 raft_consensus.cc:697] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 LEADER]: Becoming Leader. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Running, Role: LEADER
I20260709 13:00:32.308482  8106 consensus_queue.cc:237] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:32.315538  7807 catalog_manager.cc:5697] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 reported cstate change: term changed from 2 to 3, leader changed from c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194) to 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193). New cstate: current_term: 3 leader_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.419986  8188 raft_consensus.cc:993] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c: : Instructing follower 37ddb2d1ba0d4c97b81d9f9804b130c8 to start an election
I20260709 13:00:32.420542  8208 raft_consensus.cc:1081] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [term 2 LEADER]: Signalling peer 37ddb2d1ba0d4c97b81d9f9804b130c8 to start an election
I20260709 13:00:32.422079  7909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "111b72e6bd9d4b27b18c4325456efb7f"
dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
 from {username='slave'} at 127.0.0.1:58416
I20260709 13:00:32.422658  7909 raft_consensus.cc:493] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:32.422976  7909 raft_consensus.cc:3060] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.428309  7909 raft_consensus.cc:515] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:32.430008  7909 leader_election.cc:290] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 3 election: Requested vote from peers c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:32.430896  7983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111b72e6bd9d4b27b18c4325456efb7f" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
I20260709 13:00:32.431229  8057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111b72e6bd9d4b27b18c4325456efb7f" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
I20260709 13:00:32.431478  7983 raft_consensus.cc:3060] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.431720  8057 raft_consensus.cc:3055] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:32.432008  8057 raft_consensus.cc:740] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Running, Role: LEADER
I20260709 13:00:32.432825  8057 consensus_queue.cc:260] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:32.434087  8057 raft_consensus.cc:3060] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.438195  7983 raft_consensus.cc:2468] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 3.
I20260709 13:00:32.439456  7872 leader_election.cc:304] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:32.439869  8057 raft_consensus.cc:2468] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 3.
I20260709 13:00:32.440127  8106 raft_consensus.cc:2804] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:32.440614  8106 raft_consensus.cc:697] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 LEADER]: Becoming Leader. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Running, Role: LEADER
I20260709 13:00:32.441525  8106 consensus_queue.cc:237] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:32.446884  7807 catalog_manager.cc:5697] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 reported cstate change: term changed from 2 to 3, leader changed from c0e23fd9887848f08151cb92c9719d1c (127.7.25.195) to 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193). New cstate: current_term: 3 leader_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.452145  8210 raft_consensus.cc:993] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74: : Instructing follower 37ddb2d1ba0d4c97b81d9f9804b130c8 to start an election
I20260709 13:00:32.452620  8189 raft_consensus.cc:1081] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [term 2 LEADER]: Signalling peer 37ddb2d1ba0d4c97b81d9f9804b130c8 to start an election
I20260709 13:00:32.454136  7909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c4f5c50563e43a6b4600dfb7f0fc575"
dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
 from {username='slave'} at 127.0.0.1:58414
I20260709 13:00:32.454651  7909 raft_consensus.cc:493] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:32.455021  7909 raft_consensus.cc:3060] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.458076  8188 raft_consensus.cc:993] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c: : Instructing follower 37ddb2d1ba0d4c97b81d9f9804b130c8 to start an election
I20260709 13:00:32.458531  8208 raft_consensus.cc:1081] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 2 LEADER]: Signalling peer 37ddb2d1ba0d4c97b81d9f9804b130c8 to start an election
I20260709 13:00:32.459849  7906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ca06f71d27247e1bde39bb8da315c69"
dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
 from {username='slave'} at 127.0.0.1:58416
I20260709 13:00:32.460350  7906 raft_consensus.cc:493] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:32.460697  7906 raft_consensus.cc:3060] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.461488  7909 raft_consensus.cc:515] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:32.463608  7909 leader_election.cc:290] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 3 election: Requested vote from peers c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:32.464133  7983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f5c50563e43a6b4600dfb7f0fc575" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
I20260709 13:00:32.464675  7983 raft_consensus.cc:3055] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:32.464963  7983 raft_consensus.cc:740] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Running, Role: LEADER
I20260709 13:00:32.464994  8057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f5c50563e43a6b4600dfb7f0fc575" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
I20260709 13:00:32.465613  8057 raft_consensus.cc:3060] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.465780  7983 consensus_queue.cc:260] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:32.466913  7983 raft_consensus.cc:3060] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.467160  7906 raft_consensus.cc:515] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:32.468884  7906 leader_election.cc:290] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 3 election: Requested vote from peers c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:32.469698  7982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca06f71d27247e1bde39bb8da315c69" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
I20260709 13:00:32.470115  7982 raft_consensus.cc:3060] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.471489  8057 raft_consensus.cc:2468] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 3.
I20260709 13:00:32.472807  7983 raft_consensus.cc:2468] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 3.
I20260709 13:00:32.473729  8057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca06f71d27247e1bde39bb8da315c69" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
I20260709 13:00:32.473917  7872 leader_election.cc:304] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c0e23fd9887848f08151cb92c9719d1c; no voters: 
I20260709 13:00:32.474208  8057 raft_consensus.cc:3055] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:32.474617  8057 raft_consensus.cc:740] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Running, Role: LEADER
I20260709 13:00:32.474841  8106 raft_consensus.cc:2804] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:32.475302  8106 raft_consensus.cc:697] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 LEADER]: Becoming Leader. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Running, Role: LEADER
I20260709 13:00:32.475448  8057 consensus_queue.cc:260] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:32.476142  8106 consensus_queue.cc:237] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:32.476702  8057 raft_consensus.cc:3060] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.476857  7982 raft_consensus.cc:2468] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 3.
I20260709 13:00:32.478026  7872 leader_election.cc:304] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:32.478840  8192 raft_consensus.cc:2804] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:32.481209  8192 raft_consensus.cc:697] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 LEADER]: Becoming Leader. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Running, Role: LEADER
I20260709 13:00:32.482052  8192 consensus_queue.cc:237] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:32.482896  8057 raft_consensus.cc:2468] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 3.
I20260709 13:00:32.484277  7807 catalog_manager.cc:5697] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 reported cstate change: term changed from 2 to 3, leader changed from c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194) to 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193). New cstate: current_term: 3 leader_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.494761  7807 catalog_manager.cc:5697] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 reported cstate change: term changed from 2 to 3, leader changed from c0e23fd9887848f08151cb92c9719d1c (127.7.25.195) to 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193). New cstate: current_term: 3 leader_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.603336  8210 raft_consensus.cc:993] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74: : Instructing follower 37ddb2d1ba0d4c97b81d9f9804b130c8 to start an election
I20260709 13:00:32.603731  8189 raft_consensus.cc:1081] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 2 LEADER]: Signalling peer 37ddb2d1ba0d4c97b81d9f9804b130c8 to start an election
I20260709 13:00:32.605043  7906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a35f1257fc174173a9fc519308f1afa8"
dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
 from {username='slave'} at 127.0.0.1:58414
I20260709 13:00:32.605535  7906 raft_consensus.cc:493] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:32.605824  7906 raft_consensus.cc:3060] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.610270  7906 raft_consensus.cc:515] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:32.611887  7906 leader_election.cc:290] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 3 election: Requested vote from peers c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:32.612627  7982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35f1257fc174173a9fc519308f1afa8" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
I20260709 13:00:32.612890  8057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35f1257fc174173a9fc519308f1afa8" candidate_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
I20260709 13:00:32.613256  7982 raft_consensus.cc:3055] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:32.613402  8057 raft_consensus.cc:3060] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.613588  7982 raft_consensus.cc:740] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Running, Role: LEADER
I20260709 13:00:32.614403  7982 consensus_queue.cc:260] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:32.615303  7982 raft_consensus.cc:3060] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.617524  8057 raft_consensus.cc:2468] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 3.
I20260709 13:00:32.618379  7872 leader_election.cc:304] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c0e23fd9887848f08151cb92c9719d1c; no voters: 
I20260709 13:00:32.619033  8192 raft_consensus.cc:2804] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:32.619490  8192 raft_consensus.cc:697] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 LEADER]: Becoming Leader. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Running, Role: LEADER
I20260709 13:00:32.620396  7982 raft_consensus.cc:2468] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ddb2d1ba0d4c97b81d9f9804b130c8 in term 3.
I20260709 13:00:32.620460  8192 consensus_queue.cc:237] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:32.627362  7807 catalog_manager.cc:5697] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 reported cstate change: term changed from 2 to 3, leader changed from c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194) to 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193). New cstate: current_term: 3 leader_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.745559  7982 raft_consensus.cc:1275] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 3 FOLLOWER]: Refusing update from remote peer 37ddb2d1ba0d4c97b81d9f9804b130c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:32.746788  8192 consensus_queue.cc:1048] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:32.756480  8057 raft_consensus.cc:1275] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [term 3 FOLLOWER]: Refusing update from remote peer 37ddb2d1ba0d4c97b81d9f9804b130c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:32.758824  8216 consensus_queue.cc:1048] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:32.824548  7982 raft_consensus.cc:1275] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [term 3 FOLLOWER]: Refusing update from remote peer 37ddb2d1ba0d4c97b81d9f9804b130c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:32.825743  8216 consensus_queue.cc:1048] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:32.834205  8057 raft_consensus.cc:1275] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [term 3 FOLLOWER]: Refusing update from remote peer 37ddb2d1ba0d4c97b81d9f9804b130c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:32.835413  8192 consensus_queue.cc:1048] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:32.906229  8057 raft_consensus.cc:1275] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 3 FOLLOWER]: Refusing update from remote peer 37ddb2d1ba0d4c97b81d9f9804b130c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:32.907505  8192 consensus_queue.cc:1048] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:32.917058  7982 raft_consensus.cc:1275] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [term 3 FOLLOWER]: Refusing update from remote peer 37ddb2d1ba0d4c97b81d9f9804b130c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:32.918706  8216 consensus_queue.cc:1048] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:32.943778  8057 raft_consensus.cc:1275] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 3 FOLLOWER]: Refusing update from remote peer 37ddb2d1ba0d4c97b81d9f9804b130c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:32.945055  8216 consensus_queue.cc:1048] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:32.953503  7982 raft_consensus.cc:1275] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [term 3 FOLLOWER]: Refusing update from remote peer 37ddb2d1ba0d4c97b81d9f9804b130c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:32.955794  8106 consensus_queue.cc:1048] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:33.007727  7982 raft_consensus.cc:1275] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 3 FOLLOWER]: Refusing update from remote peer 37ddb2d1ba0d4c97b81d9f9804b130c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:33.009155  8106 consensus_queue.cc:1048] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:33.017973  8057 raft_consensus.cc:1275] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 3 FOLLOWER]: Refusing update from remote peer 37ddb2d1ba0d4c97b81d9f9804b130c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:33.019371  8216 consensus_queue.cc:1048] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:35.191741  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:35.199506  7906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0abf7f11b5014b72b4e98b0d646fe426"
dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
mode: GRACEFUL
new_leader_uuid: "c0e23fd9887848f08151cb92c9719d1c"
 from {username='slave'} at 127.0.0.1:58446
I20260709 13:00:35.200047  7906 raft_consensus.cc:606] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 LEADER]: Received request to transfer leadership to TS c0e23fd9887848f08151cb92c9719d1c
I20260709 13:00:35.202585  7906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ca06f71d27247e1bde39bb8da315c69"
dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
mode: GRACEFUL
new_leader_uuid: "c3a92256a04846e8aa4032c63cda2b74"
 from {username='slave'} at 127.0.0.1:58446
I20260709 13:00:35.203048  7906 raft_consensus.cc:606] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 LEADER]: Received request to transfer leadership to TS c3a92256a04846e8aa4032c63cda2b74
I20260709 13:00:35.205363  7906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a35f1257fc174173a9fc519308f1afa8"
dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
mode: GRACEFUL
new_leader_uuid: "c3a92256a04846e8aa4032c63cda2b74"
 from {username='slave'} at 127.0.0.1:58446
I20260709 13:00:35.205897  7906 raft_consensus.cc:606] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 LEADER]: Received request to transfer leadership to TS c3a92256a04846e8aa4032c63cda2b74
I20260709 13:00:35.207983  7906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8b9e47b501f42d99ae6fa8b888ae1b5"
dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
mode: GRACEFUL
new_leader_uuid: "c0e23fd9887848f08151cb92c9719d1c"
 from {username='slave'} at 127.0.0.1:58446
I20260709 13:00:35.208449  7906 raft_consensus.cc:606] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 LEADER]: Received request to transfer leadership to TS c0e23fd9887848f08151cb92c9719d1c
I20260709 13:00:35.209438  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:00:35.209910  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:35.490819  8106 raft_consensus.cc:993] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8: : Instructing follower c3a92256a04846e8aa4032c63cda2b74 to start an election
I20260709 13:00:35.491240  8230 raft_consensus.cc:1081] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 LEADER]: Signalling peer c3a92256a04846e8aa4032c63cda2b74 to start an election
I20260709 13:00:35.492532  7982 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a35f1257fc174173a9fc519308f1afa8"
dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
 from {username='slave'} at 127.0.0.1:58382
I20260709 13:00:35.493038  7982 raft_consensus.cc:493] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:35.493397  7982 raft_consensus.cc:3060] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.495992  8106 raft_consensus.cc:993] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8: : Instructing follower c3a92256a04846e8aa4032c63cda2b74 to start an election
I20260709 13:00:35.496435  8230 raft_consensus.cc:1081] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 LEADER]: Signalling peer c3a92256a04846e8aa4032c63cda2b74 to start an election
I20260709 13:00:35.497805  7983 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ca06f71d27247e1bde39bb8da315c69"
dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
 from {username='slave'} at 127.0.0.1:58382
I20260709 13:00:35.498207  7983 raft_consensus.cc:493] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:35.498471  7983 raft_consensus.cc:3060] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.499281  7982 raft_consensus.cc:515] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:35.500962  7982 leader_election.cc:290] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 4 election: Requested vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:35.501966  8057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35f1257fc174173a9fc519308f1afa8" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
I20260709 13:00:35.501964  7906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35f1257fc174173a9fc519308f1afa8" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
I20260709 13:00:35.502627  8057 raft_consensus.cc:3060] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.502967  7906 raft_consensus.cc:3055] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:35.503291  7906 raft_consensus.cc:740] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Running, Role: LEADER
I20260709 13:00:35.503176  7983 raft_consensus.cc:515] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:35.504117  7906 consensus_queue.cc:260] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:35.504958  7983 leader_election.cc:290] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 4 election: Requested vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c0e23fd9887848f08151cb92c9719d1c (127.7.25.195:34777)
I20260709 13:00:35.505429  7906 raft_consensus.cc:3060] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.505728  7909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca06f71d27247e1bde39bb8da315c69" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
I20260709 13:00:35.506199  7909 raft_consensus.cc:3055] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:35.506443  7909 raft_consensus.cc:740] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Running, Role: LEADER
I20260709 13:00:35.507110  7909 consensus_queue.cc:260] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:35.507869  7909 raft_consensus.cc:3060] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.508495  8057 raft_consensus.cc:2468] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3a92256a04846e8aa4032c63cda2b74 in term 4.
I20260709 13:00:35.510092  7947 leader_election.cc:304] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0e23fd9887848f08151cb92c9719d1c, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:35.510958  8189 raft_consensus.cc:2804] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:35.511900  7906 raft_consensus.cc:2468] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3a92256a04846e8aa4032c63cda2b74 in term 4.
I20260709 13:00:35.512696  8056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca06f71d27247e1bde39bb8da315c69" candidate_uuid: "c3a92256a04846e8aa4032c63cda2b74" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
I20260709 13:00:35.512894  8189 raft_consensus.cc:697] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 4 LEADER]: Becoming Leader. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Running, Role: LEADER
I20260709 13:00:35.513295  8056 raft_consensus.cc:3060] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.514249  7909 raft_consensus.cc:2468] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3a92256a04846e8aa4032c63cda2b74 in term 4.
I20260709 13:00:35.513759  8189 consensus_queue.cc:237] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:35.515399  7950 leader_election.cc:304] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ddb2d1ba0d4c97b81d9f9804b130c8, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:35.516219  8231 raft_consensus.cc:2804] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:35.517609  8231 raft_consensus.cc:697] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [term 4 LEADER]: Becoming Leader. State: Replica: c3a92256a04846e8aa4032c63cda2b74, State: Running, Role: LEADER
I20260709 13:00:35.518532  8231 consensus_queue.cc:237] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:35.521656  8056 raft_consensus.cc:2468] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3a92256a04846e8aa4032c63cda2b74 in term 4.
I20260709 13:00:35.522051  8230 raft_consensus.cc:993] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8: : Instructing follower c0e23fd9887848f08151cb92c9719d1c to start an election
I20260709 13:00:35.523898  8230 raft_consensus.cc:1081] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 LEADER]: Signalling peer c0e23fd9887848f08151cb92c9719d1c to start an election
I20260709 13:00:35.525596  8056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0abf7f11b5014b72b4e98b0d646fe426"
dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
 from {username='slave'} at 127.0.0.1:33378
I20260709 13:00:35.526218  8056 raft_consensus.cc:493] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:35.526580  8056 raft_consensus.cc:3060] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.530923  7804 catalog_manager.cc:5697] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 reported cstate change: term changed from 3 to 4, leader changed from 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193) to c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194). New cstate: current_term: 4 leader_uuid: "c3a92256a04846e8aa4032c63cda2b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:35.533360  8230 raft_consensus.cc:993] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8: : Instructing follower c0e23fd9887848f08151cb92c9719d1c to start an election
I20260709 13:00:35.533043  8056 raft_consensus.cc:515] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:35.533856  8106 raft_consensus.cc:1081] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 LEADER]: Signalling peer c0e23fd9887848f08151cb92c9719d1c to start an election
I20260709 13:00:35.535488  8057 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8b9e47b501f42d99ae6fa8b888ae1b5"
dest_uuid: "c0e23fd9887848f08151cb92c9719d1c"
 from {username='slave'} at 127.0.0.1:33378
I20260709 13:00:35.535923  8056 leader_election.cc:290] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 4 election: Requested vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925)
I20260709 13:00:35.535964  8057 raft_consensus.cc:493] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:35.536505  8057 raft_consensus.cc:3060] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:35.537283  7909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf7f11b5014b72b4e98b0d646fe426" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
I20260709 13:00:35.537807  7909 raft_consensus.cc:3055] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:35.538151  7909 raft_consensus.cc:740] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Running, Role: LEADER
I20260709 13:00:35.536585  7983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf7f11b5014b72b4e98b0d646fe426" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
I20260709 13:00:35.539276  7983 raft_consensus.cc:3060] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.542017  8057 raft_consensus.cc:515] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:35.544087  7906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b9e47b501f42d99ae6fa8b888ae1b5" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8"
I20260709 13:00:35.544623  7906 raft_consensus.cc:3055] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:35.544931  7906 raft_consensus.cc:740] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37ddb2d1ba0d4c97b81d9f9804b130c8, State: Running, Role: LEADER
I20260709 13:00:35.544931  7982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b9e47b501f42d99ae6fa8b888ae1b5" candidate_uuid: "c0e23fd9887848f08151cb92c9719d1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3a92256a04846e8aa4032c63cda2b74"
I20260709 13:00:35.545652  7982 raft_consensus.cc:3060] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:35.545944  7906 consensus_queue.cc:260] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:35.547040  7906 raft_consensus.cc:3060] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:35.547708  7983 raft_consensus.cc:2468] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 4.
I20260709 13:00:35.549398  8021 leader_election.cc:304] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0e23fd9887848f08151cb92c9719d1c, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:35.550554  8229 raft_consensus.cc:2804] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:35.552399  7982 raft_consensus.cc:2468] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 2.
I20260709 13:00:35.552117  7909 consensus_queue.cc:260] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:35.553505  7909 raft_consensus.cc:3060] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.553731  8021 leader_election.cc:304] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0e23fd9887848f08151cb92c9719d1c, c3a92256a04846e8aa4032c63cda2b74; no voters: 
I20260709 13:00:35.554348  7906 raft_consensus.cc:2468] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 2.
I20260709 13:00:35.555416  8229 raft_consensus.cc:697] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [term 4 LEADER]: Becoming Leader. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Running, Role: LEADER
I20260709 13:00:35.554618  8237 raft_consensus.cc:2804] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:35.556457  8229 consensus_queue.cc:237] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:35.557862  8057 leader_election.cc:290] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [CANDIDATE]: Term 2 election: Requested vote from peers 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835), c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925)
I20260709 13:00:35.567919  7909 raft_consensus.cc:2468] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e23fd9887848f08151cb92c9719d1c in term 4.
I20260709 13:00:35.565514  8237 raft_consensus.cc:697] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [term 2 LEADER]: Becoming Leader. State: Replica: c0e23fd9887848f08151cb92c9719d1c, State: Running, Role: LEADER
I20260709 13:00:35.573108  8237 consensus_queue.cc:237] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } }
I20260709 13:00:35.574232  7807 catalog_manager.cc:5697] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c reported cstate change: term changed from 3 to 4, leader changed from 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193) to c0e23fd9887848f08151cb92c9719d1c (127.7.25.195). New cstate: current_term: 4 leader_uuid: "c0e23fd9887848f08151cb92c9719d1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:35.589102  7807 catalog_manager.cc:5697] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 reported cstate change: term changed from 3 to 4, leader changed from 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193) to c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194). New cstate: current_term: 4 leader_uuid: "c3a92256a04846e8aa4032c63cda2b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:35.592036  7804 catalog_manager.cc:5697] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c reported cstate change: term changed from 1 to 2, leader changed from 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193) to c0e23fd9887848f08151cb92c9719d1c (127.7.25.195). New cstate: current_term: 2 leader_uuid: "c0e23fd9887848f08151cb92c9719d1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:35.961956  7983 raft_consensus.cc:1275] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 4 FOLLOWER]: Refusing update from remote peer c0e23fd9887848f08151cb92c9719d1c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:35.963013  8237 consensus_queue.cc:1048] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:35.972651  7909 raft_consensus.cc:1275] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 4 FOLLOWER]: Refusing update from remote peer c0e23fd9887848f08151cb92c9719d1c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:35.974262  8237 consensus_queue.cc:1048] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:35.981307  7909 raft_consensus.cc:1275] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 4 FOLLOWER]: Refusing update from remote peer c3a92256a04846e8aa4032c63cda2b74: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:35.982343  8231 consensus_queue.cc:1048] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:35.989948  8057 raft_consensus.cc:1275] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 4 FOLLOWER]: Refusing update from remote peer c3a92256a04846e8aa4032c63cda2b74: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:35.991173  8232 consensus_queue.cc:1048] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:36.002827  7909 raft_consensus.cc:1275] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 4 FOLLOWER]: Refusing update from remote peer c3a92256a04846e8aa4032c63cda2b74: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:36.003901  8232 consensus_queue.cc:1048] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:36.008534  7983 raft_consensus.cc:1275] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Refusing update from remote peer c0e23fd9887848f08151cb92c9719d1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:36.010092  8237 consensus_queue.cc:1048] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3a92256a04846e8aa4032c63cda2b74" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:36.013396  8057 raft_consensus.cc:1275] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 4 FOLLOWER]: Refusing update from remote peer c3a92256a04846e8aa4032c63cda2b74: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:36.014719  8189 consensus_queue.cc:1048] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e23fd9887848f08151cb92c9719d1c" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 34777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:36.026782  7909 raft_consensus.cc:1275] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Refusing update from remote peer c0e23fd9887848f08151cb92c9719d1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:36.028350  8229 consensus_queue.cc:1048] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37ddb2d1ba0d4c97b81d9f9804b130c8" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 34835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:36.210741  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:36.216854  7271 tablet_server.cc:179] TabletServer@127.7.25.193:0 shutting down...
I20260709 13:00:36.239636  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:36.240520  7271 tablet_replica.cc:333] T f1330727d2c94cca98bada1d0b01ad24 P 37ddb2d1ba0d4c97b81d9f9804b130c8: stopping tablet replica
I20260709 13:00:36.241207  7271 raft_consensus.cc:2243] T f1330727d2c94cca98bada1d0b01ad24 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.241671  7271 raft_consensus.cc:2272] T f1330727d2c94cca98bada1d0b01ad24 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.243448  7271 tablet_replica.cc:333] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8: stopping tablet replica
I20260709 13:00:36.244009  7271 raft_consensus.cc:2243] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.244743  7271 raft_consensus.cc:2272] T 554ffaa6916b461590a35a2317295d11 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.246539  7271 tablet_replica.cc:333] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8: stopping tablet replica
I20260709 13:00:36.247054  7271 raft_consensus.cc:2243] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.247716  7271 raft_consensus.cc:2272] T 111b72e6bd9d4b27b18c4325456efb7f P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.249392  7271 tablet_replica.cc:333] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8: stopping tablet replica
I20260709 13:00:36.249919  7271 raft_consensus.cc:2243] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.250583  7271 raft_consensus.cc:2272] T afb6b567d4804e9e8a4b91e398f5f397 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.252171  7271 tablet_replica.cc:333] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8: stopping tablet replica
I20260709 13:00:36.252637  7271 raft_consensus.cc:2243] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.253012  7271 raft_consensus.cc:2272] T b8b9e47b501f42d99ae6fa8b888ae1b5 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.255265  7271 tablet_replica.cc:333] T 4703ad43d75e489f8aff35739026419e P 37ddb2d1ba0d4c97b81d9f9804b130c8: stopping tablet replica
I20260709 13:00:36.255771  7271 raft_consensus.cc:2243] T 4703ad43d75e489f8aff35739026419e P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.256170  7271 raft_consensus.cc:2272] T 4703ad43d75e489f8aff35739026419e P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.257761  7271 tablet_replica.cc:333] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8: stopping tablet replica
I20260709 13:00:36.258224  7271 raft_consensus.cc:2243] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.258600  7271 raft_consensus.cc:2272] T 0abf7f11b5014b72b4e98b0d646fe426 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.261284  7271 tablet_replica.cc:333] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8: stopping tablet replica
I20260709 13:00:36.261790  7271 raft_consensus.cc:2243] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.262174  7271 raft_consensus.cc:2272] T a35f1257fc174173a9fc519308f1afa8 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.263903  7271 tablet_replica.cc:333] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8: stopping tablet replica
I20260709 13:00:36.264360  7271 raft_consensus.cc:2243] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.265021  7271 raft_consensus.cc:2272] T 9c4f5c50563e43a6b4600dfb7f0fc575 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.266551  7271 tablet_replica.cc:333] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8: stopping tablet replica
I20260709 13:00:36.267004  7271 raft_consensus.cc:2243] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.267373  7271 raft_consensus.cc:2272] T 5ca06f71d27247e1bde39bb8da315c69 P 37ddb2d1ba0d4c97b81d9f9804b130c8 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:36.289613  7950 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.25.193:34835: connect: Connection refused (error 111) [suppressed 34 similar messages]
W20260709 13:00:36.292799  7950 consensus_peers.cc:597] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 -> Peer 37ddb2d1ba0d4c97b81d9f9804b130c8 (127.7.25.193:34835): Couldn't send request to peer 37ddb2d1ba0d4c97b81d9f9804b130c8. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:34835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.296335  7271 tablet_server.cc:196] TabletServer@127.7.25.193:0 shutdown complete.
I20260709 13:00:36.314664  7271 tablet_server.cc:179] TabletServer@127.7.25.194:0 shutting down...
I20260709 13:00:36.338368  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:36.339267  7271 tablet_replica.cc:333] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74: stopping tablet replica
I20260709 13:00:36.339905  7271 raft_consensus.cc:2243] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.340371  7271 raft_consensus.cc:2272] T f1330727d2c94cca98bada1d0b01ad24 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:36.341156  8021 consensus_peers.cc:597] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c -> Peer c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925): Couldn't send request to peer c3a92256a04846e8aa4032c63cda2b74. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.342379  7271 tablet_replica.cc:333] T afb6b567d4804e9e8a4b91e398f5f397 P c3a92256a04846e8aa4032c63cda2b74: stopping tablet replica
I20260709 13:00:36.342934  7271 raft_consensus.cc:2243] T afb6b567d4804e9e8a4b91e398f5f397 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.343358  7271 raft_consensus.cc:2272] T afb6b567d4804e9e8a4b91e398f5f397 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.344961  7271 tablet_replica.cc:333] T 554ffaa6916b461590a35a2317295d11 P c3a92256a04846e8aa4032c63cda2b74: stopping tablet replica
I20260709 13:00:36.345515  7271 raft_consensus.cc:2243] T 554ffaa6916b461590a35a2317295d11 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.345885  7271 raft_consensus.cc:2272] T 554ffaa6916b461590a35a2317295d11 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.347397  7271 tablet_replica.cc:333] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74: stopping tablet replica
I20260709 13:00:36.347872  7271 raft_consensus.cc:2243] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.348541  7271 raft_consensus.cc:2272] T a35f1257fc174173a9fc519308f1afa8 P c3a92256a04846e8aa4032c63cda2b74 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.350440  7271 tablet_replica.cc:333] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74: stopping tablet replica
I20260709 13:00:36.350921  7271 raft_consensus.cc:2243] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.351296  7271 raft_consensus.cc:2272] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c3a92256a04846e8aa4032c63cda2b74 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.352787  7271 tablet_replica.cc:333] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74: stopping tablet replica
I20260709 13:00:36.353322  7271 raft_consensus.cc:2243] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.354034  7271 raft_consensus.cc:2272] T 5ca06f71d27247e1bde39bb8da315c69 P c3a92256a04846e8aa4032c63cda2b74 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.355887  7271 tablet_replica.cc:333] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c3a92256a04846e8aa4032c63cda2b74: stopping tablet replica
I20260709 13:00:36.356392  7271 raft_consensus.cc:2243] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.356781  7271 raft_consensus.cc:2272] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c3a92256a04846e8aa4032c63cda2b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.358690  7271 tablet_replica.cc:333] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74: stopping tablet replica
I20260709 13:00:36.359174  7271 raft_consensus.cc:2243] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.359865  7271 raft_consensus.cc:2272] T 4703ad43d75e489f8aff35739026419e P c3a92256a04846e8aa4032c63cda2b74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.361580  7271 tablet_replica.cc:333] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74: stopping tablet replica
I20260709 13:00:36.362039  7271 raft_consensus.cc:2243] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.362421  7271 raft_consensus.cc:2272] T 111b72e6bd9d4b27b18c4325456efb7f P c3a92256a04846e8aa4032c63cda2b74 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.364423  7271 tablet_replica.cc:333] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74: stopping tablet replica
W20260709 13:00:36.364542  8021 consensus_peers.cc:597] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c -> Peer c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925): Couldn't send request to peer c3a92256a04846e8aa4032c63cda2b74. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.364908  7271 raft_consensus.cc:2243] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.365355  7271 raft_consensus.cc:2272] T 0abf7f11b5014b72b4e98b0d646fe426 P c3a92256a04846e8aa4032c63cda2b74 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.393414  7271 tablet_server.cc:196] TabletServer@127.7.25.194:0 shutdown complete.
W20260709 13:00:36.412294  8021 consensus_peers.cc:597] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c -> Peer c3a92256a04846e8aa4032c63cda2b74 (127.7.25.194:39925): Couldn't send request to peer c3a92256a04846e8aa4032c63cda2b74. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:39925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.414383  7271 tablet_server.cc:179] TabletServer@127.7.25.195:0 shutting down...
I20260709 13:00:36.438066  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:36.438828  7271 tablet_replica.cc:333] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c: stopping tablet replica
I20260709 13:00:36.439592  7271 raft_consensus.cc:2243] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.440335  7271 raft_consensus.cc:2272] T f1330727d2c94cca98bada1d0b01ad24 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.442116  7271 tablet_replica.cc:333] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c: stopping tablet replica
I20260709 13:00:36.442585  7271 raft_consensus.cc:2243] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.442929  7271 raft_consensus.cc:2272] T 111b72e6bd9d4b27b18c4325456efb7f P c0e23fd9887848f08151cb92c9719d1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.444482  7271 tablet_replica.cc:333] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c: stopping tablet replica
I20260709 13:00:36.444934  7271 raft_consensus.cc:2243] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.445375  7271 raft_consensus.cc:2272] T afb6b567d4804e9e8a4b91e398f5f397 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.446900  7271 tablet_replica.cc:333] T 4703ad43d75e489f8aff35739026419e P c0e23fd9887848f08151cb92c9719d1c: stopping tablet replica
I20260709 13:00:36.447324  7271 raft_consensus.cc:2243] T 4703ad43d75e489f8aff35739026419e P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.447695  7271 raft_consensus.cc:2272] T 4703ad43d75e489f8aff35739026419e P c0e23fd9887848f08151cb92c9719d1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.449364  7271 tablet_replica.cc:333] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c: stopping tablet replica
I20260709 13:00:36.449848  7271 raft_consensus.cc:2243] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.450577  7271 raft_consensus.cc:2272] T b8b9e47b501f42d99ae6fa8b888ae1b5 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.453128  7271 tablet_replica.cc:333] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c: stopping tablet replica
I20260709 13:00:36.453676  7271 raft_consensus.cc:2243] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.454097  7271 raft_consensus.cc:2272] T a35f1257fc174173a9fc519308f1afa8 P c0e23fd9887848f08151cb92c9719d1c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.455924  7271 tablet_replica.cc:333] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c: stopping tablet replica
I20260709 13:00:36.456423  7271 raft_consensus.cc:2243] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.456835  7271 raft_consensus.cc:2272] T 554ffaa6916b461590a35a2317295d11 P c0e23fd9887848f08151cb92c9719d1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.458602  7271 tablet_replica.cc:333] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c: stopping tablet replica
I20260709 13:00:36.459067  7271 raft_consensus.cc:2243] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.459767  7271 raft_consensus.cc:2272] T 0abf7f11b5014b72b4e98b0d646fe426 P c0e23fd9887848f08151cb92c9719d1c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.461648  7271 tablet_replica.cc:333] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c: stopping tablet replica
I20260709 13:00:36.462108  7271 raft_consensus.cc:2243] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.462517  7271 raft_consensus.cc:2272] T 9c4f5c50563e43a6b4600dfb7f0fc575 P c0e23fd9887848f08151cb92c9719d1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.463971  7271 tablet_replica.cc:333] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c: stopping tablet replica
I20260709 13:00:36.464398  7271 raft_consensus.cc:2243] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:36.464780  7271 raft_consensus.cc:2272] T 5ca06f71d27247e1bde39bb8da315c69 P c0e23fd9887848f08151cb92c9719d1c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.491492  7271 tablet_server.cc:196] TabletServer@127.7.25.195:0 shutdown complete.
I20260709 13:00:36.508766  7271 master.cc:562] Master@127.7.25.254:34173 shutting down...
I20260709 13:00:36.528004  7271 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:36.528476  7271 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:36.528765  7271 tablet_replica.cc:333] T 00000000000000000000000000000000 P 47f2322cd4204fe6baa1bd4fd61fe4dd: stopping tablet replica
I20260709 13:00:36.547508  7271 master.cc:584] Master@127.7.25.254:34173 shutdown complete.
37ddb2d1ba0d4c97b81d9f9804b130c8  5
c0e23fd9887848f08151cb92c9719d1c  1
c3a92256a04846e8aa4032c63cda2b74  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10290 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:00:36.588698  7271 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.25.254:44471
I20260709 13:00:36.589833  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:36.595114  8259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:36.595184  8260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:36.596825  8262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:36.597543  7271 server_base.cc:1061] running on GCE node
I20260709 13:00:36.598410  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:36.598626  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:36.598802  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602036598770 us; error 0 us; skew 500 ppm
I20260709 13:00:36.599370  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:36.601827  7271 webserver.cc:533] Webserver started at http://127.7.25.254:41669/ using document root <none> and password file <none>
I20260709 13:00:36.602363  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:36.602550  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:36.602839  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:36.603933  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/master-0-root/instance:
uuid: "3a492d68031a44b1b0b286d8ce68436c"
format_stamp: "Formatted at 2026-07-09 13:00:36 on dist-test-slave-z1zn"
I20260709 13:00:36.608100  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:00:36.611393  8267 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:36.612129  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:00:36.612412  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/master-0-root
uuid: "3a492d68031a44b1b0b286d8ce68436c"
format_stamp: "Formatted at 2026-07-09 13:00:36 on dist-test-slave-z1zn"
I20260709 13:00:36.612699  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:36.634303  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:36.635564  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:36.672591  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.254:44471
I20260709 13:00:36.672683  8318 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.254:44471 every 8 connection(s)
I20260709 13:00:36.676468  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:36.687600  8319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c: Bootstrap starting.
I20260709 13:00:36.692201  8319 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:36.696365  8319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c: No bootstrap required, opened a new log
I20260709 13:00:36.698508  8319 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a492d68031a44b1b0b286d8ce68436c" member_type: VOTER }
I20260709 13:00:36.698926  8319 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:36.699167  8319 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a492d68031a44b1b0b286d8ce68436c, State: Initialized, Role: FOLLOWER
I20260709 13:00:36.699790  8319 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a492d68031a44b1b0b286d8ce68436c" member_type: VOTER }
I20260709 13:00:36.700256  8319 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:00:36.700488  8319 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:00:36.700755  8319 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:36.705758  8319 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a492d68031a44b1b0b286d8ce68436c" member_type: VOTER }
I20260709 13:00:36.706312  8319 leader_election.cc:304] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a492d68031a44b1b0b286d8ce68436c; no voters: 
I20260709 13:00:36.707463  8319 leader_election.cc:290] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:00:36.707803  8322 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:36.709192  8322 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c [term 1 LEADER]: Becoming Leader. State: Replica: 3a492d68031a44b1b0b286d8ce68436c, State: Running, Role: LEADER
I20260709 13:00:36.709888  8322 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a492d68031a44b1b0b286d8ce68436c" member_type: VOTER }
I20260709 13:00:36.710448  8319 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:00:36.714736  8324 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a492d68031a44b1b0b286d8ce68436c. Latest consensus state: current_term: 1 leader_uuid: "3a492d68031a44b1b0b286d8ce68436c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a492d68031a44b1b0b286d8ce68436c" member_type: VOTER } }
I20260709 13:00:36.715512  8324 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:36.716076  8323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a492d68031a44b1b0b286d8ce68436c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a492d68031a44b1b0b286d8ce68436c" member_type: VOTER } }
I20260709 13:00:36.716670  8323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:36.717710  8330 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:00:36.722364  8330 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:00:36.730042  7271 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:00:36.730839  8330 catalog_manager.cc:1383] Generated new cluster ID: 1cb03edea42f4ee7b5dbcdb1463c703d
I20260709 13:00:36.731122  8330 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:00:36.744446  8330 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:00:36.745687  8330 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:00:36.764787  8330 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c: Generated new TSK 0
I20260709 13:00:36.765525  8330 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:00:36.796142  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:36.802374  8340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:36.803638  8341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:36.805691  8343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:36.807193  7271 server_base.cc:1061] running on GCE node
I20260709 13:00:36.809545  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:36.809733  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:36.809957  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602036809920 us; error 0 us; skew 500 ppm
I20260709 13:00:36.810523  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:36.813198  7271 webserver.cc:533] Webserver started at http://127.7.25.193:36299/ using document root <none> and password file <none>
I20260709 13:00:36.813686  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:36.813915  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:36.814277  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:36.815340  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-0-root/instance:
uuid: "d653e71832b7402b9a03b46249d3b885"
format_stamp: "Formatted at 2026-07-09 13:00:36 on dist-test-slave-z1zn"
I20260709 13:00:36.819947  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:00:36.823181  8348 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:36.824016  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:00:36.824275  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-0-root
uuid: "d653e71832b7402b9a03b46249d3b885"
format_stamp: "Formatted at 2026-07-09 13:00:36 on dist-test-slave-z1zn"
I20260709 13:00:36.824512  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:36.848153  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:36.849397  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:36.850754  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:36.852903  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:36.853153  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:00:36.853402  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:36.853572  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:36.893138  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.193:43631
I20260709 13:00:36.893321  8410 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.193:43631 every 8 connection(s)
I20260709 13:00:36.897930  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:36.905406  8415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:36.906147  8416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:36.909726  8418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:36.909837  7271 server_base.cc:1061] running on GCE node
I20260709 13:00:36.911406  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:36.911613  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:36.911738  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602036911727 us; error 0 us; skew 500 ppm
I20260709 13:00:36.912298  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:36.914796  7271 webserver.cc:533] Webserver started at http://127.7.25.194:43895/ using document root <none> and password file <none>
I20260709 13:00:36.915395  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:36.915643  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:36.915974  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:36.917493  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-1-root/instance:
uuid: "105d6581548546b98eddd4ee7083bb12"
format_stamp: "Formatted at 2026-07-09 13:00:36 on dist-test-slave-z1zn"
I20260709 13:00:36.919162  8411 heartbeater.cc:344] Connected to a master server at 127.7.25.254:44471
I20260709 13:00:36.919586  8411 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:36.920473  8411 heartbeater.cc:507] Master 127.7.25.254:44471 requested a full tablet report, sending...
I20260709 13:00:36.922796  8284 ts_manager.cc:194] Registered new tserver with Master: d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631)
I20260709 13:00:36.923105  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:00:36.925374  8284 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53484
I20260709 13:00:36.927680  8423 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:36.928427  7271 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:00:36.928721  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-1-root
uuid: "105d6581548546b98eddd4ee7083bb12"
format_stamp: "Formatted at 2026-07-09 13:00:36 on dist-test-slave-z1zn"
I20260709 13:00:36.929013  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:36.949009  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:36.950276  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:36.951683  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:36.953939  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:36.954164  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:36.954411  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:36.954582  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:36.993021  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.194:36925
I20260709 13:00:36.993177  8485 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.194:36925 every 8 connection(s)
I20260709 13:00:36.997946  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:37.005262  8489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:37.007723  8490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:37.009770  8492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:37.011601  7271 server_base.cc:1061] running on GCE node
I20260709 13:00:37.012400  8486 heartbeater.cc:344] Connected to a master server at 127.7.25.254:44471
I20260709 13:00:37.012566  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:00:37.012758  8486 heartbeater.cc:461] Registering TS with master...
W20260709 13:00:37.012866  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:37.013196  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602037013176 us; error 0 us; skew 500 ppm
I20260709 13:00:37.013748  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:37.013702  8486 heartbeater.cc:507] Master 127.7.25.254:44471 requested a full tablet report, sending...
I20260709 13:00:37.015959  8284 ts_manager.cc:194] Registered new tserver with Master: 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:37.016510  7271 webserver.cc:533] Webserver started at http://127.7.25.195:38039/ using document root <none> and password file <none>
I20260709 13:00:37.017004  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:37.017266  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:37.017536  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:37.017558  8284 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53486
I20260709 13:00:37.018945  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-2-root/instance:
uuid: "b8eb0ad4490645598004d862412f4e31"
format_stamp: "Formatted at 2026-07-09 13:00:37 on dist-test-slave-z1zn"
I20260709 13:00:37.023219  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:00:37.026430  8497 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:37.027175  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:00:37.027462  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-2-root
uuid: "b8eb0ad4490645598004d862412f4e31"
format_stamp: "Formatted at 2026-07-09 13:00:37 on dist-test-slave-z1zn"
I20260709 13:00:37.027743  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:37.040053  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:37.041290  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:37.042729  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:37.044898  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:37.045179  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:00:37.045429  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:37.045617  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:37.083742  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.195:40767
I20260709 13:00:37.083845  8559 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.195:40767 every 8 connection(s)
I20260709 13:00:37.100693  8560 heartbeater.cc:344] Connected to a master server at 127.7.25.254:44471
I20260709 13:00:37.101123  8560 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:37.101824  8560 heartbeater.cc:507] Master 127.7.25.254:44471 requested a full tablet report, sending...
I20260709 13:00:37.104158  8284 ts_manager.cc:194] Registered new tserver with Master: b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:37.104264  7271 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017505584s
I20260709 13:00:37.105984  8284 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53494
I20260709 13:00:37.132293  8284 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53496:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:00:37.138170  8284 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:00:37.340484  8451 tablet_service.cc:1511] Processing CreateTablet for tablet de8d0dfcd55e4b03b9a131362bf19085 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:37.342011  8451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de8d0dfcd55e4b03b9a131362bf19085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.342144  8450 tablet_service.cc:1511] Processing CreateTablet for tablet 911fa6f4e14f47f6a76fff18a00cd58e (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:37.343392  8450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911fa6f4e14f47f6a76fff18a00cd58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.344121  8376 tablet_service.cc:1511] Processing CreateTablet for tablet de8d0dfcd55e4b03b9a131362bf19085 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:37.345474  8376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de8d0dfcd55e4b03b9a131362bf19085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.348237  8375 tablet_service.cc:1511] Processing CreateTablet for tablet 911fa6f4e14f47f6a76fff18a00cd58e (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:37.349637  8375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911fa6f4e14f47f6a76fff18a00cd58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.349334  8449 tablet_service.cc:1511] Processing CreateTablet for tablet d9cb2781af004accaffe494aebc4c13c (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:37.350054  8521 tablet_service.cc:1511] Processing CreateTablet for tablet a457c771b2be434bb71c63fe617485e1 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:37.350301  8448 tablet_service.cc:1511] Processing CreateTablet for tablet 1f865794cdc54a73bac275a71cb2034c (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:37.350747  8449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9cb2781af004accaffe494aebc4c13c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.351405  8521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a457c771b2be434bb71c63fe617485e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.351600  8448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f865794cdc54a73bac275a71cb2034c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.354347  8522 tablet_service.cc:1511] Processing CreateTablet for tablet 1f865794cdc54a73bac275a71cb2034c (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:37.355731  8522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f865794cdc54a73bac275a71cb2034c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.358355  8447 tablet_service.cc:1511] Processing CreateTablet for tablet a457c771b2be434bb71c63fe617485e1 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:37.359949  8447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a457c771b2be434bb71c63fe617485e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.360359  8524 tablet_service.cc:1511] Processing CreateTablet for tablet 911fa6f4e14f47f6a76fff18a00cd58e (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:37.358340  8523 tablet_service.cc:1511] Processing CreateTablet for tablet d9cb2781af004accaffe494aebc4c13c (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:37.361696  8524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911fa6f4e14f47f6a76fff18a00cd58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.365429  8523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9cb2781af004accaffe494aebc4c13c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.366701  8372 tablet_service.cc:1511] Processing CreateTablet for tablet a457c771b2be434bb71c63fe617485e1 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:37.367079  8525 tablet_service.cc:1511] Processing CreateTablet for tablet de8d0dfcd55e4b03b9a131362bf19085 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:37.368076  8372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a457c771b2be434bb71c63fe617485e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.368407  8525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de8d0dfcd55e4b03b9a131362bf19085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.370071  8374 tablet_service.cc:1511] Processing CreateTablet for tablet d9cb2781af004accaffe494aebc4c13c (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:37.371666  8374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9cb2781af004accaffe494aebc4c13c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.374115  8371 tablet_service.cc:1511] Processing CreateTablet for tablet e63b8dc23aaf4956bbebb9f2fa7268cd (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:37.375785  8371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63b8dc23aaf4956bbebb9f2fa7268cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.378123  8373 tablet_service.cc:1511] Processing CreateTablet for tablet 1f865794cdc54a73bac275a71cb2034c (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:37.379786  8373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f865794cdc54a73bac275a71cb2034c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.390838  8446 tablet_service.cc:1511] Processing CreateTablet for tablet e63b8dc23aaf4956bbebb9f2fa7268cd (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:37.392244  8446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63b8dc23aaf4956bbebb9f2fa7268cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.392063  8520 tablet_service.cc:1511] Processing CreateTablet for tablet e63b8dc23aaf4956bbebb9f2fa7268cd (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:37.393486  8520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63b8dc23aaf4956bbebb9f2fa7268cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.395401  8370 tablet_service.cc:1511] Processing CreateTablet for tablet 7142cc29d84f4204bd97e07c0f6f6a84 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:37.396062  8445 tablet_service.cc:1511] Processing CreateTablet for tablet 7142cc29d84f4204bd97e07c0f6f6a84 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:37.396845  8370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7142cc29d84f4204bd97e07c0f6f6a84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.397444  8445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7142cc29d84f4204bd97e07c0f6f6a84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.402392  8519 tablet_service.cc:1511] Processing CreateTablet for tablet 7142cc29d84f4204bd97e07c0f6f6a84 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:37.403858  8519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7142cc29d84f4204bd97e07c0f6f6a84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.408223  8369 tablet_service.cc:1511] Processing CreateTablet for tablet aa98ca5e34b24545adab36c2973a2f6e (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:37.409657  8369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa98ca5e34b24545adab36c2973a2f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.410737  8518 tablet_service.cc:1511] Processing CreateTablet for tablet aa98ca5e34b24545adab36c2973a2f6e (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:37.412144  8518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa98ca5e34b24545adab36c2973a2f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.415867  8444 tablet_service.cc:1511] Processing CreateTablet for tablet aa98ca5e34b24545adab36c2973a2f6e (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:37.419349  8444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa98ca5e34b24545adab36c2973a2f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.426229  8376 tablet_service.cc:1511] Processing CreateTablet for tablet 5f40fa9720bd41db92cb895437b29f60 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:37.440918  8443 tablet_service.cc:1511] Processing CreateTablet for tablet 5f40fa9720bd41db92cb895437b29f60 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:37.442332  8443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f40fa9720bd41db92cb895437b29f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.447494  8517 tablet_service.cc:1511] Processing CreateTablet for tablet 5f40fa9720bd41db92cb895437b29f60 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:37.448881  8517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f40fa9720bd41db92cb895437b29f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.438323  8376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f40fa9720bd41db92cb895437b29f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.464395  8368 tablet_service.cc:1511] Processing CreateTablet for tablet 28d98f2932e74257b6a032b544f7b4bd (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:37.465786  8368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d98f2932e74257b6a032b544f7b4bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.484714  8367 tablet_service.cc:1511] Processing CreateTablet for tablet 18bf9e256e3046b497483817dac46e78 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:37.486284  8367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18bf9e256e3046b497483817dac46e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.494024  8448 tablet_service.cc:1511] Processing CreateTablet for tablet 28d98f2932e74257b6a032b544f7b4bd (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:37.495358  8448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d98f2932e74257b6a032b544f7b4bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.517597  8372 tablet_service.cc:1511] Processing CreateTablet for tablet 866f457c2bf048109ab977c2b010de5a (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:37.519160  8372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866f457c2bf048109ab977c2b010de5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.519515  8446 tablet_service.cc:1511] Processing CreateTablet for tablet 866f457c2bf048109ab977c2b010de5a (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:37.520807  8446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866f457c2bf048109ab977c2b010de5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.521548  8523 tablet_service.cc:1511] Processing CreateTablet for tablet 28d98f2932e74257b6a032b544f7b4bd (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:37.522867  8523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d98f2932e74257b6a032b544f7b4bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.529393  8369 tablet_service.cc:1511] Processing CreateTablet for tablet 94c2a7ffe57c4521a141ed4b370b82f6 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:37.530645  8369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94c2a7ffe57c4521a141ed4b370b82f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.545914  8576 tablet_bootstrap.cc:492] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:37.549597  8577 tablet_bootstrap.cc:492] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:37.549304  8443 tablet_service.cc:1511] Processing CreateTablet for tablet 18bf9e256e3046b497483817dac46e78 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:37.550665  8575 tablet_bootstrap.cc:492] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:37.553344  8524 tablet_service.cc:1511] Processing CreateTablet for tablet 18bf9e256e3046b497483817dac46e78 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:37.554751  8524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18bf9e256e3046b497483817dac46e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.556337  8577 tablet_bootstrap.cc:654] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:37.556169  8445 tablet_service.cc:1511] Processing CreateTablet for tablet 94c2a7ffe57c4521a141ed4b370b82f6 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:37.559422  8444 tablet_service.cc:1511] Processing CreateTablet for tablet 564c455d9a5b45a4ac479c57433dcb89 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:37.561416  8525 tablet_service.cc:1511] Processing CreateTablet for tablet 564c455d9a5b45a4ac479c57433dcb89 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:37.550693  8443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18bf9e256e3046b497483817dac46e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.562603  8576 tablet_bootstrap.cc:654] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:37.562711  8525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 564c455d9a5b45a4ac479c57433dcb89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.566105  8517 tablet_service.cc:1511] Processing CreateTablet for tablet 94c2a7ffe57c4521a141ed4b370b82f6 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:37.567011  8445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94c2a7ffe57c4521a141ed4b370b82f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.567320  8517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94c2a7ffe57c4521a141ed4b370b82f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.567873  8444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 564c455d9a5b45a4ac479c57433dcb89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.567881  8577 tablet_bootstrap.cc:492] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:37.569113  8577 ts_tablet_manager.cc:1403] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.007s
I20260709 13:00:37.558288  8368 tablet_service.cc:1511] Processing CreateTablet for tablet 564c455d9a5b45a4ac479c57433dcb89 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:37.570940  8368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 564c455d9a5b45a4ac479c57433dcb89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.569123  8522 tablet_service.cc:1511] Processing CreateTablet for tablet 866f457c2bf048109ab977c2b010de5a (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:37.572358  8522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866f457c2bf048109ab977c2b010de5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.573753  8376 tablet_service.cc:1511] Processing CreateTablet for tablet 82a5ca9d87124561a0ec4d39bdfdf577 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:37.575280  8448 tablet_service.cc:1511] Processing CreateTablet for tablet 82a5ca9d87124561a0ec4d39bdfdf577 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:37.576905  8448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a5ca9d87124561a0ec4d39bdfdf577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.582449  8523 tablet_service.cc:1511] Processing CreateTablet for tablet 82a5ca9d87124561a0ec4d39bdfdf577 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:37.583583  8576 tablet_bootstrap.cc:492] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:37.583667  8523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a5ca9d87124561a0ec4d39bdfdf577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.584117  8576 ts_tablet_manager.cc:1403] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.006s
I20260709 13:00:37.587023  8576 raft_consensus.cc:359] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:37.587713  8576 raft_consensus.cc:385] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:37.588012  8576 raft_consensus.cc:740] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:37.588268  8575 tablet_bootstrap.cc:654] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:37.588985  8577 raft_consensus.cc:359] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:37.589715  8577 raft_consensus.cc:385] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:37.590020  8577 raft_consensus.cc:740] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:37.590803  8577 consensus_queue.cc:260] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:37.575258  8376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a5ca9d87124561a0ec4d39bdfdf577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.598170  8560 heartbeater.cc:499] Master 127.7.25.254:44471 was elected leader, sending a full tablet report...
I20260709 13:00:37.600402  8369 tablet_service.cc:1511] Processing CreateTablet for tablet aee63d7055b1430b8d1edea205bc40f0 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:37.601785  8369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee63d7055b1430b8d1edea205bc40f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.602947  8520 tablet_service.cc:1511] Processing CreateTablet for tablet aee63d7055b1430b8d1edea205bc40f0 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:37.604177  8520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee63d7055b1430b8d1edea205bc40f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.606514  8446 tablet_service.cc:1511] Processing CreateTablet for tablet aee63d7055b1430b8d1edea205bc40f0 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:37.607702  8446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee63d7055b1430b8d1edea205bc40f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.613369  8576 consensus_queue.cc:260] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:37.615849  8372 tablet_service.cc:1511] Processing CreateTablet for tablet 26eda7bdc3194871b01c986d3db7cccf (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:37.615801  8577 ts_tablet_manager.cc:1434] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:00:37.622159  8577 tablet_bootstrap.cc:492] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:37.626132  8372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26eda7bdc3194871b01c986d3db7cccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.626982  8450 tablet_service.cc:1511] Processing CreateTablet for tablet 26eda7bdc3194871b01c986d3db7cccf (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:37.628226  8450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26eda7bdc3194871b01c986d3db7cccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.631646  8577 tablet_bootstrap.cc:654] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:37.632952  8521 tablet_service.cc:1511] Processing CreateTablet for tablet 26eda7bdc3194871b01c986d3db7cccf (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:37.634328  8521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26eda7bdc3194871b01c986d3db7cccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.650189  8411 heartbeater.cc:499] Master 127.7.25.254:44471 was elected leader, sending a full tablet report...
I20260709 13:00:37.650750  8576 ts_tablet_manager.cc:1434] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.010s
I20260709 13:00:37.652370  8576 tablet_bootstrap.cc:492] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:37.655511  8369 tablet_service.cc:1511] Processing CreateTablet for tablet ba1839dfeba648529deb101072b3ca8c (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:37.656785  8369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1839dfeba648529deb101072b3ca8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.663574  8449 tablet_service.cc:1511] Processing CreateTablet for tablet ba1839dfeba648529deb101072b3ca8c (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:37.664882  8449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1839dfeba648529deb101072b3ca8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.669332  8576 tablet_bootstrap.cc:654] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:37.672344  8522 tablet_service.cc:1511] Processing CreateTablet for tablet ba1839dfeba648529deb101072b3ca8c (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:37.674600  8373 tablet_service.cc:1511] Processing CreateTablet for tablet da34f43baf6c442b83da63228cfeb9a2 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:37.675885  8373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da34f43baf6c442b83da63228cfeb9a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.679287  8443 tablet_service.cc:1511] Processing CreateTablet for tablet da34f43baf6c442b83da63228cfeb9a2 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:37.680639  8443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da34f43baf6c442b83da63228cfeb9a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.681173  8522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1839dfeba648529deb101072b3ca8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.686038  8575 tablet_bootstrap.cc:492] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:37.686530  8575 ts_tablet_manager.cc:1403] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.136s	user 0.008s	sys 0.006s
I20260709 13:00:37.689574  8575 raft_consensus.cc:359] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:37.690315  8575 raft_consensus.cc:385] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:37.690642  8575 raft_consensus.cc:740] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:37.693387  8575 consensus_queue.cc:260] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:37.693797  8524 tablet_service.cc:1511] Processing CreateTablet for tablet da34f43baf6c442b83da63228cfeb9a2 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:37.695261  8524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da34f43baf6c442b83da63228cfeb9a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.704144  8376 tablet_service.cc:1511] Processing CreateTablet for tablet 8897541fb7574f928493aa8e97a58f2f (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:37.705513  8376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8897541fb7574f928493aa8e97a58f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.706449  8577 tablet_bootstrap.cc:492] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:37.706924  8577 ts_tablet_manager.cc:1403] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.002s
I20260709 13:00:37.713115  8446 tablet_service.cc:1511] Processing CreateTablet for tablet 8897541fb7574f928493aa8e97a58f2f (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:37.713619  8517 tablet_service.cc:1511] Processing CreateTablet for tablet 8897541fb7574f928493aa8e97a58f2f (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:37.715080  8517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8897541fb7574f928493aa8e97a58f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.716688  8446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8897541fb7574f928493aa8e97a58f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.717762  8368 tablet_service.cc:1511] Processing CreateTablet for tablet 6427ce7790bd4629985d340936d6f356 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:37.719033  8368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6427ce7790bd4629985d340936d6f356. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:37.724797  8332 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:37.725505  8581 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.725986  8581 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:37.728475  8581 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:37.743600  8577 raft_consensus.cc:359] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:37.744683  8577 raft_consensus.cc:385] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:37.753984  8449 tablet_service.cc:1511] Processing CreateTablet for tablet 6427ce7790bd4629985d340936d6f356 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:37.755344  8449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6427ce7790bd4629985d340936d6f356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.745064  8577 raft_consensus.cc:740] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:37.758291  8577 consensus_queue.cc:260] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:37.760525  8577 ts_tablet_manager.cc:1434] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:00:37.767271  8517 tablet_service.cc:1511] Processing CreateTablet for tablet 6427ce7790bd4629985d340936d6f356 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:37.769059  8517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6427ce7790bd4629985d340936d6f356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.782015  8577 tablet_bootstrap.cc:492] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:37.801491  8520 tablet_service.cc:1511] Processing CreateTablet for tablet 1663cf9302e8495c8762465d306cb479 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:37.802301  8576 tablet_bootstrap.cc:492] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:37.803597  8449 tablet_service.cc:1511] Processing CreateTablet for tablet 1663cf9302e8495c8762465d306cb479 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:37.802855  8520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1663cf9302e8495c8762465d306cb479. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.802829  8576 ts_tablet_manager.cc:1403] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.151s	user 0.012s	sys 0.011s
I20260709 13:00:37.807212  8486 heartbeater.cc:499] Master 127.7.25.254:44471 was elected leader, sending a full tablet report...
I20260709 13:00:37.809880  8576 raft_consensus.cc:359] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:00:37.814778  8521 tablet_service.cc:1511] Processing CreateTablet for tablet 25a125e8035444f5921cc2a7eef152ae (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:37.815347  8443 tablet_service.cc:1511] Processing CreateTablet for tablet 25a125e8035444f5921cc2a7eef152ae (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:37.816113  8521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25a125e8035444f5921cc2a7eef152ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.816543  8443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25a125e8035444f5921cc2a7eef152ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.826462  8369 tablet_service.cc:1511] Processing CreateTablet for tablet 67513665d04b44c292143601e7f66ac8 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:37.826812  8446 tablet_service.cc:1511] Processing CreateTablet for tablet 67513665d04b44c292143601e7f66ac8 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:37.827762  8369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67513665d04b44c292143601e7f66ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.828066  8446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67513665d04b44c292143601e7f66ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.829262  8376 tablet_service.cc:1511] Processing CreateTablet for tablet 25a125e8035444f5921cc2a7eef152ae (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:37.830433  8450 tablet_service.cc:1511] Processing CreateTablet for tablet 848cbd6ceda8400e9d2f1d58cbbdcb7b (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:37.832546  8450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 848cbd6ceda8400e9d2f1d58cbbdcb7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.830830  8525 tablet_service.cc:1511] Processing CreateTablet for tablet 67513665d04b44c292143601e7f66ac8 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:37.812451  8576 raft_consensus.cc:385] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:37.838073  8576 raft_consensus.cc:740] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:37.838631  8525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67513665d04b44c292143601e7f66ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.839038  8576 consensus_queue.cc:260] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:00:37.846242  8575 ts_tablet_manager.cc:1434] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.159s	user 0.011s	sys 0.011s
I20260709 13:00:37.847414  8575 tablet_bootstrap.cc:492] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:37.852494  8376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25a125e8035444f5921cc2a7eef152ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.853941  8444 tablet_service.cc:1511] Processing CreateTablet for tablet c2aa75e5347f4ba5a20776a3b619eb68 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:37.854941  8368 tablet_service.cc:1511] Processing CreateTablet for tablet 1663cf9302e8495c8762465d306cb479 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:37.856178  8368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1663cf9302e8495c8762465d306cb479. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.858004  8524 tablet_service.cc:1511] Processing CreateTablet for tablet 848cbd6ceda8400e9d2f1d58cbbdcb7b (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:37.859254  8524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 848cbd6ceda8400e9d2f1d58cbbdcb7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.848570  8449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1663cf9302e8495c8762465d306cb479. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.873672  8444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2aa75e5347f4ba5a20776a3b619eb68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.876462  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:37.876515  8373 tablet_service.cc:1511] Processing CreateTablet for tablet c2aa75e5347f4ba5a20776a3b619eb68 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:37.877964  8373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2aa75e5347f4ba5a20776a3b619eb68. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:37.878207  8351 leader_election.cc:343] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:37.878770  8577 tablet_bootstrap.cc:654] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:37.882409  8576 ts_tablet_manager.cc:1434] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.000s
I20260709 13:00:37.883461  8576 tablet_bootstrap.cc:492] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:37.895277  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:00:37.896946  8349 leader_election.cc:343] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:37.897455  8349 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:37.898590  8581 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:37.900573  8585 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.901034  8585 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:37.901496  8580 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.901734  8376 tablet_service.cc:1511] Processing CreateTablet for tablet 848cbd6ceda8400e9d2f1d58cbbdcb7b (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:37.901980  8580 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:37.903138  8376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 848cbd6ceda8400e9d2f1d58cbbdcb7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.904397  8580 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:37.906499  8585 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:37.933732  8522 tablet_service.cc:1511] Processing CreateTablet for tablet 4f60cb7236fe439e9faa6d4f269e96da (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:00:37.935642  8522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f60cb7236fe439e9faa6d4f269e96da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.946784  8525 tablet_service.cc:1511] Processing CreateTablet for tablet c2aa75e5347f4ba5a20776a3b619eb68 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:37.948522  8525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2aa75e5347f4ba5a20776a3b619eb68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.959484  8576 tablet_bootstrap.cc:654] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:37.970404  8520 tablet_service.cc:1511] Processing CreateTablet for tablet a6565bc3f96a474988bd4e41a01fa3be (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:00:37.971697  8520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6565bc3f96a474988bd4e41a01fa3be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.977954  8580 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.978453  8580 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:37.980432  8580 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:37.986253  8575 tablet_bootstrap.cc:654] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:37.986935  8521 tablet_service.cc:1511] Processing CreateTablet for tablet e83390ed01194281aab5dc3a33f49783 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:00:37.988617  8521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e83390ed01194281aab5dc3a33f49783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.998517  8450 tablet_service.cc:1511] Processing CreateTablet for tablet 4f60cb7236fe439e9faa6d4f269e96da (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:00:38.000440  8450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f60cb7236fe439e9faa6d4f269e96da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.011104  8443 tablet_service.cc:1511] Processing CreateTablet for tablet a6565bc3f96a474988bd4e41a01fa3be (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:00:38.013147  8443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6565bc3f96a474988bd4e41a01fa3be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.023581  8524 tablet_service.cc:1511] Processing CreateTablet for tablet f8ce47d03b224808b5f7f17c341a5293 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:38.024300  8577 tablet_bootstrap.cc:492] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:38.027345  8577 ts_tablet_manager.cc:1403] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.258s	user 0.022s	sys 0.016s
I20260709 13:00:38.027498  8524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8ce47d03b224808b5f7f17c341a5293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.030781  8577 raft_consensus.cc:359] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.031509  8577 raft_consensus.cc:385] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.031790  8577 raft_consensus.cc:740] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.033892  8444 tablet_service.cc:1511] Processing CreateTablet for tablet e83390ed01194281aab5dc3a33f49783 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:00:38.035197  8444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e83390ed01194281aab5dc3a33f49783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.038221  8445 tablet_service.cc:1511] Processing CreateTablet for tablet f8ce47d03b224808b5f7f17c341a5293 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:38.039552  8445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8ce47d03b224808b5f7f17c341a5293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.032652  8577 consensus_queue.cc:260] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.040977  8372 tablet_service.cc:1511] Processing CreateTablet for tablet f8ce47d03b224808b5f7f17c341a5293 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:38.042335  8372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8ce47d03b224808b5f7f17c341a5293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.042768  8368 tablet_service.cc:1511] Processing CreateTablet for tablet a6565bc3f96a474988bd4e41a01fa3be (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:00:38.044081  8368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6565bc3f96a474988bd4e41a01fa3be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.046221  8369 tablet_service.cc:1511] Processing CreateTablet for tablet e83390ed01194281aab5dc3a33f49783 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:00:38.047817  8369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e83390ed01194281aab5dc3a33f49783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.048007  8577 ts_tablet_manager.cc:1434] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:00:38.051829  8576 tablet_bootstrap.cc:492] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:38.052484  8576 ts_tablet_manager.cc:1403] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.169s	user 0.019s	sys 0.038s
I20260709 13:00:38.053304  8373 tablet_service.cc:1511] Processing CreateTablet for tablet 4f60cb7236fe439e9faa6d4f269e96da (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:00:38.054828  8373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f60cb7236fe439e9faa6d4f269e96da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.117499  8448 tablet_service.cc:1511] Processing CreateTablet for tablet dc2c20c2ffc24a6cb95e8c2fe8a8c025 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:38.119405  8448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2c20c2ffc24a6cb95e8c2fe8a8c025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.125723  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:00:38.128115  8424 leader_election.cc:343] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.162065  8580 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.162781  8580 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.208148  8577 tablet_bootstrap.cc:492] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:38.212841  8576 raft_consensus.cc:359] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.213613  8576 raft_consensus.cc:385] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.213943  8576 raft_consensus.cc:740] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.215060  8576 consensus_queue.cc:260] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.215564  8580 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:38.217487  8576 ts_tablet_manager.cc:1434] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.165s	user 0.034s	sys 0.044s
I20260709 13:00:38.218544  8576 tablet_bootstrap.cc:492] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:38.224814  8576 tablet_bootstrap.cc:654] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.232760  8577 tablet_bootstrap.cc:654] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.236733  8575 tablet_bootstrap.cc:492] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:38.237589  8581 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.238078  8581 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:00:38.241714  8581 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:38.242362  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:00:38.244504  8349 leader_election.cc:343] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.244674  8522 tablet_service.cc:1511] Processing CreateTablet for tablet dc2c20c2ffc24a6cb95e8c2fe8a8c025 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:38.246016  8522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2c20c2ffc24a6cb95e8c2fe8a8c025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.251818  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:38.253273  8575 ts_tablet_manager.cc:1403] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.406s	user 0.012s	sys 0.009s
W20260709 13:00:38.253827  8427 leader_election.cc:343] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.254302  8427 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:38.255427  8585 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:38.244969  8270 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 118844us
I20260709 13:00:38.257313  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:38.259335  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:38.259917  8386 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:38.261727  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:38.263134  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:38.263101  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:38.263929  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:00:38.265964  8500 leader_election.cc:343] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:38.266611  8500 leader_election.cc:343] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.266523  8446 tablet_service.cc:1511] Processing CreateTablet for tablet e27bb2ddbf1e4b7daa5333a909bbaf31 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 13:00:38.267268  8500 leader_election.cc:343] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.267813  8446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27bb2ddbf1e4b7daa5333a909bbaf31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.268399  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:00:38.269479  8351 leader_election.cc:343] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.269538  8521 tablet_service.cc:1511] Processing CreateTablet for tablet e27bb2ddbf1e4b7daa5333a909bbaf31 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:00:38.270057  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:38.270852  8521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27bb2ddbf1e4b7daa5333a909bbaf31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.275210  8517 tablet_service.cc:1511] Processing CreateTablet for tablet bf76dc240f6a432d80b0c04f50f2d9b6 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:00:38.279100  8443 tablet_service.cc:1511] Processing CreateTablet for tablet bf76dc240f6a432d80b0c04f50f2d9b6 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:00:38.281665  8581 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:38.282550  8443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf76dc240f6a432d80b0c04f50f2d9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.240612  8376 tablet_service.cc:1511] Processing CreateTablet for tablet dc2c20c2ffc24a6cb95e8c2fe8a8c025 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:38.284844  8370 tablet_service.cc:1511] Processing CreateTablet for tablet e27bb2ddbf1e4b7daa5333a909bbaf31 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:00:38.286610  8370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27bb2ddbf1e4b7daa5333a909bbaf31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.287432  8576 tablet_bootstrap.cc:492] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:38.287900  8576 ts_tablet_manager.cc:1403] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.070s	user 0.009s	sys 0.007s
I20260709 13:00:38.290243  8517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf76dc240f6a432d80b0c04f50f2d9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.294996  8576 raft_consensus.cc:359] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.295727  8576 raft_consensus.cc:385] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.296041  8576 raft_consensus.cc:740] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.298137  8367 tablet_service.cc:1511] Processing CreateTablet for tablet bf76dc240f6a432d80b0c04f50f2d9b6 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:00:38.300002  8501 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:38.300859  8580 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:38.301297  8580 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.301656  8580 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:38.301960  8501 leader_election.cc:343] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.302382  8501 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:38.297003  8376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2c20c2ffc24a6cb95e8c2fe8a8c025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.308266  8580 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.256918  8575 raft_consensus.cc:359] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.309305  8575 raft_consensus.cc:385] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.309681  8575 raft_consensus.cc:740] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.313512  8367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf76dc240f6a432d80b0c04f50f2d9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.313017  8580 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:38.322945  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:38.311362  8575 consensus_queue.cc:260] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:38.324362  8500 leader_election.cc:343] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.325819  8575 ts_tablet_manager.cc:1434] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.072s	user 0.003s	sys 0.005s
I20260709 13:00:38.326774  8575 tablet_bootstrap.cc:492] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:38.335569  8575 tablet_bootstrap.cc:654] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.321557  8580 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:38.347728  8368 tablet_service.cc:1511] Processing CreateTablet for tablet 4923120e1f194cdabb09a6bc8feeba88 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:00:38.348239  8448 tablet_service.cc:1511] Processing CreateTablet for tablet 4923120e1f194cdabb09a6bc8feeba88 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:00:38.349731  8448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4923120e1f194cdabb09a6bc8feeba88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.296718  8576 consensus_queue.cc:260] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:38.356887  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 54962us
W20260709 13:00:38.358099  8501 leader_election.cc:343] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.358531  8501 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:38.359584  8580 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:38.359822  8371 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd574dc2f1347e8996cdb77177d1a54 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:00:38.362149  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:38.362704  8386 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.365736  8524 tablet_service.cc:1511] Processing CreateTablet for tablet 4923120e1f194cdabb09a6bc8feeba88 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:00:38.367070  8524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4923120e1f194cdabb09a6bc8feeba88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.375859  8368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4923120e1f194cdabb09a6bc8feeba88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.379158  8371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd574dc2f1347e8996cdb77177d1a54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.381804  8577 tablet_bootstrap.cc:492] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:38.382506  8577 ts_tablet_manager.cc:1403] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.333s	user 0.041s	sys 0.036s
I20260709 13:00:38.396232  8443 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd574dc2f1347e8996cdb77177d1a54 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:00:38.398196  8443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd574dc2f1347e8996cdb77177d1a54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.400600  8581 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.401255  8581 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.402129  8386 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:38.403366  8581 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:38.403795  8501 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:38.405109  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:38.405628  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:38.406234  8461 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
W20260709 13:00:38.406726  8349 leader_election.cc:343] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.406651  8577 raft_consensus.cc:359] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.407472  8577 raft_consensus.cc:385] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.407518  8351 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:38.407876  8577 raft_consensus.cc:740] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.408776  8581 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:38.409265  8581 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.409605  8581 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.410881  8575 tablet_bootstrap.cc:492] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:38.411371  8575 ts_tablet_manager.cc:1403] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.004s
I20260709 13:00:38.412096  8599 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:38.413323  8599 raft_consensus.cc:697] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:00:38.417287  8268 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 46645.8us
I20260709 13:00:38.414206  8599 consensus_queue.cc:237] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.425688  8581 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.428685  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:38.430284  8461 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.432621  8521 tablet_service.cc:1511] Processing CreateTablet for tablet 30e70dfc88914a66b000a84bef302149 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:38.433518  8369 tablet_service.cc:1511] Processing CreateTablet for tablet 56cc480ba6f642e08bb2e547a0ef50a1 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:38.434310  8443 tablet_service.cc:1511] Processing CreateTablet for tablet 30e70dfc88914a66b000a84bef302149 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:38.434844  8369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56cc480ba6f642e08bb2e547a0ef50a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.435544  8443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e70dfc88914a66b000a84bef302149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.436148  8284 catalog_manager.cc:5697] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.429345  8576 ts_tablet_manager.cc:1434] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.141s	user 0.007s	sys 0.003s
I20260709 13:00:38.433957  8521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e70dfc88914a66b000a84bef302149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.446233  8576 tablet_bootstrap.cc:492] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:38.448616  8445 tablet_service.cc:1511] Processing CreateTablet for tablet 56cc480ba6f642e08bb2e547a0ef50a1 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:38.450019  8445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56cc480ba6f642e08bb2e547a0ef50a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.450363  8461 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:38.451084  8370 tablet_service.cc:1511] Processing CreateTablet for tablet a6ecd063b1dc49a69b15eb593af51b89 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:38.452374  8370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ecd063b1dc49a69b15eb593af51b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.454617  8525 tablet_service.cc:1511] Processing CreateTablet for tablet 56cc480ba6f642e08bb2e547a0ef50a1 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:38.408730  8577 consensus_queue.cc:260] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.455909  8525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56cc480ba6f642e08bb2e547a0ef50a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.457406  8351 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:38.460318  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:38.468323  8444 tablet_service.cc:1511] Processing CreateTablet for tablet a6ecd063b1dc49a69b15eb593af51b89 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:38.414505  8575 raft_consensus.cc:359] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:00:38.469165  8575 raft_consensus.cc:385] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.473214  8575 raft_consensus.cc:740] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.478257  8450 tablet_service.cc:1511] Processing CreateTablet for tablet 21f53ea2cc904a72ae2c12832985b519 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:00:38.478860  8575 consensus_queue.cc:260] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:00:38.429509  8372 tablet_service.cc:1511] Processing CreateTablet for tablet 30e70dfc88914a66b000a84bef302149 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:38.480957  8372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e70dfc88914a66b000a84bef302149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.485863  8520 tablet_service.cc:1511] Processing CreateTablet for tablet 21f53ea2cc904a72ae2c12832985b519 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:00:38.487265  8520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21f53ea2cc904a72ae2c12832985b519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.489198  8575 ts_tablet_manager.cc:1434] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.001s
I20260709 13:00:38.463392  8517 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd574dc2f1347e8996cdb77177d1a54 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
W20260709 13:00:38.469538  8349 leader_election.cc:343] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.460829  8581 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:38.469669  8444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ecd063b1dc49a69b15eb593af51b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.472883  8522 tablet_service.cc:1511] Processing CreateTablet for tablet a6ecd063b1dc49a69b15eb593af51b89 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:38.497769  8581 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:38.502061  8581 raft_consensus.cc:697] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:38.503221  8450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21f53ea2cc904a72ae2c12832985b519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.502897  8581 consensus_queue.cc:237] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.501442  8367 tablet_service.cc:1511] Processing CreateTablet for tablet 21f53ea2cc904a72ae2c12832985b519 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:00:38.508174  8367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21f53ea2cc904a72ae2c12832985b519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.498520  8517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd574dc2f1347e8996cdb77177d1a54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.517863  8522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ecd063b1dc49a69b15eb593af51b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.497167  8575 tablet_bootstrap.cc:492] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:38.514377  8282 catalog_manager.cc:5697] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 0 to 1, leader changed from <none> to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:38.477970  8577 ts_tablet_manager.cc:1434] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.095s	user 0.013s	sys 0.000s
I20260709 13:00:38.524098  8577 tablet_bootstrap.cc:492] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:38.524832  8575 tablet_bootstrap.cc:654] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.464746  8576 tablet_bootstrap.cc:654] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.530526  8577 tablet_bootstrap.cc:654] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.531925  8371 tablet_service.cc:1511] Processing CreateTablet for tablet eedf264cd691413dbd2eec9e2b133ddf (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:38.561163  8371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eedf264cd691413dbd2eec9e2b133ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.536255  8445 tablet_service.cc:1511] Processing CreateTablet for tablet eedf264cd691413dbd2eec9e2b133ddf (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:38.566107  8445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eedf264cd691413dbd2eec9e2b133ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.544257  8525 tablet_service.cc:1511] Processing CreateTablet for tablet eedf264cd691413dbd2eec9e2b133ddf (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:38.570012  8525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eedf264cd691413dbd2eec9e2b133ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.550125  8370 tablet_service.cc:1511] Processing CreateTablet for tablet dc1ae2a0b869453e80401c580552e127 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:38.551080  8448 tablet_service.cc:1511] Processing CreateTablet for tablet dc1ae2a0b869453e80401c580552e127 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:38.556010  8369 tablet_service.cc:1511] Processing CreateTablet for tablet 9c3c85d53de1420dab74923e2fc80f02 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:38.557221  8517 tablet_service.cc:1511] Processing CreateTablet for tablet dc1ae2a0b869453e80401c580552e127 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:38.582129  8517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc1ae2a0b869453e80401c580552e127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.573853  8370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc1ae2a0b869453e80401c580552e127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.573853  8448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc1ae2a0b869453e80401c580552e127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.586004  8450 tablet_service.cc:1511] Processing CreateTablet for tablet 9c3c85d53de1420dab74923e2fc80f02 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:38.593180  8520 tablet_service.cc:1511] Processing CreateTablet for tablet 9c3c85d53de1420dab74923e2fc80f02 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:38.606540  8450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c3c85d53de1420dab74923e2fc80f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.611902  8585 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.617008  8369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c3c85d53de1420dab74923e2fc80f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.621919  8585 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:00:38.624121  8585 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:38.624850  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:38.625224  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:38.625530  8386 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
W20260709 13:00:38.626662  8424 leader_election.cc:343] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.627239  8427 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:38.627571  8445 tablet_service.cc:1511] Processing CreateTablet for tablet c80796a5190345179ad066af334e5bae (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:38.628350  8585 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:38.628778  8585 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.629226  8585 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.625721  8576 tablet_bootstrap.cc:492] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:38.634202  8576 ts_tablet_manager.cc:1403] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.188s	user 0.009s	sys 0.015s
I20260709 13:00:38.635201  8577 tablet_bootstrap.cc:492] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:38.635900  8599 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.636349  8599 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.637182  8576 raft_consensus.cc:359] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.637873  8576 raft_consensus.cc:385] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.638161  8576 raft_consensus.cc:740] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.638435  8599 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:38.638989  8576 consensus_queue.cc:260] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.640129  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:38.616827  8520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c3c85d53de1420dab74923e2fc80f02. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:38.641695  8500 leader_election.cc:343] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.642853  8577 ts_tablet_manager.cc:1403] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.006s
I20260709 13:00:38.644145  8576 ts_tablet_manager.cc:1434] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:00:38.645205  8576 tablet_bootstrap.cc:492] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:38.647094  8577 raft_consensus.cc:359] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.651008  8577 raft_consensus.cc:385] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.651419  8577 raft_consensus.cc:740] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.651679  8576 tablet_bootstrap.cc:654] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.652444  8577 consensus_queue.cc:260] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.628876  8445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c80796a5190345179ad066af334e5bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.650218  8585 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:00:38.656490  8522 tablet_service.cc:1511] Processing CreateTablet for tablet c80796a5190345179ad066af334e5bae (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:38.658115  8369 tablet_service.cc:1511] Processing CreateTablet for tablet c80796a5190345179ad066af334e5bae (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:38.659080  8369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c80796a5190345179ad066af334e5bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.660614  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:00:38.661923  8501 leader_election.cc:343] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.662350  8501 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:38.663224  8599 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:38.666072  8577 ts_tablet_manager.cc:1434] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:00:38.667709  8577 tablet_bootstrap.cc:492] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:38.668711  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:38.669325  8585 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:38.669255  8370 tablet_service.cc:1511] Processing CreateTablet for tablet da501bdc0de7404f9ecae9db442353dc (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:00:38.670064  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:38.670974  8370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da501bdc0de7404f9ecae9db442353dc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:38.671463  8424 leader_election.cc:343] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.669330  8386 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.677470  8444 tablet_service.cc:1511] Processing CreateTablet for tablet da501bdc0de7404f9ecae9db442353dc (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:00:38.677975  8524 tablet_service.cc:1511] Processing CreateTablet for tablet da501bdc0de7404f9ecae9db442353dc (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:00:38.678830  8444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da501bdc0de7404f9ecae9db442353dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.682390  8443 tablet_service.cc:1511] Processing CreateTablet for tablet 1a4fc34dde1d4b269abf3c59d18630ec (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:00:38.683472  8443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a4fc34dde1d4b269abf3c59d18630ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.683643  8521 tablet_service.cc:1511] Processing CreateTablet for tablet 1a4fc34dde1d4b269abf3c59d18630ec (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:00:38.686515  8446 tablet_service.cc:1511] Processing CreateTablet for tablet 4269b37b5f3540ba9fcfd6d23ad240b6 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:38.687719  8446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4269b37b5f3540ba9fcfd6d23ad240b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.689643  8525 tablet_service.cc:1511] Processing CreateTablet for tablet 4269b37b5f3540ba9fcfd6d23ad240b6 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:38.694573  8575 tablet_bootstrap.cc:492] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:38.675568  8522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c80796a5190345179ad066af334e5bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.695502  8575 ts_tablet_manager.cc:1403] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.199s	user 0.018s	sys 0.001s
I20260709 13:00:38.699728  8575 raft_consensus.cc:359] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.700439  8575 raft_consensus.cc:385] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.700744  8575 raft_consensus.cc:740] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.701376  8521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a4fc34dde1d4b269abf3c59d18630ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.703145  8577 tablet_bootstrap.cc:654] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.705359  8524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da501bdc0de7404f9ecae9db442353dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.705680  8575 consensus_queue.cc:260] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.713901  8368 tablet_service.cc:1511] Processing CreateTablet for tablet 4269b37b5f3540ba9fcfd6d23ad240b6 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:38.715189  8368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4269b37b5f3540ba9fcfd6d23ad240b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.718566  8575 ts_tablet_manager.cc:1434] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:00:38.719655  8575 tablet_bootstrap.cc:492] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:38.709544  8525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4269b37b5f3540ba9fcfd6d23ad240b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.695829  8386 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:38.711743  8371 tablet_service.cc:1511] Processing CreateTablet for tablet 1a4fc34dde1d4b269abf3c59d18630ec (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:00:38.722669  8371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a4fc34dde1d4b269abf3c59d18630ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.722754  8427 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:38.724309  8585 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:00:38.727422  8332 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:38.713405  8576 tablet_bootstrap.cc:492] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:38.733543  8576 ts_tablet_manager.cc:1403] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.000s
I20260709 13:00:38.739181  8369 tablet_service.cc:1511] Processing CreateTablet for tablet edca272c646743e09fb3b0c827c963b8 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:38.740396  8369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edca272c646743e09fb3b0c827c963b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.742995  8576 raft_consensus.cc:359] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.743757  8576 raft_consensus.cc:385] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.744052  8576 raft_consensus.cc:740] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.744850  8576 consensus_queue.cc:260] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.749704  8517 tablet_service.cc:1511] Processing CreateTablet for tablet edca272c646743e09fb3b0c827c963b8 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:38.750391  8367 tablet_service.cc:1511] Processing CreateTablet for tablet 455c5d2786974d92a3ee8b825edcfaa7 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:00:38.751070  8517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edca272c646743e09fb3b0c827c963b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.751631  8367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 455c5d2786974d92a3ee8b825edcfaa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.757858  8443 tablet_service.cc:1511] Processing CreateTablet for tablet edca272c646743e09fb3b0c827c963b8 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:38.759119  8443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edca272c646743e09fb3b0c827c963b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.761106  8575 tablet_bootstrap.cc:654] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.761312  8585 raft_consensus.cc:697] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:38.769232  8585 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:00:38.772181  8445 tablet_service.cc:1511] Processing CreateTablet for tablet 455c5d2786974d92a3ee8b825edcfaa7 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:00:38.773547  8445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 455c5d2786974d92a3ee8b825edcfaa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.775297  8577 tablet_bootstrap.cc:492] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:38.775959  8577 ts_tablet_manager.cc:1403] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.108s	user 0.007s	sys 0.006s
I20260709 13:00:38.780105  8577 raft_consensus.cc:359] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.781170  8521 tablet_service.cc:1511] Processing CreateTablet for tablet 455c5d2786974d92a3ee8b825edcfaa7 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:00:38.781383  8370 tablet_service.cc:1511] Processing CreateTablet for tablet 74f6762ba0124b3a87dd4d54f5693927 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:00:38.782488  8521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 455c5d2786974d92a3ee8b825edcfaa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.782590  8370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f6762ba0124b3a87dd4d54f5693927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.780895  8577 raft_consensus.cc:385] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.789357  8577 raft_consensus.cc:740] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.790896  8576 ts_tablet_manager.cc:1434] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 13:00:38.792052  8576 tablet_bootstrap.cc:492] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:38.798600  8284 catalog_manager.cc:5697] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.800324  8577 consensus_queue.cc:260] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.812201  8581 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.813297  8446 tablet_service.cc:1511] Processing CreateTablet for tablet 74f6762ba0124b3a87dd4d54f5693927 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:00:38.812736  8581 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.815828  8581 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:38.816933  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:38.817391  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:38.817570  8461 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:38.817982  8446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f6762ba0124b3a87dd4d54f5693927. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:38.818810  8349 leader_election.cc:343] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.819365  8351 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:38.820171  8521 tablet_service.cc:1511] Processing CreateTablet for tablet 74f6762ba0124b3a87dd4d54f5693927 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:00:38.820516  8581 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:38.821031  8581 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.821363  8521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f6762ba0124b3a87dd4d54f5693927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.821511  8581 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.823494  8370 tablet_service.cc:1511] Processing CreateTablet for tablet 513b83e2d61c4ad7994ad4629a3d0079 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:38.824986  8577 ts_tablet_manager.cc:1434] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.003s
I20260709 13:00:38.830565  8370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 513b83e2d61c4ad7994ad4629a3d0079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.832114  8443 tablet_service.cc:1511] Processing CreateTablet for tablet 513b83e2d61c4ad7994ad4629a3d0079 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:38.833225  8443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 513b83e2d61c4ad7994ad4629a3d0079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.835556  8367 tablet_service.cc:1511] Processing CreateTablet for tablet fd3ca20a5e4646d3b164329f7abcf44a (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:00:38.836666  8577 tablet_bootstrap.cc:492] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:38.836838  8367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd3ca20a5e4646d3b164329f7abcf44a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.820955  8576 tablet_bootstrap.cc:654] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.843436  8450 tablet_service.cc:1511] Processing CreateTablet for tablet fd3ca20a5e4646d3b164329f7abcf44a (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:00:38.844760  8450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd3ca20a5e4646d3b164329f7abcf44a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.844847  8599 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:38.846649  8604 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.847097  8604 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.849293  8604 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:38.850597  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:38.850952  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:38.851536  8535 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
W20260709 13:00:38.851992  8351 leader_election.cc:343] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.848676  8517 tablet_service.cc:1511] Processing CreateTablet for tablet fd3ca20a5e4646d3b164329f7abcf44a (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:00:38.853245  8517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd3ca20a5e4646d3b164329f7abcf44a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.853693  8444 tablet_service.cc:1511] Processing CreateTablet for tablet 4ef8cc956c764eeeb9389ea099a35006 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:00:38.854961  8444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef8cc956c764eeeb9389ea099a35006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.855535  8524 tablet_service.cc:1511] Processing CreateTablet for tablet 4ef8cc956c764eeeb9389ea099a35006 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:00:38.856813  8524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef8cc956c764eeeb9389ea099a35006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.856709  8368 tablet_service.cc:1511] Processing CreateTablet for tablet b3aa2530ec1a42c890e68f3e67582ca0 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:38.857156  8585 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.858014  8368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3aa2530ec1a42c890e68f3e67582ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.857865  8349 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:38.859375  8604 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:38.859875  8604 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.860380  8604 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.861294  8369 tablet_service.cc:1511] Processing CreateTablet for tablet 4ef8cc956c764eeeb9389ea099a35006 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:00:38.857637  8585 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.862406  8369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef8cc956c764eeeb9389ea099a35006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.863643  8585 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:38.865423  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:38.865331  8525 tablet_service.cc:1511] Processing CreateTablet for tablet 513b83e2d61c4ad7994ad4629a3d0079 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:38.866684  8525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 513b83e2d61c4ad7994ad4629a3d0079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.868249  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:38.869820  8424 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:38.870960  8585 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:38.880803  8577 tablet_bootstrap.cc:654] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.882364  8445 tablet_service.cc:1511] Processing CreateTablet for tablet b3aa2530ec1a42c890e68f3e67582ca0 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:38.886181  8604 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.907485  8444 tablet_service.cc:1511] Processing CreateTablet for tablet 612cbe4a26f4473aaa8e3c84a7719e03 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:38.908229  8445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3aa2530ec1a42c890e68f3e67582ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.908829  8444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 612cbe4a26f4473aaa8e3c84a7719e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.909195  8604 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:38.829123  8581 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.911108  8581 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:38.888975  8575 tablet_bootstrap.cc:492] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:38.912091  8576 tablet_bootstrap.cc:492] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:38.912503  8575 ts_tablet_manager.cc:1403] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.193s	user 0.029s	sys 0.006s
I20260709 13:00:38.912568  8576 ts_tablet_manager.cc:1403] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.121s	user 0.007s	sys 0.007s
I20260709 13:00:38.915637  8575 raft_consensus.cc:359] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.916404  8575 raft_consensus.cc:385] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.916720  8575 raft_consensus.cc:740] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.892447  8521 tablet_service.cc:1511] Processing CreateTablet for tablet b3aa2530ec1a42c890e68f3e67582ca0 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:38.918756  8521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3aa2530ec1a42c890e68f3e67582ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.921582  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:38.922163  8535 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.922974  8576 raft_consensus.cc:359] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.923686  8576 raft_consensus.cc:385] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:38.923954  8576 raft_consensus.cc:740] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:38.924575  8576 consensus_queue.cc:260] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.925283  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:38.894757  8371 tablet_service.cc:1511] Processing CreateTablet for tablet 37c1890dcc8947c89b8c213326526c75 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:38.926971  8371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c1890dcc8947c89b8c213326526c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.895733  8461 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.934373  8576 ts_tablet_manager.cc:1434] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:00:38.935923  8522 tablet_service.cc:1511] Processing CreateTablet for tablet 9e1d32431b1c45ebad1160a850495e16 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:00:38.937358  8522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e1d32431b1c45ebad1160a850495e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.937597  8575 consensus_queue.cc:260] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.939148  8576 tablet_bootstrap.cc:492] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:38.899626  8443 tablet_service.cc:1511] Processing CreateTablet for tablet 37c1890dcc8947c89b8c213326526c75 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:38.941756  8443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c1890dcc8947c89b8c213326526c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.946031  8520 tablet_service.cc:1511] Processing CreateTablet for tablet cf1cdd90debd40a6a2361af7491977d6 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:38.947263  8520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1cdd90debd40a6a2361af7491977d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.947357  8575 ts_tablet_manager.cc:1434] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:00:38.901257  8524 tablet_service.cc:1511] Processing CreateTablet for tablet 37c1890dcc8947c89b8c213326526c75 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:38.949743  8524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c1890dcc8947c89b8c213326526c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.906000  8368 tablet_service.cc:1511] Processing CreateTablet for tablet 612cbe4a26f4473aaa8e3c84a7719e03 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:38.953735  8368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 612cbe4a26f4473aaa8e3c84a7719e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.954846  8575 tablet_bootstrap.cc:492] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:38.906363  8525 tablet_service.cc:1511] Processing CreateTablet for tablet 612cbe4a26f4473aaa8e3c84a7719e03 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:38.957818  8525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 612cbe4a26f4473aaa8e3c84a7719e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.936683  8517 tablet_service.cc:1511] Processing CreateTablet for tablet 45d39340781e466abc648aacd7ee5822 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:00:38.961071  8575 tablet_bootstrap.cc:654] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:38.963737  8369 tablet_service.cc:1511] Processing CreateTablet for tablet 9e1d32431b1c45ebad1160a850495e16 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:00:38.965319  8372 tablet_service.cc:1511] Processing CreateTablet for tablet cf1cdd90debd40a6a2361af7491977d6 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:38.991349  8369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e1d32431b1c45ebad1160a850495e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.964711  8373 tablet_service.cc:1511] Processing CreateTablet for tablet 5b3df375d584465c8712d996256828cf (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:00:38.990854  8450 tablet_service.cc:1511] Processing CreateTablet for tablet 9e1d32431b1c45ebad1160a850495e16 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:00:38.992341  8373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b3df375d584465c8712d996256828cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.965616  8585 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.992583  8450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e1d32431b1c45ebad1160a850495e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.992938  8585 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:38.995869  8372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1cdd90debd40a6a2361af7491977d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.996027  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:38.996404  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:38.997128  8533 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
W20260709 13:00:38.997568  8427 leader_election.cc:343] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.998409  8424 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:38.999465  8613 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:38.999847  8613 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.000187  8613 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.003408  8585 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:38.966322  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:38.966645  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:00:39.005728  8351 leader_election.cc:343] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.972298  8448 tablet_service.cc:1511] Processing CreateTablet for tablet 5b3df375d584465c8712d996256828cf (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:00:38.976558  8523 tablet_service.cc:1511] Processing CreateTablet for tablet 5b3df375d584465c8712d996256828cf (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:00:39.007898  8448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b3df375d584465c8712d996256828cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.964064  8376 tablet_service.cc:1511] Processing CreateTablet for tablet 45d39340781e466abc648aacd7ee5822 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 13:00:38.970518  8349 leader_election.cc:343] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:38.971645  8534 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:38.970682  8444 tablet_service.cc:1511] Processing CreateTablet for tablet cf1cdd90debd40a6a2361af7491977d6 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:39.009526  8376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d39340781e466abc648aacd7ee5822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:39.005730  8459 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.016479  8444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1cdd90debd40a6a2361af7491977d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.970391  8446 tablet_service.cc:1511] Processing CreateTablet for tablet 45d39340781e466abc648aacd7ee5822 (DEFAULT_TABLE table=test-workload [id=0997156cc4e34396a3ae068cffc60d9c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:00:39.023728  8446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d39340781e466abc648aacd7ee5822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:38.966179  8576 tablet_bootstrap.cc:654] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.027827  8581 consensus_queue.cc:1048] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:39.040392  8459 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:38.973449  8517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d39340781e466abc648aacd7ee5822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:39.049247  8599 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.101541  8575 tablet_bootstrap.cc:492] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:39.107420  8575 ts_tablet_manager.cc:1403] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.153s	user 0.021s	sys 0.016s
I20260709 13:00:39.110562  8575 raft_consensus.cc:359] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.111280  8575 raft_consensus.cc:385] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.111589  8575 raft_consensus.cc:740] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.112278  8575 consensus_queue.cc:260] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.114845  8575 ts_tablet_manager.cc:1434] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:39.115893  8575 tablet_bootstrap.cc:492] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:39.122381  8575 tablet_bootstrap.cc:654] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.122475  8535 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:39.124300  8349 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:39.125842  8581 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:39.126451  8581 raft_consensus.cc:697] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:39.127509  8581 consensus_queue.cc:237] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.102171  8523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b3df375d584465c8712d996256828cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:39.106582  8599 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.146164  8599 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:39.147603  8351 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:39.149150  8604 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:39.152984  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:39.153877  8385 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:39.155215  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:39.102973  8613 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.172552  8501 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:39.176035  8576 tablet_bootstrap.cc:492] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:39.176492  8576 ts_tablet_manager.cc:1403] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.238s	user 0.008s	sys 0.005s
I20260709 13:00:39.178622  8625 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.179097  8625 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.183072  8577 tablet_bootstrap.cc:492] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:39.183670  8577 ts_tablet_manager.cc:1403] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.347s	user 0.028s	sys 0.049s
I20260709 13:00:39.188576  8625 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:39.188738  8613 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:39.179103  8576 raft_consensus.cc:359] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.189927  8576 raft_consensus.cc:385] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.190261  8576 raft_consensus.cc:740] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.189498  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:39.192488  8599 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:39.192723  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:39.192902  8599 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.193338  8534 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:39.194590  8427 leader_election.cc:343] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:39.195684  8576 consensus_queue.cc:260] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.197934  8625 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:00:39.200495  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:39.194051  8599 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.206615  8618 consensus_queue.cc:1048] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:00:39.207931  8500 leader_election.cc:343] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:39.208745  8577 raft_consensus.cc:359] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:00:39.209513  8577 raft_consensus.cc:385] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.209812  8577 raft_consensus.cc:740] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.211005  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:39.214076  8534 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:39.218024  8501 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:39.218485  8424 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:39.224184  8585 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:39.198164  8604 raft_consensus.cc:697] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:39.234076  8621 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:39.233901  8604 consensus_queue.cc:237] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.236224  8575 tablet_bootstrap.cc:492] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:39.238019  8576 ts_tablet_manager.cc:1434] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.061s	user 0.010s	sys 0.021s
I20260709 13:00:39.238847  8576 tablet_bootstrap.cc:492] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
W20260709 13:00:39.241544  8424 consensus_peers.cc:597] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 -> Peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Couldn't send request to peer b8eb0ad4490645598004d862412f4e31. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:39.226641  8577 consensus_queue.cc:260] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:00:39.246528  8577 ts_tablet_manager.cc:1434] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.000s
I20260709 13:00:39.247305  8577 tablet_bootstrap.cc:492] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:39.237917  8575 ts_tablet_manager.cc:1403] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.122s	user 0.034s	sys 0.025s
I20260709 13:00:39.251928  8575 raft_consensus.cc:359] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.254714  8599 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.256719  8284 catalog_manager.cc:5697] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 0 to 1, leader changed from <none> to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:39.262261  8576 tablet_bootstrap.cc:654] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.267943  8577 tablet_bootstrap.cc:654] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.267809  8585 raft_consensus.cc:697] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:39.258953  8575 raft_consensus.cc:385] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.274204  8575 raft_consensus.cc:740] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.276822  8599 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:39.277920  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:39.278846  8386 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.278175  8585 consensus_queue.cc:237] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.278050  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:39.289920  8386 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:39.291553  8501 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:39.275709  8575 consensus_queue.cc:260] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.293565  8621 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:39.293834  8460 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.296337  8621 raft_consensus.cc:697] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:39.298120  8621 consensus_queue.cc:237] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.300804  8282 catalog_manager.cc:5697] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 0 to 1, leader changed from <none> to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:39.302984  8575 ts_tablet_manager.cc:1434] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.001s
I20260709 13:00:39.305667  8284 catalog_manager.cc:5697] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:39.306933  8575 tablet_bootstrap.cc:492] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:39.313102  8604 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.304829  8460 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:39.313616  8604 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.318341  8636 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:00:39.325690  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:39.326301  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:00:39.326958  8351 leader_election.cc:343] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:39.322345  8575 tablet_bootstrap.cc:654] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:39.327898  8349 leader_election.cc:343] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:39.328320  8349 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:39.329130  8581 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:39.329216  8604 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:39.331781  8576 tablet_bootstrap.cc:492] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:39.332231  8576 ts_tablet_manager.cc:1403] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.094s	user 0.009s	sys 0.003s
I20260709 13:00:39.334391  8576 raft_consensus.cc:359] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.333899  8283 catalog_manager.cc:5697] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:39.334892  8576 raft_consensus.cc:385] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.335253  8576 raft_consensus.cc:740] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.335861  8576 consensus_queue.cc:260] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.324847  8577 tablet_bootstrap.cc:492] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:39.337419  8577 ts_tablet_manager.cc:1403] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.090s	user 0.008s	sys 0.011s
I20260709 13:00:39.337759  8576 ts_tablet_manager.cc:1434] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:00:39.338624  8576 tablet_bootstrap.cc:492] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:39.340054  8577 raft_consensus.cc:359] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.340934  8577 raft_consensus.cc:385] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.341275  8577 raft_consensus.cc:740] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.344384  8576 tablet_bootstrap.cc:654] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.345208  8604 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.345750  8604 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.346302  8577 consensus_queue.cc:260] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.351163  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:39.351924  8534 raft_consensus.cc:2393] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 1: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:00:39.352092  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:39.354332  8351 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:39.354842  8577 ts_tablet_manager.cc:1434] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:00:39.355263  8581 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.355816  8577 tablet_bootstrap.cc:492] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:39.356494  8575 tablet_bootstrap.cc:492] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:39.356926  8575 ts_tablet_manager.cc:1403] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 13:00:39.359937  8575 raft_consensus.cc:359] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.360580  8575 raft_consensus.cc:385] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.360817  8575 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.361712  8577 tablet_bootstrap.cc:654] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.352262  8604 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:39.363504  8575 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.365556  8581 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:39.367666  8575 ts_tablet_manager.cc:1434] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:00:39.368727  8575 tablet_bootstrap.cc:492] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:39.376788  8575 tablet_bootstrap.cc:654] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.383826  8577 tablet_bootstrap.cc:492] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:39.384529  8577 ts_tablet_manager.cc:1403] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.012s
I20260709 13:00:39.388530  8577 raft_consensus.cc:359] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.389573  8577 raft_consensus.cc:385] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.389993  8577 raft_consensus.cc:740] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.391142  8577 consensus_queue.cc:260] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.393512  8576 tablet_bootstrap.cc:492] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:39.393985  8576 ts_tablet_manager.cc:1403] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.018s
I20260709 13:00:39.396231  8576 raft_consensus.cc:359] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.396601  8575 tablet_bootstrap.cc:492] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:39.396715  8576 raft_consensus.cc:385] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.397001  8576 raft_consensus.cc:740] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.397200  8575 ts_tablet_manager.cc:1403] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.011s
I20260709 13:00:39.397704  8576 consensus_queue.cc:260] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.398721  8577 ts_tablet_manager.cc:1434] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:00:39.399711  8577 tablet_bootstrap.cc:492] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:39.399878  8575 raft_consensus.cc:359] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.400533  8575 raft_consensus.cc:385] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.400805  8575 raft_consensus.cc:740] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.401576  8575 consensus_queue.cc:260] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.404227  8576 ts_tablet_manager.cc:1434] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:00:39.405220  8576 tablet_bootstrap.cc:492] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:39.410207  8577 tablet_bootstrap.cc:654] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.411170  8576 tablet_bootstrap.cc:654] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.411739  8575 ts_tablet_manager.cc:1434] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:00:39.422175  8575 tablet_bootstrap.cc:492] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:39.422183  8576 tablet_bootstrap.cc:492] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:39.422693  8577 tablet_bootstrap.cc:492] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:39.422780  8576 ts_tablet_manager.cc:1403] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 13:00:39.423162  8577 ts_tablet_manager.cc:1403] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.001s
I20260709 13:00:39.424855  8576 raft_consensus.cc:359] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.425470  8576 raft_consensus.cc:385] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.425690  8576 raft_consensus.cc:740] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.425731  8577 raft_consensus.cc:359] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.426483  8577 raft_consensus.cc:385] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.426419  8576 consensus_queue.cc:260] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.426806  8577 raft_consensus.cc:740] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.427532  8581 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.427625  8577 consensus_queue.cc:260] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.428274  8575 tablet_bootstrap.cc:654] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.428057  8581 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.429174  8576 ts_tablet_manager.cc:1434] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:00:39.430032  8576 tablet_bootstrap.cc:492] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:39.430162  8581 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:39.434674  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:39.435286  8460 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:39.435781  8576 tablet_bootstrap.cc:654] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.439644  8577 ts_tablet_manager.cc:1434] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:00:39.442284  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:39.443162  8534 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:39.444593  8585 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.445075  8585 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.445425  8351 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:39.446617  8604 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:39.447080  8604 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.447232  8585 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:39.447564  8604 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.448938  8577 tablet_bootstrap.cc:492] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:39.449605  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:00:39.451066  8427 leader_election.cc:343] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:39.451907  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:39.452589  8534 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:39.453725  8424 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:39.454841  8585 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:39.455268  8577 tablet_bootstrap.cc:654] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.455205  8585 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.455775  8585 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.460984  8604 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.464968  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:39.465919  8460 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.467525  8575 tablet_bootstrap.cc:492] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:39.468125  8575 ts_tablet_manager.cc:1403] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.005s
I20260709 13:00:39.464844  8585 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.472599  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:00:39.474515  8427 leader_election.cc:343] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:39.477219  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:39.478022  8534 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.479259  8575 raft_consensus.cc:359] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.480185  8575 raft_consensus.cc:385] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.480515  8575 raft_consensus.cc:740] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.481213  8585 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:39.481654  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:39.482461  8535 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.482788  8575 consensus_queue.cc:260] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.485394  8575 ts_tablet_manager.cc:1434] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 13:00:39.488428  8577 tablet_bootstrap.cc:492] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:39.488883  8577 ts_tablet_manager.cc:1403] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.015s
I20260709 13:00:39.491533  8577 raft_consensus.cc:359] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.492157  8577 raft_consensus.cc:385] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.492420  8577 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.493158  8577 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.497400  8534 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:39.500475  8575 tablet_bootstrap.cc:492] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:39.500939  8604 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:39.502192  8577 ts_tablet_manager.cc:1434] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.002s
I20260709 13:00:39.502139  8460 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:39.502986  8535 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:39.505306  8577 tablet_bootstrap.cc:492] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:39.504187  8349 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:39.506139  8424 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:39.506749  8604 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:39.507261  8585 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:39.507742  8585 raft_consensus.cc:697] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:39.508025  8604 raft_consensus.cc:697] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:39.509028  8604 consensus_queue.cc:237] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.508594  8585 consensus_queue.cc:237] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.510951  8577 tablet_bootstrap.cc:654] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.513113  8576 tablet_bootstrap.cc:492] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:39.525442  8576 ts_tablet_manager.cc:1403] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.096s	user 0.035s	sys 0.041s
I20260709 13:00:39.526221  8282 catalog_manager.cc:5697] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 0 to 1, leader changed from <none> to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:39.524065  8284 catalog_manager.cc:5697] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:39.528208  8576 raft_consensus.cc:359] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.528879  8576 raft_consensus.cc:385] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.529189  8576 raft_consensus.cc:740] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.523548  8575 tablet_bootstrap.cc:654] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.530151  8576 consensus_queue.cc:260] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.532380  8576 ts_tablet_manager.cc:1434] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:39.532516  8577 tablet_bootstrap.cc:492] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:39.532974  8577 ts_tablet_manager.cc:1403] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:00:39.533320  8576 tablet_bootstrap.cc:492] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:39.535553  8577 raft_consensus.cc:359] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.536219  8577 raft_consensus.cc:385] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.536489  8577 raft_consensus.cc:740] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.537206  8577 consensus_queue.cc:260] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.541855  8576 tablet_bootstrap.cc:654] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.543275  8577 ts_tablet_manager.cc:1434] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:00:39.544283  8577 tablet_bootstrap.cc:492] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:39.550668  8577 tablet_bootstrap.cc:654] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.553537  8585 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.554207  8585 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.555774  8460 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.558815  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:39.559742  8535 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:39.561064  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:39.562549  8621 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.563023  8621 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.563724  8424 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:39.564899  8636 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:39.565136  8621 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:39.565428  8636 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.566000  8636 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.566884  8577 tablet_bootstrap.cc:492] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:39.567387  8581 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:39.567647  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:00:39.568835  8501 leader_election.cc:343] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:39.569438  8577 ts_tablet_manager.cc:1403] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.004s
W20260709 13:00:39.569605  8427 leader_election.cc:343] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:39.571318  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:39.572366  8577 raft_consensus.cc:359] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.573066  8577 raft_consensus.cc:385] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:00:39.573175  8500 leader_election.cc:343] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:39.573431  8577 raft_consensus.cc:740] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.573808  8500 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:39.575307  8621 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:39.574986  8577 consensus_queue.cc:260] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.576325  8585 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:39.579515  8621 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.579955  8621 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.582335  8621 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:39.583267  8577 ts_tablet_manager.cc:1434] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:00:39.584144  8577 tablet_bootstrap.cc:492] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:39.583946  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:39.585780  8385 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:39.586068  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:39.586874  8501 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:39.587661  8621 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:39.588002  8621 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.588310  8621 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.588608  8629 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:00:39.589882  8500 leader_election.cc:343] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:39.594427  8636 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.595772  8621 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.596712  8636 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:39.600450  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:39.606350  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:00:39.607378  8427 leader_election.cc:343] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:39.608224  8500 leader_election.cc:343] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:39.601831  8575 tablet_bootstrap.cc:492] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:39.609294  8575 ts_tablet_manager.cc:1403] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.109s	user 0.015s	sys 0.018s
I20260709 13:00:39.601789  8577 tablet_bootstrap.cc:654] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.602486  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:39.610222  8534 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.612839  8575 raft_consensus.cc:359] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.613529  8575 raft_consensus.cc:385] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.603482  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:39.603678  8621 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:39.604497  8576 tablet_bootstrap.cc:492] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:39.613821  8575 raft_consensus.cc:740] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.614915  8576 ts_tablet_manager.cc:1403] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.082s	user 0.042s	sys 0.017s
I20260709 13:00:39.614281  8386 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.615309  8575 consensus_queue.cc:260] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.617918  8575 ts_tablet_manager.cc:1434] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:00:39.623356  8575 tablet_bootstrap.cc:492] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:39.630919  8576 raft_consensus.cc:359] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.631443  8534 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:39.631661  8576 raft_consensus.cc:385] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.632058  8576 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.632493  8424 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:39.633613  8636 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:39.634121  8636 raft_consensus.cc:697] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:39.634428  8386 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:39.634927  8636 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.635668  8575 tablet_bootstrap.cc:654] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.635680  8501 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:39.632772  8576 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.636973  8621 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:39.637606  8621 raft_consensus.cc:697] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:39.638585  8576 ts_tablet_manager.cc:1434] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 13:00:39.638528  8621 consensus_queue.cc:237] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.639887  8576 tablet_bootstrap.cc:492] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:39.654425  8576 tablet_bootstrap.cc:654] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.667263  8576 tablet_bootstrap.cc:492] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:39.667718  8576 ts_tablet_manager.cc:1403] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.003s
I20260709 13:00:39.668047  8284 catalog_manager.cc:5697] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:39.671219  8576 raft_consensus.cc:359] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.672187  8576 raft_consensus.cc:385] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.672514  8576 raft_consensus.cc:740] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.672623  8581 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.673038  8581 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.674345  8282 catalog_manager.cc:5697] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:39.677033  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:39.679294  8535 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:39.678627  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:39.680580  8460 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:39.682073  8576 consensus_queue.cc:260] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.682829  8349 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:39.683540  8618 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:39.683866  8618 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.684182  8618 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.684253  8577 tablet_bootstrap.cc:492] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:39.684746  8577 ts_tablet_manager.cc:1403] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.101s	user 0.015s	sys 0.014s
I20260709 13:00:39.685607  8581 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:39.687363  8577 raft_consensus.cc:359] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.687997  8577 raft_consensus.cc:385] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.688273  8577 raft_consensus.cc:740] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.688902  8577 consensus_queue.cc:260] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.690905  8604 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:39.691298  8577 ts_tablet_manager.cc:1434] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:00:39.691934  8575 tablet_bootstrap.cc:492] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:39.692371  8575 ts_tablet_manager.cc:1403] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.069s	user 0.028s	sys 0.011s
I20260709 13:00:39.692832  8577 tablet_bootstrap.cc:492] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:39.695220  8575 raft_consensus.cc:359] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.695952  8575 raft_consensus.cc:385] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.696286  8575 raft_consensus.cc:740] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.696785  8618 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.697021  8575 consensus_queue.cc:260] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.698992  8577 tablet_bootstrap.cc:654] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.699363  8575 ts_tablet_manager.cc:1434] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:39.699644  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:39.700268  8459 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.700410  8575 tablet_bootstrap.cc:492] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:39.706230  8621 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.706887  8575 tablet_bootstrap.cc:654] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.706730  8621 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:00:39.707573  8459 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:39.708865  8621 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:39.708809  8351 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:39.709956  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:39.710706  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:39.710139  8629 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:39.713495  8500 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:39.714735  8625 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:39.712884  8629 raft_consensus.cc:697] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:39.716061  8629 consensus_queue.cc:237] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.722723  8625 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:00:39.724538  8618 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:39.725283  8576 ts_tablet_manager.cc:1434] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.002s
I20260709 13:00:39.726258  8576 tablet_bootstrap.cc:492] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:39.726583  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:39.727149  8535 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:39.740681  8332 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:39.740792  8535 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:39.747707  8575 tablet_bootstrap.cc:492] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:39.749348  8575 ts_tablet_manager.cc:1403] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.005s
I20260709 13:00:39.756856  8575 raft_consensus.cc:359] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.758633  8575 raft_consensus.cc:385] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.759161  8575 raft_consensus.cc:740] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.760133  8575 consensus_queue.cc:260] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.762730  8575 ts_tablet_manager.cc:1434] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:00:39.764007  8575 tablet_bootstrap.cc:492] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:39.765126  8621 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:39.766047  8577 tablet_bootstrap.cc:492] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:39.766566  8577 ts_tablet_manager.cc:1403] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.074s	user 0.022s	sys 0.034s
I20260709 13:00:39.768043  8576 tablet_bootstrap.cc:654] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.770706  8284 catalog_manager.cc:5697] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 0 to 1, leader changed from <none> to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:39.773727  8625 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.774434  8625 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.776499  8575 tablet_bootstrap.cc:654] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.777691  8577 raft_consensus.cc:359] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.778187  8577 raft_consensus.cc:385] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.778425  8577 raft_consensus.cc:740] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.782459  8577 consensus_queue.cc:260] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.785838  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:39.786546  8577 ts_tablet_manager.cc:1434] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:00:39.788599  8621 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.789041  8621 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.791002  8621 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:39.792459  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:39.793251  8625 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:39.794210  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:39.794471  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:39.794684  8535 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.793642  8577 tablet_bootstrap.cc:492] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
W20260709 13:00:39.798943  8500 leader_election.cc:343] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:39.804760  8501 leader_election.cc:343] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:39.805266  8501 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:39.809602  8625 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:39.809965  8636 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:39.810631  8533 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.807750  8501 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:39.818373  8636 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:39.830412  8599 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:39.832331  8629 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:39.837538  8577 tablet_bootstrap.cc:654] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.844023  8576 tablet_bootstrap.cc:492] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:39.844511  8576 ts_tablet_manager.cc:1403] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.118s	user 0.012s	sys 0.010s
I20260709 13:00:39.855690  8576 raft_consensus.cc:359] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.856634  8576 raft_consensus.cc:385] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.856962  8576 raft_consensus.cc:740] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.857951  8576 consensus_queue.cc:260] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.861626  8576 ts_tablet_manager.cc:1434] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:00:39.862479  8576 tablet_bootstrap.cc:492] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:39.879956  8575 tablet_bootstrap.cc:492] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:39.880463  8575 ts_tablet_manager.cc:1403] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.117s	user 0.019s	sys 0.013s
I20260709 13:00:39.882560  8629 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.883072  8629 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.883263  8575 raft_consensus.cc:359] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.883952  8575 raft_consensus.cc:385] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.884215  8575 raft_consensus.cc:740] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.886770  8576 tablet_bootstrap.cc:654] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.886953  8629 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:39.887142  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:39.886829  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:39.888631  8575 consensus_queue.cc:260] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.890725  8575 ts_tablet_manager.cc:1434] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:00:39.891858  8575 tablet_bootstrap.cc:492] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:39.892547  8535 raft_consensus.cc:2393] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 1: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:00:39.899209  8349 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:39.900063  8629 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.901304  8575 tablet_bootstrap.cc:654] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.902987  8577 tablet_bootstrap.cc:492] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:39.903455  8577 ts_tablet_manager.cc:1403] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.110s	user 0.012s	sys 0.015s
I20260709 13:00:39.906432  8577 raft_consensus.cc:359] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.908001  8575 tablet_bootstrap.cc:492] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:39.908524  8575 ts_tablet_manager.cc:1403] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.006s
I20260709 13:00:39.910975  8629 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:39.912583  8576 tablet_bootstrap.cc:492] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:39.912972  8576 ts_tablet_manager.cc:1403] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.000s
I20260709 13:00:39.912354  8575 raft_consensus.cc:359] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.913313  8575 raft_consensus.cc:385] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.913616  8575 raft_consensus.cc:740] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.914399  8575 consensus_queue.cc:260] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.915454  8576 raft_consensus.cc:359] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.916112  8576 raft_consensus.cc:385] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.916399  8575 ts_tablet_manager.cc:1434] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:00:39.907085  8577 raft_consensus.cc:385] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.917295  8577 raft_consensus.cc:740] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.917891  8575 tablet_bootstrap.cc:492] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:39.917939  8577 consensus_queue.cc:260] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.919709  8577 ts_tablet_manager.cc:1434] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.002s
I20260709 13:00:39.920586  8577 tablet_bootstrap.cc:492] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:39.921638  8613 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.922113  8613 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.924440  8613 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:39.925066  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:39.925889  8386 raft_consensus.cc:2393] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 1: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:39.925990  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:39.926964  8577 tablet_bootstrap.cc:654] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.927958  8575 tablet_bootstrap.cc:654] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.927939  8424 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:39.929565  8613 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.938665  8575 tablet_bootstrap.cc:492] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:39.939153  8575 ts_tablet_manager.cc:1403] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.005s
I20260709 13:00:39.941038  8575 raft_consensus.cc:359] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.941622  8575 raft_consensus.cc:385] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.941845  8575 raft_consensus.cc:740] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.942416  8575 consensus_queue.cc:260] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.916379  8576 raft_consensus.cc:740] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.944393  8575 ts_tablet_manager.cc:1434] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:00:39.942843  8613 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:39.945191  8629 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.944212  8576 consensus_queue.cc:260] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.945672  8629 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.946484  8673 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.947111  8673 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.947700  8629 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:39.951088  8575 tablet_bootstrap.cc:492] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:39.950791  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:39.951675  8460 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:39.953619  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:39.956933  8575 tablet_bootstrap.cc:654] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.957336  8351 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:39.959111  8629 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:39.959192  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:39.959734  8629 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.960227  8629 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.960141  8386 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:39.962085  8501 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:39.963100  8599 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:39.963433  8599 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.963788  8599 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:39.965639  8349 leader_election.cc:343] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:39.968873  8599 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.969569  8630 consensus_queue.cc:1048] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:39.971431  8630 consensus_queue.cc:1048] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:39.975032  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:39.976706  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:00:39.976980  8500 leader_election.cc:343] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:39.977515  8386 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.978978  8673 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:39.980652  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:00:39.984740  8500 leader_election.cc:343] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:39.986444  8386 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:39.987581  8501 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:39.991370  8631 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.992036  8631 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.993861  8673 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:39.994357  8673 raft_consensus.cc:697] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:39.995222  8631 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:39.995118  8673 consensus_queue.cc:237] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.997005  8613 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.997511  8613 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:39.971791  8599 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:39.998733  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:39.999531  8535 raft_consensus.cc:2393] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 1: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:00:39.999603  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:40.000204  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:40.000810  8385 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:40.001295  8351 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:40.002038  8427 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:40.002902  8636 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:40.003250  8636 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.003582  8636 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.004042  8630 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.010106  8636 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.013878  8636 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:40.014794  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:40.015385  8385 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.015488  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:40.016155  8535 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.017851  8576 ts_tablet_manager.cc:1434] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.105s	user 0.005s	sys 0.001s
I20260709 13:00:40.018828  8576 tablet_bootstrap.cc:492] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:40.021395  8629 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.022393  8385 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:40.022914  8535 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:40.023524  8427 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:40.024333  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:40.025138  8460 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.026275  8575 tablet_bootstrap.cc:492] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:40.026731  8575 ts_tablet_manager.cc:1403] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.000s
I20260709 13:00:40.027310  8613 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:40.027552  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:40.027855  8613 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:40.028213  8535 raft_consensus.cc:2376] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1. Re-sending same reply.
I20260709 13:00:40.030138  8613 raft_consensus.cc:697] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:40.031148  8575 raft_consensus.cc:359] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.031880  8575 raft_consensus.cc:385] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.032191  8575 raft_consensus.cc:740] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.033121  8575 consensus_queue.cc:260] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.039873  8575 ts_tablet_manager.cc:1434] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:00:40.034328  8613 consensus_queue.cc:237] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.044574  8460 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:40.045290  8575 tablet_bootstrap.cc:492] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:40.047685  8630 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:40.057659  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:40.058606  8636 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:40.059267  8577 tablet_bootstrap.cc:492] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
W20260709 13:00:40.059159  8349 leader_election.cc:343] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:40.059762  8577 ts_tablet_manager.cc:1403] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.139s	user 0.025s	sys 0.078s
I20260709 13:00:40.059883  8636 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:40.062731  8577 raft_consensus.cc:359] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.063455  8577 raft_consensus.cc:385] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.063731  8577 raft_consensus.cc:740] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.056332  8575 tablet_bootstrap.cc:654] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.064477  8577 consensus_queue.cc:260] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.066980  8577 ts_tablet_manager.cc:1434] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:00:40.067879  8577 tablet_bootstrap.cc:492] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:40.059801  8629 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:40.072890  8576 tablet_bootstrap.cc:654] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.073669  8577 tablet_bootstrap.cc:654] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.076131  8575 tablet_bootstrap.cc:492] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:40.076664  8575 ts_tablet_manager.cc:1403] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.005s
I20260709 13:00:40.077641  8613 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:40.079746  8351 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:40.081285  8629 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:40.081810  8629 raft_consensus.cc:697] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:40.080106  8575 raft_consensus.cc:359] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.083665  8577 tablet_bootstrap.cc:492] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:40.084158  8577 ts_tablet_manager.cc:1403] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:00:40.084553  8282 catalog_manager.cc:5697] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:40.086763  8577 raft_consensus.cc:359] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.087423  8577 raft_consensus.cc:385] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.087684  8577 raft_consensus.cc:740] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.088339  8577 consensus_queue.cc:260] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.083853  8575 raft_consensus.cc:385] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.089284  8575 raft_consensus.cc:740] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.089927  8575 consensus_queue.cc:260] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.091909  8575 ts_tablet_manager.cc:1434] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:00:40.092772  8575 tablet_bootstrap.cc:492] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:40.082772  8629 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.098598  8575 tablet_bootstrap.cc:654] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.100368  8284 catalog_manager.cc:5697] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:40.102555  8577 ts_tablet_manager.cc:1434] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.003s
I20260709 13:00:40.103588  8577 tablet_bootstrap.cc:492] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:40.112900  8577 tablet_bootstrap.cc:654] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.115943  8576 tablet_bootstrap.cc:492] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:40.116447  8576 ts_tablet_manager.cc:1403] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.098s	user 0.008s	sys 0.004s
I20260709 13:00:40.120154  8576 raft_consensus.cc:359] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.120931  8576 raft_consensus.cc:385] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.121337  8576 raft_consensus.cc:740] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.121879  8636 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:00:40.159019  8576 consensus_queue.cc:260] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.170957  8673 consensus_queue.cc:1048] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:40.172925  8282 catalog_manager.cc:5697] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 0 to 1, leader changed from <none> to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:40.181600  8576 ts_tablet_manager.cc:1434] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.065s	user 0.003s	sys 0.005s
I20260709 13:00:40.183993  8576 tablet_bootstrap.cc:492] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:40.197232  8577 tablet_bootstrap.cc:492] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:40.197752  8577 ts_tablet_manager.cc:1403] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.094s	user 0.014s	sys 0.007s
I20260709 13:00:40.201267  8631 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:40.208009  8577 raft_consensus.cc:359] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.208901  8577 raft_consensus.cc:385] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.209263  8577 raft_consensus.cc:740] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.211241  8575 tablet_bootstrap.cc:492] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:40.211941  8575 ts_tablet_manager.cc:1403] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.119s	user 0.020s	sys 0.030s
I20260709 13:00:40.221174  8577 consensus_queue.cc:260] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.229058  8699 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.229809  8699 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.231531  8577 ts_tablet_manager.cc:1434] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:00:40.232427  8577 tablet_bootstrap.cc:492] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:40.237723  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:40.238382  8385 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:40.238468  8673 consensus_queue.cc:1048] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:40.240283  8575 raft_consensus.cc:359] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.240638  8427 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:40.241017  8575 raft_consensus.cc:385] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.241326  8575 raft_consensus.cc:740] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.241962  8575 consensus_queue.cc:260] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.242794  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:40.242972  8613 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:40.243397  8613 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.242823  8673 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.243810  8613 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.244001  8575 ts_tablet_manager.cc:1434] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.000s
I20260709 13:00:40.244163  8673 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.248826  8575 tablet_bootstrap.cc:492] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:40.251597  8576 tablet_bootstrap.cc:654] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.243419  8533 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:40.255417  8673 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:40.246842  8699 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:40.260360  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:40.257967  8613 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.261495  8461 raft_consensus.cc:2393] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 1: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:00:40.262730  8629 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:40.264202  8577 tablet_bootstrap.cc:654] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.265148  8613 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:40.282953  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:40.287245  8385 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.290472  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:40.291157  8534 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.299196  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:40.304613  8575 tablet_bootstrap.cc:654] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.309983  8385 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:40.311812  8427 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:40.312750  8636 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:40.313295  8636 raft_consensus.cc:697] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:40.315131  8613 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.319130  8613 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.310400  8501 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:40.324682  8636 consensus_queue.cc:237] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.325789  8585 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.326390  8585 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.329479  8673 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.330123  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:40.330833  8535 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:40.331765  8585 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:40.333916  8424 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:40.337062  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:40.337852  8385 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:40.338168  8585 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:40.338554  8585 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.339093  8585 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.343914  8534 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:40.350560  8613 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:40.351881  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:40.357921  8576 tablet_bootstrap.cc:492] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:40.358477  8576 ts_tablet_manager.cc:1403] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.175s	user 0.009s	sys 0.005s
I20260709 13:00:40.361178  8673 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:40.364259  8576 raft_consensus.cc:359] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.365113  8576 raft_consensus.cc:385] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.365633  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:40.365567  8576 raft_consensus.cc:740] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.366428  8385 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 1: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:40.367185  8576 consensus_queue.cc:260] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.368228  8427 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:40.369230  8636 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.369729  8636 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.370244  8699 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.376451  8576 ts_tablet_manager.cc:1434] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:00:40.379206  8576 tablet_bootstrap.cc:492] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:40.375837  8636 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:40.384564  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:40.385690  8577 tablet_bootstrap.cc:492] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:40.397558  8577 ts_tablet_manager.cc:1403] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.165s	user 0.015s	sys 0.019s
I20260709 13:00:40.397466  8385 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:40.392055  8699 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:40.393347  8284 catalog_manager.cc:5697] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:40.398470  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:00:40.399804  8424 leader_election.cc:343] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:40.396101  8585 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.400358  8427 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:40.402884  8699 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:40.403287  8699 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.403057  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:40.403762  8585 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:40.403604  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:40.403919  8385 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.403687  8699 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.404418  8533 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.410212  8577 raft_consensus.cc:359] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.410944  8577 raft_consensus.cc:385] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.411335  8577 raft_consensus.cc:740] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.412583  8577 consensus_queue.cc:260] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.418705  8577 ts_tablet_manager.cc:1434] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:00:40.419680  8577 tablet_bootstrap.cc:492] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:40.411296  8533 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:40.422286  8424 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:40.423228  8576 tablet_bootstrap.cc:654] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.423808  8710 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:40.425055  8710 raft_consensus.cc:697] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:40.426241  8710 consensus_queue.cc:237] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.431309  8575 tablet_bootstrap.cc:492] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:40.431672  8575 ts_tablet_manager.cc:1403] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.187s	user 0.012s	sys 0.005s
I20260709 13:00:40.435957  8577 tablet_bootstrap.cc:654] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.429714  8385 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:40.441946  8575 raft_consensus.cc:359] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.442781  8575 raft_consensus.cc:385] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.443131  8575 raft_consensus.cc:740] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.443902  8575 consensus_queue.cc:260] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.444161  8699 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.446096  8575 ts_tablet_manager.cc:1434] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.005s
I20260709 13:00:40.446233  8699 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:40.445540  8284 catalog_manager.cc:5697] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:40.447111  8575 tablet_bootstrap.cc:492] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:40.448304  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:40.448930  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:40.449529  8384 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:40.449596  8424 leader_election.cc:343] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:40.449831  8673 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:40.455381  8384 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:40.456879  8427 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:40.457649  8699 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:40.458323  8699 raft_consensus.cc:697] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:40.459123  8699 consensus_queue.cc:237] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.467808  8284 catalog_manager.cc:5697] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:40.475914  8673 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.476423  8673 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.478471  8673 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:40.479938  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:40.480613  8459 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:40.480489  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:40.481954  8500 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:00:40.482554  8501 leader_election.cc:343] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:40.482743  8673 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:40.483129  8673 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.483445  8673 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.486356  8576 tablet_bootstrap.cc:492] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:40.486822  8576 ts_tablet_manager.cc:1403] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.002s
I20260709 13:00:40.490176  8577 tablet_bootstrap.cc:492] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:40.490650  8577 ts_tablet_manager.cc:1403] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.071s	user 0.007s	sys 0.003s
I20260709 13:00:40.493613  8599 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:40.494021  8577 raft_consensus.cc:359] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.494707  8577 raft_consensus.cc:385] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.494954  8577 raft_consensus.cc:740] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.495575  8577 consensus_queue.cc:260] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.497531  8577 ts_tablet_manager.cc:1434] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:00:40.498379  8577 tablet_bootstrap.cc:492] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:40.501107  8673 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.503914  8577 tablet_bootstrap.cc:654] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.504724  8576 raft_consensus.cc:359] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.505191  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:40.505476  8576 raft_consensus.cc:385] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.505744  8576 raft_consensus.cc:740] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.506351  8576 consensus_queue.cc:260] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:40.506667  8501 leader_election.cc:343] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:40.508340  8576 ts_tablet_manager.cc:1434] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:00:40.509223  8576 tablet_bootstrap.cc:492] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:40.509799  8577 tablet_bootstrap.cc:492] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:40.510109  8577 ts_tablet_manager.cc:1403] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:00:40.504769  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:40.512044  8460 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.512593  8577 raft_consensus.cc:359] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.513268  8577 raft_consensus.cc:385] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.513531  8577 raft_consensus.cc:740] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.514406  8577 consensus_queue.cc:260] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.516867  8577 ts_tablet_manager.cc:1434] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:00:40.518234  8577 tablet_bootstrap.cc:492] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:40.523036  8460 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:40.501971  8575 tablet_bootstrap.cc:654] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.524092  8577 tablet_bootstrap.cc:654] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.524282  8576 tablet_bootstrap.cc:654] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.527041  8500 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:40.528429  8621 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:40.528908  8621 raft_consensus.cc:697] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:40.529767  8621 consensus_queue.cc:237] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.540671  8599 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.541193  8599 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.543251  8599 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:40.543987  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:40.540693  8576 tablet_bootstrap.cc:492] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:40.545030  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:40.545680  8576 ts_tablet_manager.cc:1403] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.000s
W20260709 13:00:40.545532  8501 leader_election.cc:343] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:40.549353  8577 tablet_bootstrap.cc:492] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
W20260709 13:00:40.549304  8500 leader_election.cc:343] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:40.549907  8577 ts_tablet_manager.cc:1403] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.013s
I20260709 13:00:40.550212  8575 tablet_bootstrap.cc:492] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:40.550784  8575 ts_tablet_manager.cc:1403] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.104s	user 0.008s	sys 0.008s
I20260709 13:00:40.551702  8500 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:40.552508  8599 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:40.552619  8577 raft_consensus.cc:359] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.553866  8577 raft_consensus.cc:385] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.550457  8576 raft_consensus.cc:359] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.554189  8577 raft_consensus.cc:740] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.553658  8575 raft_consensus.cc:359] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.555006  8618 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:40.554369  8576 raft_consensus.cc:385] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.555680  8576 raft_consensus.cc:740] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.556754  8576 consensus_queue.cc:260] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.527088  8673 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:40.554925  8577 consensus_queue.cc:260] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.556035  8575 raft_consensus.cc:385] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.559026  8575 raft_consensus.cc:740] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.560052  8577 ts_tablet_manager.cc:1434] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:00:40.559818  8575 consensus_queue.cc:260] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.562670  8577 tablet_bootstrap.cc:492] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:40.563603  8575 ts_tablet_manager.cc:1434] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:00:40.564570  8575 tablet_bootstrap.cc:492] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:40.563745  8282 catalog_manager.cc:5697] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:40.561592  8576 ts_tablet_manager.cc:1434] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:00:40.570609  8577 tablet_bootstrap.cc:654] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.571095  8576 tablet_bootstrap.cc:492] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:40.576056  8575 tablet_bootstrap.cc:654] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.577288  8576 tablet_bootstrap.cc:654] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.582898  8699 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:40.605727  8630 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:40.623798  8636 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:40.638751  8575 tablet_bootstrap.cc:492] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:40.639467  8575 ts_tablet_manager.cc:1403] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.075s	user 0.018s	sys 0.032s
I20260709 13:00:40.639926  8577 tablet_bootstrap.cc:492] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:40.640924  8577 ts_tablet_manager.cc:1403] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.078s	user 0.029s	sys 0.013s
I20260709 13:00:40.643253  8621 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.643913  8621 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.646564  8621 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:40.642611  8575 raft_consensus.cc:359] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.647137  8575 raft_consensus.cc:385] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.647325  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:40.647514  8575 raft_consensus.cc:740] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.648023  8385 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:40.648126  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:40.648725  8459 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:40.648574  8575 consensus_queue.cc:260] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.649250  8501 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:40.650211  8621 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:40.650566  8621 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.650897  8621 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.652691  8575 ts_tablet_manager.cc:1434] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:00:40.654029  8575 tablet_bootstrap.cc:492] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:40.657073  8577 raft_consensus.cc:359] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.657779  8577 raft_consensus.cc:385] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.657533  8621 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.660051  8575 tablet_bootstrap.cc:654] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.660686  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:40.661327  8385 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.662125  8630 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.662616  8630 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.663177  8576 tablet_bootstrap.cc:492] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:40.663618  8576 ts_tablet_manager.cc:1403] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.093s	user 0.023s	sys 0.033s
I20260709 13:00:40.658079  8577 raft_consensus.cc:740] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.665071  8630 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:40.673568  8385 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:40.675055  8501 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:40.676110  8673 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:40.676622  8673 raft_consensus.cc:697] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:40.666764  8577 consensus_queue.cc:260] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.677670  8673 consensus_queue.cc:237] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.679764  8577 ts_tablet_manager.cc:1434] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 13:00:40.680779  8577 tablet_bootstrap.cc:492] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:40.668485  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:40.669255  8599 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.685845  8459 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:40.685992  8599 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.686544  8577 tablet_bootstrap.cc:654] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.687291  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:40.688108  8599 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:40.688251  8618 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:40.688603  8618 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.688910  8618 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.666155  8576 raft_consensus.cc:359] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.667263  8621 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:40.689580  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:40.689776  8576 raft_consensus.cc:385] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.690466  8576 raft_consensus.cc:740] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.690303  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:40.691146  8534 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:40.691223  8576 consensus_queue.cc:260] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.693001  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:40.693593  8460 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.696219  8618 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.697477  8386 raft_consensus.cc:2393] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 1: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:00:40.698180  8577 tablet_bootstrap.cc:492] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:40.698827  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:40.699466  8459 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:40.699892  8577 ts_tablet_manager.cc:1403] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:00:40.702527  8500 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:40.702504  8577 raft_consensus.cc:359] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.703317  8577 raft_consensus.cc:385] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.703614  8577 raft_consensus.cc:740] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.704241  8577 consensus_queue.cc:260] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.704655  8599 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:40.705230  8599 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.705864  8599 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.706287  8577 ts_tablet_manager.cc:1434] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:00:40.702613  8282 catalog_manager.cc:5697] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:40.707253  8577 tablet_bootstrap.cc:492] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:40.713686  8577 tablet_bootstrap.cc:654] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.715014  8599 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.716259  8460 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:40.693594  8576 ts_tablet_manager.cc:1434] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:00:40.717316  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:40.720127  8459 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.720886  8599 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:40.722241  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:40.723060  8386 raft_consensus.cc:2393] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 1: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:00:40.732463  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:40.733292  8534 raft_consensus.cc:2393] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 1: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:40.734134  8576 tablet_bootstrap.cc:492] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:40.737551  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:40.739521  8500 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:40.718214  8618 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:40.741024  8599 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:40.741384  8575 tablet_bootstrap.cc:492] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:40.743103  8575 ts_tablet_manager.cc:1403] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.017s
I20260709 13:00:40.745970  8576 tablet_bootstrap.cc:654] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.745775  8575 raft_consensus.cc:359] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.746464  8575 raft_consensus.cc:385] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.746731  8575 raft_consensus.cc:740] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.747383  8575 consensus_queue.cc:260] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.741806  8459 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:40.749095  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:40.750243  8618 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:40.750701  8618 raft_consensus.cc:697] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:40.751814  8575 ts_tablet_manager.cc:1434] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:00:40.751497  8618 consensus_queue.cc:237] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.752786  8575 tablet_bootstrap.cc:492] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:40.758327  8577 tablet_bootstrap.cc:492] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:40.759137  8577 ts_tablet_manager.cc:1403] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.052s	user 0.022s	sys 0.014s
I20260709 13:00:40.762145  8577 raft_consensus.cc:359] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.762876  8577 raft_consensus.cc:385] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.763142  8577 raft_consensus.cc:740] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.763815  8577 consensus_queue.cc:260] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.770903  8575 tablet_bootstrap.cc:654] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.775799  8577 ts_tablet_manager.cc:1434] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 13:00:40.777243  8577 tablet_bootstrap.cc:492] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:40.783708  8576 tablet_bootstrap.cc:492] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:40.784176  8576 ts_tablet_manager.cc:1403] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.022s
I20260709 13:00:40.785940  8283 catalog_manager.cc:5697] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 0 to 1, leader changed from <none> to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:40.786957  8576 raft_consensus.cc:359] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.787635  8576 raft_consensus.cc:385] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.787896  8576 raft_consensus.cc:740] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.788532  8576 consensus_queue.cc:260] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.790729  8576 ts_tablet_manager.cc:1434] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:00:40.791630  8576 tablet_bootstrap.cc:492] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:40.794623  8577 tablet_bootstrap.cc:654] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:40.794646  8332 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:40.798115  8575 tablet_bootstrap.cc:492] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:40.798339  8599 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.798574  8575 ts_tablet_manager.cc:1403] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.003s
I20260709 13:00:40.798825  8599 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.799286  8576 tablet_bootstrap.cc:654] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.801072  8599 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:40.801403  8575 raft_consensus.cc:359] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.802071  8575 raft_consensus.cc:385] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.802316  8575 raft_consensus.cc:740] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.803274  8575 consensus_queue.cc:260] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.803421  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:40.805572  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:40.806377  8385 raft_consensus.cc:2393] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 1: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:00:40.810559  8621 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.811260  8621 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.811635  8501 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:40.813115  8673 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.815932  8621 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:40.823552  8673 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:40.819522  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:40.824493  8385 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:40.825803  8501 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:40.826721  8621 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:40.827090  8621 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.827316  8621 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.819581  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:40.831313  8459 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:40.831792  8710 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:40.833562  8621 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.834031  8575 ts_tablet_manager.cc:1434] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:00:40.836069  8710 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:40.836990  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:40.840476  8386 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.841130  8576 tablet_bootstrap.cc:492] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:40.838358  8575 tablet_bootstrap.cc:492] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:40.843052  8577 tablet_bootstrap.cc:492] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:40.843554  8577 ts_tablet_manager.cc:1403] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.000s
I20260709 13:00:40.839114  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:40.845424  8459 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.846333  8577 raft_consensus.cc:359] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.847080  8577 raft_consensus.cc:385] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.847399  8577 raft_consensus.cc:740] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.841588  8576 ts_tablet_manager.cc:1403] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.030s
I20260709 13:00:40.849256  8577 consensus_queue.cc:260] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.853133  8577 ts_tablet_manager.cc:1434] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:00:40.852454  8576 raft_consensus.cc:359] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.853767  8576 raft_consensus.cc:385] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.854090  8576 raft_consensus.cc:740] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.854856  8576 consensus_queue.cc:260] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.858536  8636 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:40.860368  8575 tablet_bootstrap.cc:654] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.860678  8673 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.861156  8673 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.863149  8673 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:40.866349  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:40.866478  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:00:40.867848  8501 leader_election.cc:343] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:40.868494  8500 leader_election.cc:343] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:40.868929  8500 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:40.870033  8673 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:40.866572  8576 ts_tablet_manager.cc:1434] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 13:00:40.854270  8577 tablet_bootstrap.cc:492] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:40.871696  8386 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:40.882190  8501 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:40.883442  8673 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:40.884116  8673 raft_consensus.cc:697] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:40.885486  8577 tablet_bootstrap.cc:654] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.885274  8673 consensus_queue.cc:237] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.878688  8575 tablet_bootstrap.cc:492] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:40.890208  8575 ts_tablet_manager.cc:1403] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.007s
I20260709 13:00:40.878985  8576 tablet_bootstrap.cc:492] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:40.892488  8459 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:40.839659  8621 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:40.894412  8585 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:40.895268  8575 raft_consensus.cc:359] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.895958  8575 raft_consensus.cc:385] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.896193  8576 tablet_bootstrap.cc:654] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.896225  8575 raft_consensus.cc:740] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.902277  8575 consensus_queue.cc:260] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.904415  8575 ts_tablet_manager.cc:1434] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:00:40.910951  8575 tablet_bootstrap.cc:492] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:40.917760  8575 tablet_bootstrap.cc:654] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.922366  8577 tablet_bootstrap.cc:492] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:40.922935  8577 ts_tablet_manager.cc:1403] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.000s
I20260709 13:00:40.924278  8673 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.924817  8673 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.926584  8585 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:40.927028  8577 raft_consensus.cc:359] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.927891  8577 raft_consensus.cc:385] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.928951  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:40.935088  8460 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:40.926978  8673 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:40.936868  8500 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:40.938122  8625 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:40.938614  8625 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.939029  8625 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.931166  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:40.931957  8599 consensus_queue.cc:1048] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:40.940464  8501 leader_election.cc:343] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:40.945860  8625 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.949942  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:40.946769  8577 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.947297  8599 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:40.951385  8501 leader_election.cc:343] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:40.951678  8599 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.953778  8599 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:40.956097  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:40.957626  8625 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:00:40.958851  8501 leader_election.cc:343] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:40.960291  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:40.959407  8576 tablet_bootstrap.cc:492] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:40.959514  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:40.961441  8459 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:40.962352  8576 ts_tablet_manager.cc:1403] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.013s
I20260709 13:00:40.962627  8500 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:40.955670  8284 catalog_manager.cc:5697] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:40.960916  8461 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.964318  8625 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:40.964723  8625 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.965137  8625 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:40.971719  8625 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.973516  8576 raft_consensus.cc:359] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.974360  8576 raft_consensus.cc:385] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.974694  8576 raft_consensus.cc:740] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.974992  8709 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:40.975931  8576 consensus_queue.cc:260] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.976433  8461 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:40.977752  8500 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:40.978055  8576 ts_tablet_manager.cc:1434] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:00:40.978524  8599 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:40.979048  8599 raft_consensus.cc:697] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:40.979833  8599 consensus_queue.cc:237] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.980696  8575 tablet_bootstrap.cc:492] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:40.981150  8575 ts_tablet_manager.cc:1403] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.070s	user 0.019s	sys 0.006s
I20260709 13:00:40.985854  8575 raft_consensus.cc:359] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.986490  8575 raft_consensus.cc:385] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.986759  8575 raft_consensus.cc:740] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.987080  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:40.988082  8625 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:00:40.988261  8501 leader_election.cc:343] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:40.956745  8577 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.988258  8585 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.990890  8585 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:40.992118  8577 ts_tablet_manager.cc:1434] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.069s	user 0.004s	sys 0.002s
I20260709 13:00:40.993551  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:40.994278  8585 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:40.989215  8576 tablet_bootstrap.cc:492] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
W20260709 13:00:40.994891  8427 leader_election.cc:343] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:40.996707  8577 tablet_bootstrap.cc:492] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:41.000523  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:00:41.002305  8424 leader_election.cc:343] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.002875  8424 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:41.003970  8709 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:41.006699  8384 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:41.013154  8576 tablet_bootstrap.cc:654] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.016086  8283 catalog_manager.cc:5697] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:41.016660  8673 consensus_queue.cc:1048] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:41.017056  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:41.017700  8461 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:41.019141  8575 consensus_queue.cc:260] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.021555  8575 ts_tablet_manager.cc:1434] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:00:41.024698  8461 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:41.025292  8575 tablet_bootstrap.cc:492] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:41.026063  8500 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:41.027411  8625 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:41.027969  8625 raft_consensus.cc:697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:41.028878  8625 consensus_queue.cc:237] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.032559  8575 tablet_bootstrap.cc:654] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.035329  8577 tablet_bootstrap.cc:654] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.044595  8576 tablet_bootstrap.cc:492] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:41.045178  8576 ts_tablet_manager.cc:1403] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.000s
I20260709 13:00:41.048199  8576 raft_consensus.cc:359] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.048910  8576 raft_consensus.cc:385] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.049199  8576 raft_consensus.cc:740] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.050024  8577 tablet_bootstrap.cc:492] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:41.049855  8576 consensus_queue.cc:260] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.050598  8577 ts_tablet_manager.cc:1403] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.056s	user 0.008s	sys 0.007s
I20260709 13:00:41.052336  8576 ts_tablet_manager.cc:1434] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:41.053350  8576 tablet_bootstrap.cc:492] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:41.053750  8577 raft_consensus.cc:359] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.054508  8577 raft_consensus.cc:385] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.054800  8577 raft_consensus.cc:740] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.055629  8577 consensus_queue.cc:260] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.058365  8577 ts_tablet_manager.cc:1434] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:41.059614  8576 tablet_bootstrap.cc:654] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.061913  8577 tablet_bootstrap.cc:492] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:41.068125  8577 tablet_bootstrap.cc:654] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.069190  8575 tablet_bootstrap.cc:492] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:41.069768  8575 ts_tablet_manager.cc:1403] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.019s
I20260709 13:00:41.070984  8576 tablet_bootstrap.cc:492] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:41.071460  8576 ts_tablet_manager.cc:1403] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.006s
I20260709 13:00:41.072561  8575 raft_consensus.cc:359] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.073344  8575 raft_consensus.cc:385] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.073652  8575 raft_consensus.cc:740] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.074101  8576 raft_consensus.cc:359] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.074772  8576 raft_consensus.cc:385] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.074374  8575 consensus_queue.cc:260] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.075050  8576 raft_consensus.cc:740] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.075465  8625 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:41.076154  8576 consensus_queue.cc:260] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.076730  8575 ts_tablet_manager.cc:1434] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:00:41.077752  8575 tablet_bootstrap.cc:492] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:41.078431  8576 ts_tablet_manager.cc:1434] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:00:41.079342  8576 tablet_bootstrap.cc:492] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:41.084676  8575 tablet_bootstrap.cc:654] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.090209  8576 tablet_bootstrap.cc:654] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.099566  8625 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.100144  8625 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.102041  8621 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:41.104557  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:41.105901  8625 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:00:41.106022  8500 leader_election.cc:343] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.112607  8575 tablet_bootstrap.cc:492] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:41.113413  8575 ts_tablet_manager.cc:1403] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.036s	user 0.023s	sys 0.011s
I20260709 13:00:41.113353  8630 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.114413  8630 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.117511  8575 raft_consensus.cc:359] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.112670  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:41.118701  8575 raft_consensus.cc:385] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.118721  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:41.119436  8575 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.119782  8461 raft_consensus.cc:2393] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 1: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:41.120431  8575 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:41.121820  8501 leader_election.cc:343] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.122458  8501 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:41.123212  8575 ts_tablet_manager.cc:1434] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:00:41.123514  8621 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:41.124477  8575 tablet_bootstrap.cc:492] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:41.126068  8630 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:41.126312  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:41.127849  8349 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:41.132745  8631 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:41.155432  8631 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:41.158967  8636 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.172135  8636 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.175098  8636 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:41.177129  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:41.179821  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:00:41.180349  8427 leader_election.cc:343] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.180497  8534 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:41.181294  8575 tablet_bootstrap.cc:654] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.181604  8424 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:41.182937  8636 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:41.183305  8636 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.183640  8636 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:41.188176  8618 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.188717  8618 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.190761  8618 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:41.192191  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:41.193748  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:41.195937  8461 raft_consensus.cc:2393] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 1: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:41.197136  8351 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:41.198467  8618 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:41.200412  8281 catalog_manager.cc:5697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:41.206645  8575 tablet_bootstrap.cc:492] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:41.206898  8636 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.217224  8575 ts_tablet_manager.cc:1403] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.093s	user 0.008s	sys 0.014s
I20260709 13:00:41.219548  8576 tablet_bootstrap.cc:492] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:41.219326  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:41.219990  8576 ts_tablet_manager.cc:1403] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.141s	user 0.059s	sys 0.051s
I20260709 13:00:41.220484  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:00:41.220731  8427 leader_election.cc:343] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.220538  8575 raft_consensus.cc:359] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.221218  8533 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:41.221415  8575 raft_consensus.cc:385] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.221724  8575 raft_consensus.cc:740] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.222476  8576 raft_consensus.cc:359] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.223016  8576 raft_consensus.cc:385] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.223260  8576 raft_consensus.cc:740] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.222363  8575 consensus_queue.cc:260] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.225423  8575 ts_tablet_manager.cc:1434] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:00:41.225761  8576 consensus_queue.cc:260] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.226118  8709 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.226614  8709 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.227581  8576 ts_tablet_manager.cc:1434] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:00:41.228319  8576 tablet_bootstrap.cc:492] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:41.228652  8709 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:41.229514  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:41.230160  8385 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:41.230419  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:41.231074  8534 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:41.231956  8427 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:41.232715  8533 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:41.233357  8709 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:41.233712  8709 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.233971  8575 tablet_bootstrap.cc:492] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:41.234006  8424 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:41.234925  8585 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:41.235375  8585 raft_consensus.cc:697] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:41.236223  8585 consensus_queue.cc:237] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.234047  8709 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:41.240173  8575 tablet_bootstrap.cc:654] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.241217  8636 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:41.215437  8618 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:41.248159  8576 tablet_bootstrap.cc:654] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.254305  8577 tablet_bootstrap.cc:492] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:41.254762  8577 ts_tablet_manager.cc:1403] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.195s	user 0.034s	sys 0.033s
I20260709 13:00:41.255887  8709 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.257333  8577 raft_consensus.cc:359] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.257992  8577 raft_consensus.cc:385] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.258236  8577 raft_consensus.cc:740] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.258874  8577 consensus_queue.cc:260] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.259537  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:41.260126  8385 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:41.260917  8577 ts_tablet_manager.cc:1434] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:00:41.264544  8577 tablet_bootstrap.cc:492] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:41.267443  8575 tablet_bootstrap.cc:492] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:41.267896  8575 ts_tablet_manager.cc:1403] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.005s
I20260709 13:00:41.269354  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:41.269971  8533 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:41.270411  8575 raft_consensus.cc:359] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.271076  8575 raft_consensus.cc:385] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.271345  8575 raft_consensus.cc:740] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.271992  8575 consensus_queue.cc:260] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.275334  8577 tablet_bootstrap.cc:654] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.276751  8575 ts_tablet_manager.cc:1434] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:00:41.279780  8575 tablet_bootstrap.cc:492] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:41.283118  8621 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:41.283807  8709 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:41.267235  8385 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:41.285785  8575 tablet_bootstrap.cc:654] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.285868  8427 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:41.287755  8710 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:41.288235  8710 raft_consensus.cc:697] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:41.290947  8710 consensus_queue.cc:237] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.309351  8576 tablet_bootstrap.cc:492] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:41.309907  8576 ts_tablet_manager.cc:1403] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.082s	user 0.005s	sys 0.014s
I20260709 13:00:41.310241  8533 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:41.312403  8576 raft_consensus.cc:359] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.313262  8576 raft_consensus.cc:385] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.313525  8576 raft_consensus.cc:740] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.314143  8576 consensus_queue.cc:260] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.316522  8576 ts_tablet_manager.cc:1434] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:00:41.315848  8284 catalog_manager.cc:5697] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:41.317054  8577 tablet_bootstrap.cc:492] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:41.317499  8577 ts_tablet_manager.cc:1403] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.009s
I20260709 13:00:41.325094  8710 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.325630  8710 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.327893  8710 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:41.329937  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:00:41.331346  8424 leader_election.cc:343] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.329942  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:00:41.333130  8427 leader_election.cc:343] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.333650  8427 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:41.334553  8576 tablet_bootstrap.cc:492] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:41.337316  8763 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:41.339627  8577 raft_consensus.cc:359] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.340320  8577 raft_consensus.cc:385] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.340577  8577 raft_consensus.cc:740] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.341240  8577 consensus_queue.cc:260] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.341571  8710 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:41.344879  8283 catalog_manager.cc:5697] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:41.347898  8577 ts_tablet_manager.cc:1434] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:00:41.348987  8577 tablet_bootstrap.cc:492] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:41.354061  8673 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:41.356947  8577 tablet_bootstrap.cc:654] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.364043  8576 tablet_bootstrap.cc:654] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.369513  8577 tablet_bootstrap.cc:492] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:41.370015  8577 ts_tablet_manager.cc:1403] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:00:41.370226  8625 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.367686  8575 tablet_bootstrap.cc:492] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:41.370828  8625 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.371423  8575 ts_tablet_manager.cc:1403] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.092s	user 0.032s	sys 0.017s
I20260709 13:00:41.372678  8577 raft_consensus.cc:359] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.373473  8577 raft_consensus.cc:385] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.373736  8577 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.378448  8577 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.373760  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:41.384383  8763 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:00:41.388130  8577 ts_tablet_manager.cc:1434] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:00:41.385594  8625 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:00:41.390075  8501 leader_election.cc:343] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.389900  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:41.390295  8575 raft_consensus.cc:359] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.391996  8575 raft_consensus.cc:385] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:00:41.392287  8500 leader_election.cc:343] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.392297  8575 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.392848  8500 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:41.393441  8575 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.394162  8673 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:41.392468  8577 tablet_bootstrap.cc:492] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:41.394099  8576 tablet_bootstrap.cc:492] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:41.395661  8576 ts_tablet_manager.cc:1403] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.008s
I20260709 13:00:41.395764  8575 ts_tablet_manager.cc:1434] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:00:41.399910  8575 tablet_bootstrap.cc:492] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:41.401659  8576 raft_consensus.cc:359] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.403172  8576 raft_consensus.cc:385] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.403910  8576 raft_consensus.cc:740] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.405283  8576 consensus_queue.cc:260] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.407280  8575 tablet_bootstrap.cc:654] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.409339  8577 tablet_bootstrap.cc:654] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.409974  8576 ts_tablet_manager.cc:1434] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:00:41.410837  8673 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.411346  8673 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.412408  8576 tablet_bootstrap.cc:492] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:41.415050  8673 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:41.416800  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:41.418553  8763 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.419044  8763 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.416905  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:41.422331  8461 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:41.423483  8500 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:41.424392  8673 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:41.424762  8673 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.425110  8673 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:41.428239  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:41.428896  8460 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:41.430202  8576 tablet_bootstrap.cc:654] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.430171  8351 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:41.431054  8618 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:41.431182  8763 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:41.431424  8618 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.431787  8618 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:41.432240  8501 leader_election.cc:343] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.432125  8673 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.435042  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:41.436537  8763 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:41.437104  8501 leader_election.cc:343] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.437006  8763 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.438717  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:41.439394  8534 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:41.439855  8673 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:41.440477  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:41.441115  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:41.441753  8461 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:41.442466  8763 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:41.441220  8460 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:41.443603  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:41.444170  8351 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:41.444223  8534 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:41.446096  8618 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.446588  8630 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:41.447012  8630 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.447345  8630 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:41.453378  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:41.454196  8534 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:41.456629  8618 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:41.459337  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:41.460098  8459 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:41.455729  8630 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.470830  8630 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:41.472043  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:41.472719  8458 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:41.469277  8673 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:00:41.498610  8575 tablet_bootstrap.cc:492] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:41.499341  8575 ts_tablet_manager.cc:1403] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.100s	user 0.009s	sys 0.006s
I20260709 13:00:41.516017  8461 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:41.523331  8585 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.524056  8585 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.527531  8458 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:41.527742  8500 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:41.529247  8599 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:41.529695  8351 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:41.529976  8599 raft_consensus.cc:697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:41.530648  8618 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:41.531330  8618 raft_consensus.cc:697] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:41.502192  8625 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:00:41.531034  8599 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.532441  8618 consensus_queue.cc:237] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:41.537139  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 80853.7us
I20260709 13:00:41.534569  8625 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.549543  8625 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.549543  8673 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:00:41.549530  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:00:41.555052  8427 leader_election.cc:343] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.556859  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:41.555341  8625 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:41.567644  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:41.568558  8461 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
W20260709 13:00:41.570997  8501 leader_election.cc:343] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.577111  8585 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:41.621858  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:41.622694  8533 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:41.610662  8779 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.626410  8779 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.627794  8576 tablet_bootstrap.cc:492] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:41.717636  8534 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:41.684831  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:41.736969  8535 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:41.746749  8500 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:41.851179  8625 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:00:41.855659  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 106932us
I20260709 13:00:41.890583  8625 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.854053  8424 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:41.975857  8576 ts_tablet_manager.cc:1403] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.564s	user 0.044s	sys 0.088s
I20260709 13:00:41.912245  8625 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:41.981065  8577 tablet_bootstrap.cc:492] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:41.981626  8577 ts_tablet_manager.cc:1403] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.589s	user 0.034s	sys 0.064s
I20260709 13:00:41.914860  8779 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:41.984660  8575 raft_consensus.cc:359] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.988773  8575 raft_consensus.cc:385] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.989130  8575 raft_consensus.cc:740] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.986207  8710 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:41.989836  8575 consensus_queue.cc:260] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:41.990401  8710 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.990813  8710 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:41.986734  8459 consensus_meta.cc:287] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.526s	user 0.012s	sys 0.002s
I20260709 13:00:41.997529  8459 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:42.005116  8710 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.007411  8710 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:42.012295  8576 raft_consensus.cc:359] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.012912  8576 raft_consensus.cc:385] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.013182  8576 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.013679  8576 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.015918  8533 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:42.016804  8577 raft_consensus.cc:359] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.017714  8577 raft_consensus.cc:385] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.018093  8577 raft_consensus.cc:740] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.019526  8577 consensus_queue.cc:260] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.021457  8575 ts_tablet_manager.cc:1434] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.522s	user 0.027s	sys 0.041s
W20260709 13:00:42.021826  8575 ts_tablet_manager.cc:1467] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: Tablet startup took 522ms
I20260709 13:00:42.024173  8577 ts_tablet_manager.cc:1434] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.001s
I20260709 13:00:42.024293  8576 ts_tablet_manager.cc:1434] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.048s	user 0.001s	sys 0.005s
I20260709 13:00:42.025275  8577 tablet_bootstrap.cc:492] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:42.062567  8383 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:42.022092  8575 ts_tablet_manager.cc:1469] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: Trace:
0709 13:00:38.277950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.278122 (+   172us) service_pool.cc:224] Handling call
0709 13:00:38.282092 (+  3970us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:00:38.282184 (+    92us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:00:38.299375 (+ 17191us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:38.340725 (+ 41350us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:38.353005 (+ 12280us) inbound_call.cc:177] Queueing success response
0709 13:00:41.399484 (+3046479us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:00:41.499755 (+100271us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:00:41.588279 (+ 88524us) tablet_replica.cc:261] Starting instrumentation
0709 13:00:41.589631 (+  1352us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":27819,"raft.queue_time_us":28936,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":2434,"tablet-open.queue_time_us":3058326}
I20260709 13:00:42.080472  8575 tablet_bootstrap.cc:492] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:42.083458  8631 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.084419  8631 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.099021  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:00:42.114133  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 44927.7us
I20260709 13:00:42.115767  8625 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:41.979202  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 130436us
W20260709 13:00:42.121385  8786 log.cc:927] Time spent T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:00:42.121603  8349 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:00:42.122509  8427 leader_election.cc:343] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.123822  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:42.125142  8618 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:42.125779  8618 raft_consensus.cc:697] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:42.128281  8618 consensus_queue.cc:237] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.135651  8631 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:42.119489  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:42.147454  8575 tablet_bootstrap.cc:654] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.148453  8625 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:42.159513  8533 raft_consensus.cc:2393] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 1: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:00:42.179687  8282 catalog_manager.cc:5697] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 0 to 1, leader changed from <none> to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:42.181689  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:42.184485  8534 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.181697  8636 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:00:42.189548  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:42.190420  8380 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.195423  8763 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:42.195968  8576 tablet_bootstrap.cc:492] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
W20260709 13:00:42.197492  8501 consensus_peers.cc:597] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:42.203827  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:42.204651  8461 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:42.190986  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:42.209530  8532 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:42.211505  8349 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:42.218189  8534 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:42.220369  8763 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:42.223170  8763 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.223539  8763 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.224869  8283 catalog_manager.cc:5697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:42.262333  8351 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:42.263398  8577 tablet_bootstrap.cc:654] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.266454  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:42.267295  8457 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.277602  8779 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:42.277488  8763 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.280216  8763 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:42.281179  8575 tablet_bootstrap.cc:492] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:42.281893  8575 ts_tablet_manager.cc:1403] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.202s	user 0.017s	sys 0.020s
I20260709 13:00:42.283973  8380 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:42.286154  8585 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:42.295075  8575 raft_consensus.cc:359] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.295769  8575 raft_consensus.cc:385] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.296078  8575 raft_consensus.cc:740] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.297581  8575 consensus_queue.cc:260] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.325685  8576 tablet_bootstrap.cc:654] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.336548  8636 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:00:42.335162  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:42.350426  8533 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.351117  8424 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
W20260709 13:00:42.354327  8332 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:42.355216  8636 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:42.355993  8636 raft_consensus.cc:697] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:42.357314  8636 consensus_queue.cc:237] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.358057  8575 ts_tablet_manager.cc:1434] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.074s	user 0.004s	sys 0.005s
I20260709 13:00:42.361405  8575 tablet_bootstrap.cc:492] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:42.382378  8577 tablet_bootstrap.cc:492] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:42.382979  8577 ts_tablet_manager.cc:1403] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.358s	user 0.022s	sys 0.014s
I20260709 13:00:42.382637  8673 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:42.388712  8457 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:42.390443  8577 raft_consensus.cc:359] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.391242  8577 raft_consensus.cc:385] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.391515  8577 raft_consensus.cc:740] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.392139  8577 consensus_queue.cc:260] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.398352  8533 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:42.399441  8501 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:42.400014  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:42.401285  8577 ts_tablet_manager.cc:1434] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:00:42.401464  8625 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:42.400934  8457 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.403672  8349 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:42.406226  8789 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:00:42.405162  8625 raft_consensus.cc:697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:42.421392  8577 tablet_bootstrap.cc:492] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:42.418443  8625 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.423687  8779 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:42.426074  8575 tablet_bootstrap.cc:654] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.461686  8803 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:42.462565  8803 raft_consensus.cc:697] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:42.463125  8457 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:42.478996  8577 tablet_bootstrap.cc:654] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.480437  8576 tablet_bootstrap.cc:492] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:42.481189  8576 ts_tablet_manager.cc:1403] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.286s	user 0.026s	sys 0.000s
I20260709 13:00:42.487353  8575 tablet_bootstrap.cc:492] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:42.488055  8575 ts_tablet_manager.cc:1403] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.127s	user 0.010s	sys 0.009s
I20260709 13:00:42.488919  8585 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:00:42.482170  8803 consensus_queue.cc:237] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.510658  8576 raft_consensus.cc:359] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.513072  8576 raft_consensus.cc:385] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.513388  8576 raft_consensus.cc:740] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.514031  8576 consensus_queue.cc:260] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.514319  8575 raft_consensus.cc:359] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.515244  8575 raft_consensus.cc:385] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.515496  8575 raft_consensus.cc:740] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.516158  8576 ts_tablet_manager.cc:1434] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:00:42.517359  8576 tablet_bootstrap.cc:492] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:42.520918  8575 consensus_queue.cc:260] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.524773  8575 ts_tablet_manager.cc:1434] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:00:42.547346  8576 tablet_bootstrap.cc:654] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.557430  8575 tablet_bootstrap.cc:492] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:42.566043  8577 tablet_bootstrap.cc:492] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:42.566586  8577 ts_tablet_manager.cc:1403] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.157s	user 0.011s	sys 0.010s
I20260709 13:00:42.578920  8575 tablet_bootstrap.cc:654] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.646099  8576 tablet_bootstrap.cc:492] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:42.650395  8576 ts_tablet_manager.cc:1403] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.133s	user 0.011s	sys 0.018s
I20260709 13:00:42.650086  8577 raft_consensus.cc:359] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.650815  8577 raft_consensus.cc:385] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.651108  8577 raft_consensus.cc:740] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.652694  8576 raft_consensus.cc:359] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.653267  8576 raft_consensus.cc:385] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.653578  8576 raft_consensus.cc:740] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.654394  8576 consensus_queue.cc:260] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.655179  8709 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.655547  8799 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:42.655660  8709 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.658455  8709 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:42.659605  8576 ts_tablet_manager.cc:1434] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:00:42.659765  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:42.660081  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:42.660456  8532 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:42.660703  8576 tablet_bootstrap.cc:492] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:42.660663  8386 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:42.661759  8424 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:42.662956  8709 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:42.663300  8709 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.663636  8709 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.671739  8576 tablet_bootstrap.cc:654] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.672052  8577 consensus_queue.cc:260] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.672431  8709 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.677115  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:42.677738  8386 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.679178  8577 ts_tablet_manager.cc:1434] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.112s	user 0.005s	sys 0.002s
I20260709 13:00:42.680361  8577 tablet_bootstrap.cc:492] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:42.685657  8618 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:42.688387  8709 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:42.691840  8763 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.693903  8763 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.695986  8763 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:42.696359  8386 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:42.696730  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:42.697588  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:42.698731  8533 raft_consensus.cc:2393] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 1: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:00:42.700443  8349 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:42.702092  8763 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.693133  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:42.704039  8532 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.691885  8576 tablet_bootstrap.cc:492] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:42.705696  8576 ts_tablet_manager.cc:1403] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.003s
I20260709 13:00:42.690457  8282 catalog_manager.cc:5697] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:42.714280  8427 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:42.715454  8709 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:42.715967  8709 raft_consensus.cc:697] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:42.716765  8709 consensus_queue.cc:237] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.717631  8577 tablet_bootstrap.cc:654] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.711017  8532 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:42.725000  8575 tablet_bootstrap.cc:492] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:42.725487  8575 ts_tablet_manager.cc:1403] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.172s	user 0.040s	sys 0.073s
I20260709 13:00:42.728015  8575 raft_consensus.cc:359] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.728722  8575 raft_consensus.cc:385] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.728986  8575 raft_consensus.cc:740] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.712069  8763 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:42.713335  8576 raft_consensus.cc:359] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.729658  8576 raft_consensus.cc:385] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.730012  8576 raft_consensus.cc:740] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.730237  8575 consensus_queue.cc:260] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.730810  8576 consensus_queue.cc:260] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.732463  8575 ts_tablet_manager.cc:1434] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:00:42.733403  8576 ts_tablet_manager.cc:1434] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:00:42.735069  8575 tablet_bootstrap.cc:492] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:42.738819  8577 tablet_bootstrap.cc:492] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:42.739984  8577 ts_tablet_manager.cc:1403] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.060s	user 0.007s	sys 0.006s
I20260709 13:00:42.741142  8576 tablet_bootstrap.cc:492] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:42.742486  8577 raft_consensus.cc:359] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.743095  8577 raft_consensus.cc:385] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.743366  8577 raft_consensus.cc:740] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.744035  8577 consensus_queue.cc:260] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.746774  8577 ts_tablet_manager.cc:1434] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:00:42.747545  8577 tablet_bootstrap.cc:492] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:42.748238  8283 catalog_manager.cc:5697] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 0 to 1, leader changed from <none> to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:42.749895  8283 catalog_manager.cc:5697] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 0 to 1, leader changed from <none> to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:42.751628  8576 tablet_bootstrap.cc:654] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.751768  8575 tablet_bootstrap.cc:654] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.753587  8577 tablet_bootstrap.cc:654] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.757215  8625 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.757745  8625 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.759908  8625 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:42.761474  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:42.762804  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:00:42.764999  8500 leader_election.cc:343] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.768627  8577 tablet_bootstrap.cc:492] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:42.769129  8577 ts_tablet_manager.cc:1403] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
W20260709 13:00:42.772008  8501 leader_election.cc:343] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.772413  8577 raft_consensus.cc:359] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.772655  8501 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:42.773130  8577 raft_consensus.cc:385] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.773495  8577 raft_consensus.cc:740] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.774248  8577 consensus_queue.cc:260] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.776257  8577 ts_tablet_manager.cc:1434] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:42.777067  8599 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:42.777189  8577 tablet_bootstrap.cc:492] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:42.779578  8575 tablet_bootstrap.cc:492] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:42.780001  8575 ts_tablet_manager.cc:1403] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.047s	user 0.002s	sys 0.015s
I20260709 13:00:42.782672  8575 raft_consensus.cc:359] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.783169  8575 raft_consensus.cc:385] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.783392  8575 raft_consensus.cc:740] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.783684  8577 tablet_bootstrap.cc:654] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.783972  8575 consensus_queue.cc:260] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.785985  8575 ts_tablet_manager.cc:1434] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:00:42.786952  8575 tablet_bootstrap.cc:492] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:42.787058  8576 tablet_bootstrap.cc:492] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:42.787546  8576 ts_tablet_manager.cc:1403] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.006s
I20260709 13:00:42.790333  8576 raft_consensus.cc:359] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.791041  8576 raft_consensus.cc:385] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.791370  8576 raft_consensus.cc:740] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.792053  8576 consensus_queue.cc:260] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.792922  8575 tablet_bootstrap.cc:654] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.794744  8576 ts_tablet_manager.cc:1434] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:00:42.795812  8576 tablet_bootstrap.cc:492] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:42.794780  8281 catalog_manager.cc:5697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:42.804716  8576 tablet_bootstrap.cc:654] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.827966  8576 tablet_bootstrap.cc:492] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:42.828673  8576 ts_tablet_manager.cc:1403] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.005s
I20260709 13:00:42.832914  8576 raft_consensus.cc:359] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.835647  8282 catalog_manager.cc:5697] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:42.840907  8577 tablet_bootstrap.cc:492] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:42.841432  8577 ts_tablet_manager.cc:1403] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.023s
I20260709 13:00:42.844611  8577 raft_consensus.cc:359] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.845288  8577 raft_consensus.cc:385] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.845566  8577 raft_consensus.cc:740] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.846298  8577 consensus_queue.cc:260] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.848122  8577 ts_tablet_manager.cc:1434] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:00:42.848887  8577 tablet_bootstrap.cc:492] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:42.834064  8576 raft_consensus.cc:385] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.855041  8576 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.855943  8576 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.860211  8576 ts_tablet_manager.cc:1434] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:00:42.861176  8576 tablet_bootstrap.cc:492] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:42.861294  8789 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:42.852952  8577 tablet_bootstrap.cc:654] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.860747  8575 tablet_bootstrap.cc:492] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:42.866338  8575 ts_tablet_manager.cc:1403] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.080s	user 0.015s	sys 0.048s
I20260709 13:00:42.868642  8576 tablet_bootstrap.cc:654] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.868975  8575 raft_consensus.cc:359] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.873817  8575 raft_consensus.cc:385] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.874164  8575 raft_consensus.cc:740] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.874931  8575 consensus_queue.cc:260] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.879551  8575 ts_tablet_manager.cc:1434] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:00:42.881531  8575 tablet_bootstrap.cc:492] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:42.888347  8709 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.888892  8709 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.891597  8709 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:42.893615  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:42.894323  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:00:42.895085  8427 leader_election.cc:343] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.895035  8532 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:42.897547  8575 tablet_bootstrap.cc:654] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.898995  8636 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.899559  8585 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.899492  8636 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.900038  8585 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.902083  8636 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:42.903172  8585 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:42.903486  8424 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:42.904182  8585 raft_consensus.cc:2804] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:42.904577  8585 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.904970  8585 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.904789  8788 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:42.907729  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:42.908607  8530 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:42.910343  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:42.911078  8532 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:42.912352  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:42.913172  8380 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:42.914377  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:42.915076  8383 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:42.916531  8427 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:42.917513  8636 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:42.917683  8427 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:42.918054  8636 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.918958  8790 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:42.919332  8790 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.919672  8790 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.924450  8709 consensus_queue.cc:1048] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:42.910290  8575 tablet_bootstrap.cc:492] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:42.918589  8636 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.924989  8585 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.954344  8575 ts_tablet_manager.cc:1403] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.073s	user 0.031s	sys 0.003s
I20260709 13:00:42.956915  8575 raft_consensus.cc:359] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.957767  8575 raft_consensus.cc:385] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.958132  8575 raft_consensus.cc:740] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.938411  8790 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.958900  8575 consensus_queue.cc:260] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.960836  8790 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:42.961148  8575 ts_tablet_manager.cc:1434] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:00:42.962205  8575 tablet_bootstrap.cc:492] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:42.967883  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:42.968519  8380 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.968719  8763 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:42.971390  8636 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.975420  8380 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:42.979326  8427 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:42.979786  8384 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.981160  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:42.981730  8385 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.983101  8636 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:42.984146  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:42.976123  8575 tablet_bootstrap.cc:654] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.988857  8530 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.990032  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:42.990706  8533 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.990967  8710 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.993650  8710 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.996201  8710 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:43.001046  8530 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:43.001708  8385 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:43.011533  8427 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:43.012836  8790 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:43.013561  8790 raft_consensus.cc:697] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:43.014590  8790 consensus_queue.cc:237] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:42.990459  8636 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:43.210033  8636 raft_consensus.cc:697] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:00:44.290262  7276 debug-util.cc:398] Leaking SignalData structure 0x7b080000f980 after lost signal to thread 8838
W20260709 13:00:44.326941  7276 kernel_stack_watchdog.cc:198] Thread 8838 stuck at /apache/dev/git/kudu/src/kudu/consensus/log.cc:409 for 111ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260709 13:00:45.009902  8575 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 2.003s	user 0.022s	sys 0.095s
W20260709 13:00:45.053354  8575 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 2.046s	user 0.022s	sys 0.096s
I20260709 13:00:44.319619  8636 consensus_queue.cc:237] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:44.962270  8585 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:00:45.296185  8576 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 2.425s	user 0.120s	sys 0.165s
W20260709 13:00:45.296664  8576 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 2.426s	user 0.120s	sys 0.165s
I20260709 13:00:45.445828  8577 tablet_bootstrap.cc:492] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:45.446440  8577 ts_tablet_manager.cc:1403] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 2.598s	user 0.039s	sys 0.073s
W20260709 13:00:45.674634  8790 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.090s	user 0.010s	sys 0.002s
W20260709 13:00:45.680231  8799 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.910s	user 0.005s	sys 0.011s
W20260709 13:00:45.681094  8790 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.097s	user 0.011s	sys 0.002s
W20260709 13:00:45.682907  8799 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.996s	user 0.005s	sys 0.011s
I20260709 13:00:45.691769  8575 tablet_bootstrap.cc:492] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:45.692457  8575 ts_tablet_manager.cc:1403] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 2.730s	user 0.031s	sys 0.097s
I20260709 13:00:45.696681  8576 tablet_bootstrap.cc:492] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:45.697368  8576 ts_tablet_manager.cc:1403] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 2.836s	user 0.131s	sys 0.165s
I20260709 13:00:45.703025  8577 raft_consensus.cc:359] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:45.703713  8577 raft_consensus.cc:385] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.703601  8576 raft_consensus.cc:359] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:45.704120  8577 raft_consensus.cc:740] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.704396  8576 raft_consensus.cc:385] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.704715  8576 raft_consensus.cc:740] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
W20260709 13:00:45.700258  8636 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.009s	sys 0.033s
I20260709 13:00:45.704823  8577 consensus_queue.cc:260] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:45.705339  8576 consensus_queue.cc:260] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:45.726486  8576 ts_tablet_manager.cc:1434] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
W20260709 13:00:45.705600  8636 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.009s	sys 0.034s
I20260709 13:00:45.728827  8576 tablet_bootstrap.cc:492] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:45.785770  8577 ts_tablet_manager.cc:1434] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.339s	user 0.007s	sys 0.000s
I20260709 13:00:45.869076  8576 tablet_bootstrap.cc:654] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:45.932291  8576 tablet_bootstrap.cc:492] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:45.932879  8576 ts_tablet_manager.cc:1403] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.204s	user 0.039s	sys 0.028s
I20260709 13:00:45.936300  8576 raft_consensus.cc:359] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:45.937202  8576 raft_consensus.cc:385] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.937494  8576 raft_consensus.cc:740] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.938364  8576 consensus_queue.cc:260] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:45.940255  8576 ts_tablet_manager.cc:1434] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:00:45.941612  8576 tablet_bootstrap.cc:492] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:45.948134  8576 tablet_bootstrap.cc:654] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:46.009126  7276 debug-util.cc:398] Leaking SignalData structure 0x7b080000f820 after lost signal to thread 8501
W20260709 13:00:46.009651  7276 kernel_stack_watchdog.cc:198] Thread 8501 stuck at /apache/dev/git/kudu/src/kudu/util/thread.cc:642 for 1389ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:00:46.020780  8576 tablet_bootstrap.cc:492] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:46.021421  8576 ts_tablet_manager.cc:1403] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.080s	user 0.034s	sys 0.026s
W20260709 13:00:46.024434  8383 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.065s	user 0.050s	sys 0.096s
W20260709 13:00:46.025012  8383 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.066s	user 0.051s	sys 0.097s
I20260709 13:00:46.024471  8576 raft_consensus.cc:359] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.025481  8576 raft_consensus.cc:385] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.025725  8576 raft_consensus.cc:740] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.025902  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 101) took 3068 ms. Trace:
I20260709 13:00:46.026396  8576 consensus_queue.cc:260] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.026414  8383 rpcz_store.cc:276] 0709 13:00:42.957490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.957703 (+   213us) service_pool.cc:224] Handling call
0709 13:00:42.958007 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.958309 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.958342 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.959108 (+   766us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.025446 (+3066338us) raft_consensus.cc:1645] Marking committed up to 0
0709 13:00:46.025503 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.025594 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.025646 (+    52us) raft_consensus.cc:1685] finished
0709 13:00:46.025657 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.025822 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1939,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":3065970,"threads_started":1,"wal-append.queue_time_us":2721599}
I20260709 13:00:46.028527  8576 ts_tablet_manager.cc:1434] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:46.066987  8799 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.067530  8799 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.066973  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:00:46.070551  8385 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 105) took 3060 ms (client timeout 2060 ms). Trace:
W20260709 13:00:46.070994  8385 rpcz_store.cc:269] 0709 13:00:43.010369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.013641 (+  3272us) service_pool.cc:224] Handling call
0709 13:00:46.070438 (+3056797us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.070315  8799 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.080714  8799 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:46.081256  8799 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.081692  8846 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.082011  8854 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.082306  8846 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.082618  8854 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.083340  8799 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.084205  8846 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.084618  8854 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:00:46.121424  8533 consensus_meta.cc:287] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 3.129s	user 0.057s	sys 0.097s
I20260709 13:00:46.121857  8533 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
W20260709 13:00:46.122534  8533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38894 (request call id 93) took 3133 ms (client timeout 1623 ms). Trace:
W20260709 13:00:46.122916  8533 rpcz_store.cc:269] 0709 13:00:42.989630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.989776 (+   146us) service_pool.cc:224] Handling call
0709 13:00:46.122436 (+3132660us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:46.126325  8499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.067s	user 0.000s	sys 0.013s
W20260709 13:00:46.126678  8499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.079s	user 0.000s	sys 0.013s
I20260709 13:00:46.128290  8848 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:46.128387  8789 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:46.128698  8847 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:46.128816  8848 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.128922  8789 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.129369  8847 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.131726  8847 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.132285  8847 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.132864  8789 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.132807  8847 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.136237  8847 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.137429  8848 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.356427  8846 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.356993  8846 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:46.357872  8424 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.372s	user 0.017s	sys 0.013s
W20260709 13:00:46.358199  8424 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.372s	user 0.017s	sys 0.013s
I20260709 13:00:46.359130  8846 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.360354  8799 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:46.361677  8853 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.362113  8846 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:46.362167  8853 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.362706  8846 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.364424  8853 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.364547  8846 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.365664  8384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 100) took 3386 ms. Trace:
I20260709 13:00:46.366122  8853 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:46.366712  8853 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.369292  8853 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.366426  8384 rpcz_store.cc:276] 0709 13:00:42.979082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.979205 (+   123us) service_pool.cc:224] Handling call
0709 13:00:42.979530 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.128054 (+3148524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.128085 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:46.128525 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.138595 (+ 10070us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:46.139557 (+   962us) log.cc:844] Serialized 14 byte log entry
0709 13:00:46.139760 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.139846 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.365436 (+225590us) raft_consensus.cc:1685] finished
0709 13:00:46.365460 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.365604 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":938,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":8184,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":142,"thread_start_us":10361,"threads_started":2,"wal-append.queue_time_us":10092}
I20260709 13:00:46.370520  8846 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.371044  8846 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.373172  8846 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.447412  8854 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.448046  8854 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.448415  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 97) took 3541 ms. Trace:
I20260709 13:00:46.448798  8386 rpcz_store.cc:276] 0709 13:00:42.906735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.906879 (+   144us) service_pool.cc:224] Handling call
0709 13:00:42.907209 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.907600 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.907642 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.908351 (+   709us) log.cc:844] Serialized 26 byte log entry
0709 13:00:42.923657 (+ 15306us) raft_consensus.cc:1645] Marking committed up to 0
0709 13:00:42.923786 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.923855 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.017628 (+ 93773us) raft_consensus.cc:1685] finished
0709 13:00:43.017653 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.448354 (+3430701us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1367,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":14224,"threads_started":1,"wal-append.queue_time_us":16160}
I20260709 13:00:46.450176  8854 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.451625  8854 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.452095  8854 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.455304  8854 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.459438  8846 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.459959  8846 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.460604  8854 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:46.461251  8854 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.461889  8846 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.463792  8854 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.474135  8854 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.475575  8854 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:00:46.474509  8577 tablet_bootstrap.cc:492] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:46.479043  8853 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:46.479563  8853 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.481982  8846 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.482518  8846 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.360857  8799 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.484618  8846 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.486603  8799 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.488067  8577 tablet_bootstrap.cc:654] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.490326  8799 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.491250  8799 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.493810  8799 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.494244  8846 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:46.494299  8799 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.494866  8846 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.495007  8799 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.496135  8853 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.496999  8846 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.478282  8854 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.497231  8799 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.499114  8799 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:46.499327  8854 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:46.499580  8799 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.499867  8854 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.502104  8854 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.502592  8854 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:46.503073  8854 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:46.504402  8426 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.920s	user 0.008s	sys 0.014s
W20260709 13:00:46.504733  8426 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.936s	user 0.008s	sys 0.014s
I20260709 13:00:46.505033  8854 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.505214  8853 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.506767  8799 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.508308  8853 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:46.509071  8501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.890s	user 0.001s	sys 0.022s
W20260709 13:00:46.509593  8501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.890s	user 0.002s	sys 0.022s
I20260709 13:00:46.511163  8853 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.514235  8577 tablet_bootstrap.cc:492] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:46.514673  8599 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.515141  8599 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.515949  8848 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:46.516422  8848 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.517118  8599 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.517845  8577 ts_tablet_manager.cc:1403] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.006s
I20260709 13:00:46.518388  8848 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.519083  8576 tablet_bootstrap.cc:492] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:46.520540  8848 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.521030  8848 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.521036  8577 raft_consensus.cc:359] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.523262  8848 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.524040  8599 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.524470  8847 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:46.524518  8599 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.525065  8847 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.526604  8599 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.526877  8847 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.527076  8599 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.527483  8599 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.527947  8282 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53486 (request call id 81) took 3539 ms. Trace:
I20260709 13:00:46.528303  8282 rpcz_store.cc:276] 0709 13:00:42.988208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.988344 (+   136us) service_pool.cc:224] Handling call
0709 13:00:46.527856 (+3539512us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3}
I20260709 13:00:46.529810  8599 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.521885  8577 raft_consensus.cc:385] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.530807  8577 raft_consensus.cc:740] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.531622  8577 consensus_queue.cc:260] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.531924  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:46.533879  8577 ts_tablet_manager.cc:1434] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:00:46.534077  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:46.534403  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:46.534663  8386 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:46.534849  8577 tablet_bootstrap.cc:492] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
W20260709 13:00:46.535799  8498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.767s	user 0.014s	sys 0.028s
I20260709 13:00:46.535692  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:00:46.536136  8498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.851s	user 0.015s	sys 0.028s
I20260709 13:00:46.536952  8599 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.537400  8599 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.538841  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:46.539376  8599 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.539693  8845 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.539899  8599 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.540145  8845 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.540303  8599 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.540696  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:46.541396  8385 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:46.541749  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:46.542632  8386 raft_consensus.cc:2410] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:00:46.542922  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:46.541411  8849 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.543507  8383 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:46.543890  8849 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:00:46.545050  8847 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:46.545171  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:46.545732  8790 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:46.545565  8847 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.546734  8577 tablet_bootstrap.cc:654] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.546265  8790 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.547153  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:46.547822  8383 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:46.547914  8845 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.548327  8790 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.548604  8841 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:46.549245  8841 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.551767  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:46.551954  8599 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.552378  8383 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:46.554082  8841 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.554044  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:46.554731  8849 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.555861  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:46.556416  8386 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:46.557377  8847 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.559623  8501 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:46.547189  8844 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:46.560834  8844 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.562446  8861 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:46.562896  8866 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.563009  8861 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.564682  8599 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:46.563961  8500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.695s	user 0.000s	sys 0.026s
W20260709 13:00:46.565209  8500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.727s	user 0.000s	sys 0.027s
I20260709 13:00:46.565107  8599 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.565762  8599 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.565068  8501 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:46.551949  8575 raft_consensus.cc:359] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.568074  8575 raft_consensus.cc:385] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.568418  8575 raft_consensus.cc:740] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.540499  8625 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.583102  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:46.583978  8386 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:46.566380  8709 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.587100  8575 consensus_queue.cc:260] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.576910  8585 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:46.589305  8585 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.590425  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:46.563866  8849 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:46.563086  8844 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.607293  8501 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:46.611991  8501 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:46.600500  8709 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.586360  8625 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.608443  8789 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:46.607566  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:46.604827  8848 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.614301  8845 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:46.619567  8861 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.620220  8575 ts_tablet_manager.cc:1434] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.927s	user 0.010s	sys 0.002s
I20260709 13:00:46.581511  8866 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.622614  8866 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.626153  8585 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.619819  8845 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.626866  8845 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.627749  8625 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.628093  8709 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.618165  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:46.613339  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:46.611327  8847 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:00:46.620489  8575 ts_tablet_manager.cc:1467] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: Tablet startup took 927ms
I20260709 13:00:46.630290  8501 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:46.613997  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:46.624976  8861 raft_consensus.cc:2804] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:46.638409  8861 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.630539  8636 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:46.602762  8849 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.617503  8789 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:46.634967  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:46.636442  8867 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:46.623611  8848 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.639005  8533 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:46.651158  8636 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.638759  8861 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.625165  8866 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.659682  8585 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:46.663895  8863 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:46.650378  8385 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.633325  8847 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.659021  8789 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.666685  8866 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.660818  8709 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:46.670198  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:46.670135  8709 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.664386  8863 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.671701  8867 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.695194  8869 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:46.695741  8869 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.696106  8869 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.663369  8585 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.698139  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:00:46.633559  8575 ts_tablet_manager.cc:1469] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: Trace:
0709 13:00:38.477114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.477267 (+   153us) service_pool.cc:224] Handling call
0709 13:00:38.479142 (+  1875us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:00:38.479240 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:00:38.540955 (+ 61715us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:38.571863 (+ 30908us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:38.572307 (+   444us) inbound_call.cc:177] Queueing success response
0709 13:00:42.961866 (+4389559us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:00:45.692807 (+2730941us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:00:45.703047 (+ 10240us) tablet_replica.cc:261] Starting instrumentation
0709 13:00:45.703508 (+   461us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":849889,"raft.queue_time_us":29425,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":8834,"tablet-open.queue_time_us":4389634}
I20260709 13:00:46.703258  8577 tablet_bootstrap.cc:492] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:46.703718  8577 ts_tablet_manager.cc:1403] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.169s	user 0.015s	sys 0.041s
W20260709 13:00:46.723692  8487 tablet.cc:2406] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:00:46.976581  8576 tablet_bootstrap.cc:654] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.735800  8636 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.782604  8575 tablet_bootstrap.cc:492] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:46.972955  8845 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.894006  8869 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.028204  8577 raft_consensus.cc:359] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.032244  8577 raft_consensus.cc:385] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.032967  8577 raft_consensus.cc:740] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
W20260709 13:00:46.740520  8332 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:00:47.029855  8424 connection.cc:256] RPC call timeout handler was delayed by -1.9127525900000251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
W20260709 13:00:47.033764  8424 connection.cc:256] RPC call timeout handler was delayed by -1.4780511829999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21130000000000002s for a response
I20260709 13:00:46.739166  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:46.788281  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:46.821609  8790 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:00:47.035918  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 405665us
I20260709 13:00:46.779222  8863 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.981317  8636 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.818982  8844 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:46.926590  8867 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:46.820604  8710 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:46.852849  8799 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.928359  8625 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:00:47.036887  8501 leader_election.cc:343] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:46.980135  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:00:46.975150  8427 connection.cc:256] RPC call timeout handler was delayed by -1.750142545000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20600000000000002s for a response
I20260709 13:00:46.849529  8868 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:46.853250  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:46.852665  8841 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:46.894500  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:46.780664  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:46.781247  8709 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.010061  8847 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.810384  8853 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.965772  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.039987  8501 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:47.039340  8577 consensus_queue.cc:260] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.042240  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:46.818753  8599 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:46.964090  8789 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.038913  8866 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:46.891664  8862 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:47.050436  8501 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:47.041064  8867 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:46.976667  8873 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:47.038154  8861 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:47.041129  8427 connection.cc:256] RPC call timeout handler was delayed by -1.6061790460000225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
I20260709 13:00:47.040016  8863 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:47.041683  8385 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:47.049001  8848 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:47.050295  8585 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.039170  8636 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.039855  8790 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.040366  8844 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.040750  8799 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.041828  8625 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.040679  8710 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.049599  8841 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.067068  8577 ts_tablet_manager.cc:1434] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.363s	user 0.007s	sys 0.020s
I20260709 13:00:47.051644  8853 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:47.056015  8427 connection.cc:256] RPC call timeout handler was delayed by -1.462179046000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260709 13:00:47.061645  8847 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.061537  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.053517  8868 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.063616  8873 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.074126  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.074847  8849 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:47.074828  8844 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.056674  8867 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:47.070978  8427 connection.cc:256] RPC call timeout handler was delayed by -1.3883790460000682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
I20260709 13:00:47.082391  8867 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.077157  8871 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.058682  8863 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.069998  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.078114  8790 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.072297  8847 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.078675  8710 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.080642  8841 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.072531  8533 raft_consensus.cc:2393] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 1: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:47.077314  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.075759  8461 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:47.085330  8866 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:47.089635  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.089984  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.090706  8873 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.091611  8625 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:47.078897  8870 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.078229  8845 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:47.058727  8862 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.094359  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.072049  8875 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.094219  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.094700  8847 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.092010  8853 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.094216  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.122223  8799 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.107841  8456 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:47.108783  8789 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:47.109133  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:47.122689  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.123134  8380 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:47.106290  8427 leader_election.cc:343] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.103246  8599 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:47.110278  8576 tablet_bootstrap.cc:492] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:47.111090  8863 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.111137  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.125846  8379 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:47.111415  8869 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:47.126612  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.127264  8386 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:47.120517  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.128548  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.113603  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:47.115442  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.115825  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.130949  8861 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:47.105450  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.131729  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.132275  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.132858  8460 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:47.132946  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.133810  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.134128  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.134411  8460 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:47.117494  8384 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:47.135308  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.107054  8866 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.136029  8382 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.118075  8625 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.117451  8875 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:47.102793  8849 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:47.138688  8866 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:47.138476  8849 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.138271  8625 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.138283  8875 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.140432  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.129403  8576 ts_tablet_manager.cc:1403] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 1.100s	user 0.037s	sys 0.080s
I20260709 13:00:47.114156  8636 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.083154  8871 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.142303  8625 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:47.146440  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.146715  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.146977  8871 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:47.147738  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.147825  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.127282  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.113675  8870 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.151952  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:47.152704  8386 raft_consensus.cc:2393] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 1: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:00:47.154111  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.159371  8386 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:47.139523  8452 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:47.158684  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.162846  8457 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:47.163182  8530 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:47.161275  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.163861  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.164475  8461 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:47.164570  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.165724  8577 tablet_bootstrap.cc:492] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:47.162921  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.168967  8454 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:47.170056  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.170833  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:47.159061  8849 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:47.177868  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.174296  8378 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.152271  8458 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:47.182065  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:47.182628  8381 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.184291  8873 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.172973  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.171300  8868 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.185532  8427 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:47.186534  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.186192  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.216523  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.218497  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.219372  8455 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:47.226236  8501 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:47.227578  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.234733  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.175442  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.236380  8625 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:47.236677  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 51231.6us
I20260709 13:00:47.236841  8625 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:47.237340  8841 raft_consensus.cc:2804] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:47.237324  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.238837  8501 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:47.239951  8380 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:00:47.239892  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.239892  8625 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.241425  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.243103  8849 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.244554  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.244635  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.246315  8501 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:47.245440  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.247102  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.251200  8575 tablet_bootstrap.cc:654] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.247128  8841 raft_consensus.cc:697] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:47.269335  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.275045  8872 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.271677  8501 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:47.250705  8532 raft_consensus.cc:2393] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 2: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:47.278013  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.275584  8872 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.248787  8849 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.284345  8853 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.284765  8872 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:47.288564  8870 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.289120  8863 consensus_queue.cc:1048] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.289330  8424 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.288451  8283 catalog_manager.cc:5697] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.249397  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.290861  8283 catalog_manager.cc:5697] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.290488  8576 raft_consensus.cc:359] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.292382  8576 raft_consensus.cc:385] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.292660  8576 raft_consensus.cc:740] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.293318  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.260331  8382 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:00:47.275803  8875 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:00:47.248869  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.295312  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.296193  8875 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:47.297523  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.292014  8871 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.298164  8871 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.298264  8530 raft_consensus.cc:2393] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 2: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:47.298537  8871 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.249140  8384 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:47.301369  8862 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.299103  8385 raft_consensus.cc:1240] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.276124  8381 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:00:47.300390  8576 consensus_queue.cc:260] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.303597  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.304472  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.306332  8379 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.289969  8849 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:47.305274  8501 leader_election.cc:343] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.307837  8501 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:47.305625  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.269944  8841 consensus_queue.cc:237] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.300558  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.302794  8870 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.317183  8870 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.317565  8870 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.321384  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.322721  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.321213  8625 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.329010  8576 ts_tablet_manager.cc:1434] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.188s	user 0.008s	sys 0.001s
I20260709 13:00:47.329938  8577 tablet_bootstrap.cc:654] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:47.331280  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 47411.9us
I20260709 13:00:47.323627  8599 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:47.328450  8534 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:47.341188  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.338697  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.346143  8576 tablet_bootstrap.cc:492] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:47.343842  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.348387  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.348496  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.351025  8527 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:47.351186  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.351377  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.342669  8599 raft_consensus.cc:697] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:47.362023  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.343876  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.362699  8599 consensus_queue.cc:237] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.362995  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.362962  8535 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:47.364013  8878 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.364164  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.364486  8878 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:47.362694  8386 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:47.347946  8381 raft_consensus.cc:1240] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.364912  8878 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.366909  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:00:47.369509  8556 debug-util.cc:398] Leaking SignalData structure 0x7b08001998a0 after lost signal to thread 7274
I20260709 13:00:47.340817  8847 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.360474  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.362074  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.379073  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.379642  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.379724  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.382124  8847 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:47.382283  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.369654  8378 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:00:47.377166  8531 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 2: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:47.403805  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.362063  8870 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.404340  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.414691  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.386055  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.412561  8532 raft_consensus.cc:1240] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.414729  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.402678  8528 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:47.427181  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.427773  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.428313  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:47.428531  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.429011  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.427220  8455 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:47.418519  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.430261  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.418907  8384 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.443231  8500 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.444341  8875 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.444651  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:47.445307  8535 raft_consensus.cc:2393] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 2: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:47.446022  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:47.446326  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.446651  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:47.447705  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.448498  8349 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:47.448948  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.449326  8853 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.449548  8454 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:47.449717  8853 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.450121  8853 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.446123  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.447342  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:00:47.443332  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 108512us
I20260709 13:00:47.450361  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.444365  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.451083  8500 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.456269  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.459760  8351 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:47.468493  8883 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:47.452502  8556 debug-util.cc:398] Leaking SignalData structure 0x7b080017a620 after lost signal to thread 8318
I20260709 13:00:47.472083  8500 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.451009  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.473976  8847 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.475605  8500 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.453610  8625 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:47.480893  8500 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.479946  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.470460  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.475454  8875 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.485270  8500 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.486711  8500 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.469414  8849 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.477674  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:47.489189  8500 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.482718  8847 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.490729  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.491968  8576 tablet_bootstrap.cc:654] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.494076  8575 tablet_bootstrap.cc:492] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:47.494692  8575 ts_tablet_manager.cc:1403] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.749s	user 0.025s	sys 0.023s
I20260709 13:00:47.496412  8841 consensus_queue.cc:1059] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:00:47.500452  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.500975  8841 raft_consensus.cc:3055] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:47.501446  8841 raft_consensus.cc:740] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:47.501742  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.502339  8841 consensus_queue.cc:260] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.489960  8866 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.503585  8841 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.503588  8866 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.504259  8866 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.505380  8427 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:47.485107  8872 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.483408  8349 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:47.515419  8875 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:47.499239  8556 debug-util.cc:398] Leaking SignalData structure 0x7b0800288ec0 after lost signal to thread 8410
I20260709 13:00:47.489825  8789 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.501459  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.522222  8881 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.516568  8636 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.524263  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.532523  8500 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.543215  8865 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.542136  8534 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 1: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:47.521319  8789 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:47.548048  8500 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.531369  8636 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.551151  8500 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.551949  8500 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.542106  8872 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.542201  8881 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:47.545183  8789 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.555742  8500 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:00:47.548806  8556 debug-util.cc:398] Leaking SignalData structure 0x7b0800288780 after lost signal to thread 8485
I20260709 13:00:47.550630  8636 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.557360  8848 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:47.555956  8845 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.561261  8575 raft_consensus.cc:359] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.562247  8575 raft_consensus.cc:385] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.562629  8575 raft_consensus.cc:740] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.553807  8861 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.554425  8847 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.565265  8575 consensus_queue.cc:260] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.556110  8881 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.560792  8862 consensus_queue.cc:1059] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:00:47.595486  8427 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:47.596859  8575 ts_tablet_manager.cc:1434] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.003s
W20260709 13:00:47.605345  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 47142.7us
W20260709 13:00:47.602262  8556 debug-util.cc:398] Leaking SignalData structure 0x7b0800262a80 after lost signal to thread 8559
W20260709 13:00:47.606402  8500 leader_election.cc:343] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.607985  8500 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.603438  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:00:47.610005  8500 leader_election.cc:343] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.611392  8500 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.613157  8577 tablet_bootstrap.cc:492] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:47.613721  8577 ts_tablet_manager.cc:1403] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.455s	user 0.017s	sys 0.026s
I20260709 13:00:47.613806  8625 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:47.614306  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:47.610922  8710 consensus_queue.cc:1059] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:00:47.616045  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:47.616729  8528 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.616565  8577 raft_consensus.cc:359] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.617323  8577 raft_consensus.cc:385] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.617609  8577 raft_consensus.cc:740] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.618232  8577 consensus_queue.cc:260] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.619822  8577 ts_tablet_manager.cc:1434] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:00:47.619930  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:47.608263  8849 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:47.609229  8868 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.608949  8863 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.613662  8871 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.610157  8847 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.626866  8351 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:47.627552  8871 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:00:47.627745  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 160989us
I20260709 13:00:47.628275  8526 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 1: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:47.628460  8351 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:47.625262  8868 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.630815  8799 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.630939  8868 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.630216  8883 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.636705  8870 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:00:47.605432  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 89246.3us
I20260709 13:00:47.641217  8863 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.642284  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:47.643445  8531 raft_consensus.cc:1240] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.643780  8790 raft_consensus.cc:3055] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:47.644029  8863 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.644232  8790 raft_consensus.cc:740] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:47.625440  8710 raft_consensus.cc:3055] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:47.644800  8710 raft_consensus.cc:740] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:47.642129  8534 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.646173  8790 consensus_queue.cc:260] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.642138  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.647414  8789 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.647889  8878 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.648998  8533 raft_consensus.cc:2393] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 2: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:47.649757  8789 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:47.646194  8710 consensus_queue.cc:260] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.644729  8636 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.650717  8710 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.651425  8454 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 1: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:00:47.651305  8527 raft_consensus.cc:1240] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.653182  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:47.653782  8454 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.647550  8349 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:47.656075  8636 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.656188  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.658149  8349 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:47.658383  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:47.658839  8883 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.658962  8891 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.659211  8883 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:47.659431  8891 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:47.659672  8883 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.659888  8891 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.657408  8351 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:00:47.661824  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 49562.5us
I20260709 13:00:47.662710  8351 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:47.660539  8535 raft_consensus.cc:1240] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.664019  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.664173  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.664845  8534 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 1: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:47.665158  8799 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:47.669054  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.669581  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.657126  8885 log.cc:927] Time spent T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:00:47.670115  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:47.647468  8790 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.663515  8351 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:47.673421  8351 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:47.664026  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.677248  8799 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.711920  8862 consensus_queue.cc:1059] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:47.669337  8531 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.724416  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.724897  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:47.726117  8575 tablet_bootstrap.cc:492] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:47.677670  8799 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:47.664404  8894 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.737651  8894 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.733279  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.735391  8532 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.738107  8894 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:47.743122  8873 raft_consensus.cc:3055] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:47.741365  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:00:47.740513  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 67166.9us
I20260709 13:00:47.753662  8577 tablet_bootstrap.cc:492] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:47.754688  8878 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:47.752837  8894 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.738303  8799 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.759722  8351 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:47.758774  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:47.751080  8873 raft_consensus.cc:740] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:47.769615  8873 consensus_queue.cc:260] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.773427  8873 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.780405  8576 tablet_bootstrap.cc:492] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:47.780951  8576 ts_tablet_manager.cc:1403] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.441s	user 0.018s	sys 0.008s
I20260709 13:00:47.783725  8576 raft_consensus.cc:359] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.784431  8576 raft_consensus.cc:385] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.784710  8576 raft_consensus.cc:740] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.786049  8576 consensus_queue.cc:260] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.787262  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:47.767405  8891 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.767940  8349 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:47.795584  8898 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.796500  8898 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.796856  8898 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:47.797272  8898 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.797374  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:47.798573  8385 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.788210  8866 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.803110  8896 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.803239  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:47.805459  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.796803  8891 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.811129  8576 ts_tablet_manager.cc:1434] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.030s	user 0.015s	sys 0.011s
I20260709 13:00:47.812119  8575 tablet_bootstrap.cc:654] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.808807  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:47.814632  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:00:47.807832  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 50230.9us
I20260709 13:00:47.818442  8576 tablet_bootstrap.cc:492] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:47.815263  8379 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:47.809684  8531 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:47.823763  8528 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 1: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:47.825716  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:47.808821  8883 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.815441  8866 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:47.825671  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:47.830406  8383 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.822057  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:47.832311  8529 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 1: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:47.833704  8456 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 1: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:00:47.836122  8577 tablet_bootstrap.cc:654] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.817935  8853 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:47.842532  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.842728  8377 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.846354  8894 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.848565  8894 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.849707  8529 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.828755  8868 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.851505  8460 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 1: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:00:47.852526  8385 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:47.852895  8868 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.832933  8881 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.856320  8377 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.856977  8881 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.857674  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:47.858688  8424 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.858925  8385 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.862200  8424 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.828963  8349 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:47.870012  8424 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.872179  8427 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:47.873844  8863 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.874223  8863 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.874543  8863 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.874591  8424 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.861029  8790 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.867475  8379 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.867702  8862 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.883086  8424 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.881506  8881 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.884871  8385 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:47.873306  8868 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.882354  8636 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:47.893946  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 70702.4us
I20260709 13:00:47.895681  8636 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.895402  8862 consensus_queue.cc:1059] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:00:47.892155  8883 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.906455  8424 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:00:47.912356  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 125165us
I20260709 13:00:47.914057  8424 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.914717  8351 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:47.916018  8424 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.916561  8427 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:47.915793  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:47.920656  8351 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:47.924289  8899 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.925904  8899 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:47.926282  8899 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.917791  8636 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.919056  8790 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.917858  8853 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:47.911408  8349 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:47.935525  8905 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.936317  8636 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:47.936848  8636 raft_consensus.cc:697] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:47.937373  8870 raft_consensus.cc:3055] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:47.938511  8383 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:47.939100  8896 raft_consensus.cc:2764] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:00:47.937754  8870 raft_consensus.cc:740] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:47.943063  8870 consensus_queue.cc:260] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.944198  8870 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.927398  8883 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.945564  8351 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:47.949440  8424 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.950368  8891 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.937741  8636 consensus_queue.cc:237] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:47.950735  8891 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:47.951100  8891 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.952664  8881 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.953737  8424 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.950063  8351 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:47.955261  8424 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.956916  8424 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.959569  8424 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.960544  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:47.961395  8529 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 1: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:47.963276  8873 consensus_queue.cc:1059] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:47.958230  8790 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.965334  8379 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.945720  8883 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:47.970943  8904 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.956820  8905 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.955734  8894 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.976323  8710 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.976953  8424 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.958596  8862 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.977032  8894 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:47.966701  8881 raft_consensus.cc:2764] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:00:47.975950  8883 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:47.960034  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 54066.5us
I20260709 13:00:47.979815  8894 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.983358  8424 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.983426  8873 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.984290  8873 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.984898  8424 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.986078  8424 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.987739  8904 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.990638  8424 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.989818  8905 consensus_queue.cc:1059] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:47.978456  8868 consensus_queue.cc:1059] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:00:47.998178  8577 tablet_bootstrap.cc:492] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
W20260709 13:00:47.999185  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 82658.5us
I20260709 13:00:48.000276  8577 ts_tablet_manager.cc:1403] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.247s	user 0.007s	sys 0.017s
I20260709 13:00:47.999744  8424 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:47.978991  8898 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.006659  8873 raft_consensus.cc:3055] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.007133  8873 raft_consensus.cc:740] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:48.008989  8636 consensus_queue.cc:1059] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:48.009438  8427 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:48.015769  8862 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.015905  8349 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:48.016923  8636 consensus_queue.cc:1059] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:47.999974  8710 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.003103  8866 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.993767  8458 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
W20260709 13:00:48.039470  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 83281.1us
I20260709 13:00:48.037350  8881 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.042307  8501 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:48.043910  8427 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:48.050007  8501 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:48.052740  8576 tablet_bootstrap.cc:654] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:48.053329  8905 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:48.055488  8501 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:48.059312  8575 tablet_bootstrap.cc:492] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:48.059763  8575 ts_tablet_manager.cc:1403] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.334s	user 0.012s	sys 0.013s
I20260709 13:00:48.039978  8894 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.040150  8866 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.048753  8790 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:48.037279  8873 consensus_queue.cc:260] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.043497  8349 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:48.061758  8875 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:48.063282  8789 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:48.055245  8710 consensus_queue.cc:1059] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:00:48.076300  8577 raft_consensus.cc:359] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.077422  8577 raft_consensus.cc:385] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.065624  8892 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:48.077690  8577 raft_consensus.cc:740] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.070339  8898 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:48.071635  8377 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.082762  8907 raft_consensus.cc:3055] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.083033  8873 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.083190  8907 raft_consensus.cc:740] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:48.084422  8452 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:00:48.084076  8907 consensus_queue.cc:260] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.087185  8575 raft_consensus.cc:359] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.087855  8575 raft_consensus.cc:385] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.088122  8575 raft_consensus.cc:740] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.088696  8575 consensus_queue.cc:260] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.079684  8863 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.090085  8894 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:48.090385  8575 ts_tablet_manager.cc:1434] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 13:00:48.091284  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:48.091522  8863 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:48.092548  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:48.091486  8575 tablet_bootstrap.cc:492] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:48.075809  8789 raft_consensus.cc:697] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:48.094638  8789 consensus_queue.cc:237] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.098439  8501 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:48.099668  8847 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.100440  8454 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:00:48.074548  8875 raft_consensus.cc:697] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:48.095628  8891 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.105672  8577 consensus_queue.cc:260] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.101255  8913 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.118826  8907 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.072564  8799 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.109211  8904 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.115094  8892 raft_consensus.cc:697] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:00:48.128422  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 80775.7us
I20260709 13:00:48.122375  8349 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:48.130581  8799 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:48.114629  8869 consensus_queue.cc:1059] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:00:48.136231  8894 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.129467  8383 raft_consensus.cc:1240] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.141750  8577 ts_tablet_manager.cc:1434] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.141s	user 0.007s	sys 0.001s
I20260709 13:00:48.128616  8911 raft_consensus.cc:3055] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.140034  8891 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:48.146708  8870 consensus_queue.cc:1059] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:00:48.148994  8868 raft_consensus.cc:3055] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.149459  8868 raft_consensus.cc:740] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:48.150413  8868 consensus_queue.cc:260] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:00:48.151836  8868 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.153568  8892 consensus_queue.cc:237] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.156280  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:48.157105  8383 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 1: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:00:48.147253  8875 consensus_queue.cc:237] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.158203  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:48.159533  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:48.163969  8459 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:00:48.166080  8501 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:48.167097  8625 consensus_queue.cc:1059] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:48.167181  8349 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:48.168766  8898 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.169034  8869 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:48.143703  8911 raft_consensus.cc:740] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:48.170499  8911 consensus_queue.cc:260] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.171672  8460 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.173417  8577 tablet_bootstrap.cc:492] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:48.175527  8790 raft_consensus.cc:697] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:48.177234  8576 tablet_bootstrap.cc:492] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:48.176795  8790 consensus_queue.cc:237] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.177802  8576 ts_tablet_manager.cc:1403] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.361s	user 0.010s	sys 0.011s
I20260709 13:00:48.182368  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:48.183209  8386 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.184979  8905 raft_consensus.cc:697] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:48.158970  8383 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 1: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:00:48.211361  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:00:48.213224  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 47230.6us
I20260709 13:00:48.214044  8501 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:48.147610  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:48.218096  8905 consensus_queue.cc:237] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.218410  8576 raft_consensus.cc:359] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.219532  8576 raft_consensus.cc:385] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.219985  8576 raft_consensus.cc:740] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.221065  8576 consensus_queue.cc:260] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.229180  8576 ts_tablet_manager.cc:1434] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.051s	user 0.016s	sys 0.002s
I20260709 13:00:48.222559  8625 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:48.212486  8911 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.238689  8386 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:48.241017  8427 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:48.244387  8919 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:48.246384  8377 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 1: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:00:48.246476  8919 raft_consensus.cc:697] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:48.247680  8377 raft_consensus.cc:1240] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.147969  8899 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.248813  8501 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:48.249289  8386 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.249984  8575 tablet_bootstrap.cc:654] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:48.212815  8894 consensus_queue.cc:1059] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:00:48.225310  8349 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:48.287853  8385 raft_consensus.cc:1240] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.255426  8922 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:48.282902  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:48.283425  8899 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:48.286695  8576 tablet_bootstrap.cc:492] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:48.255843  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:48.296499  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:48.297583  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:48.298398  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:48.299176  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:00:48.296164  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 221454us
I20260709 13:00:48.302251  8529 raft_consensus.cc:1240] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:00:48.247552  8919 consensus_queue.cc:237] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.293965  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:48.303803  8894 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.306222  8898 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.295501  8625 consensus_queue.cc:1059] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:00:48.295550  8799 consensus_queue.cc:1059] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:00:48.308854  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:00:48.312707  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 95234.8us
I20260709 13:00:48.331118  8384 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.332921  8869 raft_consensus.cc:3055] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.324035  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:48.334898  8869 raft_consensus.cc:740] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:48.333556  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:48.340386  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:48.340992  8526 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.341022  8380 raft_consensus.cc:1240] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.322160  8883 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.325205  8925 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.338009  8500 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:48.352603  8625 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:48.353039  8452 raft_consensus.cc:2410] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260709 13:00:48.372583  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 81100.1us
I20260709 13:00:48.351701  8907 consensus_queue.cc:1059] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:00:48.372073  8625 raft_consensus.cc:697] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:48.382227  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:48.382891  8625 consensus_queue.cc:237] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.385787  8386 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.386958  8577 tablet_bootstrap.cc:654] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:48.390386  8453 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
W20260709 13:00:48.393189  8914 log.cc:927] Time spent T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.327s	user 0.003s	sys 0.001s
I20260709 13:00:48.402684  8916 consensus_queue.cc:1059] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:00:48.358686  8925 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.407266  8863 raft_consensus.cc:3055] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.407735  8863 raft_consensus.cc:740] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:48.389585  8790 raft_consensus.cc:3055] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.408748  8863 consensus_queue.cc:260] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.418401  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:48.419541  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:48.419929  8526 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:48.420118  8789 consensus_queue.cc:1059] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:00:48.425319  8576 tablet_bootstrap.cc:654] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:48.423297  8351 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:48.426034  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:48.428267  8378 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:48.374092  8869 consensus_queue.cc:260] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.403297  8904 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:48.433727  8869 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.434723  8458 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36448 (request call id 130) took 1025 ms. Trace:
I20260709 13:00:48.435281  8458 rpcz_store.cc:276] 0709 13:00:47.409675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.411909 (+  2234us) service_pool.cc:224] Handling call
0709 13:00:47.724775 (+312866us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b5800110a98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360eee 0000000000375939 00007f36cd3d41e0 00007f36cd49d0c4 00007f36cd49d131 00007f36cd44b0a0 00007f36cd44a984 00007f36c69c56d4 00007f36c69c5662
0709 13:00:48.434489 (+709714us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54001e69d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:00:48.434643 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529637376}
I20260709 13:00:48.441648  8847 raft_consensus.cc:3055] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.442165  8847 raft_consensus.cc:740] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:48.443379  8847 consensus_queue.cc:260] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:48.450488  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 73508.1us
I20260709 13:00:48.410786  8790 raft_consensus.cc:740] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:48.451467  8501 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:00:48.455890  8501 leader_election.cc:343] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:48.456430  8501 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:48.457774  8501 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:48.431231  8881 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:48.426201  8933 raft_consensus.cc:3055] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.457810  8875 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.469991  8929 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:00:48.462383  8382 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.465731  8863 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.464689  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:48.457907  8907 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:00:48.467022  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:48.460868  8930 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.468852  8933 raft_consensus.cc:740] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:48.472573  8861 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:48.474774  8883 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:48.474195  8934 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.481215  8636 raft_consensus.cc:3055] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.467767  8881 raft_consensus.cc:697] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:48.487145  8636 raft_consensus.cc:740] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:48.455008  8904 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.490759  8904 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:48.475662  8790 consensus_queue.cc:260] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.488057  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:48.492296  8790 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.499279  8386 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.501469  8577 tablet_bootstrap.cc:492] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:48.501883  8577 ts_tablet_manager.cc:1403] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.358s	user 0.008s	sys 0.006s
I20260709 13:00:48.481912  8458 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:48.506325  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:48.497383  8862 raft_consensus.cc:3055] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.509277  8862 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:48.510155  8862 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.511353  8862 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.487772  8861 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.503670  8636 consensus_queue.cc:260] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.513878  8875 consensus_queue.cc:1059] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:48.522893  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:48.514851  8881 consensus_queue.cc:237] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.528438  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:00:48.529803  8427 leader_election.cc:343] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:48.515668  8575 tablet_bootstrap.cc:492] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:48.531184  8575 ts_tablet_manager.cc:1403] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.440s	user 0.014s	sys 0.029s
I20260709 13:00:48.520624  8925 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:48.522863  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:48.524308  8913 raft_consensus.cc:3055] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.514228  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:48.503002  8934 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.525867  8907 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:00:48.535270  8913 raft_consensus.cc:740] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:48.534971  8933 consensus_queue.cc:260] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.536965  8916 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:48.535303  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:48.526420  8861 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.535660  8875 raft_consensus.cc:3055] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.537789  8913 consensus_queue.cc:260] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.539583  8913 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.538084  8381 raft_consensus.cc:1240] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:48.542678  8332 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:48.544435  8577 raft_consensus.cc:359] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.545761  8577 raft_consensus.cc:385] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.545979  8577 raft_consensus.cc:740] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.538153  8526 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:48.538882  8875 raft_consensus.cc:740] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:48.550647  8577 consensus_queue.cc:260] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.556950  8923 raft_consensus.cc:3055] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.558000  8923 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:48.558627  8934 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:48.560539  8575 raft_consensus.cc:359] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.561241  8575 raft_consensus.cc:385] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.561542  8575 raft_consensus.cc:740] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.558916  8923 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.562140  8923 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.562253  8575 consensus_queue.cc:260] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.544970  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:48.563782  8577 ts_tablet_manager.cc:1434] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.002s
I20260709 13:00:48.567591  8866 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:48.557107  8875 consensus_queue.cc:260] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.573891  8424 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:48.580365  8863 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.581457  8875 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.589551  8424 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:48.592089  8577 tablet_bootstrap.cc:492] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:48.572540  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:48.592074  8575 ts_tablet_manager.cc:1434] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.001s
I20260709 13:00:48.593901  8863 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:48.582557  8881 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.588121  8381 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:48.591753  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 46885.7us
I20260709 13:00:48.595403  8863 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.618770  8847 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.621654  8349 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:48.612156  8863 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.624758  8575 tablet_bootstrap.cc:492] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:48.630391  8919 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:48.623798  8883 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:00:48.634495  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.635133  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.635871  8500 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:48.635958  8349 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:48.638025  8883 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.638280  8283 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53486 (request call id 82) took 1357 ms. Trace:
I20260709 13:00:48.643957  8625 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:48.644299  8625 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.644564  8625 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:48.629303  8940 log.cc:927] Time spent T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:00:48.667223  8501 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:48.669178  8501 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:48.664728  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:48.652806  8383 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.674281  8636 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.649466  8929 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 13:00:48.683725  8501 leader_election.cc:343] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:48.669730  8934 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.672300  8939 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.688699  8625 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.688793  8284 catalog_manager.cc:5697] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 1 to 2, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 2 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.688856  8459 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.689004  8869 consensus_queue.cc:1059] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:00:48.699224  8938 consensus_queue.cc:1059] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:00:48.696091  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:48.638674  8283 rpcz_store.cc:276] 0709 13:00:47.281030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.281204 (+   174us) service_pool.cc:224] Handling call
0709 13:00:48.638196 (+1356992us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:47.385680 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:47.474937 (+ 89257us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:47.474969 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:00:47.474985 (+    16us) tablet.cc:662] Decoding operations
0709 13:00:47.478437 (+  3452us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:47.478523 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:47.478550 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:47.478904 (+   354us) tablet.cc:701] Row locks acquired
0709 13:00:47.478922 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:00:47.479065 (+   143us) write_op.cc:270] Start()
0709 13:00:47.479184 (+   119us) write_op.cc:276] Timestamp: P: 1783602047479026 usec, L: 0
0709 13:00:47.479209 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:00:47.484316 (+  5107us) log.cc:844] Serialized 922 byte log entry
0709 13:00:47.861323 (+377007us) op_driver.cc:464] REPLICATION: finished
0709 13:00:47.966132 (+104809us) write_op.cc:301] APPLY: starting
0709 13:00:47.972954 (+  6822us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:47.977118 (+  4164us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:47.977290 (+   172us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:47.993315 (+ 16025us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:48.005741 (+ 12426us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:00:48.009146 (+  3405us) write_op.cc:312] APPLY: finished
0709 13:00:48.046427 (+ 37281us) log.cc:844] Serialized 28 byte log entry
0709 13:00:48.054077 (+  7650us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:48.057717 (+  3640us) write_op.cc:454] Released schema lock
0709 13:00:48.059170 (+  1453us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:48.074286 (+ 15116us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:48.075754 (+  1468us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":972,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":88442,"apply.run_cpu_time_us":2849,"apply.run_wall_time_us":112852,"num_ops":2,"prepare.queue_time_us":68658,"prepare.run_cpu_time_us":77853,"prepare.run_wall_time_us":391257,"raft.queue_time_us":57268,"raft.run_cpu_time_us":19376,"raft.run_wall_time_us":57097,"replication_time_us":378877,"thread_start_us":382269,"threads_started":4,"wal-append.queue_time_us":306623}]]}
W20260709 13:00:48.702742  8501 leader_election.cc:343] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:48.710186  8576 tablet_bootstrap.cc:492] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:48.710669  8576 ts_tablet_manager.cc:1403] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.424s	user 0.011s	sys 0.009s
I20260709 13:00:48.713243  8893 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.073s
I20260709 13:00:48.714044  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:48.713819  8930 raft_consensus.cc:3055] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.706029  8381 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.709782  8863 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:48.726140  8942 log.cc:927] Time spent T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:00:48.728626  8383 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:00:48.728935  8863 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:48.706275  8934 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:00:48.735778  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:48.736403  8529 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.712705  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:48.723255  8930 raft_consensus.cc:740] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:48.732909  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:48.747712  8577 tablet_bootstrap.cc:654] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:48.753882  8500 leader_election.cc:343] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:48.754359  8500 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:48.755266  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:48.755425  8938 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:48.758086  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:48.758525  8871 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:48.759357  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:48.767555  8933 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.776443  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:48.738922  8922 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:00:48.744242  8934 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 13:00:48.783766  8576 raft_consensus.cc:359] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.784574  8576 raft_consensus.cc:385] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.786362  8576 raft_consensus.cc:740] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.787814  8576 consensus_queue.cc:260] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.784752  8893 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:48.791265  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:48.792028  8930 consensus_queue.cc:260] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.784674  8349 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:48.797712  8625 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:48.801191  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:48.819001  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:48.827116  8453 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.827158  8460 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:00:48.832641  8862 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:48.834035  8636 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:48.814976  8944 log.cc:927] Time spent T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:00:48.850773  8576 ts_tablet_manager.cc:1434] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.140s	user 0.003s	sys 0.005s
I20260709 13:00:48.843940  8460 pending_rounds.cc:85] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12: Aborting all ops after (but not including) 0
I20260709 13:00:48.858834  8460 pending_rounds.cc:107] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:00:48.861356  8460 raft_consensus.cc:2889] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:48.867276  8575 tablet_bootstrap.cc:654] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:48.840683  8383 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.854061  8904 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:48.845805  8625 consensus_queue.cc:1175] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "105d6581548546b98eddd4ee7083bb12" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
W20260709 13:00:48.871225  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 86633.8us
I20260709 13:00:48.871547  8526 raft_consensus.cc:2393] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 1: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:48.875715  8881 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.871248  8382 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.881614  8459 raft_consensus.cc:2393] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 1: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:00:48.876691  8934 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:00:48.876466  8789 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:00:48.877640  8904 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.934128  8500 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:48.939280  8904 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:48.942687  8625 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:48.912297  8847 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:00:48.945256  8532 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:00:48.917621  8861 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.955127  8576 tablet_bootstrap.cc:492] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:48.968086  8577 tablet_bootstrap.cc:492] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:48.943974  8349 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:48.968686  8577 ts_tablet_manager.cc:1403] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.381s	user 0.013s	sys 0.011s
I20260709 13:00:48.973528  8862 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.974970  8862 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:48.977123  8862 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:48.978015  8575 tablet_bootstrap.cc:492] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:48.981149  8575 ts_tablet_manager.cc:1403] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.367s	user 0.011s	sys 0.010s
I20260709 13:00:48.967639  8790 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:00:48.968178  8530 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:00:49.001523  8861 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:49.001838  8383 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:48.978271  8529 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:00:48.989668  8883 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:00:48.992960  8949 log.cc:927] Time spent T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.149s	user 0.002s	sys 0.000s
I20260709 13:00:49.023412  8930 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:49.025178  8861 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:49.025656  8963 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:00:49.025723  8861 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.024534  8528 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:00:49.031874  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:00:48.997915  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 75371.9us
I20260709 13:00:49.034476  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:49.035792  8576 tablet_bootstrap.cc:654] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:48.998327  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:48.998090  8862 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:00:49.044157  8861 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:49.048868  8534 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:00:49.050520  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:49.052124  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:49.044796  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:49.036314  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:49.070143  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:49.071588  8577 raft_consensus.cc:359] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.072173  8577 raft_consensus.cc:385] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:49.072417  8577 raft_consensus.cc:740] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
W20260709 13:00:49.086930  8424 leader_election.cc:343] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:49.087531  8427 leader_election.cc:343] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:49.087950  8427 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:49.088006  8577 consensus_queue.cc:260] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.074509  8377 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:49.107440  8427 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:49.108541  8636 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:49.101786  8863 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:49.103377  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 56871.6us
I20260709 13:00:49.116891  8349 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:49.118462  8349 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:00:49.120646  8500 leader_election.cc:343] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:49.121724  8913 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:49.122277  8913 raft_consensus.cc:697] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:49.123549  8577 ts_tablet_manager.cc:1434] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.151s	user 0.014s	sys 0.009s
I20260709 13:00:49.121594  8899 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:49.128548  8899 raft_consensus.cc:697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:49.129632  8899 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:49.131029  8501 leader_election.cc:343] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:49.119745  8575 raft_consensus.cc:359] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.135749  8575 raft_consensus.cc:385] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:49.136162  8575 raft_consensus.cc:740] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:49.142203  8427 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:49.143673  8913 consensus_queue.cc:237] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.145097  8863 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:49.146711  8863 raft_consensus.cc:697] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:49.147572  8863 consensus_queue.cc:237] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.149657  8577 tablet_bootstrap.cc:492] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:49.150132  8575 consensus_queue.cc:260] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.151089  8460 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:49.151373  8281 catalog_manager.cc:5697] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 2, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:49.164192  8575 ts_tablet_manager.cc:1434] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.177s	user 0.007s	sys 0.000s
I20260709 13:00:49.170961  8636 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.171502  8636 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.173617  8636 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:49.175347  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:49.179355  8459 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.180457  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:49.181173  8527 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:00:49.182662  8377 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:49.183694  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:49.185508  8424 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:49.186187  8636 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:49.186642  8636 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.187023  8636 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.189201  8939 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:49.189718  8939 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.190071  8939 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:49.196296  8575 tablet_bootstrap.cc:492] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:49.189265  8929 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:00:49.208480  8501 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:49.152513  8349 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:49.220597  8636 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.217957  8922 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:49.226169  8636 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:49.226658  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:49.227123  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:49.228909  8899 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:49.238410  8899 raft_consensus.cc:697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:49.239346  8899 consensus_queue.cc:237] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.231156  8527 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.254642  8577 tablet_bootstrap.cc:654] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:49.243419  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 103354us
I20260709 13:00:49.257745  8349 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:49.259049  8349 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:49.260176  8853 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:49.227846  8922 raft_consensus.cc:697] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:49.266556  8853 raft_consensus.cc:697] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:49.263444  8883 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:49.273176  8883 raft_consensus.cc:697] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:49.268020  8922 consensus_queue.cc:237] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.274053  8883 consensus_queue.cc:237] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.275175  8853 consensus_queue.cc:237] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.280213  8929 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.283564  8576 tablet_bootstrap.cc:492] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:49.284199  8576 ts_tablet_manager.cc:1403] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.338s	user 0.026s	sys 0.004s
I20260709 13:00:49.285497  8283 catalog_manager.cc:5697] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:49.280756  8929 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.266610  8527 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:00:49.287986  8283 catalog_manager.cc:5697] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:49.291524  8939 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.297066  8424 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:49.299494  8283 catalog_manager.cc:5697] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.301623  8529 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:49.305294  8862 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:49.305860  8862 raft_consensus.cc:697] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:49.306973  8283 catalog_manager.cc:5697] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.308446  8283 catalog_manager.cc:5697] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:49.306723  8862 consensus_queue.cc:237] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.313916  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:49.315102  8892 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:49.315241  8636 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.315706  8636 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:49.317934  8501 leader_election.cc:343] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:49.315660  8892 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.329053  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:49.329933  8460 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:49.332219  8636 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:49.324199  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:49.336279  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:49.332093  8939 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:49.331845  8929 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:49.338029  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:00:49.356626  8501 leader_election.cc:343] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:49.347455  8383 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:00:49.382081  8892 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:49.359526  8455 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:49.412271  8460 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
W20260709 13:00:49.360678  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 43849.1us
I20260709 13:00:49.384594  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:49.417433  8379 raft_consensus.cc:2393] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 2: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:00:49.412305  8576 raft_consensus.cc:359] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.427100  8576 raft_consensus.cc:385] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:49.427474  8576 raft_consensus.cc:740] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:49.428933  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:49.429993  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:49.430570  8500 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:49.430851  8460 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:00:49.432401  8847 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:49.432754  8847 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.433177  8847 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:49.436754  8500 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:49.436733  8930 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:49.426105  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:49.446017  8529 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.445969  8939 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:49.449318  8939 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:49.449678  8528 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:00:49.449712  8939 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:49.444806  8930 raft_consensus.cc:697] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:49.452411  8930 consensus_queue.cc:237] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:49.440459  8977 log.cc:927] Time spent T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.062s	user 0.000s	sys 0.002s
I20260709 13:00:49.457660  8575 tablet_bootstrap.cc:654] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:49.464179  8454 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.437995  8576 consensus_queue.cc:260] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.479080  8881 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.485069  8881 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:00:49.486830  8427 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:49.492543  8636 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:49.493158  8636 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.493449  8576 ts_tablet_manager.cc:1434] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.209s	user 0.007s	sys 0.011s
I20260709 13:00:49.493566  8636 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.497649  8881 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:00:49.506966  8979 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.144s	user 0.000s	sys 0.002s
I20260709 13:00:49.473299  8853 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:00:49.470952  8847 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.517565  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:49.518414  8460 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:00:49.525265  8981 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:49.526628  8939 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.528754  8939 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:49.530431  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:49.531136  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:49.553141  8527 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:00:49.532440  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:49.557626  8853 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:49.557886  8847 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:49.558040  8853 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.558436  8853 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.559250  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:49.560341  8385 raft_consensus.cc:2393] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 2: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:00:49.537472  8281 catalog_manager.cc:5697] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 1 to 2, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 2 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.563211  8281 catalog_manager.cc:5697] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 1 to 2, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 2 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.568127  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:49.570674  8281 catalog_manager.cc:5697] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 1 to 2, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 2 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:49.574213  8501 leader_election.cc:343] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:49.576295  8281 catalog_manager.cc:5697] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 1 to 2, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 2 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.581699  8576 tablet_bootstrap.cc:492] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:49.593469  8636 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.594053  8577 tablet_bootstrap.cc:492] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:49.596124  8577 ts_tablet_manager.cc:1403] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.457s	user 0.021s	sys 0.030s
I20260709 13:00:49.577828  8790 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:00:49.583343  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:49.598963  8458 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:49.578473  8863 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:49.604563  8863 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.635468  8636 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:00:49.671455  8332 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:49.690405  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:49.678305  8871 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.700395  8881 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.688549  8454 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:00:49.676401  8458 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:49.642541  8862 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.722579  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:49.723124  8534 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.683226  8853 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:00:49.717986  8383 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.734892  8500 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:49.736663  8636 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:49.737176  8636 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.720362  8893 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.751523  8636 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:49.752200  8529 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:49.718598  8871 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.746176  8939 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:49.725710  8863 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:49.758266  8532 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.756824  8893 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.763487  8863 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.764040  8893 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:49.764070  8863 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.769218  8863 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:49.769402  8575 tablet_bootstrap.cc:492] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:49.770095  8575 ts_tablet_manager.cc:1403] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.583s	user 0.076s	sys 0.089s
I20260709 13:00:49.770529  8871 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:49.719527  8881 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.813938  8894 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:49.816166  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:49.817528  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:49.818043  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:49.818171  8381 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:00:49.818418  8460 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:49.819474  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:49.819782  8853 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:49.823937  8534 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:00:49.824697  8577 raft_consensus.cc:359] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.825420  8577 raft_consensus.cc:385] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:49.825675  8577 raft_consensus.cc:740] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:49.826402  8460 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.826344  8577 consensus_queue.cc:260] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.829773  8500 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:49.830667  8427 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:49.830984  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:49.721333  8862 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.850126  8636 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:49.871599  8636 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.850850  8575 raft_consensus.cc:359] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.871953  8636 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.874694  8575 raft_consensus.cc:385] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:49.875293  8575 raft_consensus.cc:740] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:49.878850  8575 consensus_queue.cc:260] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:49.879274  8500 consensus_peers.cc:597] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:49.880043  8577 ts_tablet_manager.cc:1434] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.284s	user 0.016s	sys 0.011s
I20260709 13:00:49.881208  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:49.882205  8460 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.828143  8853 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:49.889863  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:49.890390  8881 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:49.890532  8526 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.894075  8636 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.895965  8636 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:49.849577  8939 raft_consensus.cc:697] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:49.901721  8460 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:00:49.829707  8383 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:00:49.881158  8871 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:49.938385  8577 tablet_bootstrap.cc:492] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:49.902500  8894 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:50.061671  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:50.062528  8529 raft_consensus.cc:2393] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 2: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:00:50.059237  8866 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:50.046550  8923 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:50.065732  8866 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.066275  8923 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:49.994308  8871 raft_consensus.cc:697] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:49.904404  8853 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.068885  8790 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:50.075577  8427 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:50.085418  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:49.943594  8995 consensus_queue.cc:1059] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.143s
I20260709 13:00:50.086346  8460 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:00:50.087163  8576 tablet_bootstrap.cc:654] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:50.095608  8500 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:50.096453  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:50.099318  8575 ts_tablet_manager.cc:1434] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.329s	user 0.011s	sys 0.023s
I20260709 13:00:50.077883  8923 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:50.070389  8894 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:50.111420  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 232932us
I20260709 13:00:50.082754  8997 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:50.084179  8930 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:00:50.061002  8939 consensus_queue.cc:237] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.088181  8790 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.132258  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:50.134439  8534 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:50.097705  8913 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:00:50.129539  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:50.115667  8899 raft_consensus.cc:3055] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:50.116663  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:50.117470  8923 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:50.153407  8460 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:50.156720  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:50.157837  8386 raft_consensus.cc:2393] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 2: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:00:50.141014  8866 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:50.167184  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:50.167876  8534 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:00:50.144629  8899 raft_consensus.cc:740] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:50.144348  8997 raft_consensus.cc:697] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:50.149672  8996 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:50.149415  8923 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:00:50.151260  8862 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:00:50.172602  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 77106.2us
I20260709 13:00:50.161928  9000 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:50.177606  8460 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:50.159128  8526 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:00:50.171940  8529 raft_consensus.cc:2393] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 2: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:00:50.176115  9000 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.197430  8534 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:50.175704  8923 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:50.287892  9000 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:50.289752  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:50.290459  8380 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:50.179044  8922 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.144100  8871 consensus_queue.cc:237] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.191468  8996 raft_consensus.cc:697] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:50.301364  8996 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:00:50.291781  8899 consensus_queue.cc:260] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.304595  8899 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:50.307971  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:50.309010  8379 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 2: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:00:50.309685  8992 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.310163  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:50.310225  8992 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.311076  8379 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:50.314057  8992 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:50.272861  8862 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:50.341575  8427 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:50.344545  8998 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:50.343251  9000 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.345532  9000 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.347512  9000 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:50.348738  8790 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:50.345003  8998 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.349488  8998 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:50.339080  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:50.350678  8424 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:50.351713  8862 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.352160  8424 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:50.353826  8862 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:50.354449  8862 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:50.354789  8999 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:50.355176  8999 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.355487  8894 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:00:50.315500  8991 log.cc:927] Time spent T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.220s	user 0.001s	sys 0.001s
I20260709 13:00:50.350910  8454 raft_consensus.cc:2368] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3.
I20260709 13:00:50.353726  8636 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:50.355523  8999 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:50.363802  8380 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:00:50.322057  8922 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.374361  8427 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:50.367653  8969 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.377485  8790 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.385480  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:50.343745  8997 consensus_queue.cc:237] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.430502  8577 tablet_bootstrap.cc:654] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:50.432430  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 80318.2us
I20260709 13:00:50.384908  8862 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:50.433698  8424 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:50.400034  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:50.422219  8458 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:50.424795  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:50.426222  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:50.421329  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:50.443212  8862 raft_consensus.cc:697] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:50.434692  9006 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.438478  9000 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:50.457470  8862 consensus_queue.cc:237] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.458555  8922 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:50.449162  8380 raft_consensus.cc:2393] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 1: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:50.392900  8969 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.400914  8790 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.447718  8529 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:50.466729  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:50.467697  8386 raft_consensus.cc:2368] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3.
I20260709 13:00:50.438028  8999 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.456404  8535 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:00:50.473271  8379 raft_consensus.cc:2393] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 2: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:00:50.491904  8500 leader_election.cc:400] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3.
I20260709 13:00:50.492424  8500 leader_election.cc:403] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:50.456284  9006 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:50.509604  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 64402.8us
I20260709 13:00:50.520817  8576 tablet_bootstrap.cc:492] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:50.521559  8576 ts_tablet_manager.cc:1403] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.941s	user 0.022s	sys 0.035s
I20260709 13:00:50.523809  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:50.507351  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:50.524511  8535 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
W20260709 13:00:50.552453  8500 leader_election.cc:343] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:50.559110  9006 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:50.564844  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:50.566432  8424 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:50.566764  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:50.567854  8863 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:50.568372  8863 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:50.568770  8863 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:50.571924  8994 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.417s	user 0.002s	sys 0.000s
I20260709 13:00:50.572532  8892 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.573043  8892 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.574280  8969 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:50.576510  8999 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:50.577200  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:50.579259  8535 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:00:50.579617  8998 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.584195  8923 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.584885  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:50.593390  8424 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:50.567922  8526 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 2: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:00:50.591365  8381 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:00:50.601922  8923 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:50.602276  8790 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:50.602391  9010 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.633051  9010 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:50.633630  8501 consensus_peers.cc:597] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:50.602952  8459 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:50.635107  8501 leader_election.cc:400] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3.
I20260709 13:00:50.636452  9010 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:50.603483  8535 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3. Ops: [2.1-2.1]
I20260709 13:00:50.603348  8998 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:50.654999  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:50.656538  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:50.609141  8892 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:50.609975  9000 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:50.610214  8863 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.611562  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:50.689821  8454 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:00:50.694451  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:50.617460  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:50.617677  8993 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.695999  8533 raft_consensus.cc:2393] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 2: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:50.695843  8993 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.698153  8993 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:50.621034  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:50.701452  8532 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:00:50.692821  8863 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:50.703568  8528 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:50.705724  8424 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:50.631717  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:50.712510  8529 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:00:50.646709  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:50.647390  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:50.754092  8531 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:50.754388  8461 raft_consensus.cc:2368] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3.
I20260709 13:00:50.648166  9010 consensus_queue.cc:1048] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:50.652552  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:50.756209  8899 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:50.756410  8535 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:00:50.657249  8459 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:50.658952  8575 tablet_bootstrap.cc:492] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:50.659307  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:50.760119  8455 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:00:50.662191  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:50.761509  8530 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:50.663256  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:50.756744  8899 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.604683  8999 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:50.769368  8999 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:50.769889  8999 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:50.770960  8899 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:50.756984  8531 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:50.671059  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:50.679350  8913 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:00:50.682449  8500 leader_election.cc:343] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:50.684036  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:00:50.776121  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 93717.5us
I20260709 13:00:50.776356  8381 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:00:50.686908  8576 raft_consensus.cc:359] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.623306  8853 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:50.713214  8533 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:50.782379  8939 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:50.713233  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.782902  8939 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.646605  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:50.715958  8281 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53494 (request call id 78) took 1435 ms. Trace:
I20260709 13:00:50.716003  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:50.791889  8349 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:50.716020  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:50.719590  8453 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:00:50.721702  9005 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:50.741883  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 226587us
I20260709 13:00:50.750845  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:50.665691  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:50.767593  8922 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3.
I20260709 13:00:50.768985  8577 tablet_bootstrap.cc:492] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:50.784111  8576 raft_consensus.cc:385] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:50.784519  8575 tablet_bootstrap.cc:654] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:50.813714  8577 ts_tablet_manager.cc:1403] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.926s	user 0.058s	sys 0.058s
I20260709 13:00:50.814154  8576 raft_consensus.cc:740] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:50.807512  8427 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:50.808254  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:50.784998  8281 rpcz_store.cc:276] 0709 13:00:49.280508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.281313 (+   805us) service_pool.cc:224] Handling call
0709 13:00:50.715892 (+1434579us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:49.646837 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:49.647566 (+   729us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:49.647613 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:00:49.647638 (+    25us) tablet.cc:662] Decoding operations
0709 13:00:49.696523 (+ 48885us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:49.701173 (+  4650us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:49.702019 (+   846us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:00:49.745224 (+ 43205us) tablet.cc:701] Row locks acquired
0709 13:00:49.747680 (+  2456us) write_op.cc:260] PREPARE: finished
0709 13:00:49.777911 (+ 30231us) write_op.cc:270] Start()
0709 13:00:49.795657 (+ 17746us) write_op.cc:276] Timestamp: P: 1783602049774391 usec, L: 0
0709 13:00:49.795691 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:00:49.814142 (+ 18451us) log.cc:844] Serialized 1693 byte log entry
0709 13:00:49.994044 (+179902us) op_driver.cc:464] REPLICATION: finished
0709 13:00:50.297018 (+302974us) write_op.cc:301] APPLY: starting
0709 13:00:50.313323 (+ 16305us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:50.313534 (+   211us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:50.313680 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:50.314252 (+   572us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:50.314497 (+   245us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:00:50.314552 (+    55us) write_op.cc:312] APPLY: finished
0709 13:00:50.357940 (+ 43388us) log.cc:844] Serialized 40 byte log entry
0709 13:00:50.366175 (+  8235us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:50.368970 (+  2795us) write_op.cc:454] Released schema lock
0709 13:00:50.377720 (+  8750us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:50.389148 (+ 11428us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:50.397782 (+  8634us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17876,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":152572,"apply.run_cpu_time_us":3106,"apply.run_wall_time_us":108371,"num_ops":4,"prepare.queue_time_us":698,"prepare.run_cpu_time_us":12193,"prepare.run_wall_time_us":167624,"replication_time_us":142655,"thread_start_us":76249,"threads_started":1}]]}
I20260709 13:00:50.825066  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:00:50.830011  8332 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:50.731909  8283 catalog_manager.cc:5697] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 2, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:50.813246  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:50.830322  8427 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:00:50.840863  8351 leader_election.cc:343] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:50.845141  8996 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:50.847894  8997 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:50.841305  9016 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:00:50.852859  8576 consensus_queue.cc:260] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.838279  8283 catalog_manager.cc:5697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 2, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:50.855437  8283 catalog_manager.cc:5697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 2, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:50.857260  8283 catalog_manager.cc:5697] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 2, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:50.833557  8527 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:50.839043  8863 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:50.859565  8283 catalog_manager.cc:5697] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 2, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:50.850821  8452 raft_consensus.cc:2368] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3.
I20260709 13:00:50.838752  8969 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:50.862787  8999 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.830183  8899 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:00:50.864027  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:50.867344  8939 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:50.898991  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:50.899854  8386 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:50.901648  8385 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:50.902673  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:50.874768  8500 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:50.851377  9006 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:50.851392  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:50.905813  8460 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:00:50.887636  8530 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:00:50.885396  8577 raft_consensus.cc:359] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.907696  8577 raft_consensus.cc:385] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:50.908078  8577 raft_consensus.cc:740] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:50.908943  8577 consensus_queue.cc:260] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.886083  9000 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:50.812722  9005 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.901531  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:50.880091  8576 ts_tablet_manager.cc:1434] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.358s	user 0.012s	sys 0.000s
I20260709 13:00:50.906186  9006 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:50.890959  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 46887.4us
I20260709 13:00:50.923832  8577 ts_tablet_manager.cc:1434] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.110s	user 0.009s	sys 0.000s
I20260709 13:00:50.918428  8386 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:00:50.922677  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:50.908277  8528 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:00:50.878293  8969 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.878829  8913 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:00:50.939018  8969 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:50.944182  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:50.941543  8386 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:50.941336  8427 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:50.909695  8930 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:50.939183  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:50.936698  8351 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:50.955277  8424 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:50.954276  8500 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:50.958521  8636 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:50.958976  8636 raft_consensus.cc:697] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:00:50.940711  9020 log.cc:927] Time spent T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:00:50.959311  8424 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:50.961583  9010 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:50.962013  9010 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.962090  8382 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:50.962407  9010 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:50.963835  8929 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:50.964332  8929 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.965768  8577 tablet_bootstrap.cc:492] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:50.947048  8893 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:50.966441  8893 raft_consensus.cc:697] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:50.967367  8893 consensus_queue.cc:237] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.959702  8636 consensus_queue.cc:237] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:50.929385  9006 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:50.968489  8929 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:50.969466  8891 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:50.990343  9009 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:50.991529  8351 leader_election.cc:400] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3.
I20260709 13:00:50.996660  8351 leader_election.cc:403] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:50.998195  8351 leader_election.cc:400] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3.
I20260709 13:00:50.998449  8351 leader_election.cc:403] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:50.914074  8997 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.056s
I20260709 13:00:50.948484  8452 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:00:51.005568  8881 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3.
I20260709 13:00:51.000670  8377 raft_consensus.cc:2393] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 2: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:00:51.009637  8501 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:50.995882  8891 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:51.016311  8501 leader_election.cc:343] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:51.016961  8501 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:51.010722  8930 raft_consensus.cc:697] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:51.021008  9005 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:51.001964  9009 raft_consensus.cc:697] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:51.024302  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:51.001216  8997 consensus_queue.cc:1243] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer d653e71832b7402b9a03b46249d3b885 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:00:51.050591  8575 tablet_bootstrap.cc:492] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:51.007688  8863 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:51.024216  8500 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:51.052496  8575 ts_tablet_manager.cc:1403] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.394s	user 0.044s	sys 0.011s
I20260709 13:00:51.052711  8501 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:51.055564  8527 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:00:51.057514  8969 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:51.058481  8939 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:51.021773  8993 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:51.016055  8891 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.061295  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:51.075181  8460 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:00:51.021152  8930 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:51.007748  8853 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:00:51.069419  8999 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:51.062496  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:51.020051  8528 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:51.070905  8530 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:00:51.071950  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 47847.7us
W20260709 13:00:51.073858  8501 consensus_peers.cc:597] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:51.088747  8501 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:51.008774  9010 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:51.060128  8452 raft_consensus.cc:1275] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:51.075286  8929 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:51.074782  8993 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.080937  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:51.092566  8386 raft_consensus.cc:2393] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 2: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:00:51.069538  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:51.094087  8386 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:51.015766  8907 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:00:51.098875  8384 pending_rounds.cc:85] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 0
I20260709 13:00:51.099213  8384 pending_rounds.cc:107] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 2.1
I20260709 13:00:51.099489  8384 raft_consensus.cc:2889] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:51.098913  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:51.102259  8575 raft_consensus.cc:359] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:51.103091  8575 raft_consensus.cc:385] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:51.103451  8575 raft_consensus.cc:740] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:51.069643  9009 consensus_queue.cc:237] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:51.079098  8969 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:51.109517  8460 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:51.095448  8993 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.092258  8929 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.100915  8535 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:51.114373  8575 consensus_queue.cc:260] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:51.115442  8500 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:51.108644  8381 raft_consensus.cc:2393] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 1: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:00:51.104532  8922 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:51.136178  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:51.112380  8929 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.138585  8575 ts_tablet_manager.cc:1434] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.002s
I20260709 13:00:51.106681  8999 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:00:51.122478  8923 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:51.133950  8969 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:51.142068  9038 log.cc:927] Time spent T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:00:51.150079  8577 tablet_bootstrap.cc:654] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:51.150812  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:51.151561  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:51.151973  8891 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:51.153733  8460 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:51.154280  8576 tablet_bootstrap.cc:492] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:51.131532  8939 consensus_queue.cc:1048] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:00:51.154280  8575 tablet_bootstrap.cc:492] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:51.160209  8351 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:51.163844  8455 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:51.164263  8995 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:51.165274  8883 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:00:51.164088  8453 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:00:51.154541  8969 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:51.155190  9006 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:51.171944  8847 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:51.170701  8535 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:51.175464  9010 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:51.202152  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:51.177789  8899 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
W20260709 13:00:51.221385  9041 log.cc:927] Time spent T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:00:51.222043  8385 raft_consensus.cc:2368] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 2. Current term is 3.
I20260709 13:00:51.181298  8379 raft_consensus.cc:1240] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:51.191284  8528 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:00:51.274493  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 157174us
I20260709 13:00:51.272886  8532 raft_consensus.cc:2368] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 2. Current term is 3.
I20260709 13:00:51.296051  8382 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:00:51.289901  8969 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:51.290817  8891 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:51.292826  8993 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:51.327651  8349 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:51.297200  9002 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3.
I20260709 13:00:51.336941  8427 leader_election.cc:400] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 2. Current term is 3.
I20260709 13:00:51.333541  9016 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:00:51.342537  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 178246us
I20260709 13:00:51.334887  8891 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:00:51.342670  9040 log.cc:927] Time spent T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:00:51.347407  9044 log.cc:927] Time spent T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:00:51.347967  9039 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:00:51.325721  9005 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:00:51.352726  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:51.340054  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:51.344276  9006 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:51.382011  8351 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:51.419318  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:51.362762  8461 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.425496  8883 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:51.426082  8883 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.426366  8576 tablet_bootstrap.cc:654] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:51.426633  8883 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.426137  9000 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:51.427016  8847 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:51.431803  8847 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.362401  8891 raft_consensus.cc:697] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:51.380985  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:51.438751  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:51.434631  9000 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.445032  8460 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.450552  8891 consensus_queue.cc:237] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:51.441910  8384 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.460261  8455 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:51.480423  8460 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:00:51.488132  8575 tablet_bootstrap.cc:654] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:51.496400  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:51.501381  8533 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 3: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:51.475313  8993 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:00:51.489298  9037 log.cc:927] Time spent T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.279s	user 0.002s	sys 0.000s
I20260709 13:00:51.496325  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:51.488333  8883 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:51.516238  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:00:51.554052  9045 log.cc:927] Time spent T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 13:00:51.564162  9043 log.cc:927] Time spent T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:00:51.572430  8577 tablet_bootstrap.cc:492] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:51.573135  8577 ts_tablet_manager.cc:1403] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.608s	user 0.017s	sys 0.009s
I20260709 13:00:51.555215  8992 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.598932  8385 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:51.601614  8351 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:51.618518  8883 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:51.590705  8992 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:51.619995  9054 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:00:51.620561  8992 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:51.591106  8847 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:51.616012  9005 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:51.610853  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:51.630076  8424 leader_election.cc:400] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 2. Current term is 3.
I20260709 13:00:51.616982  8351 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:51.633776  8424 leader_election.cc:403] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:00:51.641510  8969 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:51.642277  8969 raft_consensus.cc:697] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:51.643415  8969 consensus_queue.cc:237] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:51.650801  9000 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:51.704213  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:51.705050  8456 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.666343  8997 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.686861  8383 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 3: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:00:51.652542  8893 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
W20260709 13:00:51.707466  9056 log.cc:927] Time spent T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:00:51.741194  8847 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:51.759168  9000 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:00:51.761610  8929 consensus_meta.cc:287] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.619s	user 0.012s	sys 0.000s
I20260709 13:00:51.762147  8929 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:51.765686  8529 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:00:51.768385  9049 log.cc:927] Time spent T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:00:51.719903  8997 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:00:51.756137  8381 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:51.780805  8997 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:51.764833  8929 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:51.797380  8577 raft_consensus.cc:359] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:51.798313  8577 raft_consensus.cc:385] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:51.798597  8577 raft_consensus.cc:740] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:51.799414  8577 consensus_queue.cc:260] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:51.803615  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 218861us
I20260709 13:00:51.811144  8349 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:51.814733  8577 ts_tablet_manager.cc:1434] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.241s	user 0.007s	sys 0.001s
I20260709 13:00:51.818543  9046 consensus_queue.cc:1059] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:00:51.811908  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:51.817571  8501 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:51.836018  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:51.824779  8930 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:51.847286  8386 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:51.850087  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:00:51.863020  8501 leader_election.cc:343] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:51.863641  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 189487us
I20260709 13:00:51.857031  8384 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:00:51.865896  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:51.857646  8381 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:51.870433  8636 consensus_queue.cc:1059] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:51.860740  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:51.872004  8863 raft_consensus.cc:3055] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:51.869334  8501 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:51.872404  8863 raft_consensus.cc:740] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:51.879746  8575 tablet_bootstrap.cc:492] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:51.880214  8575 ts_tablet_manager.cc:1403] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.726s	user 0.022s	sys 0.033s
I20260709 13:00:51.881114  8939 consensus_queue.cc:1059] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:00:51.886947  8939 raft_consensus.cc:3055] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:51.887365  8939 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:51.887504  8456 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:00:51.889349  9064 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.889981  9064 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:51.874279  8999 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:00:51.892469  9064 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:51.876405  8892 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:51.893491  8892 raft_consensus.cc:697] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:51.894397  8892 consensus_queue.cc:237] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:51.896777  9048 log.cc:927] Time spent T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.490s	user 0.002s	sys 0.002s
I20260709 13:00:51.898928  8863 consensus_queue.cc:260] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:51.900125  8863 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.907940  8527 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:51.874361  8461 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:00:52.008244  8576 tablet_bootstrap.cc:492] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:52.022984  8576 ts_tablet_manager.cc:1403] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.869s	user 0.036s	sys 0.026s
I20260709 13:00:52.026851  8379 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:52.027582  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:52.027774  8576 raft_consensus.cc:359] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.028474  8576 raft_consensus.cc:385] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:00:51.999866  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 67802.3us
I20260709 13:00:52.030040  8576 raft_consensus.cc:740] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:51.888242  8939 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:51.910682  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:52.048164  8424 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:51.910524  8862 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 2. Current term is 3.
I20260709 13:00:52.076682  8576 consensus_queue.cc:260] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:52.141170  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 93127.7us
I20260709 13:00:52.193645  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:52.187479  8575 raft_consensus.cc:359] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.197876  8575 raft_consensus.cc:385] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.198282  8575 raft_consensus.cc:740] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.002631  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:52.018385  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:51.955976  8881 consensus_queue.cc:1059] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.253s
I20260709 13:00:52.204200  8575 consensus_queue.cc:260] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.206564  9074 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:52.014925  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:51.912878  8532 raft_consensus.cc:1240] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:51.936877  8528 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:52.211823  8576 ts_tablet_manager.cc:1434] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.189s	user 0.004s	sys 0.025s
I20260709 13:00:51.997819  8527 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:52.156747  8863 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:52.011704  9010 raft_consensus.cc:3055] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:52.220908  8575 ts_tablet_manager.cc:1434] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.340s	user 0.016s	sys 0.020s
I20260709 13:00:52.022462  8893 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.198s
I20260709 13:00:52.213550  9074 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.230762  8577 tablet_bootstrap.cc:492] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:52.231738  9074 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:52.232844  8907 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:52.213654  8998 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:52.266386  8577 tablet_bootstrap.cc:654] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.261788  8998 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.275919  8998 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:52.233533  9010 raft_consensus.cc:740] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:52.277772  9010 consensus_queue.cc:260] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.279959  9010 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:52.351663  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.362514  8853 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:52.364905  8996 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:52.365525  9001 raft_consensus.cc:3055] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:52.396035  9001 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:52.395664  8996 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.394621  8853 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.417232  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:52.431514  8996 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:52.433122  9001 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.435077  9001 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.447337  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:52.452769  8853 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:00:52.408365  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 53718.3us
I20260709 13:00:52.478474  8636 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.479350  8636 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.485368  8351 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:52.489017  8899 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:52.491003  8899 raft_consensus.cc:697] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:52.492607  8899 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.518589  8636 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:52.521801  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:52.522433  8577 tablet_bootstrap.cc:492] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
W20260709 13:00:52.523924  8427 leader_election.cc:343] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.523828  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:52.525429  8453 raft_consensus.cc:2410] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:52.538038  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:52.537109  8996 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.542371  8996 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.552779  9050 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:52.554195  8455 raft_consensus.cc:1240] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:00:52.549816  8577 ts_tablet_manager.cc:1403] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.319s	user 0.013s	sys 0.009s
I20260709 13:00:52.558629  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:52.550143  8996 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:52.565234  8576 tablet_bootstrap.cc:492] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:52.577138  9057 consensus_queue.cc:1059] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:52.579380  8460 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:52.588124  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:52.590013  8575 tablet_bootstrap.cc:492] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:52.591219  8457 raft_consensus.cc:1275] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:52.595522  8892 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:52.596390  8892 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.598224  8939 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.600098  8892 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:52.602348  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:52.602946  9001 raft_consensus.cc:3055] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:52.603406  9001 raft_consensus.cc:740] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:52.605798  8457 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:52.609001  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:52.604461  9001 consensus_queue.cc:260] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:52.620234  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.610363  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:52.634143  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:52.634943  8535 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
W20260709 13:00:52.641671  8501 leader_election.cc:343] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.642352  8424 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:52.643849  9073 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:52.646093  9064 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:52.647763  8530 raft_consensus.cc:1275] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:00:52.648428  8530 pending_rounds.cc:85] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 1
I20260709 13:00:52.646776  9064 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.648669  9001 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.648972  8530 pending_rounds.cc:107] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:00:52.649854  8530 raft_consensus.cc:2889] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:52.650589  9064 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:52.653234  8528 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:52.653972  8866 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:52.654574  8866 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.654716  8862 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:52.654130  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:52.632817  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:52.663961  8894 consensus_queue.cc:1048] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:52.666119  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:52.681262  8894 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:52.682129  8894 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.684939  8894 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:52.694782  8424 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
W20260709 13:00:52.698671  8351 leader_election.cc:343] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.700237  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:52.701313  9012 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:00:52.701509  8332 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:52.701895  9012 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.702421  9012 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.703198  8281 rpcz_store.cc:275] Call kudu.master.MasterService.IsCreateTableDone from 127.0.0.1:53496 (request call id 37) took 1549 ms. Trace:
I20260709 13:00:52.703715  8281 rpcz_store.cc:276] 0709 13:00:51.169260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.173398 (+  4138us) service_pool.cc:224] Handling call
0709 13:00:51.587427 (+414029us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540014ebd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ef090 00007f36c848df3a 00007f36ce2441cc 00007f36ce343a36 00007f36cc80c8a4 00007f36cc80c832 00007f36cc80c761 00007f36cc80c6dc 00007f36cc80b992 00007f36c67c048c 00007f36c67bf8c6
0709 13:00:51.587579 (+   152us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0709 13:00:51.970556 (+382977us) catalog_manager.cc:2317] Verify if the table creation is in progress for test-workload [id=0997156cc4e34396a3ae068cffc60d9c]
0709 13:00:52.702865 (+732309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1104880,"spinlock_wait_cycles":234340736}
I20260709 13:00:52.748626  8881 consensus_queue.cc:1048] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:00:52.747973  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 48753.3us
I20260709 13:00:52.755623  9073 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:52.756359  9073 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.757611  8530 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:52.759338  8866 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:52.759600  9073 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:52.760133  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:52.756973  8576 tablet_bootstrap.cc:654] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:52.774451  8500 leader_election.cc:343] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.778527  8500 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:52.777132  8424 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:52.796834  9057 consensus_queue.cc:1059] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:52.804442  8881 raft_consensus.cc:3055] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:52.814954  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:52.808362  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:52.810055  9093 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:52.810704  8500 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:52.813567  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:52.813669  8577 raft_consensus.cc:359] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.816689  8577 raft_consensus.cc:385] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.815099  8881 raft_consensus.cc:740] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:52.807255  8997 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:52.817001  8577 raft_consensus.cc:740] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.824532  8993 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:52.826215  8500 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:52.827631  8500 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:52.827917  8992 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:52.829123  8575 tablet_bootstrap.cc:654] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:52.831486  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 54449.7us
I20260709 13:00:52.834576  8922 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:52.818763  8997 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:52.838102  8997 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:52.840415  8283 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53484 (request call id 85) took 3334 ms. Trace:
I20260709 13:00:52.841820  8881 consensus_queue.cc:260] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.843330  8881 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.840931  8283 rpcz_store.cc:276] 0709 13:00:49.506131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.511228 (+  5097us) service_pool.cc:224] Handling call
0709 13:00:52.840189 (+3328961us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:50.938293 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:50.938908 (+   615us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:50.938942 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:00:50.938965 (+    23us) tablet.cc:662] Decoding operations
0709 13:00:50.942582 (+  3617us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:50.942652 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:50.942680 (+    28us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:00:50.943234 (+   554us) tablet.cc:701] Row locks acquired
0709 13:00:50.943252 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:00:50.943381 (+   129us) write_op.cc:270] Start()
0709 13:00:50.943487 (+   106us) write_op.cc:276] Timestamp: P: 1783602050943342 usec, L: 0
0709 13:00:50.943508 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:00:51.011012 (+ 67504us) log.cc:844] Serialized 2078 byte log entry
0709 13:00:51.134813 (+123801us) op_driver.cc:464] REPLICATION: finished
0709 13:00:51.332548 (+197735us) write_op.cc:301] APPLY: starting
0709 13:00:51.332694 (+   146us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:51.333051 (+   357us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:51.335503 (+  2452us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:51.439875 (+104372us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:51.454403 (+ 14528us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:00:51.465754 (+ 11351us) write_op.cc:312] APPLY: finished
0709 13:00:51.491601 (+ 25847us) log.cc:844] Serialized 46 byte log entry
0709 13:00:51.504314 (+ 12713us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:51.513244 (+  8930us) write_op.cc:454] Released schema lock
0709 13:00:51.516190 (+  2946us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:51.548022 (+ 31832us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:51.549945 (+  1923us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":46944,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":192731,"apply.run_cpu_time_us":4079,"apply.run_wall_time_us":193563,"num_ops":5,"prepare.queue_time_us":71528,"prepare.run_cpu_time_us":4207,"prepare.run_wall_time_us":83736,"replication_time_us":178435,"thread_start_us":164565,"threads_started":2}]]}
I20260709 13:00:52.845860  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 252) took 1093 ms. Trace:
I20260709 13:00:52.848107  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:52.832455  8424 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:52.850244  8385 rpcz_store.cc:276] 0709 13:00:51.596461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.598382 (+  1921us) service_pool.cc:224] Handling call
0709 13:00:51.598753 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:51.711779 (+113026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:51.711822 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.119727 (+407905us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b1800305c20. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53662a6 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a
0709 13:00:52.524939 (+405212us) spinlock_profiling.cc:243] Waited 6.55 ms on lock 0x7b2c000014c8. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2
0709 13:00:52.525652 (+   713us) log.cc:844] Serialized 26 byte log entry
0709 13:00:52.534124 (+  8472us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:52.551448 (+ 17324us) log.cc:844] Serialized 14 byte log entry
0709 13:00:52.552395 (+   947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.552533 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:52.670015 (+117482us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b1800305c20. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:00:52.673145 (+  3130us) raft_consensus.cc:1685] finished
0709 13:00:52.673170 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.689622 (+ 16452us) inbound_call.cc:177] Queueing success response
0709 13:00:52.721986 (+ 32364us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b1800305c20. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
Metrics: {"mutex_wait_us":1149,"prepare.queue_time_us":16338,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":5597,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":18187,"spinlock_wait_cycles":32728960,"thread_start_us":6672,"threads_started":1,"wal-append.queue_time_us":26337}
I20260709 13:00:52.866304  8998 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:52.867755  8577 consensus_queue.cc:260] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:52.881467  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 53936.3us
W20260709 13:00:52.882840  8500 leader_election.cc:343] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.883306  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:52.884151  9064 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:52.886337  8577 ts_tablet_manager.cc:1434] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.307s	user 0.012s	sys 0.003s
I20260709 13:00:52.894841  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:52.897969  8382 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:00:52.905252  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 72911.2us
I20260709 13:00:52.914340  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:52.916304  8424 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:52.897962  8997 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.907052  8853 consensus_queue.cc:1048] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:00:52.912667  9057 consensus_queue.cc:1048] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:00:52.927632  8893 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:52.920778  8922 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.931311  9073 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:52.931936  8457 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:52.936771  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:52.937170  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:52.937497  8893 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:00:52.932103  8349 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:52.932924  8577 tablet_bootstrap.cc:492] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:52.933598  8452 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:52.938019  8893 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.940529  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:52.941262  8893 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:52.934631  8997 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:52.934355  8282 catalog_manager.cc:5697] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 2 to 3, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:52.937786  9073 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.942703  8349 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:52.942713  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:52.944424  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:52.945014  9057 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:52.946498  8853 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:52.946354  8893 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:52.947221  8893 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.936821  8922 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.949113  8282 catalog_manager.cc:5697] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:52.950129  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:52.950731  8386 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:00:52.951529  8993 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:52.952036  8922 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:52.955449  9073 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:52.957832  8427 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:52.961766  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:52.963168  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:52.964035  9072 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:52.964447  9072 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:52.964491  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:52.964826  9072 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.965747  8500 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:52.970800  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:52.968241  8424 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:52.975390  8500 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:52.978698  8998 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:52.976480  9064 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:52.980118  8349 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:52.981379  8899 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:52.981719  8899 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.982024  8899 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.982244  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:52.983160  8528 raft_consensus.cc:2393] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 3: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:52.985584  8939 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:52.988839  8349 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:52.989264  9057 consensus_queue.cc:1059] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:52.990665  9057 raft_consensus.cc:3055] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:52.991055  9057 raft_consensus.cc:740] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:52.991925  9057 consensus_queue.cc:260] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.993273  9057 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:52.993752  8500 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:52.994637  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:00:52.995152  8500 leader_election.cc:343] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.995496  8993 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:52.994588  8866 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:52.999254  8501 leader_election.cc:343] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.999387  8899 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:52.999689  8501 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:52.973665  9012 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.000370  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:52.972971  8893 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:53.010164  9092 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:53.018150  8575 tablet_bootstrap.cc:492] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:53.021338  8575 ts_tablet_manager.cc:1403] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.432s	user 0.021s	sys 0.014s
I20260709 13:00:53.012851  9001 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:53.035389  8427 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:53.037556  8893 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:53.056823  9012 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:53.057498  8899 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:53.057780  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:00:53.059341  8427 leader_election.cc:343] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.060804  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:00:53.064764  8351 leader_election.cc:343] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.064133  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:53.065650  8534 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.066867  8424 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:53.066744  8575 raft_consensus.cc:359] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.068491  8575 raft_consensus.cc:385] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.068756  8575 raft_consensus.cc:740] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.074592  9012 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:53.075734  8575 consensus_queue.cc:260] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.086755  8577 tablet_bootstrap.cc:654] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.074925  9072 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.093885  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:53.094574  8527 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.096697  8535 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:00:53.097255  8535 pending_rounds.cc:85] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 1
I20260709 13:00:53.097584  8535 pending_rounds.cc:107] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:00:53.097909  8535 raft_consensus.cc:2889] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:53.135551  8576 tablet_bootstrap.cc:492] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:53.136147  8576 ts_tablet_manager.cc:1403] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.572s	user 0.010s	sys 0.011s
I20260709 13:00:53.149111  8527 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:53.150090  8575 ts_tablet_manager.cc:1434] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.128s	user 0.008s	sys 0.000s
I20260709 13:00:53.151095  8534 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:53.151376  8575 tablet_bootstrap.cc:492] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
W20260709 13:00:53.152562  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 44953.8us
I20260709 13:00:53.155864  8894 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.156522  8894 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.157490  8424 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:53.158169  8452 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:53.158205  8997 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.158588  8576 raft_consensus.cc:359] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.159333  8576 raft_consensus.cc:385] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.159626  8576 raft_consensus.cc:740] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.160159  8997 raft_consensus.cc:697] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:53.160386  8576 consensus_queue.cc:260] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.161211  8997 consensus_queue.cc:237] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.161906  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:53.165933  8349 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:53.168069  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:53.169061  8459 raft_consensus.cc:2410] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:53.169168  8894 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:53.169643  8881 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.170145  8881 raft_consensus.cc:697] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:53.171108  8881 consensus_queue.cc:237] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.173699  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:53.174571  8530 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:00:53.181558  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:53.182303  8899 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:53.182453  8380 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:00:53.182762  8899 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.183143  8899 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.156885  9072 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:53.183786  8427 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:53.184512  9073 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:53.185024  9073 raft_consensus.cc:697] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:53.162873  8996 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:53.185899  9073 consensus_queue.cc:237] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.186380  9001 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:53.163553  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:53.198288  8576 ts_tablet_manager.cc:1434] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.006s
I20260709 13:00:53.203845  9012 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.204418  9012 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.205309  8527 raft_consensus.cc:2393] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 3: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:53.214865  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:00:53.217356  8427 leader_election.cc:343] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.213551  9012 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:53.217808  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:53.233152  8577 tablet_bootstrap.cc:492] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:53.233690  8577 ts_tablet_manager.cc:1403] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.311s	user 0.014s	sys 0.007s
I20260709 13:00:53.235116  8899 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.237759  8899 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:53.239212  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:53.239814  8533 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.234599  8527 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:53.245055  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:53.245704  8454 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.245755  8424 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:53.251089  8533 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:00:53.252749  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:53.254206  8883 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:53.254833  8883 raft_consensus.cc:697] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:53.261185  8862 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:53.261749  8862 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.263798  8862 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:53.267630  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:53.268582  8527 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 3: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:53.256026  8883 consensus_queue.cc:237] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.277611  8577 raft_consensus.cc:359] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.278424  8577 raft_consensus.cc:385] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.278738  8577 raft_consensus.cc:740] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.279700  8454 raft_consensus.cc:2410] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:53.270000  8997 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.281172  8997 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.281535  8997 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.287719  8575 tablet_bootstrap.cc:654] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.287477  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:53.289271  8386 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:00:53.290630  8427 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:53.291762  9072 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:53.292150  9072 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:53.288970  8577 consensus_queue.cc:260] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.293956  9072 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:53.298544  8576 tablet_bootstrap.cc:492] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
W20260709 13:00:53.305855  9116 log.cc:927] Time spent T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:00:53.315039  8576 tablet_bootstrap.cc:654] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.320753  8577 ts_tablet_manager.cc:1434] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260709 13:00:53.322021  8577 tablet_bootstrap.cc:492] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:53.311687  9072 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.337298  8282 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53486 (request call id 84) took 3614 ms. Trace:
I20260709 13:00:53.343907  8283 catalog_manager.cc:5697] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:00:53.346596  8283 catalog_manager.cc:5697] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 0 to 1, leader changed from <none> to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.349684  8283 catalog_manager.cc:5697] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 3, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.351594  8283 catalog_manager.cc:5697] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 3, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:53.352598  8575 tablet_bootstrap.cc:492] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:53.353114  8575 ts_tablet_manager.cc:1403] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.202s	user 0.012s	sys 0.020s
I20260709 13:00:53.353456  8283 catalog_manager.cc:5697] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:00:53.354875  8283 catalog_manager.cc:5697] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 3, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.355809  8575 raft_consensus.cc:359] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.356483  8575 raft_consensus.cc:385] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.357059  8575 raft_consensus.cc:740] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.356359  8283 catalog_manager.cc:5697] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:00:53.357729  8575 consensus_queue.cc:260] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.358062  8283 catalog_manager.cc:5697] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:00:53.359333  8283 catalog_manager.cc:5697] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:00:53.359908  8575 ts_tablet_manager.cc:1434] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:00:53.361006  8575 tablet_bootstrap.cc:492] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:53.360844  8283 catalog_manager.cc:5697] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:00:53.345227  8997 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.364894  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:00:53.366477  8427 leader_election.cc:343] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.337713  8282 rpcz_store.cc:276] 0709 13:00:49.743276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.748436 (+  5160us) service_pool.cc:224] Handling call
0709 13:00:53.337221 (+3588785us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:53.051282 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:53.051913 (+   631us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:53.051963 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:00:53.051982 (+    19us) tablet.cc:662] Decoding operations
0709 13:00:53.052461 (+   479us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:53.052548 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:53.052575 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:53.054194 (+  1619us) tablet.cc:701] Row locks acquired
0709 13:00:53.061312 (+  7118us) write_op.cc:260] PREPARE: finished
0709 13:00:53.061563 (+   251us) write_op.cc:270] Start()
0709 13:00:53.061717 (+   154us) write_op.cc:276] Timestamp: P: 1783602053061504 usec, L: 0
0709 13:00:53.061754 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:00:53.076441 (+ 14687us) log.cc:844] Serialized 922 byte log entry
0709 13:00:53.302758 (+226317us) op_driver.cc:464] REPLICATION: finished
0709 13:00:53.320941 (+ 18183us) write_op.cc:301] APPLY: starting
0709 13:00:53.321020 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:53.321175 (+   155us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:53.321338 (+   163us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:53.321792 (+   454us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:53.322072 (+   280us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:00:53.322143 (+    71us) write_op.cc:312] APPLY: finished
0709 13:00:53.322477 (+   334us) log.cc:844] Serialized 28 byte log entry
0709 13:00:53.322676 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:53.322755 (+    79us) write_op.cc:454] Released schema lock
0709 13:00:53.322805 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:53.323148 (+   343us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:53.323174 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":17936,"apply.run_cpu_time_us":2194,"apply.run_wall_time_us":2199,"num_ops":2,"prepare.queue_time_us":57890,"prepare.run_cpu_time_us":39041,"prepare.run_wall_time_us":135693,"raft.queue_time_us":59453,"raft.run_cpu_time_us":13452,"raft.run_wall_time_us":17687,"replication_time_us":240828,"thread_start_us":142375,"threads_started":4,"wal-append.queue_time_us":148854}]]}
I20260709 13:00:53.367571  8575 tablet_bootstrap.cc:654] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.371793  8997 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:53.371702  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:53.373540  8534 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 3: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:53.374017  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:53.370663  9072 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:53.374596  8533 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.378316  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:53.381688  8533 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:53.381857  8576 tablet_bootstrap.cc:492] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:53.382797  8576 ts_tablet_manager.cc:1403] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.015s
I20260709 13:00:53.382983  8424 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:53.383764  9072 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.384287  9072 raft_consensus.cc:697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:53.386677  9072 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.389454  8284 catalog_manager.cc:5697] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:53.392171  8577 tablet_bootstrap.cc:654] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.400964  8575 tablet_bootstrap.cc:492] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:53.401439  8575 ts_tablet_manager.cc:1403] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.004s
I20260709 13:00:53.403489  8576 raft_consensus.cc:359] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.404206  8576 raft_consensus.cc:385] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.404469  8576 raft_consensus.cc:740] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.405150  8576 consensus_queue.cc:260] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.413170  8576 ts_tablet_manager.cc:1434] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 13:00:53.414381  8576 tablet_bootstrap.cc:492] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:53.414954  8577 tablet_bootstrap.cc:492] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:53.415489  8577 ts_tablet_manager.cc:1403] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.003s
I20260709 13:00:53.420195  8577 raft_consensus.cc:359] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.420971  8577 raft_consensus.cc:385] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.421353  8577 raft_consensus.cc:740] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.422166  8577 consensus_queue.cc:260] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.423486  8576 tablet_bootstrap.cc:654] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.427443  8284 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53494 (request call id 79) took 1561 ms. Trace:
I20260709 13:00:53.428244  8577 ts_tablet_manager.cc:1434] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:00:53.429899  8577 tablet_bootstrap.cc:492] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:53.427062  8575 raft_consensus.cc:359] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.430661  8575 raft_consensus.cc:385] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.427902  8284 rpcz_store.cc:276] 0709 13:00:51.865663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.867238 (+  1575us) service_pool.cc:224] Handling call
0709 13:00:53.427365 (+1560127us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:53.403983 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:53.404497 (+   514us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:53.404532 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:00:53.404552 (+    20us) tablet.cc:662] Decoding operations
0709 13:00:53.413039 (+  8487us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:53.415266 (+  2227us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:53.415299 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:53.415503 (+   204us) tablet.cc:701] Row locks acquired
0709 13:00:53.415522 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:00:53.415657 (+   135us) write_op.cc:270] Start()
0709 13:00:53.415758 (+   101us) write_op.cc:276] Timestamp: P: 1783602053415616 usec, L: 0
0709 13:00:53.415778 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:00:53.416340 (+   562us) log.cc:844] Serialized 537 byte log entry
0709 13:00:53.419115 (+  2775us) op_driver.cc:464] REPLICATION: finished
0709 13:00:53.419546 (+   431us) write_op.cc:301] APPLY: starting
0709 13:00:53.419624 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:53.419720 (+    96us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:53.419805 (+    85us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:53.419965 (+   160us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:53.420379 (+   414us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:00:53.420431 (+    52us) write_op.cc:312] APPLY: finished
0709 13:00:53.420602 (+   171us) log.cc:844] Serialized 22 byte log entry
0709 13:00:53.420759 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:53.420839 (+    80us) write_op.cc:454] Released schema lock
0709 13:00:53.420877 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:53.421225 (+   348us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:53.421261 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":703637,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":232,"apply.run_cpu_time_us":1376,"apply.run_wall_time_us":1617,"num_ops":1,"prepare.queue_time_us":112,"prepare.run_cpu_time_us":4285,"prepare.run_wall_time_us":14292,"replication_time_us":2583,"spinlock_wait_cycles":302336}]]}
I20260709 13:00:53.430976  8282 catalog_manager.cc:5697] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 0 to 1, leader changed from <none> to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.433784  8883 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.431058  8575 raft_consensus.cc:740] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.434283  8883 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.437995  8575 consensus_queue.cc:260] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.443140  8384 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:00:53.443696  8883 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:53.444393  8427 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:53.444105  8282 catalog_manager.cc:5697] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:00:53.445452  9072 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:53.446022  9072 raft_consensus.cc:697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:53.445552  8282 catalog_manager.cc:5697] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 4, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 4 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.446859  9072 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.447927  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:53.448525  8534 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:53.444859  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:00:53.450372  8351 leader_election.cc:343] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.455389  8349 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:53.458750  8899 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.459260  8899 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.459713  8899 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.471740  8577 tablet_bootstrap.cc:654] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.469846  8283 catalog_manager.cc:5697] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 2 to 3, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.484759  8283 catalog_manager.cc:5697] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.491284  8577 tablet_bootstrap.cc:492] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:53.491845  8577 ts_tablet_manager.cc:1403] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.062s	user 0.009s	sys 0.003s
I20260709 13:00:53.494254  8575 ts_tablet_manager.cc:1434] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.093s	user 0.006s	sys 0.003s
I20260709 13:00:53.494629  8577 raft_consensus.cc:359] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.495420  8577 raft_consensus.cc:385] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.495797  8577 raft_consensus.cc:740] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.500382  8577 consensus_queue.cc:260] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.503758  8899 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.516289  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:00:53.517566  8351 leader_election.cc:343] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.495373  8575 tablet_bootstrap.cc:492] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:53.517915  8576 tablet_bootstrap.cc:492] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:53.518131  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:53.518447  8576 ts_tablet_manager.cc:1403] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.104s	user 0.017s	sys 0.021s
I20260709 13:00:53.518663  8533 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.515769  8577 ts_tablet_manager.cc:1434] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.004s
I20260709 13:00:53.528604  8577 tablet_bootstrap.cc:492] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:53.531453  8576 raft_consensus.cc:359] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.532112  8576 raft_consensus.cc:385] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.532351  8576 raft_consensus.cc:740] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.533738  8533 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:53.534133  8899 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:53.535826  8575 tablet_bootstrap.cc:654] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.535444  8576 consensus_queue.cc:260] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.536793  8349 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:53.538089  8883 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.538515  8576 ts_tablet_manager.cc:1434] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:00:53.538708  8883 raft_consensus.cc:697] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:53.539129  8577 tablet_bootstrap.cc:654] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.539494  8576 tablet_bootstrap.cc:492] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:53.548303  8576 tablet_bootstrap.cc:654] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.561026  8576 tablet_bootstrap.cc:492] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:53.539552  8883 consensus_queue.cc:237] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.561574  8576 ts_tablet_manager.cc:1403] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.008s
I20260709 13:00:53.564762  8576 raft_consensus.cc:359] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.565479  8576 raft_consensus.cc:385] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.565744  8576 raft_consensus.cc:740] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.566362  8576 consensus_queue.cc:260] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.568522  8576 ts_tablet_manager.cc:1434] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:00:53.569497  8576 tablet_bootstrap.cc:492] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:53.575325  9072 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.575857  9072 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.578214  8577 tablet_bootstrap.cc:492] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:53.578855  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:53.580760  8577 ts_tablet_manager.cc:1403] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.009s
I20260709 13:00:53.580860  9072 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:53.584658  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:53.585428  8533 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 1: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:00:53.586201  8862 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:53.594195  8284 catalog_manager.cc:5697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.595901  8284 catalog_manager.cc:5697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 2 to 3, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.598215  8424 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:53.603561  8533 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:53.608637  9072 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.628134  8576 tablet_bootstrap.cc:654] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.624069  8577 raft_consensus.cc:359] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.630038  8577 raft_consensus.cc:385] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.630439  8577 raft_consensus.cc:740] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.618681  8862 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:00:53.634209  8577 consensus_queue.cc:260] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.637385  8577 ts_tablet_manager.cc:1434] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:00:53.639240  9072 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:53.638875  8284 catalog_manager.cc:5697] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 0 to 1, leader changed from <none> to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.640899  8384 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.652525  8380 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:53.656661  8862 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:53.661684  8899 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:00:53.668248  8577 tablet_bootstrap.cc:492] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:53.669531  9092 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.670130  9092 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.672127  9092 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:53.677412  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:53.679342  8575 tablet_bootstrap.cc:492] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:53.680598  8575 ts_tablet_manager.cc:1403] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.186s	user 0.028s	sys 0.016s
I20260709 13:00:53.680789  8899 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:53.681027  8501 leader_election.cc:343] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.693754  8386 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.703287  8576 tablet_bootstrap.cc:492] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:53.703925  8576 ts_tablet_manager.cc:1403] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.135s	user 0.011s	sys 0.031s
I20260709 13:00:53.702214  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:53.705498  8460 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:53.710114  8575 raft_consensus.cc:359] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.710783  8575 raft_consensus.cc:385] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.711035  8575 raft_consensus.cc:740] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.711592  8575 consensus_queue.cc:260] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.729522  8576 raft_consensus.cc:359] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.730295  8576 raft_consensus.cc:385] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.730581  8576 raft_consensus.cc:740] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.731493  8577 tablet_bootstrap.cc:654] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.732226  8460 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:00:53.732596  8460 pending_rounds.cc:85] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12: Aborting all ops after (but not including) 1
I20260709 13:00:53.732887  8460 pending_rounds.cc:107] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:00:53.733199  8460 raft_consensus.cc:2889] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:53.733268  8576 consensus_queue.cc:260] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.744624  8576 ts_tablet_manager.cc:1434] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.002s
I20260709 13:00:53.745434  8993 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.745759  8576 tablet_bootstrap.cc:492] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:53.742615  9092 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.745961  8993 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.746367  9092 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.747136  8853 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:53.749369  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:00:53.750851  8501 leader_election.cc:343] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.753266  8575 ts_tablet_manager.cc:1434] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.001s
W20260709 13:00:53.786083  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 92003.9us
I20260709 13:00:53.786159  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:53.787055  8575 tablet_bootstrap.cc:492] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:53.790176  8500 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:53.788995  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:00:53.794080  8501 leader_election.cc:343] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.793781  8459 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:53.779747  8997 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.795929  8997 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.796911  9142 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.797354  9142 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.797665  9142 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.798040  8997 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:53.800150  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:53.800992  8534 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:00:53.753681  9092 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:53.803115  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:53.803260  8424 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:53.780519  9004 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.753657  8993 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:53.832471  9004 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.813827  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:53.896584  8500 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:53.944835  8576 tablet_bootstrap.cc:654] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:53.945402  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 136376us
I20260709 13:00:53.939550  9064 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.948557  9064 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.949581  9072 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:53.975804  8500 leader_election.cc:343] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.978164  8500 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:53.979369  8577 tablet_bootstrap.cc:492] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:53.980041  8577 ts_tablet_manager.cc:1403] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.318s	user 0.021s	sys 0.008s
I20260709 13:00:53.981889  8998 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:53.982163  8527 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:00:53.982759  8534 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:53.983196  9004 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:00:53.987030  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 108197us
I20260709 13:00:53.974715  9064 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.996692  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:53.987322  8883 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.993767  9093 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:54.010056  8881 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:54.011219  8500 leader_election.cc:343] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.010699  8881 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:53.998980  9149 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:00:54.002523  8883 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.021375  8577 raft_consensus.cc:359] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.069307  8577 raft_consensus.cc:385] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.069625  8577 raft_consensus.cc:740] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.070269  8577 consensus_queue.cc:260] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:54.073403  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 71175.8us
I20260709 13:00:54.084196  8577 ts_tablet_manager.cc:1434] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.002s
I20260709 13:00:54.087610  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:54.088383  8883 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:54.092682  9160 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.093299  9160 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.095804  9160 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:54.068156  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:54.027173  8881 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:54.106889  8577 tablet_bootstrap.cc:492] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:54.122226  8575 tablet_bootstrap.cc:654] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.123613  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:00:54.142812  8351 leader_election.cc:343] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.107539  9142 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:54.176980  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 90030.4us
I20260709 13:00:54.175249  9142 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:54.189918  9143 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:54.190526  9143 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.192055  8576 tablet_bootstrap.cc:492] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:54.192550  8576 ts_tablet_manager.cc:1403] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.447s	user 0.011s	sys 0.029s
I20260709 13:00:54.179342  9154 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:00:54.186196  9155 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:54.195616  8501 leader_election.cc:343] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.196357  9155 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.197479  9143 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:54.196358  8501 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:54.203084  9143 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:54.200711  8576 raft_consensus.cc:359] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:54.205960  8332 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:54.206265  8576 raft_consensus.cc:385] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.203958  9064 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.206583  8576 raft_consensus.cc:740] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.211738  8576 consensus_queue.cc:260] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.214061  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:54.214490  8577 tablet_bootstrap.cc:654] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.215221  8576 ts_tablet_manager.cc:1434] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260709 13:00:54.216183  8576 tablet_bootstrap.cc:492] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:54.199021  9155 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:54.219517  9064 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:54.221601  8575 tablet_bootstrap.cc:492] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:54.227972  8575 ts_tablet_manager.cc:1403] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.444s	user 0.033s	sys 0.018s
I20260709 13:00:54.231163  8576 tablet_bootstrap.cc:654] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.237648  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:54.238791  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:54.229221  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:54.240417  8455 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:00:54.241631  8575 raft_consensus.cc:359] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.245193  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:54.245776  8384 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.248137  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:54.243824  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:54.249445  8383 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:00:54.244195  9150 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:54.251680  9072 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:54.252159  9072 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:54.259678  8351 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:54.266479  8381 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.269486  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:54.274943  8377 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:54.279659  9072 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.282616  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:54.283216  8459 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.245220  8575 raft_consensus.cc:385] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.288334  8575 raft_consensus.cc:740] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
W20260709 13:00:54.287621  8501 leader_election.cc:343] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.290405  8384 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:54.326054  9152 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:54.326553  9152 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.328678  8459 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:54.336441  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:54.337342  8534 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:54.341249  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:54.342203  8455 raft_consensus.cc:2393] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 3: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:00:54.344046  8575 consensus_queue.cc:260] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.326956  9152 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:54.349826  8501 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:54.351080  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:54.361126  8576 tablet_bootstrap.cc:492] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:54.361629  8576 ts_tablet_manager.cc:1403] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.146s	user 0.034s	sys 0.048s
I20260709 13:00:54.364585  8893 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:54.365372  9161 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.369032  8501 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:54.370800  9148 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:54.371644  9169 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:54.373651  9169 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:54.374056  9169 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:54.376047  8351 consensus_peers.cc:597] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:54.379899  9092 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:54.380465  9092 raft_consensus.cc:697] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:54.381307  9092 consensus_queue.cc:237] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.381618  8576 raft_consensus.cc:359] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.383416  8576 raft_consensus.cc:385] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.383764  8576 raft_consensus.cc:740] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.365859  9161 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:54.395890  8349 leader_election.cc:343] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.396561  8349 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:54.397639  8349 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:54.390300  8576 consensus_queue.cc:260] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.401357  9162 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:54.406148  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:54.406800  8457 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.406859  9153 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:54.388460  9072 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:54.423518  8575 ts_tablet_manager.cc:1434] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.195s	user 0.014s	sys 0.002s
I20260709 13:00:54.423415  8349 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:54.430824  9153 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:54.431308  8457 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:54.432547  8576 ts_tablet_manager.cc:1434] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260709 13:00:54.439776  8500 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:54.444216  8993 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:54.444756  8993 raft_consensus.cc:697] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:54.451200  8576 tablet_bootstrap.cc:492] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:54.432560  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:54.451264  8993 consensus_queue.cc:237] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.463490  9161 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:54.476979  8424 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:54.477537  8575 tablet_bootstrap.cc:492] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:54.478904  9148 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:54.477016  9162 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:54.477541  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:54.480464  9152 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.484422  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:54.490094  8382 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
W20260709 13:00:54.501277  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 54071.9us
I20260709 13:00:54.502455  8427 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:54.503309  8997 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:54.503708  8997 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.504045  8997 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:54.497383  9169 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.526229  8576 tablet_bootstrap.cc:654] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.526453  9001 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.527624  8577 tablet_bootstrap.cc:492] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:54.528119  8577 ts_tablet_manager.cc:1403] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.423s	user 0.011s	sys 0.011s
I20260709 13:00:54.529593  9001 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.533921  8527 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:00:54.535696  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:54.536263  9001 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:54.536448  8459 raft_consensus.cc:2393] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 1: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:54.548977  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:54.552518  8349 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:54.553215  9001 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.545287  9064 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.559574  8575 tablet_bootstrap.cc:654] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.558987  9064 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.566332  9148 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.566886  9148 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.570488  9169 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:54.571130  9064 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:54.578032  8577 raft_consensus.cc:359] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.578329  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:54.578769  8577 raft_consensus.cc:385] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.579095  8577 raft_consensus.cc:740] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.581271  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:54.579739  8577 consensus_queue.cc:260] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:54.582633  8501 leader_election.cc:343] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.583691  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:54.584304  8459 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:54.581297  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:54.585695  8527 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:54.586292  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:54.587323  9152 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:54.589901  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:54.590444  8532 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:54.593874  8424 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:54.594812  8500 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:00:54.595212  9073 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:54.595610  9073 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.595863  9169 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:54.596483  9169 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.596937  9169 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.598685  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:54.569000  9148 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:54.596050  9073 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.603820  9001 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:54.606590  8427 leader_election.cc:343] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.594239  8577 ts_tablet_manager.cc:1434] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.066s	user 0.004s	sys 0.004s
I20260709 13:00:54.598841  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:54.608624  8459 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:54.612305  8386 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:00:54.604558  8997 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.615983  8501 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:54.621117  9092 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:54.621613  9092 raft_consensus.cc:697] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:54.622449  9092 consensus_queue.cc:237] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.628397  8454 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:54.640635  8577 tablet_bootstrap.cc:492] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:54.646657  8459 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:00:54.652412  8458 raft_consensus.cc:2368] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 3. Current term is 4.
I20260709 13:00:54.660007  8351 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:54.661676  9167 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:54.662189  9167 raft_consensus.cc:697] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:54.662731  8997 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:54.645016  9162 consensus_queue.cc:1059] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:00:54.667976  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:54.668573  8384 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:54.667876  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:54.681564  8384 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:00:54.681838  8576 tablet_bootstrap.cc:492] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:54.682405  8576 ts_tablet_manager.cc:1403] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.231s	user 0.010s	sys 0.015s
I20260709 13:00:54.662978  9167 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.682621  8427 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:54.671679  9152 raft_consensus.cc:3055] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:54.691560  8577 tablet_bootstrap.cc:654] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.689677  9073 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.700409  8284 catalog_manager.cc:5697] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:54.704537  8284 catalog_manager.cc:5697] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:54.687420  8997 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:54.685961  9152 raft_consensus.cc:740] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:54.722625  8500 leader_election.cc:400] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 3. Current term is 4.
I20260709 13:00:54.717450  8997 raft_consensus.cc:697] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:54.731462  8576 raft_consensus.cc:359] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.733992  8576 raft_consensus.cc:385] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.734243  8576 raft_consensus.cc:740] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.736377  8576 consensus_queue.cc:260] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.728770  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:00:54.740229  8427 leader_election.cc:343] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.733024  9073 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:54.746294  8532 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:00:54.748692  8575 tablet_bootstrap.cc:492] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:54.749229  8575 ts_tablet_manager.cc:1403] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.279s	user 0.016s	sys 0.025s
I20260709 13:00:54.753126  8576 ts_tablet_manager.cc:1434] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.001s
I20260709 13:00:54.761948  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:54.762732  8997 consensus_queue.cc:237] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.765017  9169 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.755620  9152 consensus_queue.cc:260] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.766348  8527 raft_consensus.cc:2393] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 1: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:54.766433  9152 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:54.767043  9169 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:54.771737  8575 raft_consensus.cc:359] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.772360  8575 raft_consensus.cc:385] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.774897  8575 raft_consensus.cc:740] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.775559  8575 consensus_queue.cc:260] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.776340  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:54.779637  8424 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:00:54.783459  8501 leader_election.cc:343] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.785776  9072 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:54.786419  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:54.787189  8458 raft_consensus.cc:2393] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 1: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:00:54.788980  8575 ts_tablet_manager.cc:1434] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.002s
I20260709 13:00:54.789556  8500 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:54.789984  8575 tablet_bootstrap.cc:492] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:54.790660  9151 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:54.792721  8576 tablet_bootstrap.cc:492] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:54.797547  9169 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:54.810139  8577 tablet_bootstrap.cc:492] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:54.810745  8577 ts_tablet_manager.cc:1403] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.177s	user 0.027s	sys 0.012s
I20260709 13:00:54.815285  8577 raft_consensus.cc:359] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.815958  8577 raft_consensus.cc:385] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.816226  8577 raft_consensus.cc:740] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.816835  8577 consensus_queue.cc:260] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.821388  8575 tablet_bootstrap.cc:654] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.823025  8577 ts_tablet_manager.cc:1434] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:00:54.828524  8577 tablet_bootstrap.cc:492] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:54.841256  8281 catalog_manager.cc:5697] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 2 to 4, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 4 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:54.915503  9191 log.cc:927] Time spent T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:00:54.919279  8577 tablet_bootstrap.cc:654] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.921980  8576 tablet_bootstrap.cc:654] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:54.936468  8577 tablet_bootstrap.cc:492] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:54.937027  8577 ts_tablet_manager.cc:1403] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.109s	user 0.016s	sys 0.001s
I20260709 13:00:54.939649  8577 raft_consensus.cc:359] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.940729  8577 raft_consensus.cc:385] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.941062  8577 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.941891  8577 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.942488  8575 tablet_bootstrap.cc:492] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:54.942878  9178 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:54.943099  8575 ts_tablet_manager.cc:1403] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.153s	user 0.025s	sys 0.037s
I20260709 13:00:54.947460  8575 raft_consensus.cc:359] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.948194  8575 raft_consensus.cc:385] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.948534  8575 raft_consensus.cc:740] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.949222  8575 consensus_queue.cc:260] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.951565  8575 ts_tablet_manager.cc:1434] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:54.952726  8575 tablet_bootstrap.cc:492] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:54.957533  8577 ts_tablet_manager.cc:1434] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260709 13:00:54.964895  8577 tablet_bootstrap.cc:492] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:54.967100  8576 tablet_bootstrap.cc:492] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:54.967841  8576 ts_tablet_manager.cc:1403] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.208s	user 0.036s	sys 0.045s
I20260709 13:00:54.980418  8576 raft_consensus.cc:359] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.981495  8576 raft_consensus.cc:385] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.981786  8576 raft_consensus.cc:740] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.982368  8576 consensus_queue.cc:260] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:54.996914  8575 tablet_bootstrap.cc:654] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.004637  8576 ts_tablet_manager.cc:1434] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.002s
I20260709 13:00:55.004601  9178 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.008308  9178 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.014490  9178 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:55.008980  9073 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.015901  9073 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.021044  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:55.021435  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:55.021893  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:00:55.023577  8501 leader_election.cc:343] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.025815  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:55.026002  8424 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:55.027087  8576 tablet_bootstrap.cc:492] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
W20260709 13:00:55.027755  8500 leader_election.cc:343] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.028206  8500 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:55.027352  9148 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:55.034698  9092 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.035202  9092 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.037230  9092 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:55.038928  8386 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:55.030790  9178 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:55.039507  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:55.042279  8382 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:55.043372  8501 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:55.045992  8577 tablet_bootstrap.cc:654] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.027755  9169 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:00:55.048877  9092 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:55.024669  9073 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:55.049340  9092 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.056432  9092 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.056248  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:00:55.058174  8500 leader_election.cc:343] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.049518  9178 consensus_queue.cc:1059] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:00:55.059764  9178 raft_consensus.cc:3055] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:55.061149  8281 catalog_manager.cc:5697] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.061535  9178 raft_consensus.cc:740] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:55.068495  9178 consensus_queue.cc:260] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.079600  8576 tablet_bootstrap.cc:654] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.075397  9178 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:55.086319  9151 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:55.093094  8575 tablet_bootstrap.cc:492] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:55.093581  8575 ts_tablet_manager.cc:1403] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.141s	user 0.015s	sys 0.013s
I20260709 13:00:55.096132  8575 raft_consensus.cc:359] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.096776  8575 raft_consensus.cc:385] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.097060  8575 raft_consensus.cc:740] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.103209  8575 consensus_queue.cc:260] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.105300  8575 ts_tablet_manager.cc:1434] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:00:55.106334  8575 tablet_bootstrap.cc:492] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:55.098794  8577 tablet_bootstrap.cc:492] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:55.109647  8577 ts_tablet_manager.cc:1403] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.149s	user 0.017s	sys 0.003s
I20260709 13:00:55.099079  8458 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.112524  8577 raft_consensus.cc:359] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.113227  8577 raft_consensus.cc:385] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.113484  8577 raft_consensus.cc:740] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.116888  8577 consensus_queue.cc:260] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.120929  8577 ts_tablet_manager.cc:1434] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:00:55.121887  8577 tablet_bootstrap.cc:492] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31: Bootstrap starting.
I20260709 13:00:55.122035  9092 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.127182  9092 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:55.127764  8577 tablet_bootstrap.cc:654] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.128644  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:55.129096  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:55.129312  8454 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.129756  8382 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.132234  8575 tablet_bootstrap.cc:654] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.151660  9152 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.152288  9152 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.161947  8454 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:55.174489  8500 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:55.175375  8993 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:55.175890  8993 raft_consensus.cc:697] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:55.176709  8993 consensus_queue.cc:237] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.178396  8455 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:55.187140  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:55.188390  8530 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:55.186483  9152 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:55.189752  8349 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:55.191140  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:55.191419  9162 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:55.191821  8455 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:55.193053  9162 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:55.193452  9162 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.193817  9162 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.208914  8576 tablet_bootstrap.cc:492] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:55.209448  8576 ts_tablet_manager.cc:1403] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.189s	user 0.014s	sys 0.004s
I20260709 13:00:55.212098  8576 raft_consensus.cc:359] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.212746  8576 raft_consensus.cc:385] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.213001  8576 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.213781  8576 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.215852  8576 ts_tablet_manager.cc:1434] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:00:55.216749  8576 tablet_bootstrap.cc:492] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:55.223763  8576 tablet_bootstrap.cc:654] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.227080  9162 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.227926  8382 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:55.233578  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:55.234391  8527 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.235100  9064 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.237834  9162 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:55.238473  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:55.235774  9064 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.240320  8455 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.251886  9064 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:55.253028  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:55.253607  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:55.253736  8379 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
W20260709 13:00:55.257916  8500 leader_election.cc:343] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.258458  8501 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:55.260015  9092 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:55.260454  9092 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.260877  9092 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.267848  8527 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:55.268821  8455 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:55.269335  8349 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:55.270120  9146 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:55.270591  9146 raft_consensus.cc:697] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:55.271354  9146 consensus_queue.cc:237] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.285410  8577 tablet_bootstrap.cc:492] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31: No bootstrap required, opened a new log
I20260709 13:00:55.285959  8577 ts_tablet_manager.cc:1403] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31: Time spent bootstrapping tablet: real 0.164s	user 0.005s	sys 0.041s
I20260709 13:00:55.289153  8527 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:55.290441  8284 catalog_manager.cc:5697] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:55.288735  8577 raft_consensus.cc:359] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.303521  8577 raft_consensus.cc:385] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.294946  9160 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:55.296957  8576 tablet_bootstrap.cc:492] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:55.304396  8576 ts_tablet_manager.cc:1403] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.088s	user 0.011s	sys 0.000s
I20260709 13:00:55.306963  8576 raft_consensus.cc:359] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.307611  8576 raft_consensus.cc:385] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.307889  8576 raft_consensus.cc:740] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.303835  8577 raft_consensus.cc:740] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.310572  8577 consensus_queue.cc:260] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.312614  8577 ts_tablet_manager.cc:1434] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:00:55.313305  8576 consensus_queue.cc:260] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.315444  8576 ts_tablet_manager.cc:1434] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.002s
I20260709 13:00:55.316341  8576 tablet_bootstrap.cc:492] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:55.320303  8283 catalog_manager.cc:5697] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 0 to 1, leader changed from <none> to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.321125  8530 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:00:55.323596  8530 pending_rounds.cc:85] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 2
I20260709 13:00:55.323834  8530 pending_rounds.cc:107] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:00:55.324095  8530 raft_consensus.cc:2889] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:55.327348  9162 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.327857  9162 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.329730  9073 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:55.330823  9162 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:55.331498  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:55.333165  8576 tablet_bootstrap.cc:654] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:55.333115  8351 leader_election.cc:343] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.333774  9092 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.336117  9092 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:55.336239  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:55.336814  8386 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.337693  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:55.340850  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:00:55.341370  8500 leader_election.cc:343] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.341485  8532 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:55.348455  8349 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:55.349037  8386 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:55.349547  9162 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:55.349937  9162 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.350275  9162 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.350206  8501 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:55.353961  9178 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:55.354487  9178 raft_consensus.cc:697] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:55.355257  9178 consensus_queue.cc:237] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.366711  8379 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:55.368320  9072 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:55.371749  8575 tablet_bootstrap.cc:492] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:55.372246  8575 ts_tablet_manager.cc:1403] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.266s	user 0.020s	sys 0.030s
W20260709 13:00:55.374848  8332 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:55.376147  9162 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.378352  9162 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:55.379123  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:55.381064  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:55.381649  8532 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:55.382128  8351 leader_election.cc:343] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.389143  8576 tablet_bootstrap.cc:492] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:55.389629  8576 ts_tablet_manager.cc:1403] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.003s
I20260709 13:00:55.389909  8575 raft_consensus.cc:359] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.390841  8575 raft_consensus.cc:385] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.391191  8575 raft_consensus.cc:740] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.392046  8575 consensus_queue.cc:260] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.392439  8576 raft_consensus.cc:359] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.393132  8576 raft_consensus.cc:385] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.393425  8576 raft_consensus.cc:740] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.394153  8576 consensus_queue.cc:260] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.396143  8576 ts_tablet_manager.cc:1434] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:00:55.397119  8576 tablet_bootstrap.cc:492] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:55.397980  8575 ts_tablet_manager.cc:1434] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.002s
I20260709 13:00:55.399287  8575 tablet_bootstrap.cc:492] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:55.399717  9092 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.400334  9092 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.402562  9092 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:55.403733  8576 tablet_bootstrap.cc:654] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.403913  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:55.405530  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:00:55.407160  8501 leader_election.cc:343] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:55.407702  8500 leader_election.cc:343] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.408231  8500 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:55.416420  9151 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:55.432883  9151 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.458952  9072 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.476805  9072 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.477840  9162 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.480132  9162 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:00:55.480557  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 72913.8us
I20260709 13:00:55.482216  9162 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:55.479031  8532 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:55.484990  9072 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:55.486033  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:55.486887  8532 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:55.487323  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:55.487941  8424 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:55.489008  9072 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:55.489471  9072 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.489943  8349 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:55.496884  8575 tablet_bootstrap.cc:654] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.496964  9162 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:55.497787  9162 raft_consensus.cc:697] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:55.489046  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:00:55.494722  8351 leader_election.cc:343] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.495796  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:55.498744  9162 consensus_queue.cc:237] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.433459  9151 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.505270  9151 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:00:55.505489  8427 leader_election.cc:343] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.506785  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:55.506922  8284 catalog_manager.cc:5697] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:55.499938  9072 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:55.508545  8500 leader_election.cc:343] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.508545  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:55.509481  8379 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 0.
I20260709 13:00:55.510552  8501 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:55.511094  8532 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 0.
I20260709 13:00:55.512691  9151 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:55.513064  9151 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.513432  9151 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.515280  8349 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:55.516182  8575 tablet_bootstrap.cc:492] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:55.516134  9167 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:55.516647  9167 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.517105  9167 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.533211  8575 ts_tablet_manager.cc:1403] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.134s	user 0.010s	sys 0.003s
I20260709 13:00:55.557548  9072 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.581840  9160 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.582316  9160 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.584339  9160 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:55.586341  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:55.587231  8530 raft_consensus.cc:2393] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 1: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:55.593106  8576 tablet_bootstrap.cc:492] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:55.593653  8576 ts_tablet_manager.cc:1403] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.197s	user 0.021s	sys 0.035s
I20260709 13:00:55.590173  8575 raft_consensus.cc:359] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.598379  8575 raft_consensus.cc:385] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.598645  8575 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.599320  8575 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.601064  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:55.601370  9072 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:55.603806  9167 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.605757  9064 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:55.606261  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:55.606889  8530 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.609300  8575 ts_tablet_manager.cc:1434] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.000s
I20260709 13:00:55.609807  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:55.610387  8575 tablet_bootstrap.cc:492] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:55.610579  8454 raft_consensus.cc:2393] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 1: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:00:55.606842  8576 raft_consensus.cc:359] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.611778  8576 raft_consensus.cc:385] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.612074  8576 raft_consensus.cc:740] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.612705  8576 consensus_queue.cc:260] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.614660  9151 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.617873  8386 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.618882  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:55.619762  8532 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 1: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:00:55.624365  8575 tablet_bootstrap.cc:654] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.617897  9167 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:55.626158  9151 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:55.627760  8576 ts_tablet_manager.cc:1434] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:00:55.629494  8576 tablet_bootstrap.cc:492] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885: Bootstrap starting.
I20260709 13:00:55.629647  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:55.630461  8379 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 1: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:00:55.631878  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:55.632421  8455 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.635944  8576 tablet_bootstrap.cc:654] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.642163  8386 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:55.686264  8575 tablet_bootstrap.cc:492] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:55.684728  8455 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:00:55.703903  8575 ts_tablet_manager.cc:1403] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.094s	user 0.016s	sys 0.021s
I20260709 13:00:55.703804  8427 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:55.637446  8283 catalog_manager.cc:5697] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 0 to 1, leader changed from <none> to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.704691  9072 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:55.705237  9072 raft_consensus.cc:697] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:55.645985  8351 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:00:55.706058  9072 consensus_queue.cc:237] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.706800  9167 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.707051  8575 raft_consensus.cc:359] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.707841  8575 raft_consensus.cc:385] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.708232  8575 raft_consensus.cc:740] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.655732  8530 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:55.639866  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:55.713883  8458 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 1: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:00:55.716073  8500 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:55.718669  9167 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:55.719532  9064 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:55.721612  8575 consensus_queue.cc:260] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.725458  8575 ts_tablet_manager.cc:1434] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:00:55.726677  8575 tablet_bootstrap.cc:492] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:55.732570  8575 tablet_bootstrap.cc:654] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.749019  8575 tablet_bootstrap.cc:492] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:55.749761  8458 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:55.750255  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 104337us
I20260709 13:00:55.751333  8351 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:55.753441  9152 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:55.753959  9152 raft_consensus.cc:697] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:00:55.754791  9152 consensus_queue.cc:237] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.757596  8575 ts_tablet_manager.cc:1403] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.003s
I20260709 13:00:55.758721  9064 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:55.760975  8575 raft_consensus.cc:359] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.763830  8575 raft_consensus.cc:385] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.764109  8575 raft_consensus.cc:740] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.765579  8575 consensus_queue.cc:260] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.776360  8575 ts_tablet_manager.cc:1434] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:00:55.777338  8575 tablet_bootstrap.cc:492] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12: Bootstrap starting.
I20260709 13:00:55.783444  8575 tablet_bootstrap.cc:654] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.672150  9160 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.119s
I20260709 13:00:55.792752  8284 catalog_manager.cc:5697] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.824926  8576 tablet_bootstrap.cc:492] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885: No bootstrap required, opened a new log
I20260709 13:00:55.825497  8576 ts_tablet_manager.cc:1403] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885: Time spent bootstrapping tablet: real 0.196s	user 0.031s	sys 0.032s
I20260709 13:00:55.828053  8576 raft_consensus.cc:359] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.828770  8576 raft_consensus.cc:385] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.829034  8576 raft_consensus.cc:740] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.829999  8576 consensus_queue.cc:260] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.831897  8576 ts_tablet_manager.cc:1434] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:00:55.853394  9064 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:55.863127  9167 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:55.874155  9213 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.069s	user 0.000s	sys 0.002s
I20260709 13:00:55.897619  8283 catalog_manager.cc:5697] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 0 to 1, leader changed from <none> to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:55.916400  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 58767.1us
I20260709 13:00:55.917757  9064 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:55.944139  8575 tablet_bootstrap.cc:492] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12: No bootstrap required, opened a new log
I20260709 13:00:55.944619  8575 ts_tablet_manager.cc:1403] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12: Time spent bootstrapping tablet: real 0.168s	user 0.033s	sys 0.072s
I20260709 13:00:55.949407  8575 raft_consensus.cc:359] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.950150  8575 raft_consensus.cc:385] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.950436  8575 raft_consensus.cc:740] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.951021  8575 consensus_queue.cc:260] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:55.952287  8575 ts_tablet_manager.cc:1434] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:00:56.025516  9167 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:56.036728  8454 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.053508  9148 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.054147  9162 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:56.054497  9148 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:56.063627  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:56.064471  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:56.066617  9148 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:56.066675  8424 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:00:56.070919  9148 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:56.091571  9148 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:56.104673  9072 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:56.229306  9231 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:56.229884  9231 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:56.232012  9231 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:56.235947  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:56.236783  8458 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:00:56.239084  9148 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.239566  9148 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:56.242033  9148 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:56.244537  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:56.245198  8532 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:56.246271  8424 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:56.247116  9148 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:56.247565  9148 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.248435  9148 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.257301  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:56.257980  8382 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 0.
I20260709 13:00:56.258607  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:56.259224  8379 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:00:56.264073  8501 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:56.265813  9064 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:56.266180  9064 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:00:56.266546  9064 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:56.273263  9148 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:56.277045  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:56.277211  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:56.277657  8384 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.277993  8527 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.278941  9148 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:56.284866  8384 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:56.285943  8427 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:56.287410  9148 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:56.287871  9148 raft_consensus.cc:697] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:56.293300  9064 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:56.288637  9148 consensus_queue.cc:237] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:56.298398  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:56.298771  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:56.299600  8454 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:00:56.302258  9064 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:56.301540  8527 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:00:56.311622  9073 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.312194  9073 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:56.313596  8284 catalog_manager.cc:5697] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:56.314412  9073 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:56.317122  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:00:56.317165  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:56.317807  8530 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:00:56.319073  8424 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:56.319271  8384 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:00:56.320410  8501 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:00:56.321444  9178 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:56.321909  9178 raft_consensus.cc:697] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:56.323987  9178 consensus_queue.cc:237] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:56.325723  9072 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:56.326071  9072 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.326354  9072 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:56.335803  9160 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:56.343665  9072 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:56.345969  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:56.346113  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:00:56.346951  8382 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:56.347569  9072 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:56.354110  8284 catalog_manager.cc:5697] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 4 to 5, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 5 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:56.362537  9178 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.363039  9178 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:56.365010  9178 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:56.365970  8382 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:00:56.367316  8427 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:00:56.369488  9072 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:56.371767  9072 raft_consensus.cc:697] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:00:56.373345  9072 consensus_queue.cc:237] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:56.361683  9146 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:00:56.394043  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:00:56.394693  8454 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:56.407079  8284 catalog_manager.cc:5697] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 5 to 6, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 6 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:56.413029  8500 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:00:56.414003  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:00:56.414661  8382 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:00:56.417714  9064 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:56.418143  9064 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.418463  9064 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:56.425930  9064 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:56.433521  9064 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:56.434935  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:00:56.435555  8382 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:56.440861  8382 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:00:56.453161  8501 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:00:56.454591  9178 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:56.456022  9178 raft_consensus.cc:697] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:56.457010  9178 consensus_queue.cc:237] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:56.464896  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:00:56.465515  8458 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:56.477734  8332 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:56.478596  8458 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:00:56.483423  8281 catalog_manager.cc:5697] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 0 to 2, leader changed from <none> to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 2 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:56.762780  9148 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:56.796164  9148 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:56.796620  8530 raft_consensus.cc:3055] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:56.797027  8530 raft_consensus.cc:740] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:00:56.797817  8530 consensus_queue.cc:260] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:00:56.798841  8530 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:56.806560  8530 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:00:56.826328  8530 pending_rounds.cc:85] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 2
I20260709 13:00:56.826835  8530 pending_rounds.cc:107] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:00:56.827099  8530 raft_consensus.cc:2889] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:56.828925  9073 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:56.844272  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260709 13:00:56.846694  8382 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:00:56.849463  9220 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:00:56.907636  9249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:56.907693  9248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:56.909396  9251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:56.910373  7271 server_base.cc:1061] running on GCE node
I20260709 13:00:56.911818  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:56.912084  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:56.912283  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602056912266 us; error 0 us; skew 500 ppm
I20260709 13:00:56.913046  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:56.916798  7271 webserver.cc:533] Webserver started at http://127.7.25.196:39603/ using document root <none> and password file <none>
I20260709 13:00:56.917371  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:56.917600  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:56.917977  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:56.919449  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-3-root/instance:
uuid: "446d9310dce14ff4afff2dc2d64f68d8"
format_stamp: "Formatted at 2026-07-09 13:00:56 on dist-test-slave-z1zn"
I20260709 13:00:56.926407  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:00:56.928085  8382 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:00:56.930116  9178 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:56.940764  9256 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:56.942150  7271 fs_manager.cc:730] Time spent opening block manager: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:00:56.942605  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-3-root
uuid: "446d9310dce14ff4afff2dc2d64f68d8"
format_stamp: "Formatted at 2026-07-09 13:00:56 on dist-test-slave-z1zn"
I20260709 13:00:56.942986  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:56.960440  8458 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:00:56.962080  9064 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:56.963745  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:56.965422  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:56.967162  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:56.987941  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:56.988200  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:56.988492  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:56.988694  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:57.162358  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.196:40669
I20260709 13:00:57.162469  9320 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.196:40669 every 8 connection(s)
I20260709 13:00:57.262297  7271 auto_leader_rebalancer-test.cc:384] add a tserver: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:00:57.293444  9321 heartbeater.cc:344] Connected to a master server at 127.7.25.254:44471
I20260709 13:00:57.293982  9321 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:57.294945  9321 heartbeater.cc:507] Master 127.7.25.254:44471 requested a full tablet report, sending...
I20260709 13:00:57.297233  8281 ts_manager.cc:194] Registered new tserver with Master: 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:00:57.299180  8281 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59480
I20260709 13:00:57.563458  8384 consensus_queue.cc:237] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:00:57.569464  8532 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:57.572131  9146 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:57.575819  8458 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:57.577334  9146 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:57.596402  9162 raft_consensus.cc:2955] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
W20260709 13:00:57.598402  8351 consensus_peers.cc:597] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 848cbd6ceda8400e9d2f1d58cbbdcb7b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:57.598737  8532 raft_consensus.cc:2955] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:00:57.611007  8458 raft_consensus.cc:2955] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:00:57.615722  8281 catalog_manager.cc:5697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 2 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:00:57.687530  8527 consensus_queue.cc:237] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:00:57.708380  8384 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:57.710801  8993 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:57.714998  8455 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:57.717900  8993 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:00:57.726218  8500 consensus_peers.cc:597] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18bf9e256e3046b497483817dac46e78. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:57.725670  9178 raft_consensus.cc:2955] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:00:57.727247  8384 raft_consensus.cc:2955] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:00:57.763402  8284 catalog_manager.cc:5697] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 2 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:57.775034  8458 raft_consensus.cc:2955] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:00:57.789182  8454 consensus_queue.cc:237] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:00:57.800766  8532 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:57.802186  9072 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:57.802368  8384 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:57.805135  9072 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:57.828557  9072 raft_consensus.cc:2955] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:00:57.830314  8384 raft_consensus.cc:2955] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:00:57.835781  8527 raft_consensus.cc:2955] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:00:57.850606  8530 consensus_queue.cc:237] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:00:57.852566  8283 catalog_manager.cc:5697] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:57.882000  8426 consensus_peers.cc:597] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a6ecd063b1dc49a69b15eb593af51b89. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:57.890761  8458 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:57.890761  8382 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:57.892380  9064 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:00:57.893482  8500 consensus_peers.cc:597] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 26eda7bdc3194871b01c986d3db7cccf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:57.893482  8993 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:57.910732  8993 raft_consensus.cc:2955] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:00:57.914023  8382 raft_consensus.cc:2955] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:00:57.939930  8283 catalog_manager.cc:5697] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 2 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:57.944139  8458 raft_consensus.cc:2955] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:00:58.128424  9350 ts_tablet_manager.cc:933] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631)
I20260709 13:00:58.144304  9350 tablet_copy_client.cc:323] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.193:43631
I20260709 13:00:58.170598  8396 tablet_copy_service.cc:140] P d653e71832b7402b9a03b46249d3b885: Received BeginTabletCopySession request for tablet 848cbd6ceda8400e9d2f1d58cbbdcb7b from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:48484)
I20260709 13:00:58.171307  8396 tablet_copy_service.cc:161] P d653e71832b7402b9a03b46249d3b885: Beginning new tablet copy session on tablet 848cbd6ceda8400e9d2f1d58cbbdcb7b from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:48484: session id = 446d9310dce14ff4afff2dc2d64f68d8-848cbd6ceda8400e9d2f1d58cbbdcb7b
I20260709 13:00:58.200104  8396 tablet_copy_source_session.cc:215] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:58.204344  9350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 848cbd6ceda8400e9d2f1d58cbbdcb7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.223980  9350 tablet_copy_client.cc:806] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:58.224727  9350 tablet_copy_client.cc:670] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:58.258663  9350 tablet_copy_client.cc:538] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:58.282554  9350 tablet_bootstrap.cc:492] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:00:58.302513  9321 heartbeater.cc:499] Master 127.7.25.254:44471 was elected leader, sending a full tablet report...
I20260709 13:00:58.306151  9350 tablet_bootstrap.cc:492] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:58.307284  9350 tablet_bootstrap.cc:492] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:00:58.308023  9350 ts_tablet_manager.cc:1403] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.005s
I20260709 13:00:58.314769  9350 raft_consensus.cc:359] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:00:58.315737  9350 raft_consensus.cc:740] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:00:58.316890  9350 consensus_queue.cc:260] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:00:58.330814  9350 ts_tablet_manager.cc:1434] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.022s	user 0.015s	sys 0.001s
I20260709 13:00:58.332764  8396 tablet_copy_service.cc:342] P d653e71832b7402b9a03b46249d3b885: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-848cbd6ceda8400e9d2f1d58cbbdcb7b received from {username='slave'} at 127.0.0.1:48484
I20260709 13:00:58.333268  8396 tablet_copy_service.cc:434] P d653e71832b7402b9a03b46249d3b885: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-848cbd6ceda8400e9d2f1d58cbbdcb7b on tablet 848cbd6ceda8400e9d2f1d58cbbdcb7b with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:00:58.338732  9350 ts_tablet_manager.cc:933] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:58.357892  9350 tablet_copy_client.cc:323] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.195:40767
I20260709 13:00:58.362645  9357 ts_tablet_manager.cc:933] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:00:58.373229  9357 tablet_copy_client.cc:323] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.195:40767
I20260709 13:00:58.375169  8545 tablet_copy_service.cc:140] P b8eb0ad4490645598004d862412f4e31: Received BeginTabletCopySession request for tablet 18bf9e256e3046b497483817dac46e78 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:47306)
I20260709 13:00:58.375396  8544 tablet_copy_service.cc:140] P b8eb0ad4490645598004d862412f4e31: Received BeginTabletCopySession request for tablet 26eda7bdc3194871b01c986d3db7cccf from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:47306)
I20260709 13:00:58.375769  8545 tablet_copy_service.cc:161] P b8eb0ad4490645598004d862412f4e31: Beginning new tablet copy session on tablet 18bf9e256e3046b497483817dac46e78 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:47306: session id = 446d9310dce14ff4afff2dc2d64f68d8-18bf9e256e3046b497483817dac46e78
I20260709 13:00:58.378743  8544 tablet_copy_service.cc:161] P b8eb0ad4490645598004d862412f4e31: Beginning new tablet copy session on tablet 26eda7bdc3194871b01c986d3db7cccf from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:47306: session id = 446d9310dce14ff4afff2dc2d64f68d8-26eda7bdc3194871b01c986d3db7cccf
I20260709 13:00:58.381928  9355 ts_tablet_manager.cc:933] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:00:58.396235  8544 tablet_copy_source_session.cc:215] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:58.400753  9357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26eda7bdc3194871b01c986d3db7cccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.403002  9355 tablet_copy_client.cc:323] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.194:36925
I20260709 13:00:58.396926  8545 tablet_copy_source_session.cc:215] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:58.407342  9350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18bf9e256e3046b497483817dac46e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.445276  9350 tablet_copy_client.cc:806] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:58.446115  9350 tablet_copy_client.cc:670] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:58.451112  9350 tablet_copy_client.cc:538] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:58.461862  9357 tablet_copy_client.cc:806] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:58.462633  9357 tablet_copy_client.cc:670] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:58.470829  9357 tablet_copy_client.cc:538] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:58.479604  9350 tablet_bootstrap.cc:492] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:00:58.492311  9357 tablet_bootstrap.cc:492] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:00:58.561681  8471 tablet_copy_service.cc:140] P 105d6581548546b98eddd4ee7083bb12: Received BeginTabletCopySession request for tablet a6ecd063b1dc49a69b15eb593af51b89 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:53010)
I20260709 13:00:58.562269  8471 tablet_copy_service.cc:161] P 105d6581548546b98eddd4ee7083bb12: Beginning new tablet copy session on tablet a6ecd063b1dc49a69b15eb593af51b89 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:53010: session id = 446d9310dce14ff4afff2dc2d64f68d8-a6ecd063b1dc49a69b15eb593af51b89
I20260709 13:00:58.571547  8471 tablet_copy_source_session.cc:215] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:58.576170  9355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ecd063b1dc49a69b15eb593af51b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:58.582433  9350 tablet_bootstrap.cc:492] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:58.584408  9350 tablet_bootstrap.cc:492] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:00:58.585143  9350 ts_tablet_manager.cc:1403] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.120s	user 0.025s	sys 0.006s
I20260709 13:00:58.588150  9350 raft_consensus.cc:359] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:00:58.596109  9350 raft_consensus.cc:740] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:00:58.597930  9350 consensus_queue.cc:260] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:00:58.603749  9357 tablet_bootstrap.cc:492] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:58.605676  9357 tablet_bootstrap.cc:492] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:00:58.604689  9355 tablet_copy_client.cc:806] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:58.607281  9355 tablet_copy_client.cc:670] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:58.613487  9355 tablet_copy_client.cc:538] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:58.614585  9350 ts_tablet_manager.cc:1434] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:00:58.629164  9357 ts_tablet_manager.cc:1403] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.137s	user 0.023s	sys 0.007s
I20260709 13:00:58.633100  8544 tablet_copy_service.cc:342] P b8eb0ad4490645598004d862412f4e31: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-18bf9e256e3046b497483817dac46e78 received from {username='slave'} at 127.0.0.1:47306
I20260709 13:00:58.633622  8544 tablet_copy_service.cc:434] P b8eb0ad4490645598004d862412f4e31: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-18bf9e256e3046b497483817dac46e78 on tablet 18bf9e256e3046b497483817dac46e78 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:00:58.634794  9357 raft_consensus.cc:359] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:00:58.635674  9357 raft_consensus.cc:740] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:00:58.645361  9357 consensus_queue.cc:260] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:00:58.648540  9355 tablet_bootstrap.cc:492] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:00:58.654343  9357 ts_tablet_manager.cc:1434] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:00:58.669989  8544 tablet_copy_service.cc:342] P b8eb0ad4490645598004d862412f4e31: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-26eda7bdc3194871b01c986d3db7cccf received from {username='slave'} at 127.0.0.1:47306
I20260709 13:00:58.670468  8544 tablet_copy_service.cc:434] P b8eb0ad4490645598004d862412f4e31: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-26eda7bdc3194871b01c986d3db7cccf on tablet 26eda7bdc3194871b01c986d3db7cccf with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:00:58.694614  9355 tablet_bootstrap.cc:492] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:58.695695  9355 tablet_bootstrap.cc:492] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:00:58.696422  9355 ts_tablet_manager.cc:1403] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.048s	user 0.023s	sys 0.006s
I20260709 13:00:58.699461  9355 raft_consensus.cc:359] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:00:58.700402  9355 raft_consensus.cc:740] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:00:58.701156  9355 consensus_queue.cc:260] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:00:58.707741  9355 ts_tablet_manager.cc:1434] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.005s
I20260709 13:00:58.708787  9296 raft_consensus.cc:1217] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:00:58.711702  8471 tablet_copy_service.cc:342] P 105d6581548546b98eddd4ee7083bb12: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-a6ecd063b1dc49a69b15eb593af51b89 received from {username='slave'} at 127.0.0.1:53010
I20260709 13:00:58.712158  8471 tablet_copy_service.cc:434] P 105d6581548546b98eddd4ee7083bb12: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-a6ecd063b1dc49a69b15eb593af51b89 on tablet a6ecd063b1dc49a69b15eb593af51b89 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:00:58.787915  9296 raft_consensus.cc:1217] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:00:58.830049  9296 raft_consensus.cc:1217] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:00:59.005975  9296 raft_consensus.cc:1217] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:59.160832  9146 raft_consensus.cc:1064] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:00:59.163196  9146 consensus_queue.cc:237] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:00:59.187574  8532 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:59.189464  9296 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEARNER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:59.189710  9366 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:59.192051  9370 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:59.232440  9349 raft_consensus.cc:2955] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.234529  9296 raft_consensus.cc:2955] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.253583  8284 catalog_manager.cc:5697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.256377  8527 raft_consensus.cc:2955] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.262391  8454 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:59.265568  9370 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:00:59.291265  8455 raft_consensus.cc:2955] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.339478  9178 raft_consensus.cc:1064] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:00:59.343044  9178 consensus_queue.cc:237] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:00:59.391068  9363 raft_consensus.cc:1064] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:00:59.445714  9064 raft_consensus.cc:1064] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:00:59.447909  9064 consensus_queue.cc:237] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:00:59.451460  9363 consensus_queue.cc:237] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:00:59.463652  9296 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEARNER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:59.465412  9064 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:59.467185  8458 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:59.475829  9064 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:59.481899  8384 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:59.483387  8993 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:59.516292  8454 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:59.518079  9064 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:59.522181  8382 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:59.530278  9178 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:59.537245  9295 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEARNER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:59.546460  9064 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:59.574158  9064 raft_consensus.cc:2955] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.589439  9296 raft_consensus.cc:2955] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.605528  8382 consensus_queue.cc:237] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:00:59.615497  9178 raft_consensus.cc:2955] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.619398  8384 raft_consensus.cc:2955] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.642493  8527 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:59.648953  9295 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:00:59.711048  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 54271.2us
W20260709 13:00:59.712014  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 92770.7us
I20260709 13:00:59.705456  8281 catalog_manager.cc:5697] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.703518  9220 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:00:59.723052  9148 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:00:59.734294  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 110606us
I20260709 13:00:59.714654  9295 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:59.744197  8527 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:59.741622  8379 raft_consensus.cc:2955] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.753669  9349 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:00:59.787067  8454 raft_consensus.cc:2955] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.787117  9370 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:00:59.832268  9296 raft_consensus.cc:2955] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.859355  8384 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:59.867049  8454 raft_consensus.cc:2955] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.886561  9370 raft_consensus.cc:2955] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.889233  8527 raft_consensus.cc:2955] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.889385  8283 catalog_manager.cc:5697] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.914793  9392 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:59.914027  9395 raft_consensus.cc:2955] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:00:59.913417  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 75462.2us
I20260709 13:00:59.922057  8271 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 848cbd6ceda8400e9d2f1d58cbbdcb7b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:59.930183  9296 raft_consensus.cc:2955] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.932868  8283 catalog_manager.cc:5697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index 4 to 5, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New cstate: current_term: 2 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.948019  8530 consensus_queue.cc:237] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:00:59.951148  8527 consensus_queue.cc:237] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:00:59.963387  8284 catalog_manager.cc:5697] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.970952  9295 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:59.971007  9294 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:59.975847  9393 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:59.975878  9390 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:00:59.978467  8384 raft_consensus.cc:2955] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.978560  9294 raft_consensus.cc:2955] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:00:59.989295  8455 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:59.991917  8457 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:59.994549  8530 raft_consensus.cc:2955] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:00.012691  9391 raft_consensus.cc:2955] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:00.015597  9394 raft_consensus.cc:2955] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:00.018692  9296 raft_consensus.cc:2955] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:00.023269  8448 tablet_service.cc:1558] Processing DeleteTablet for tablet 848cbd6ceda8400e9d2f1d58cbbdcb7b with delete_type TABLET_DATA_TOMBSTONED (TS 105d6581548546b98eddd4ee7083bb12 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36438
I20260709 13:01:00.038252  9294 raft_consensus.cc:2955] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:00.064668  8268 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 26eda7bdc3194871b01c986d3db7cccf with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:01:00.081413  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 48880.2us
W20260709 13:01:00.094887  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 66384.6us
I20260709 13:01:00.099618  8993 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:00.099678  9178 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:00.109549  8457 raft_consensus.cc:2955] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:00.119731  8281 catalog_manager.cc:5697] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index 4 to 5, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New cstate: current_term: 2 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:00.137607  9401 tablet_replica.cc:333] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:01:00.138633  9401 raft_consensus.cc:2243] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.143225  8268 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 18bf9e256e3046b497483817dac46e78 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:00.145200  9401 raft_consensus.cc:2272] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.159752  8458 raft_consensus.cc:2955] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:00.164072  9401 ts_tablet_manager.cc:1916] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:00.168880  8283 catalog_manager.cc:5697] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 4 to 5, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New cstate: current_term: 2 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:00.175731  8373 tablet_service.cc:1558] Processing DeleteTablet for tablet 26eda7bdc3194871b01c986d3db7cccf with delete_type TABLET_DATA_TOMBSTONED (TS d653e71832b7402b9a03b46249d3b885 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:59326
I20260709 13:01:00.181945  8371 tablet_service.cc:1558] Processing DeleteTablet for tablet 18bf9e256e3046b497483817dac46e78 with delete_type TABLET_DATA_TOMBSTONED (TS d653e71832b7402b9a03b46249d3b885 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:59326
I20260709 13:01:00.185938  9406 tablet_replica.cc:333] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:01:00.187052  9406 raft_consensus.cc:2243] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.187891  9406 raft_consensus.cc:2272] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.191601  9406 ts_tablet_manager.cc:1916] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:00.211171  9406 ts_tablet_manager.cc:1929] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:01:00.211786  9406 log.cc:1199] T 26eda7bdc3194871b01c986d3db7cccf P d653e71832b7402b9a03b46249d3b885: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-0-root/wals/26eda7bdc3194871b01c986d3db7cccf
I20260709 13:01:00.213757  8271 catalog_manager.cc:5028] TS d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): tablet 26eda7bdc3194871b01c986d3db7cccf (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:00.213780  9406 tablet_replica.cc:333] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:01:00.222323  9406 raft_consensus.cc:2243] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.223205  9406 raft_consensus.cc:2272] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.226814  9406 ts_tablet_manager.cc:1916] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:00.228951  9401 ts_tablet_manager.cc:1929] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:01:00.230468  9401 log.cc:1199] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 105d6581548546b98eddd4ee7083bb12: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-1-root/wals/848cbd6ceda8400e9d2f1d58cbbdcb7b
I20260709 13:01:00.233794  8270 catalog_manager.cc:5028] TS 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): tablet 848cbd6ceda8400e9d2f1d58cbbdcb7b (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:00.242480  9406 ts_tablet_manager.cc:1929] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:01:00.242980  9406 log.cc:1199] T 18bf9e256e3046b497483817dac46e78 P d653e71832b7402b9a03b46249d3b885: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-0-root/wals/18bf9e256e3046b497483817dac46e78
I20260709 13:01:00.244922  8271 catalog_manager.cc:5028] TS d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): tablet 18bf9e256e3046b497483817dac46e78 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:00.534438  8458 consensus_queue.cc:237] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:00.547043  9294 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:00.550287  9402 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:00.558035  8379 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:00.565565  9402 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:00.578393  9395 raft_consensus.cc:2955] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:00.590570  8379 raft_consensus.cc:2955] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:00.638913  9294 raft_consensus.cc:2955] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:00.644784  8283 catalog_manager.cc:5697] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index 3 to 4, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:00.650483  8270 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a6ecd063b1dc49a69b15eb593af51b89 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:00.671060  8523 tablet_service.cc:1558] Processing DeleteTablet for tablet a6ecd063b1dc49a69b15eb593af51b89 with delete_type TABLET_DATA_TOMBSTONED (TS b8eb0ad4490645598004d862412f4e31 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38890
I20260709 13:01:00.681883  9407 tablet_replica.cc:333] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:01:00.719429  9407 raft_consensus.cc:2243] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.720222  9407 raft_consensus.cc:2272] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.723618  9407 ts_tablet_manager.cc:1916] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:00.735268  9407 ts_tablet_manager.cc:1929] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:00.735750  9407 log.cc:1199] T a6ecd063b1dc49a69b15eb593af51b89 P b8eb0ad4490645598004d862412f4e31: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-2-root/wals/a6ecd063b1dc49a69b15eb593af51b89
I20260709 13:01:00.737356  8268 catalog_manager.cc:5028] TS b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): tablet a6ecd063b1dc49a69b15eb593af51b89 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:01.788491  8455 consensus_queue.cc:237] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
W20260709 13:01:01.795997  8426 consensus_peers.cc:597] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8ce47d03b224808b5f7f17c341a5293. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:01.796867  8532 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:01.798336  9402 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:01.798748  8379 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:01.800616  9402 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:01.808135  9402 raft_consensus.cc:2955] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:01.809134  8532 raft_consensus.cc:2955] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:01.831358  8527 consensus_queue.cc:237] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:01.831740  8384 raft_consensus.cc:2955] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:01.836143  8281 catalog_manager.cc:5697] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:01.857832  8458 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:01.859163  8500 consensus_peers.cc:597] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 25a125e8035444f5921cc2a7eef152ae. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:01.860021  9413 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:01.861855  8384 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:01.866462  9413 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:01.880910  9411 raft_consensus.cc:2955] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:01.884088  8455 raft_consensus.cc:2955] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:01.888202  8379 raft_consensus.cc:2955] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:01.921121  8379 consensus_queue.cc:237] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:01.937438  8284 catalog_manager.cc:5697] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:01.961220  8532 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:01.963163  9415 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:01.964956  8455 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:01.966336  8351 consensus_peers.cc:597] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4f60cb7236fe439e9faa6d4f269e96da. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:01.968508  9415 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:01.979359  9370 raft_consensus.cc:2955] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:01.981431  8532 raft_consensus.cc:2955] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:01.988009  8458 raft_consensus.cc:2955] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:01.995733  8457 consensus_queue.cc:237] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:02.002348  8281 catalog_manager.cc:5697] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:02.031234  8426 consensus_peers.cc:597] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4923120e1f194cdabb09a6bc8feeba88. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:02.034649  8379 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:02.035849  8532 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:02.036626  9410 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:02.037774  9402 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:02.058501  9410 raft_consensus.cc:2955] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:02.060303  8382 raft_consensus.cc:2955] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:02.083572  8284 catalog_manager.cc:5697] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:02.109891  8527 raft_consensus.cc:2955] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:02.311331  9433 ts_tablet_manager.cc:933] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:02.317878  9433 tablet_copy_client.cc:323] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.194:36925
I20260709 13:01:02.319630  8471 tablet_copy_service.cc:140] P 105d6581548546b98eddd4ee7083bb12: Received BeginTabletCopySession request for tablet f8ce47d03b224808b5f7f17c341a5293 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:53010)
I20260709 13:01:02.320196  8471 tablet_copy_service.cc:161] P 105d6581548546b98eddd4ee7083bb12: Beginning new tablet copy session on tablet f8ce47d03b224808b5f7f17c341a5293 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:53010: session id = 446d9310dce14ff4afff2dc2d64f68d8-f8ce47d03b224808b5f7f17c341a5293
I20260709 13:01:02.327482  8471 tablet_copy_source_session.cc:215] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:02.331818  9433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8ce47d03b224808b5f7f17c341a5293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:02.352911  9433 tablet_copy_client.cc:806] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:02.353660  9433 tablet_copy_client.cc:670] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:02.358199  9433 tablet_copy_client.cc:538] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:02.370908  9433 tablet_bootstrap.cc:492] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:02.405658  9433 tablet_bootstrap.cc:492] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:02.407122  9433 tablet_bootstrap.cc:492] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:02.408013  9433 ts_tablet_manager.cc:1403] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.020s
I20260709 13:01:02.411271  9433 raft_consensus.cc:359] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:02.412302  9433 raft_consensus.cc:740] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:02.413132  9433 consensus_queue.cc:260] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:02.425979  9433 ts_tablet_manager.cc:1434] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.002s
I20260709 13:01:02.427902  8471 tablet_copy_service.cc:342] P 105d6581548546b98eddd4ee7083bb12: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-f8ce47d03b224808b5f7f17c341a5293 received from {username='slave'} at 127.0.0.1:53010
I20260709 13:01:02.428396  8471 tablet_copy_service.cc:434] P 105d6581548546b98eddd4ee7083bb12: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-f8ce47d03b224808b5f7f17c341a5293 on tablet f8ce47d03b224808b5f7f17c341a5293 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:02.448647  9433 ts_tablet_manager.cc:933] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:02.458145  9438 ts_tablet_manager.cc:933] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631)
I20260709 13:01:02.469810  9433 tablet_copy_client.cc:323] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.195:40767
I20260709 13:01:02.471657  8544 tablet_copy_service.cc:140] P b8eb0ad4490645598004d862412f4e31: Received BeginTabletCopySession request for tablet 25a125e8035444f5921cc2a7eef152ae from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:47306)
I20260709 13:01:02.472146  9438 tablet_copy_client.cc:323] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.193:43631
I20260709 13:01:02.472205  8544 tablet_copy_service.cc:161] P b8eb0ad4490645598004d862412f4e31: Beginning new tablet copy session on tablet 25a125e8035444f5921cc2a7eef152ae from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:47306: session id = 446d9310dce14ff4afff2dc2d64f68d8-25a125e8035444f5921cc2a7eef152ae
I20260709 13:01:02.485491  8544 tablet_copy_source_session.cc:215] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:02.489554  9433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25a125e8035444f5921cc2a7eef152ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:02.526197  8396 tablet_copy_service.cc:140] P d653e71832b7402b9a03b46249d3b885: Received BeginTabletCopySession request for tablet 4f60cb7236fe439e9faa6d4f269e96da from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:48484)
I20260709 13:01:02.527756  8396 tablet_copy_service.cc:161] P d653e71832b7402b9a03b46249d3b885: Beginning new tablet copy session on tablet 4f60cb7236fe439e9faa6d4f269e96da from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:48484: session id = 446d9310dce14ff4afff2dc2d64f68d8-4f60cb7236fe439e9faa6d4f269e96da
W20260709 13:01:02.574316  8315 debug-util.cc:398] Leaking SignalData structure 0x7b080003a320 after lost signal to thread 7274
W20260709 13:01:02.576102  8315 debug-util.cc:398] Leaking SignalData structure 0x7b08000359a0 after lost signal to thread 8318
W20260709 13:01:02.582242  8315 debug-util.cc:398] Leaking SignalData structure 0x7b080026ffa0 after lost signal to thread 8410
W20260709 13:01:02.584600  8315 debug-util.cc:398] Leaking SignalData structure 0x7b08000ddf40 after lost signal to thread 8485
W20260709 13:01:02.585140  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 48783.4us
I20260709 13:01:02.624562  9442 ts_tablet_manager.cc:933] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:01:02.650023  8315 debug-util.cc:398] Leaking SignalData structure 0x7b080029f980 after lost signal to thread 8559
W20260709 13:01:02.652329  8315 debug-util.cc:398] Leaking SignalData structure 0x7b080023b040 after lost signal to thread 9320
I20260709 13:01:02.657438  8396 tablet_copy_source_session.cc:215] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:02.698040  9438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f60cb7236fe439e9faa6d4f269e96da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:02.721635  9442 tablet_copy_client.cc:323] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.194:36925
I20260709 13:01:02.725517  8471 tablet_copy_service.cc:140] P 105d6581548546b98eddd4ee7083bb12: Received BeginTabletCopySession request for tablet 4923120e1f194cdabb09a6bc8feeba88 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:53010)
I20260709 13:01:02.726212  8471 tablet_copy_service.cc:161] P 105d6581548546b98eddd4ee7083bb12: Beginning new tablet copy session on tablet 4923120e1f194cdabb09a6bc8feeba88 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:53010: session id = 446d9310dce14ff4afff2dc2d64f68d8-4923120e1f194cdabb09a6bc8feeba88
I20260709 13:01:02.731703  9433 tablet_copy_client.cc:806] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:02.732558  9433 tablet_copy_client.cc:670] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:02.739845  9433 tablet_copy_client.cc:538] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:02.762739  8471 tablet_copy_source_session.cc:215] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:02.767374  9438 tablet_copy_client.cc:806] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:02.768334  9438 tablet_copy_client.cc:670] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:02.782821  9442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4923120e1f194cdabb09a6bc8feeba88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:02.785429  9433 tablet_bootstrap.cc:492] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:02.814081  9438 tablet_copy_client.cc:538] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:02.824822  9438 tablet_bootstrap.cc:492] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:02.843116  9433 tablet_bootstrap.cc:492] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:02.859047  9442 tablet_copy_client.cc:806] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:02.859779  9442 tablet_copy_client.cc:670] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:02.861122  9433 tablet_bootstrap.cc:492] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:02.861992  9433 ts_tablet_manager.cc:1403] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.077s	user 0.028s	sys 0.001s
I20260709 13:01:02.874145  9442 tablet_copy_client.cc:538] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:02.882179  9433 raft_consensus.cc:359] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:02.883563  9433 raft_consensus.cc:740] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:02.884310  9433 consensus_queue.cc:260] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:02.889552  9442 tablet_bootstrap.cc:492] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:02.899252  9294 raft_consensus.cc:1217] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:02.911576  9433 ts_tablet_manager.cc:1434] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.005s
I20260709 13:01:02.922350  8544 tablet_copy_service.cc:342] P b8eb0ad4490645598004d862412f4e31: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-25a125e8035444f5921cc2a7eef152ae received from {username='slave'} at 127.0.0.1:47306
I20260709 13:01:02.922875  8544 tablet_copy_service.cc:434] P b8eb0ad4490645598004d862412f4e31: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-25a125e8035444f5921cc2a7eef152ae on tablet 25a125e8035444f5921cc2a7eef152ae with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:02.947772  9438 tablet_bootstrap.cc:492] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:02.949587  9294 raft_consensus.cc:1217] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:01:02.953915  9438 tablet_bootstrap.cc:492] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:02.954736  9438 ts_tablet_manager.cc:1403] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.130s	user 0.018s	sys 0.011s
I20260709 13:01:02.961429  9438 raft_consensus.cc:359] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:02.962733  9438 raft_consensus.cc:740] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:02.963707  9438 consensus_queue.cc:260] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:02.979974  9438 ts_tablet_manager.cc:1434] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:01:02.983422  8396 tablet_copy_service.cc:342] P d653e71832b7402b9a03b46249d3b885: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-4f60cb7236fe439e9faa6d4f269e96da received from {username='slave'} at 127.0.0.1:48484
I20260709 13:01:02.983933  8396 tablet_copy_service.cc:434] P d653e71832b7402b9a03b46249d3b885: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-4f60cb7236fe439e9faa6d4f269e96da on tablet 4f60cb7236fe439e9faa6d4f269e96da with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:03.024295  9442 tablet_bootstrap.cc:492] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:03.025558  9442 tablet_bootstrap.cc:492] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:03.026376  9442 ts_tablet_manager.cc:1403] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.137s	user 0.029s	sys 0.005s
I20260709 13:01:03.034427  9294 raft_consensus.cc:1217] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:03.054396  9442 raft_consensus.cc:359] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:03.065356  9442 raft_consensus.cc:740] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:03.066275  9442 consensus_queue.cc:260] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:03.070432  9442 ts_tablet_manager.cc:1434] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.004s
I20260709 13:01:03.072371  8471 tablet_copy_service.cc:342] P 105d6581548546b98eddd4ee7083bb12: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-4923120e1f194cdabb09a6bc8feeba88 received from {username='slave'} at 127.0.0.1:53010
I20260709 13:01:03.072911  8471 tablet_copy_service.cc:434] P 105d6581548546b98eddd4ee7083bb12: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-4923120e1f194cdabb09a6bc8feeba88 on tablet 4923120e1f194cdabb09a6bc8feeba88 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:03.348290  9402 raft_consensus.cc:1064] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:03.351428  9402 consensus_queue.cc:237] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:03.446450  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 228940us
I20260709 13:01:03.446830  9294 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:03.451315  9451 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:03.462198  8533 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:03.464211  9402 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:03.468684  9415 raft_consensus.cc:1064] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:03.473888  9415 consensus_queue.cc:237] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:03.487090  8379 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:03.510622  9402 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:03.521818  9402 raft_consensus.cc:2955] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:03.532879  8527 raft_consensus.cc:2955] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:03.541532  9449 raft_consensus.cc:1064] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:03.550169  9296 raft_consensus.cc:2955] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:03.554111  9294 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:03.555989  8454 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:03.561568  9409 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:03.568338  9444 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:03.571858  8382 raft_consensus.cc:2955] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:03.575449  8527 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:03.579746  8284 catalog_manager.cc:5697] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:03.580266  9409 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:01:03.587725  9449 consensus_queue.cc:237] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:03.635114  9296 raft_consensus.cc:1217] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:01:03.659456  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 50812.1us
I20260709 13:01:03.660496  9409 raft_consensus.cc:2955] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:03.662070  8454 raft_consensus.cc:2955] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:03.681051  9294 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:03.682272  8457 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:03.683713  8384 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:03.685204  9441 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:03.694844  9411 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:03.698101  9388 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:03.707796  9294 raft_consensus.cc:2955] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:03.781333  8533 raft_consensus.cc:2955] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:03.809564  9388 raft_consensus.cc:2955] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:03.813544  9294 raft_consensus.cc:2955] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:03.839861  8379 raft_consensus.cc:2955] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:03.827193  8454 raft_consensus.cc:2955] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:03.910596  8281 catalog_manager.cc:5697] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:03.912305  8281 catalog_manager.cc:5697] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:03.944325  8533 consensus_queue.cc:237] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:03.948769  8379 consensus_queue.cc:237] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:03.955592  9294 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:03.957890  9449 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:03.958354  8382 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:03.963333  8458 consensus_queue.cc:237] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:03.966885  8527 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:03.973333  9370 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:03.974649  9296 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:03.977021  9449 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:03.977830  9370 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:03.981666  8379 raft_consensus.cc:2955] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:03.981825  9294 raft_consensus.cc:2955] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:03.985302  9409 raft_consensus.cc:2955] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:03.983637  9388 raft_consensus.cc:2955] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:03.993274  8533 raft_consensus.cc:2955] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:03.997030  9295 raft_consensus.cc:2955] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:04.007560  8284 catalog_manager.cc:5697] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index 3 to 4, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:04.010185  8283 catalog_manager.cc:5697] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index 3 to 4, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:04.021239  8382 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:04.026157  9386 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:04.038074  8448 tablet_service.cc:1558] Processing DeleteTablet for tablet 25a125e8035444f5921cc2a7eef152ae with delete_type TABLET_DATA_TOMBSTONED (TS 105d6581548546b98eddd4ee7083bb12 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36438
I20260709 13:01:04.038787  9410 raft_consensus.cc:2955] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:04.041775  8384 raft_consensus.cc:2955] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:04.047586  8450 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f60cb7236fe439e9faa6d4f269e96da with delete_type TABLET_DATA_TOMBSTONED (TS 105d6581548546b98eddd4ee7083bb12 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36438
I20260709 13:01:03.997001  9296 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:04.078394  9386 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:04.083258  8271 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4f60cb7236fe439e9faa6d4f269e96da with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:04.084923  9294 raft_consensus.cc:2955] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:04.126814  8284 catalog_manager.cc:5697] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 4 to 5, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:04.170284  9402 raft_consensus.cc:1064] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:04.172677  9402 consensus_queue.cc:237] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:04.181741  8523 tablet_service.cc:1558] Processing DeleteTablet for tablet f8ce47d03b224808b5f7f17c341a5293 with delete_type TABLET_DATA_TOMBSTONED (TS b8eb0ad4490645598004d862412f4e31 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:38890
W20260709 13:01:04.194902  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 83971us
I20260709 13:01:04.199855  8270 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f8ce47d03b224808b5f7f17c341a5293 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:04.209247  8268 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 25a125e8035444f5921cc2a7eef152ae with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:04.215631  9472 tablet_replica.cc:333] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:01:04.218773  9472 raft_consensus.cc:2243] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.224704  9472 raft_consensus.cc:2272] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.217509  9470 tablet_replica.cc:333] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:01:04.229640  9470 raft_consensus.cc:2243] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.230569  9470 raft_consensus.cc:2272] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.261430  9470 ts_tablet_manager.cc:1916] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:04.276249  9472 ts_tablet_manager.cc:1916] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:04.292340  9294 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:01:04.294262  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 56569.1us
I20260709 13:01:04.297034  8379 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:04.302559  9473 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:04.305605  9473 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:04.307955  8527 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:04.315816  9473 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:04.397352  9473 raft_consensus.cc:2955] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:04.409390  8530 raft_consensus.cc:2955] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:04.414088  9472 ts_tablet_manager.cc:1929] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:01:04.414701  9472 log.cc:1199] T f8ce47d03b224808b5f7f17c341a5293 P b8eb0ad4490645598004d862412f4e31: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-2-root/wals/f8ce47d03b224808b5f7f17c341a5293
I20260709 13:01:04.399613  9470 ts_tablet_manager.cc:1929] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:04.430590  9470 log.cc:1199] T 25a125e8035444f5921cc2a7eef152ae P 105d6581548546b98eddd4ee7083bb12: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-1-root/wals/25a125e8035444f5921cc2a7eef152ae
I20260709 13:01:04.432525  9470 tablet_replica.cc:333] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:01:04.433761  8270 catalog_manager.cc:5028] TS 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): tablet 25a125e8035444f5921cc2a7eef152ae (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:04.433662  8384 raft_consensus.cc:2955] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:04.437814  8268 catalog_manager.cc:5028] TS b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): tablet f8ce47d03b224808b5f7f17c341a5293 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:04.457708  9470 raft_consensus.cc:2243] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.466068  8283 catalog_manager.cc:5697] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:04.465765  9296 raft_consensus.cc:2955] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:04.466981  9470 raft_consensus.cc:2272] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.475106  9470 ts_tablet_manager.cc:1916] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:04.503648  8458 consensus_queue.cc:237] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:04.513981  8382 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:04.515465  9474 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:04.525796  9475 raft_consensus.cc:2955] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:04.533201  8382 raft_consensus.cc:2955] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:04.590703  9470 ts_tablet_manager.cc:1929] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:04.591274  9470 log.cc:1199] T 4f60cb7236fe439e9faa6d4f269e96da P 105d6581548546b98eddd4ee7083bb12: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-1-root/wals/4f60cb7236fe439e9faa6d4f269e96da
I20260709 13:01:04.593034  8270 catalog_manager.cc:5028] TS 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): tablet 4f60cb7236fe439e9faa6d4f269e96da (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:04.601675  9294 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:04.605180  9402 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:04.610785  8282 catalog_manager.cc:5697] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index 3 to 4, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:04.627674  9294 raft_consensus.cc:2955] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:04.629340  8270 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4923120e1f194cdabb09a6bc8feeba88 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:04.635277  8523 tablet_service.cc:1558] Processing DeleteTablet for tablet 4923120e1f194cdabb09a6bc8feeba88 with delete_type TABLET_DATA_TOMBSTONED (TS b8eb0ad4490645598004d862412f4e31 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38890
I20260709 13:01:04.648170  9472 tablet_replica.cc:333] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:01:04.675619  9472 raft_consensus.cc:2243] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:04.676575  9472 raft_consensus.cc:2272] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:04.680050  9472 ts_tablet_manager.cc:1916] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:04.697046  9472 ts_tablet_manager.cc:1929] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:04.697605  9472 log.cc:1199] T 4923120e1f194cdabb09a6bc8feeba88 P b8eb0ad4490645598004d862412f4e31: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-2-root/wals/4923120e1f194cdabb09a6bc8feeba88
I20260709 13:01:04.699240  8268 catalog_manager.cc:5028] TS b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): tablet 4923120e1f194cdabb09a6bc8feeba88 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:05.721215  8457 consensus_queue.cc:237] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
W20260709 13:01:05.728278  8426 consensus_peers.cc:597] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a6565bc3f96a474988bd4e41a01fa3be. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:05.732262  8379 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:05.732638  8527 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:05.733946  9481 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:05.734875  9386 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:05.768491  9473 raft_consensus.cc:2955] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:05.781569  8379 raft_consensus.cc:2955] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:05.783618  8527 raft_consensus.cc:2955] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:05.799885  8283 catalog_manager.cc:5697] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:05.801280  8532 consensus_queue.cc:237] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:05.844873  8379 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:05.846586  9411 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:05.851300  8457 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:05.867952  9449 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:01:05.871766  8500 consensus_peers.cc:597] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 911fa6f4e14f47f6a76fff18a00cd58e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:05.912024  9411 raft_consensus.cc:2955] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:05.914321  8379 raft_consensus.cc:2955] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:05.920573  8458 raft_consensus.cc:2955] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:05.927261  8454 consensus_queue.cc:237] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:05.934185  8282 catalog_manager.cc:5697] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:05.945542  8426 consensus_peers.cc:597] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: edca272c646743e09fb3b0c827c963b8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:05.948253  8530 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:05.948382  8379 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:05.949685  9473 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:05.950556  9386 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:06.020314  9481 raft_consensus.cc:2955] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:06.021945  8532 raft_consensus.cc:2955] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:06.050117  8282 catalog_manager.cc:5697] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:06.052016  8454 consensus_queue.cc:237] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:06.061957  8384 raft_consensus.cc:2955] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
W20260709 13:01:06.118539  8426 consensus_peers.cc:597] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dc1ae2a0b869453e80401c580552e127. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:06.121243  8384 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:06.121243  8532 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:06.123234  9473 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:06.125736  9473 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:06.160833  9497 ts_tablet_manager.cc:933] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:06.172374  9481 raft_consensus.cc:2955] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:06.179268  8530 raft_consensus.cc:2955] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:06.183017  8384 raft_consensus.cc:2955] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:06.188709  9497 tablet_copy_client.cc:323] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.194:36925
I20260709 13:01:06.192250  8471 tablet_copy_service.cc:140] P 105d6581548546b98eddd4ee7083bb12: Received BeginTabletCopySession request for tablet a6565bc3f96a474988bd4e41a01fa3be from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:53010)
I20260709 13:01:06.192860  8471 tablet_copy_service.cc:161] P 105d6581548546b98eddd4ee7083bb12: Beginning new tablet copy session on tablet a6565bc3f96a474988bd4e41a01fa3be from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:53010: session id = 446d9310dce14ff4afff2dc2d64f68d8-a6565bc3f96a474988bd4e41a01fa3be
I20260709 13:01:06.198356  8282 catalog_manager.cc:5697] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:06.207213  8471 tablet_copy_source_session.cc:215] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:06.223733  9497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6565bc3f96a474988bd4e41a01fa3be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.242962  9497 tablet_copy_client.cc:806] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:06.243666  9497 tablet_copy_client.cc:670] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:06.253202  9497 tablet_copy_client.cc:538] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:06.271544  9497 tablet_bootstrap.cc:492] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:06.314571  9497 tablet_bootstrap.cc:492] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:06.315665  9497 tablet_bootstrap.cc:492] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:06.316401  9497 ts_tablet_manager.cc:1403] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.018s
I20260709 13:01:06.319584  9497 raft_consensus.cc:359] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:06.320500  9497 raft_consensus.cc:740] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:06.321244  9497 consensus_queue.cc:260] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:06.377270  9497 ts_tablet_manager.cc:1434] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.061s	user 0.035s	sys 0.029s
I20260709 13:01:06.383193  8471 tablet_copy_service.cc:342] P 105d6581548546b98eddd4ee7083bb12: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-a6565bc3f96a474988bd4e41a01fa3be received from {username='slave'} at 127.0.0.1:53010
I20260709 13:01:06.383714  8471 tablet_copy_service.cc:434] P 105d6581548546b98eddd4ee7083bb12: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-a6565bc3f96a474988bd4e41a01fa3be on tablet a6565bc3f96a474988bd4e41a01fa3be with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:06.416426  9497 ts_tablet_manager.cc:933] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:06.422406  9497 tablet_copy_client.cc:323] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.195:40767
I20260709 13:01:06.424471  8544 tablet_copy_service.cc:140] P b8eb0ad4490645598004d862412f4e31: Received BeginTabletCopySession request for tablet 911fa6f4e14f47f6a76fff18a00cd58e from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:47306)
I20260709 13:01:06.425187  8544 tablet_copy_service.cc:161] P b8eb0ad4490645598004d862412f4e31: Beginning new tablet copy session on tablet 911fa6f4e14f47f6a76fff18a00cd58e from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:47306: session id = 446d9310dce14ff4afff2dc2d64f68d8-911fa6f4e14f47f6a76fff18a00cd58e
I20260709 13:01:06.438048  8544 tablet_copy_source_session.cc:215] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:06.444211  9497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911fa6f4e14f47f6a76fff18a00cd58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.471163  9497 tablet_copy_client.cc:806] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:06.473529  9497 tablet_copy_client.cc:670] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:06.490072  9497 tablet_copy_client.cc:538] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:06.510027  9505 ts_tablet_manager.cc:933] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:06.511190  9497 tablet_bootstrap.cc:492] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:06.530160  9294 raft_consensus.cc:1217] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:01:06.568228  9497 tablet_bootstrap.cc:492] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:06.572083  9497 tablet_bootstrap.cc:492] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:06.572906  9497 ts_tablet_manager.cc:1403] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.062s	user 0.031s	sys 0.000s
I20260709 13:01:06.580332  9497 raft_consensus.cc:359] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:06.581331  9497 raft_consensus.cc:740] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:06.582120  9497 consensus_queue.cc:260] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:06.583694  9505 tablet_copy_client.cc:323] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.194:36925
I20260709 13:01:06.588174  9497 ts_tablet_manager.cc:1434] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:01:06.590111  8471 tablet_copy_service.cc:140] P 105d6581548546b98eddd4ee7083bb12: Received BeginTabletCopySession request for tablet edca272c646743e09fb3b0c827c963b8 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:53010)
I20260709 13:01:06.590677  8471 tablet_copy_service.cc:161] P 105d6581548546b98eddd4ee7083bb12: Beginning new tablet copy session on tablet edca272c646743e09fb3b0c827c963b8 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:53010: session id = 446d9310dce14ff4afff2dc2d64f68d8-edca272c646743e09fb3b0c827c963b8
I20260709 13:01:06.596028  8544 tablet_copy_service.cc:342] P b8eb0ad4490645598004d862412f4e31: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-911fa6f4e14f47f6a76fff18a00cd58e received from {username='slave'} at 127.0.0.1:47306
I20260709 13:01:06.596534  8544 tablet_copy_service.cc:434] P b8eb0ad4490645598004d862412f4e31: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-911fa6f4e14f47f6a76fff18a00cd58e on tablet 911fa6f4e14f47f6a76fff18a00cd58e with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:06.598467  8471 tablet_copy_source_session.cc:215] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:06.602923  9505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edca272c646743e09fb3b0c827c963b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.622390  9505 tablet_copy_client.cc:806] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:06.623036  9505 tablet_copy_client.cc:670] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:06.623739  9497 ts_tablet_manager.cc:933] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:06.629814  9505 tablet_copy_client.cc:538] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:06.645802  9505 tablet_bootstrap.cc:492] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:06.701475  9505 tablet_bootstrap.cc:492] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:06.702546  9505 tablet_bootstrap.cc:492] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:06.703354  9505 ts_tablet_manager.cc:1403] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.010s
I20260709 13:01:06.715759  9505 raft_consensus.cc:359] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:06.717057  9505 raft_consensus.cc:740] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:06.717892  9505 consensus_queue.cc:260] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:06.721098  9505 ts_tablet_manager.cc:1434] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 13:01:06.724367  8471 tablet_copy_service.cc:342] P 105d6581548546b98eddd4ee7083bb12: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-edca272c646743e09fb3b0c827c963b8 received from {username='slave'} at 127.0.0.1:53010
I20260709 13:01:06.724855  8471 tablet_copy_service.cc:434] P 105d6581548546b98eddd4ee7083bb12: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-edca272c646743e09fb3b0c827c963b8 on tablet edca272c646743e09fb3b0c827c963b8 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:06.725785  9497 tablet_copy_client.cc:323] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.194:36925
I20260709 13:01:06.728338  8471 tablet_copy_service.cc:140] P 105d6581548546b98eddd4ee7083bb12: Received BeginTabletCopySession request for tablet dc1ae2a0b869453e80401c580552e127 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:53010)
I20260709 13:01:06.728937  8471 tablet_copy_service.cc:161] P 105d6581548546b98eddd4ee7083bb12: Beginning new tablet copy session on tablet dc1ae2a0b869453e80401c580552e127 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:53010: session id = 446d9310dce14ff4afff2dc2d64f68d8-dc1ae2a0b869453e80401c580552e127
I20260709 13:01:06.761219  8471 tablet_copy_source_session.cc:215] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:06.767381  9497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc1ae2a0b869453e80401c580552e127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:06.784508  9497 tablet_copy_client.cc:806] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:06.785197  9497 tablet_copy_client.cc:670] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:06.791049  9497 tablet_copy_client.cc:538] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:06.806241  9497 tablet_bootstrap.cc:492] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:06.818648  9294 raft_consensus.cc:1217] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:06.862815  9497 tablet_bootstrap.cc:492] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:06.863897  9497 tablet_bootstrap.cc:492] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:06.864770  9497 ts_tablet_manager.cc:1403] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.059s	user 0.029s	sys 0.014s
I20260709 13:01:06.868969  9497 raft_consensus.cc:359] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:06.869903  9497 raft_consensus.cc:740] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:06.870615  9497 consensus_queue.cc:260] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:06.873198  9497 ts_tablet_manager.cc:1434] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:06.875716  8471 tablet_copy_service.cc:342] P 105d6581548546b98eddd4ee7083bb12: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-dc1ae2a0b869453e80401c580552e127 received from {username='slave'} at 127.0.0.1:53010
I20260709 13:01:06.876180  8471 tablet_copy_service.cc:434] P 105d6581548546b98eddd4ee7083bb12: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-dc1ae2a0b869453e80401c580552e127 on tablet dc1ae2a0b869453e80401c580552e127 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:07.090996  9294 raft_consensus.cc:1217] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:07.115118  9294 raft_consensus.cc:1217] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:07.148345  9514 raft_consensus.cc:1064] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:07.151845  9514 consensus_queue.cc:237] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:07.189574  8527 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:07.190577  9294 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:07.191534  9386 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:07.192379  9473 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:07.202325  8379 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:07.203811  9386 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:07.217963  9386 raft_consensus.cc:2955] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.222766  9449 raft_consensus.cc:1064] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:07.225819  8384 raft_consensus.cc:2955] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.231817  9449 consensus_queue.cc:237] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:07.248600  8284 catalog_manager.cc:5697] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.261026  9294 raft_consensus.cc:2955] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.301216  8530 raft_consensus.cc:2955] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.305627  9296 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:07.311372  8458 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:07.327776  9411 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:07.330224  9449 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:01:07.334877  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 56347us
I20260709 13:01:07.336865  8384 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:07.347100  9480 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:07.374884  9522 raft_consensus.cc:2955] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.384871  9294 raft_consensus.cc:2955] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.386323  8454 consensus_queue.cc:237] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:07.390583  8458 raft_consensus.cc:2955] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.401042  9296 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:07.402779  9386 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:07.408922  8527 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:07.411298  9514 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:07.399406  8284 catalog_manager.cc:5697] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.414120  9513 raft_consensus.cc:2955] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.415335  9296 raft_consensus.cc:2955] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.420723  8530 raft_consensus.cc:2955] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.442318  8284 catalog_manager.cc:5697] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 4 to 5, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.444970  8270 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a6565bc3f96a474988bd4e41a01fa3be with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:07.470211  8373 tablet_service.cc:1558] Processing DeleteTablet for tablet a6565bc3f96a474988bd4e41a01fa3be with delete_type TABLET_DATA_TOMBSTONED (TS d653e71832b7402b9a03b46249d3b885 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:59326
I20260709 13:01:07.500964  8384 raft_consensus.cc:2955] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.509627  9528 tablet_replica.cc:333] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:01:07.517933  9528 raft_consensus.cc:2243] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:07.518759  9528 raft_consensus.cc:2272] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:07.522634  9528 ts_tablet_manager.cc:1916] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:07.544361  9528 ts_tablet_manager.cc:1929] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:01:07.544872  9528 log.cc:1199] T a6565bc3f96a474988bd4e41a01fa3be P d653e71832b7402b9a03b46249d3b885: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-0-root/wals/a6565bc3f96a474988bd4e41a01fa3be
I20260709 13:01:07.544975  8530 consensus_queue.cc:237] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:07.559360  8271 catalog_manager.cc:5028] TS d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): tablet a6565bc3f96a474988bd4e41a01fa3be (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:07.563705  9296 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:07.566671  9480 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:07.575804  9480 raft_consensus.cc:2955] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.579025  9296 raft_consensus.cc:2955] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.590837  8379 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:07.594269  9522 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:07.604846  8384 raft_consensus.cc:2955] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.614064  8284 catalog_manager.cc:5697] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 3 to 4, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.630777  8268 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 911fa6f4e14f47f6a76fff18a00cd58e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:07.636559  9386 raft_consensus.cc:1064] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:07.641435  8448 tablet_service.cc:1558] Processing DeleteTablet for tablet 911fa6f4e14f47f6a76fff18a00cd58e with delete_type TABLET_DATA_TOMBSTONED (TS 105d6581548546b98eddd4ee7083bb12 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36438
I20260709 13:01:07.655625  9386 consensus_queue.cc:237] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:07.668138  9529 tablet_replica.cc:333] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:01:07.673723  9529 raft_consensus.cc:2243] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:07.677472  9529 raft_consensus.cc:2272] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:07.684649  9529 ts_tablet_manager.cc:1916] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:07.686523  9296 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:07.688051  9513 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:07.696738  8530 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:07.696738  8384 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:07.698392  9473 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:07.700199  9386 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:07.709755  9529 ts_tablet_manager.cc:1929] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:07.710098  9386 raft_consensus.cc:1064] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:07.710242  9529 log.cc:1199] T 911fa6f4e14f47f6a76fff18a00cd58e P 105d6581548546b98eddd4ee7083bb12: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-1-root/wals/911fa6f4e14f47f6a76fff18a00cd58e
I20260709 13:01:07.714633  8270 catalog_manager.cc:5028] TS 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): tablet 911fa6f4e14f47f6a76fff18a00cd58e (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:07.712594  9386 consensus_queue.cc:237] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:07.719965  9473 raft_consensus.cc:2955] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.721794  8384 raft_consensus.cc:2955] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.738215  9294 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:07.741263  9498 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:07.741750  8379 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:07.745142  9498 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:07.751428  8527 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:07.798477  8284 catalog_manager.cc:5697] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:07.800701  8527 raft_consensus.cc:2955] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.809610  9498 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:07.817638  9473 raft_consensus.cc:2955] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.837509  8384 raft_consensus.cc:2955] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.865516  8532 raft_consensus.cc:2955] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.882962  9296 raft_consensus.cc:2955] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.896965  8284 catalog_manager.cc:5697] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.905359  8458 consensus_queue.cc:237] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:07.916272  8532 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:07.921208  9386 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:07.924659  9294 raft_consensus.cc:2955] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.936926  8458 consensus_queue.cc:237] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:07.941028  9537 raft_consensus.cc:2955] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.948674  8532 raft_consensus.cc:2955] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.958657  8379 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:07.960696  9473 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:07.964570  9295 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:07.967345  9386 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:07.969108  9514 raft_consensus.cc:2955] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.982914  9296 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:07.982878  9295 raft_consensus.cc:2955] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.984741  9473 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:07.984959  8384 raft_consensus.cc:2955] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:07.989418  8270 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dc1ae2a0b869453e80401c580552e127 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:08.004920  8270 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet edca272c646743e09fb3b0c827c963b8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:08.001458  8283 catalog_manager.cc:5697] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index 3 to 4, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:08.017197  9296 raft_consensus.cc:2955] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:08.069950  8284 catalog_manager.cc:5697] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 3 to 4, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:08.077490  8373 tablet_service.cc:1558] Processing DeleteTablet for tablet edca272c646743e09fb3b0c827c963b8 with delete_type TABLET_DATA_TOMBSTONED (TS d653e71832b7402b9a03b46249d3b885 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59326
I20260709 13:01:08.101281  8523 tablet_service.cc:1558] Processing DeleteTablet for tablet dc1ae2a0b869453e80401c580552e127 with delete_type TABLET_DATA_TOMBSTONED (TS b8eb0ad4490645598004d862412f4e31 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38890
I20260709 13:01:08.111148  9542 tablet_replica.cc:333] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:01:08.112272  9542 raft_consensus.cc:2243] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:08.113008  9542 raft_consensus.cc:2272] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:08.118696  9542 ts_tablet_manager.cc:1916] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:08.114043  9541 tablet_replica.cc:333] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:01:08.121836  9541 raft_consensus.cc:2243] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:08.122654  9541 raft_consensus.cc:2272] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:08.125939  9541 ts_tablet_manager.cc:1916] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:08.145890  9541 ts_tablet_manager.cc:1929] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:08.146739  9541 log.cc:1199] T edca272c646743e09fb3b0c827c963b8 P d653e71832b7402b9a03b46249d3b885: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-0-root/wals/edca272c646743e09fb3b0c827c963b8
I20260709 13:01:08.149340  8271 catalog_manager.cc:5028] TS d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): tablet edca272c646743e09fb3b0c827c963b8 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:08.159584  9542 ts_tablet_manager.cc:1929] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:08.160014  9542 log.cc:1199] T dc1ae2a0b869453e80401c580552e127 P b8eb0ad4490645598004d862412f4e31: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-2-root/wals/dc1ae2a0b869453e80401c580552e127
I20260709 13:01:08.161404  8268 catalog_manager.cc:5028] TS b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): tablet dc1ae2a0b869453e80401c580552e127 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
W20260709 13:01:09.665580  8315 debug-util.cc:398] Leaking SignalData structure 0x7b080014b560 after lost signal to thread 7274
I20260709 13:01:09.711776  9543 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:09.712725  9543 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.716071  9543 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.782133  9543 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:09.786566  9543 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:09.805328  8315 debug-util.cc:398] Leaking SignalData structure 0x7b080029f8a0 after lost signal to thread 8318
I20260709 13:01:09.805485  9544 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:09.806128  9544 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.809167  9544 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.819536  9473 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:09.820377  9473 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.822718  9473 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.824852  9555 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:09.825857  9555 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:09.827033  9544 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:09.827659  9544 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.828382  9555 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:09.830060  9544 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.831203  9545 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:09.838054  9543 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.833866  9549 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:09.838762  9554 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:09.838222  9545 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.839282  9554 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.840260  9553 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:09.840759  9553 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:09.838763  9549 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.841854  9554 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:09.842970  9543 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:09.843677  9549 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.843525  9543 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.841257  9545 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.845582  9543 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.847378  9554 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:09.847836  9554 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.849771  9554 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:09.855463  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:09.857674  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:09.858920  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:09.861383  8424 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.008s	sys 0.006s
W20260709 13:01:09.861739  8424 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.008s	sys 0.006s
I20260709 13:01:09.861892  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:09.843302  9553 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:09.863013  9553 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:09.863526  9553 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:09.872949  9473 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:09.873628  9473 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.875388  9473 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.875801  9473 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:09.876192  9473 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.877885  9544 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:09.878482  9544 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.880967  9544 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.882388  9556 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:09.883033  9556 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.885177  9460 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:09.885496  9556 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:09.885699  9460 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.886165  9556 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:09.886508  9522 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:09.886636  9556 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.887087  9522 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.888653  9556 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:09.888998  9522 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:09.889420  9558 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:09.889914  9558 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.892429  9460 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.888870  9557 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:09.899216  9557 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.900540  9460 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:09.901330  9460 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.903231  9460 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.904170  9473 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.912029  9553 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.912120  9557 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:09.918098  9543 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:09.918874  9555 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:09.918678  9543 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.919380  9555 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.921679  9554 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:09.922214  9554 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.924237  9554 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:09.927341  9555 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.927721  9522 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:01:09.929677  8315 debug-util.cc:398] Leaking SignalData structure 0x7b0800035d20 after lost signal to thread 8410
I20260709 13:01:09.930557  9555 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:09.931103  9555 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.933359  9555 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.939940  9560 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:09.940383  9449 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:09.950707  9543 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.951270  9449 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.941325  9553 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:01:09.942814  8315 debug-util.cc:398] Leaking SignalData structure 0x7b080003c4c0 after lost signal to thread 8485
I20260709 13:01:09.952344  9553 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:09.953289  8315 debug-util.cc:398] Leaking SignalData structure 0x7b08003205e0 after lost signal to thread 8559
I20260709 13:01:09.953423  9449 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:09.916554  9546 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:09.944372  9538 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:09.942904  9557 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:09.955297  9538 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:09.950482  9545 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:01:09.954842  8315 debug-util.cc:398] Leaking SignalData structure 0x7b0800285b00 after lost signal to thread 9320
I20260709 13:01:09.958477  9548 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:01:09.959210  8315 debug-util.cc:398] Leaking SignalData structure 0x7b080029f2e0 after lost signal to thread 9542
I20260709 13:01:09.951681  9554 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:09.928435  9522 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:09.961345  9554 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.962721  9522 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:09.957703  9538 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:09.958214  9545 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.958874  9560 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:09.964337  9567 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:09.965215  9545 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.964860  9567 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.954180  9546 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.965888  9560 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.966396  9560 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:09.966840  9560 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:09.967337  9546 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.960316  9449 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:09.967691  9567 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:09.963340  9554 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:09.968114  9449 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.989418  9449 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:09.963340  9522 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:09.960745  9553 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.959059  9548 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.990108  9522 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.991732  9548 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.955412  9557 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.969769  9568 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:09.992180  9522 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:09.992548  9568 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:09.970304  9558 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:09.993731  9557 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:09.971364  9559 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:09.971472  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:09.972651  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:09.973469  9556 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:09.994670  9559 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.995528  9556 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.977566  9563 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:09.997545  9556 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:09.968863  9560 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:09.980759  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:01:09.978631  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 87793.7us
I20260709 13:01:09.998255  9560 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:09.998375  9544 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:09.998745  9560 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:09.999020  9544 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.981307  9562 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:10.001345  9562 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.003145  9564 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.003926  9562 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.003679  9564 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.983796  9566 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.004594  9566 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.995642  9568 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:09.997391  9563 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:09.996984  9559 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:10.007002  9566 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:10.007596  9563 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:09.982143  9555 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:10.008394  9555 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.010504  9555 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.000835  9560 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.011080  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.011897  9564 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.012753  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.013382  8384 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:01:10.013784  9538 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.013906  9555 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:10.014412  9544 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.014834  9473 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:10.014496  9538 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.014525  9555 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.016865  9555 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.017433  9538 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.018240  9561 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.014664  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.019130  8384 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:01:10.019002  9561 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:01:10.021646  9549 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.022346  9549 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.025169  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.027146  9514 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:10.028021  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.029229  9538 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.030151  9538 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.030740  9568 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:10.031612  9568 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:10.033344  9538 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.034147  9538 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.034631  9568 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:10.034781  9538 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.065164  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:10.065810  9295 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:01:10.026695  9561 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.066658  9538 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.035857  9568 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:10.036259  9555 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:10.067560  9555 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.038282  8427 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:10.069193  9561 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.069792  9555 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.069703  9561 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.042124  9569 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.070818  9569 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.071825  9561 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.072363  9561 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:10.072710  9561 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:10.044462  9559 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.044562  9556 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:10.045229  9563 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.072988  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.045049  9566 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.049042  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.051102  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.052719  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.052942  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.053326  9562 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:10.053756  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.054953  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.055652  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.056039  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.056173  9549 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.056465  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.057183  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.058420  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.059267  9564 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.073065  9561 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.073472  9556 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.083503  9560 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.084120  9560 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:10.085318  9556 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:10.085394  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.073598  9563 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.086794  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.087297  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.087817  9563 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:10.087994  8531 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:01:10.088994  9564 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.074975  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.076980  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.018254  9473 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:10.077700  9562 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.078147  8452 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:01:10.093365  9473 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:10.078482  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.074747  9569 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.090910  9564 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.094714  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.095286  8533 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:01:10.096020  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.096736  9553 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:10.097186  9560 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.061070  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.062830  9570 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.113793  9561 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.114274  9570 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.114869  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.115924  9561 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.064404  9557 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.118460  9557 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:10.027976  9514 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.097465  9553 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:10.121598  9571 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.122543  9538 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.122895  9553 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.098637  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.122982  9514 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.122262  9571 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.124027  9565 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:10.124293  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.125659  9571 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.099419  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.100704  9555 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:10.126372  9555 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:10.127017  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.127353  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.128252  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.128468  9555 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:10.128646  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.079957  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.096493  8533 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:01:10.081765  9544 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.073427  9559 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.102289  9563 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.102564  9572 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.090922  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.150738  8528 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:01:10.151885  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.102790  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.153532  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.075701  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.154824  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.155418  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.155776  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.082247  8454 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:01:10.157341  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.157771  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.158134  8386 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 1.
I20260709 13:01:10.158798  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.159389  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.076620  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.077683  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.161161  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.081197  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:10.162052  8382 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 1.
I20260709 13:01:10.081378  8427 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:10.082898  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:01:10.162848  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 81547.8us
I20260709 13:01:10.105429  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.106338  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:10.107944  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:10.073948  9566 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.165378  9561 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:10.165810  9561 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:10.166159  9561 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.166239  9566 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:10.074831  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.168125  9556 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.168663  9556 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:01:10.089047  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.169759  8531 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:01:10.077464  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.170855  9556 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:10.171399  9556 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:10.116117  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.171859  9556 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:10.116772  9560 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:10.156836  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.173034  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:10.173285  9560 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:10.173695  8458 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:01:10.117303  8527 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:01:10.175663  9560 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.175887  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.173287  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.067483  9568 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:10.179275  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.179503  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.179988  8528 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 1.
I20260709 13:01:10.180342  9568 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:10.125612  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.100581  9562 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.060868  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.180606  8460 consensus_queue.cc:237] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:10.181586  8535 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:01:10.181783  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.182896  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.190493  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.190790  8535 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:01:10.191183  8378 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:10.191716  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.190511  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.194392  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.195408  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.196331  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.196528  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.197508  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.197643  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:10.131736  8424 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.198261  8381 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.198657  9514 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.120823  9557 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:10.116948  9570 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:10.124655  9565 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.142884  9563 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.201357  9563 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:10.201400  9565 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.123075  9538 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.202610  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:10.203269  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 71638.8us
I20260709 13:01:10.203843  9538 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.145875  9559 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:10.147348  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.149441  8534 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:10.205192  8424 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.139357  9544 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.130299  9260 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.207568  9514 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:01:10.207859  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 77768.1us
I20260709 13:01:10.208590  9544 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.180666  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.209666  8530 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:10.209590  9260 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.210600  9560 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:10.210641  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.183802  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.211377  9560 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:10.211840  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.212190  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.184388  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.213675  8424 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.212867  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.182976  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.164062  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.214962  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:10.214993  8426 consensus_peers.cc:597] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1663cf9302e8495c8762465d306cb479. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:10.215850  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.216090  8424 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.181017  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.192941  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.213294  9572 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.186522  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.225378  8424 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:10.189673  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.227324  8381 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:01:10.228065  8378 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.198632  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.229175  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.138186  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.229893  8533 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:01:10.206130  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.206039  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.139611  9555 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:10.207950  9514 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.184590  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.242638  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.217576  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.218951  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.219681  9258 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:10.219894  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.186051  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.221243  9565 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:10.222635  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.223619  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.224099  9544 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:10.224380  9556 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:10.227831  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.247933  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.252739  9564 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:10.252911  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.253443  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.290670  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.240490  9571 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:10.298033  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.296957  9544 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.298781  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:10.290864  9568 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:10.299961  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.310362  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.310251  9561 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.311398  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.311805  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.300338  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.312510  9561 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.298327  9572 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.312516  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.311443  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.255028  9258 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:01:10.317876  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 62926.7us
I20260709 13:01:10.318771  9258 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.319748  9573 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:10.320508  9573 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.305459  9564 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.323213  9564 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.323719  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.323911  8500 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:10.324560  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:10.324851  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 104767us
I20260709 13:01:10.324962  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.325228  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.324592  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.327163  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.290376  9261 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.300457  9549 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:10.328133  9549 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.328539  9549 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.330330  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.306864  9544 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.308674  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.310616  9568 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.333858  9568 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.333631  9565 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.305956  9562 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:01:10.335098  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 44959.4us
I20260709 13:01:10.335963  9261 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.306253  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:10.339555  9548 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:10.339968  9548 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:10.340351  9548 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.340380  9556 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:10.342536  9562 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.340863  9556 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.343595  9556 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.346138  9261 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.347748  9573 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:10.347862  8501 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:10.348644  9567 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:10.347090  9562 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.349071  9567 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:10.349545  9567 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:10.350800  8501 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.351421  9261 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.352568  9261 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.246814  9514 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.354449  8501 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.354599  9548 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:10.355321  9553 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.375730  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.336966  9560 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.357383  9557 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.357913  8380 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:10.358347  9573 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:10.361311  9544 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.362200  8349 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.368252  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.254171  9555 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.374101  9559 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:10.374176  8501 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.377614  9573 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:10.374917  9522 consensus_queue.cc:1059] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:10.377223  9548 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:10.379083  9261 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.380354  8349 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:01:10.383253  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 157940us
I20260709 13:01:10.379115  8351 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.384547  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.385977  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.386086  8424 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.380693  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.387547  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:10.388113  9449 raft_consensus.cc:3055] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:10.388577  9449 raft_consensus.cc:740] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:10.389573  9548 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.390293  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.390797  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.391093  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:10.380649  9573 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.380522  9546 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:10.389669  9553 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.380733  9562 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.393729  8427 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:10.394798  8349 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.395381  8424 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.379371  9560 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:10.399394  9560 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:10.399873  9560 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.400544  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.397466  9449 consensus_queue.cc:260] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.398522  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.393627  9543 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.399116  8424 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.379983  9554 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:10.368795  9549 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.401054  9571 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:10.403322  9572 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:10.425498  9571 raft_consensus.cc:697] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:10.405702  8351 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.397192  9564 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:10.404112  9548 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:10.405879  9561 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:10.408257  9562 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:10.380124  9567 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.409859  9449 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.408607  8349 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.427191  9543 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.410881  8424 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.412766  9560 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:10.434545  8424 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.435451  9544 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.416347  9514 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.411360  9473 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:10.438747  9473 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.439231  9473 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.427507  9564 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.442852  9564 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.444072  9567 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:10.411188  9565 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.432865  8349 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.447781  9295 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.448549  8349 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.440867  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:10.418870  9555 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.426414  9571 consensus_queue.cc:237] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.438975  9545 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.428659  8351 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:10.450850  8349 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.442296  8424 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.452126  9565 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:10.447230  9473 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.459650  9551 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:10.450815  9544 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:10.451098  9449 consensus_queue.cc:1059] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:10.462316  9473 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.462008  9565 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:10.462572  9559 raft_consensus.cc:3055] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:10.462100  9544 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.483994  9565 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:10.484179  9559 raft_consensus.cc:740] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:10.464974  8351 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.484552  9565 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.465361  9577 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:10.466468  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:10.488096  8351 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.464224  8424 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.471513  8349 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.447202  9568 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:10.485159  9559 consensus_queue.cc:260] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:10.487361  9545 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:10.492169  9546 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.484304  9544 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:10.488297  9577 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.494652  9577 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.452127  9575 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:10.430146  9573 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:10.491098  8351 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.496497  8424 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.498521  9546 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.499917  9576 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:10.511230  9561 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:10.470624  9555 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.502895  9559 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.503530  9569 raft_consensus.cc:2955] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:10.504405  9564 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.497638  9575 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.507081  9514 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.512032  8424 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.516830  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:10.534792  8424 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.520685  9549 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.521289  9293 raft_consensus.cc:1240] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.525683  8501 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.516857  9546 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.532125  8457 raft_consensus.cc:1240] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.533349  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:10.533634  8458 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.511541  9576 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.524489  9575 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:10.575513  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 49951.2us
I20260709 13:01:10.577646  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.511672  9561 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.581627  8501 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.581648  8461 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:10.590206  9449 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:10.593293  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 85687.7us
W20260709 13:01:10.596812  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 64120.5us
I20260709 13:01:10.574240  9564 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.599073  8501 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.576174  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:10.517279  8378 raft_consensus.cc:2955] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:10.579818  9567 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.580994  9576 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:10.603089  9449 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:10.587328  8380 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.597340  9549 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:10.588215  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:01:10.615562  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 80864.2us
I20260709 13:01:10.595479  9561 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:10.605942  9568 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.616384  8424 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.613634  9560 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.587697  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.617448  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:10.629282  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:10.630983  9556 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.633314  9514 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:10.607542  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.610759  9549 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:10.601711  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:10.634256  8424 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.635870  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:10.634285  9565 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.611474  9572 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.636724  8283 catalog_manager.cc:5697] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 1 to 2, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:10.622279  8351 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.621943  9577 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.657135  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:10.643273  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.625483  9573 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.644811  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.659760  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.644719  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.643846  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.664011  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.657325  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:10.641943  9473 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.658739  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.666664  8459 raft_consensus.cc:1240] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.643920  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.660531  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:10.641072  9549 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.670418  8457 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.672120  8351 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:10.674180  9545 consensus_queue.cc:1059] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:10.674889  9555 consensus_queue.cc:1059] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:10.675494  9580 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.677242  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:10.678180  9546 raft_consensus.cc:3055] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:10.678575  9546 raft_consensus.cc:740] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:10.681572  8454 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.675925  9555 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:10.693754  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.671078  9556 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:10.686677  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:10.679006  9547 consensus_queue.cc:1059] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:01:10.679414  9546 consensus_queue.cc:260] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.695979  9555 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:10.708582  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.706949  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.714802  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.716182  9261 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.718760  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.719211  9261 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.720912  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.721272  9573 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:10.721364  9568 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.722666  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.722769  9261 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.709470  9555 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:10.710063  9543 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:01:10.738034  9568 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.739682  9543 consensus_queue.cc:1059] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:10.740707  9543 raft_consensus.cc:3055] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:10.741060  9543 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:10.741422  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.741827  9543 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.743561  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.746601  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:10.743013  9543 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.736701  8456 raft_consensus.cc:1240] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.736123  9546 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.737422  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:10.725587  9557 consensus_queue.cc:1059] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:01:10.746620  9577 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.752566  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.761467  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:10.758278  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:10.736899  9575 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.758747  9548 raft_consensus.cc:3055] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:10.764155  9572 consensus_queue.cc:1059] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:01:10.786001  8459 raft_consensus.cc:1240] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.786684  9583 raft_consensus.cc:3055] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:10.787410  9583 raft_consensus.cc:740] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:10.795327  9295 raft_consensus.cc:1240] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.796257  9556 raft_consensus.cc:3055] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:10.777305  9548 raft_consensus.cc:740] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:10.796823  9556 raft_consensus.cc:740] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:01:10.819953  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 225045us
I20260709 13:01:10.822978  9565 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.831619  9562 raft_consensus.cc:3055] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:10.832108  9562 raft_consensus.cc:740] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:10.790138  9583 consensus_queue.cc:260] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:10.809468  9558 consensus_queue.cc:1059] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:01:10.846573  8532 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 2.
I20260709 13:01:10.845000  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:10.839145  8282 catalog_manager.cc:5697] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:10.853122  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:10.843271  9580 raft_consensus.cc:3055] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:10.861145  9555 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.864277  9555 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.861853  9583 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.864540  9556 consensus_queue.cc:260] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:10.848889  9581 consensus_queue.cc:1059] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:01:10.860337  9551 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.851128  9544 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.854571  9575 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.861251  9580 raft_consensus.cc:740] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:10.877687  9581 raft_consensus.cc:3055] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:10.878123  9581 raft_consensus.cc:740] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:10.879762  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:10.840068  9549 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.874001  8377 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:10.874274  9544 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.876415  9258 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:10.847373  9548 consensus_queue.cc:260] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.871676  9587 consensus_queue.cc:1059] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:01:10.878132  9580 consensus_queue.cc:260] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.886240  9568 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:10.886883  9568 raft_consensus.cc:697] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:10.887866  9568 consensus_queue.cc:237] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:10.873742  9576 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.871547  9562 consensus_queue.cc:260] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.891276  8459 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:10.886809  9580 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.885381  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:10.885936  8532 consensus_queue.cc:237] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:10.893795  9561 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:01:10.893692  9577 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:10.898645  8460 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:10.891942  9556 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.891811  9548 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.899431  8349 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.910621  8349 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.879007  9581 consensus_queue.cc:260] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.914290  8349 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.906782  9562 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.907554  9576 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.914424  9555 consensus_queue.cc:1059] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:01:10.920463  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.921002  8527 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.923473  9565 raft_consensus.cc:3055] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:10.924083  9565 raft_consensus.cc:740] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:10.917114  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:10.925213  9565 consensus_queue.cc:260] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:01:10.926832  9565 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:10.927322  8377 raft_consensus.cc:1240] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.928337  8460 raft_consensus.cc:1240] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.928637  8378 raft_consensus.cc:1240] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:10.922071  9589 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:10.923537  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.922529  9588 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.917987  9551 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.930243  9589 consensus_queue.cc:1059] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:10.913419  9591 consensus_queue.cc:1059] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:01:10.933555  9591 raft_consensus.cc:3055] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:10.934054  9591 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:10.934353  9558 consensus_queue.cc:1059] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:10.935415  9558 raft_consensus.cc:3055] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:10.935788  9558 raft_consensus.cc:740] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:10.935222  9591 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.936952  9549 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.931349  9551 raft_consensus.cc:3055] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:10.937250  9557 consensus_queue.cc:1059] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:10.939265  9551 raft_consensus.cc:740] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:10.952124  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:10.952934  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:10.953910  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:10.936996  9591 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:10.936609  9558 consensus_queue.cc:260] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.958863  9581 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.963446  8460 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:10.962476  9546 raft_consensus.cc:3055] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:10.965114  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:10.966121  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:10.965504  9546 raft_consensus.cc:740] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:10.967649  8453 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.946060  9551 consensus_queue.cc:260] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.967934  9546 consensus_queue.cc:260] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:10.968750  9551 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.969285  9546 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.976783  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:10.977397  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:10.977990  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.979064  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.984007  8349 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:10.986038  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:10.986491  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:10.973940  9558 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.988672  8500 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.004766  9449 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:11.005312  9449 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:11.005836  9449 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.985124  9559 raft_consensus.cc:3055] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:11.002274  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:10.992472  9561 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:10.974402  9588 consensus_queue.cc:1059] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:01:11.019150  9559 raft_consensus.cc:740] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:11.052879  9588 raft_consensus.cc:3055] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:11.023635  9545 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:11.053013  8531 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:11.057413  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:11.059208  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:11.055337  9295 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:11.054244  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:01:11.068163  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.058890  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:11.078532  8377 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:11.085716  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:11.085981  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:11.054960  9559 consensus_queue.cc:260] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:11.053452  9588 raft_consensus.cc:740] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:11.087021  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:11.089303  8424 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.095327  8424 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.093114  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:11.095722  9449 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:11.099277  8532 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:01:11.099489  9449 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:11.101794  8385 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:11.102480  8424 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.126242  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:01:11.130174  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 141573us
I20260709 13:01:11.130448  8424 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.089788  9559 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:11.092571  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:11.102875  9514 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:11.193922  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 63566.6us
I20260709 13:01:11.097532  9575 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.131338  8500 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.198858  8424 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.200592  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:11.106012  9547 consensus_queue.cc:1059] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:01:11.170755  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:11.216907  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:01:11.222160  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 94354.5us
I20260709 13:01:11.131906  9570 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:01:11.195043  9572 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.222918  8427 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:01:11.226763  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 95486.5us
I20260709 13:01:11.101428  8529 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:11.297371  8384 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
W20260709 13:01:11.300099  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 316208us
I20260709 13:01:11.302086  8501 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:11.194640  9588 consensus_queue.cc:260] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:11.231218  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:01:11.299297  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 70166.1us
I20260709 13:01:11.299446  8500 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.194357  9569 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.307891  8500 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.232998  9554 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:11.302901  9449 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:01:11.304857  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 82022.3us
I20260709 13:01:11.309124  8424 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:11.305727  9592 log.cc:927] Time spent T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:01:11.316190  9554 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.309731  9544 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:11.326891  8424 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.328011  8424 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.309850  9567 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.333247  9449 raft_consensus.cc:697] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:11.299994  9585 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:11.330973  8349 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:11.336020  9449 consensus_queue.cc:237] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:11.331266  9569 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.332418  9549 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:11.312436  9572 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:01:11.341536  9514 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.334345  9544 raft_consensus.cc:697] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:01:11.360167  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 52364.7us
I20260709 13:01:11.363234  8500 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.362013  9598 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:01:11.366989  9583 consensus_meta.cc:287] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.016s
I20260709 13:01:11.368574  9543 raft_consensus.cc:3055] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:11.368976  9543 raft_consensus.cc:740] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:11.369786  9543 consensus_queue.cc:260] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:11.371177  9543 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:11.371179  9588 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:11.375147  8500 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.377193  8527 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:11.376760  8500 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.365813  9570 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:11.386909  8500 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.372629  9544 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } }
I20260709 13:01:11.381232  9558 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:11.404143  9580 consensus_meta.cc:287] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.013s
I20260709 13:01:11.404428  8526 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:11.406157  8380 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:11.410631  8500 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.413642  9559 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.425897  9600 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.390404  9563 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:11.441301  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 129665us
W20260709 13:01:11.447606  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.459681  8281 catalog_manager.cc:5697] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 1 to 2, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 2 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:11.468708  8380 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:11.479506  8378 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:01:11.480954  8500 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.482718  9563 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:11.484339  8500 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.486874  9563 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:11.489984  9568 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:11.490477  8500 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.492416  9558 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:11.493521  9563 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:11.493609  8427 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:11.495007  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.495697  9602 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:11.497937  9449 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.498695  9602 raft_consensus.cc:697] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:11.499596  9602 consensus_queue.cc:237] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:11.500023  8500 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.494061  9563 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:11.504386  9449 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.505735  9563 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:11.506817  8500 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.507892  9563 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.507920  8526 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:11.508306  8500 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.510228  9568 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:11.510419  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:11.510455  9563 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:11.510862  8500 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.523794  8500 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.526060  9449 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.524992  9563 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:11.531661  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 203710us
I20260709 13:01:11.533073  8424 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.533274  8500 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:11.536211  9449 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.536367  9604 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.538566  8424 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.540278  9544 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:11.538568  8500 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.548468  9558 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.554437  9563 raft_consensus.cc:2955] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:11.556457  8384 raft_consensus.cc:2955] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:11.567339  9449 consensus_queue.cc:1059] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:11.568424  9600 raft_consensus.cc:3055] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:11.568792  9600 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:11.569494  8424 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.570639  8424 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.580205  9559 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:11.585399  9600 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:11.586093  9559 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:11.586833  9600 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:11.582104  8500 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.582909  9605 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:11.595124  9449 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.578619  9544 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.597723  8500 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.597723  8424 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.599957  8424 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.601312  9473 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.602666  8424 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.602844  9449 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:11.603628  9449 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:11.604125  9449 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:11.606896  9449 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:11.608351  8349 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:11.602777  9583 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.609277  9569 consensus_queue.cc:1059] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:11.611796  9559 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:11.612707  8424 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.611936  9565 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:11.615916  9565 raft_consensus.cc:697] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:11.609674  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:11.617247  9514 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:11.606395  9602 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.617781  9514 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:11.616856  9565 consensus_queue.cc:237] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:11.631407  8528 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:11.630144  9514 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:11.611857  9569 raft_consensus.cc:3055] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:11.637030  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:11.637599  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:11.630263  9609 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:01:11.633383  8284 catalog_manager.cc:5697] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 3 to 4, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 4 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:11.641677  8453 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:11.642052  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:11.642266  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:01:11.639091  8500 consensus_peers.cc:597] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf1cdd90debd40a6a2361af7491977d6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:11.632998  8283 catalog_manager.cc:5697] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 1 to 2, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 2 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:11.657271  8332 auto_rebalancer.cc:629] Failed to schedule move for tablet 6427ce7790bd4629985d340936d6f356: Illegal state: Replica d653e71832b7402b9a03b46249d3b885 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:01:11.661221  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:11.636389  9569 raft_consensus.cc:740] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:11.665112  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:11.663754  9570 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:11.666493  9569 consensus_queue.cc:260] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:11.667798  9569 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:11.663364  9602 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:01:11.674993  8500 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.695966  8500 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.694852  9563 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:11.699039  9522 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:11.715109  8332 auto_rebalancer.cc:629] Failed to schedule move for tablet 9c3c85d53de1420dab74923e2fc80f02: Illegal state: Replica b8eb0ad4490645598004d862412f4e31 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:01:11.719704  9514 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:11.744241  8283 catalog_manager.cc:5697] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 1 to 2, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:11.785912  9615 ts_tablet_manager.cc:933] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:11.797677  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:11.804327  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:11.799993  9514 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:11.807472  8534 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:11.805531  8528 raft_consensus.cc:2955] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:11.810129  9563 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:11.810657  9563 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:11.808841  8424 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:11.812685  9600 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:11.813274  9600 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:11.814025  9563 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:11.820086  9514 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:11.839524  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:11.834318  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:11.840386  8460 raft_consensus.cc:2393] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 2: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:11.837093  9600 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:11.835292  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:11.853452  8377 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:11.831666  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:11.843123  9514 raft_consensus.cc:697] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:11.855808  9514 consensus_queue.cc:237] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:11.870900  8501 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:11.883317  9600 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:11.891113  8380 raft_consensus.cc:2393] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 2: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:11.908623  8284 catalog_manager.cc:5697] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:11.911103  8284 catalog_manager.cc:5697] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 2, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:11.900379  9600 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:11.913159  9600 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:11.923547  8377 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:11.930117  9615 tablet_copy_client.cc:323] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.194:36925
I20260709 13:01:11.969506  8471 tablet_copy_service.cc:140] P 105d6581548546b98eddd4ee7083bb12: Received BeginTabletCopySession request for tablet 1663cf9302e8495c8762465d306cb479 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:53010)
I20260709 13:01:11.970103  8471 tablet_copy_service.cc:161] P 105d6581548546b98eddd4ee7083bb12: Beginning new tablet copy session on tablet 1663cf9302e8495c8762465d306cb479 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:53010: session id = 446d9310dce14ff4afff2dc2d64f68d8-1663cf9302e8495c8762465d306cb479
I20260709 13:01:11.981509  8380 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:11.991091  9549 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:11.985813  8471 tablet_copy_source_session.cc:215] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:11.977185  8453 raft_consensus.cc:2955] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:11.996301  9568 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:11.999393  9568 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:12.001595  9568 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:12.003356  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:12.003710  9615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1663cf9302e8495c8762465d306cb479. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:12.004220  8452 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 2.
I20260709 13:01:12.003348  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:12.005565  8380 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 2: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:12.005292  9260 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:12.006354  9568 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:12.006729  9568 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:12.007203  9568 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:12.009218  9600 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.011377  9600 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:12.013448  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:12.014320  8452 raft_consensus.cc:2393] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 2: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:12.017486  9559 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:12.023897  8377 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:12.024363  8528 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:12.026190  9544 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:12.038426  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 147422us
I20260709 13:01:12.051465  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:12.056768  8535 raft_consensus.cc:1275] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:12.058871  9565 consensus_queue.cc:1048] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:12.060356  8528 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:12.062000  8452 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:12.072026  9604 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:12.030642  9568 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:12.081894  8501 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:12.078622  9522 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:12.088711  9449 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:12.091807  9559 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:12.092628  8284 catalog_manager.cc:5697] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 2 to 3, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.107190  9588 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.142707  9568 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:12.143587  9588 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.144253  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:12.145022  8380 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 2: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:12.146319  9588 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:12.133589  8381 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:12.157150  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:12.159932  8526 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:01:12.163594  8501 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:12.164557  9600 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:12.162421  9551 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.165225  9600 raft_consensus.cc:697] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:12.165282  9551 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.168126  8349 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:12.160713  9559 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:12.169579  9565 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:12.169927  9551 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:12.169943  9565 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.170297  8529 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:12.170557  9565 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.171631  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:12.172281  8526 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:12.172472  9615 tablet_copy_client.cc:806] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:12.173105  9615 tablet_copy_client.cc:670] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:12.174288  8349 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:12.166296  9600 consensus_queue.cc:237] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.179602  9580 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:12.180020  9580 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.180370  9580 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:12.182389  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:12.183085  8456 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:12.183421  9565 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.185707  9565 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:12.192485  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:12.200667  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:12.201375  8535 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.205829  9588 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.206164  9449 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.206589  9588 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.208992  9544 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:12.209010  9588 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:12.206804  9449 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:12.215659  8535 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:12.219429  9604 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:12.219591  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:12.219991  9604 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.220366  9449 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:12.220312  8529 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:01:12.222234  9604 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:12.230168  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:12.234076  8459 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:12.218206  9615 tablet_copy_client.cc:538] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:12.246017  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:12.246783  9291 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:12.248126  8500 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:12.249177  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:12.249765  8456 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.250113  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:12.255086  8452 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 2.
I20260709 13:01:12.255471  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:12.256354  9260 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:12.257937  8424 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:12.248919  9522 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:12.258616  9522 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.258975  9522 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.261452  9569 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:12.263813  9568 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:12.264397  9568 raft_consensus.cc:697] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:12.269271  9568 consensus_queue.cc:237] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:12.270507  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:12.271203  8453 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:12.310340  9543 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.310914  9543 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.312929  9543 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:12.315246  8381 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:12.321874  9615 tablet_bootstrap.cc:492] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
W20260709 13:01:12.336985  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 111646us
I20260709 13:01:12.342658  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:12.343348  8459 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:12.344983  8351 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:12.320731  9522 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:12.348913  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:12.361759  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:12.362507  8535 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:01:12.368227  8349 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:12.335381  9583 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:01:12.355906  9588 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:12.370995  9634 ts_tablet_manager.cc:933] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:12.370824  8453 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:12.387917  8456 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:12.389568  9543 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:12.390182  9543 raft_consensus.cc:697] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:12.391031  9543 consensus_queue.cc:237] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.371727  9551 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:12.372794  9588 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.373045  9632 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.401726  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:12.403178  8384 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:01:12.376646  9614 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.399209  9551 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.419845  8283 catalog_manager.cc:5697] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 1 to 2, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 2 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:12.400153  9588 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.427453  9522 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:12.430241  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:12.431097  8384 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.451421  8529 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:12.452664  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:12.453366  9295 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.454473  9602 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:12.421693  9614 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:12.425771  9551 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.457902  9614 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:12.459111  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:12.459822  8529 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 1.
I20260709 13:01:12.397869  9580 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.461040  9258 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:12.419227  9632 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.463128  9632 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:12.463201  9580 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:12.473198  9614 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:12.477509  9614 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.471696  8282 catalog_manager.cc:5697] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 1 to 2, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 2 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:12.481398  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 48000.1us
I20260709 13:01:12.478019  9614 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.478011  8453 raft_consensus.cc:1275] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:12.483129  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:12.486897  8461 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:12.487778  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 119625us
I20260709 13:01:12.490049  8384 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:12.472808  9295 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:12.486438  9632 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.490887  9634 tablet_copy_client.cc:323] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.195:40767
I20260709 13:01:12.489287  9600 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:12.503659  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:12.504325  8534 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:01:12.493973  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:12.506047  8456 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:12.507558  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:12.508143  8526 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:12.510350  9600 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:12.511608  9588 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.512494  9600 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:12.498346  9632 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.515390  8461 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:12.516424  8501 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:12.516592  8349 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:12.519829  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:12.520462  8461 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:12.508582  9551 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.525578  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:12.526402  9600 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:12.532328  9543 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:12.577728  9543 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.578106  9543 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.578966  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:12.579741  8377 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 2.
I20260709 13:01:12.582466  9551 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:12.583065  9551 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:12.600696  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 81731.6us
I20260709 13:01:12.602238  8351 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:12.603703  8351 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:12.575688  9632 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:12.575793  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:12.614544  8544 tablet_copy_service.cc:140] P b8eb0ad4490645598004d862412f4e31: Received BeginTabletCopySession request for tablet cf1cdd90debd40a6a2361af7491977d6 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:47306)
I20260709 13:01:12.600903  9551 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:12.607470  9565 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:12.583254  9580 consensus_queue.cc:1048] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:01:12.601444  9600 raft_consensus.cc:697] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:12.627557  9551 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:12.640226  8378 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:12.622864  9636 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:12.655797  9636 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.656616  9636 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.658315  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:12.658658  8501 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:12.638732  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:12.665627  9563 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:12.678972  9563 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:12.679471  9563 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:12.667526  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:12.681524  8453 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.632586  9600 consensus_queue.cc:237] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:12.629020  9565 raft_consensus.cc:697] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:12.688448  9565 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.625793  9588 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:12.624480  8544 tablet_copy_service.cc:161] P b8eb0ad4490645598004d862412f4e31: Beginning new tablet copy session on tablet cf1cdd90debd40a6a2361af7491977d6 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:47306: session id = 446d9310dce14ff4afff2dc2d64f68d8-cf1cdd90debd40a6a2361af7491977d6
I20260709 13:01:12.700969  9543 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.710314  9563 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:12.640987  8526 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:12.621063  9614 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:12.726912  9543 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:12.727988  9563 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:12.729800  9291 raft_consensus.cc:2368] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3.
I20260709 13:01:12.733134  8544 tablet_copy_source_session.cc:215] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:12.733440  8500 leader_election.cc:400] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3.
I20260709 13:01:12.734179  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:01:12.739431  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 58185us
I20260709 13:01:12.674994  8461 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:12.743332  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 216488us
I20260709 13:01:12.743731  9634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1cdd90debd40a6a2361af7491977d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:12.723502  9636 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.729521  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:12.749671  9295 raft_consensus.cc:2368] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3.
I20260709 13:01:12.749925  8377 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:12.750720  9636 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:12.751372  8501 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:12.751672  8461 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:12.752209  9563 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:12.751367  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:12.752849  8533 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.752789  9563 raft_consensus.cc:697] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:12.753238  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:12.753901  8452 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.753930  9563 consensus_queue.cc:237] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:12.760651  8533 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:12.763012  9634 tablet_copy_client.cc:806] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:12.763667  9634 tablet_copy_client.cc:670] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:12.767411  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:12.767942  8459 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.769649  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:12.770212  8533 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.771612  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:12.772228  8529 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.774217  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:12.778739  8533 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:12.779755  8500 leader_election.cc:400] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3.
I20260709 13:01:12.782557  8459 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:12.717917  8453 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:12.783635  9634 tablet_copy_client.cc:538] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:01:12.785789  9615 log.cc:927] Time spent T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:12.786031  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:12.786851  8526 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:12.788010  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:12.788491  9614 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:12.789723  8529 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:12.791105  9615 tablet_bootstrap.cc:492] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:12.792335  9615 tablet_bootstrap.cc:492] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:12.793258  9615 ts_tablet_manager.cc:1403] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.472s	user 0.030s	sys 0.004s
I20260709 13:01:12.796475  9634 tablet_bootstrap.cc:492] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:12.796962  9615 raft_consensus.cc:359] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:12.798125  9615 raft_consensus.cc:740] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:12.853116  8378 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:12.841857  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:12.861442  8380 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.832471  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:12.879518  9588 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:12.880445  9588 raft_consensus.cc:697] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:12.879505  8281 catalog_manager.cc:5697] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:12.879227  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 47363.8us
I20260709 13:01:12.884809  8452 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:12.882118  9588 consensus_queue.cc:237] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.882160  8282 catalog_manager.cc:5697] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.902724  8380 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
I20260709 13:01:12.905565  8281 catalog_manager.cc:5697] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.909574  8349 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:12.913132  8351 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:12.913934  9565 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:12.914804  8351 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:12.917269  9643 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:12.917568  9551 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:12.917945  9643 raft_consensus.cc:697] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:12.918663  9551 raft_consensus.cc:697] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:12.923061  9551 consensus_queue.cc:237] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.926347  8351 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:12.920035  9643 consensus_queue.cc:237] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.927831  9633 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:12.928480  9633 raft_consensus.cc:697] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:01:12.930406  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 74092.4us
I20260709 13:01:12.930853  9633 consensus_queue.cc:237] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.939831  8452 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:12.942114  9614 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:12.942817  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:12.943722  8526 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.936650  9615 consensus_queue.cc:260] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
W20260709 13:01:12.987974  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 93189.7us
I20260709 13:01:13.009452  9543 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:13.010373  9543 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:12.978796  9615 ts_tablet_manager.cc:1434] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.185s	user 0.011s	sys 0.000s
I20260709 13:01:13.014595  9565 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.035857  9565 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:13.070434  9565 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:13.071568  9614 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:13.071938  9261 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:13.073256  9641 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:13.074002  9641 raft_consensus.cc:697] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:13.075599  9641 consensus_queue.cc:237] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:13.039719  9543 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:13.097872  8384 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:13.098591  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:13.099421  8533 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:13.102119  8533 raft_consensus.cc:1275] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:13.103184  9295 raft_consensus.cc:1217] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:01:13.107934  9543 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.108834  9543 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:13.111305  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:13.111871  9543 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:13.106194  8281 catalog_manager.cc:5697] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 1 to 2, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 2 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:13.112227  8533 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:13.125975  8453 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:13.135980  8471 tablet_copy_service.cc:342] P 105d6581548546b98eddd4ee7083bb12: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-1663cf9302e8495c8762465d306cb479 received from {username='slave'} at 127.0.0.1:53010
I20260709 13:01:13.136739  8471 tablet_copy_service.cc:434] P 105d6581548546b98eddd4ee7083bb12: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-1663cf9302e8495c8762465d306cb479 on tablet 1663cf9302e8495c8762465d306cb479 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:13.134882  8349 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:13.147431  9647 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:13.148063  9647 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:13.149853  9647 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.154009  9543 consensus_queue.cc:1048] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:01:13.158229  8349 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:13.131161  8526 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:13.166901  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:13.169371  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:13.170853  9522 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:13.171906  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:13.176518  9295 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:13.178547  8460 raft_consensus.cc:1275] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:13.179021  8377 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:13.178541  8459 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:13.184123  9600 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:13.163017  9565 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:13.189704  9565 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.190120  9565 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:13.196911  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:13.198796  8461 raft_consensus.cc:2393] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 2: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:13.212451  9623 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 13:01:13.292461  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 45056.3us
W20260709 13:01:13.298163  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 45879.5us
W20260709 13:01:13.303277  9659 log.cc:927] Time spent T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:01:13.308348  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:13.313925  9580 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:13.314680  9580 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:13.315631  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 47627us
I20260709 13:01:13.316913  9580 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:13.288210  9551 consensus_queue.cc:1048] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:01:13.356508  9449 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:01:13.356395  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:13.361835  8460 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:13.370440  9647 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:13.373216  9647 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:13.387782  8351 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:13.395810  9565 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:13.398509  9565 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:13.392422  9647 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:13.421557  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:13.422302  8454 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:13.420514  9647 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:13.437728  8457 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:13.438886  8454 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:13.422940  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:13.442500  9543 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:13.444049  8456 raft_consensus.cc:2393] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 2: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:13.444852  8459 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:13.441673  9647 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:13.455416  9291 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:13.458539  9634 tablet_bootstrap.cc:492] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:13.459738  9634 tablet_bootstrap.cc:492] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:13.460631  9634 ts_tablet_manager.cc:1403] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.664s	user 0.017s	sys 0.018s
I20260709 13:01:13.486181  9634 raft_consensus.cc:359] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:13.487098  9634 raft_consensus.cc:740] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:13.487776  9634 consensus_queue.cc:260] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:13.494571  8528 raft_consensus.cc:3055] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:13.494992  8528 raft_consensus.cc:740] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:13.495237  9558 consensus_queue.cc:1059] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:13.496091  9558 consensus_queue.cc:1243] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer 446d9310dce14ff4afff2dc2d64f68d8 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:01:13.497529  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:13.498469  8533 raft_consensus.cc:2393] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 4: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:13.499181  8529 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:13.501017  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:13.503866  9647 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:13.506035  9647 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:13.507876  9634 ts_tablet_manager.cc:1434] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.001s
I20260709 13:01:13.509163  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:13.509887  8529 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:13.510128  8544 tablet_copy_service.cc:342] P b8eb0ad4490645598004d862412f4e31: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-cf1cdd90debd40a6a2361af7491977d6 received from {username='slave'} at 127.0.0.1:47306
I20260709 13:01:13.510741  8544 tablet_copy_service.cc:434] P b8eb0ad4490645598004d862412f4e31: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-cf1cdd90debd40a6a2361af7491977d6 on tablet cf1cdd90debd40a6a2361af7491977d6 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:13.496898  8528 consensus_queue.cc:260] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:13.516940  8534 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:13.523020  8528 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:13.535674  8386 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:13.535840  9580 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:13.537173  8380 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:13.516642  8535 raft_consensus.cc:1275] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:13.516991  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:13.542145  8533 raft_consensus.cc:2393] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 4: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:13.526201  9633 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:13.528575  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:13.557832  8527 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:13.514847  8281 catalog_manager.cc:5697] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 2 to 3, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 3 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:13.566413  9672 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:13.568254  8351 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:13.568923  9565 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:13.568943  8456 raft_consensus.cc:1275] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:13.569643  9632 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:13.571007  9632 raft_consensus.cc:697] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:13.571928  9632 consensus_queue.cc:237] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:13.574859  8460 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:13.553030  8461 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:13.596012  9543 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.596931  9565 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.599140  8349 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:13.600097  9580 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:13.600613  9580 raft_consensus.cc:697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:13.600831  8529 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:13.601624  9580 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:13.603710  9565 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.606705  9643 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:13.609408  8351 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:13.610538  9569 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.611099  9569 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:13.612381  9647 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:13.613166  9647 raft_consensus.cc:697] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:13.614194  9647 consensus_queue.cc:237] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:13.615504  9569 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:13.615754  8453 raft_consensus.cc:1275] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:13.624223  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:13.627864  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:13.628643  8527 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:01:13.633958  8528 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:01:13.636955  8528 pending_rounds.cc:85] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 4
I20260709 13:01:13.641227  8528 pending_rounds.cc:107] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:01:13.641723  8528 raft_consensus.cc:2889] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:13.653760  8533 raft_consensus.cc:1275] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:13.661247  9583 raft_consensus.cc:1064] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:13.666706  9672 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:13.664057  9583 consensus_queue.cc:237] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:13.680280  8424 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:13.683465  8527 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:13.685097  9653 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:13.685492  9653 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.685824  9653 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:13.694440  9653 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:13.711158  9632 consensus_queue.cc:1048] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:13.719552  9653 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:13.721400  9650 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:13.741983  9291 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:13.740150  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:13.743546  8535 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:13.746454  9657 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:13.748914  9570 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.749742  9570 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:13.752249  8535 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:13.752653  9570 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:01:13.819276  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 63300.3us
I20260709 13:01:13.820256  8424 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:13.821358  9544 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:13.821933  9544 raft_consensus.cc:697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:13.822992  9544 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:13.830049  9650 consensus_queue.cc:1048] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:13.830993  9295 raft_consensus.cc:1217] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:13.852263  8384 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:13.854718  8529 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:13.721944  8283 catalog_manager.cc:5697] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:13.859400  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:13.860077  8461 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:13.859865  8283 catalog_manager.cc:5697] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:13.723188  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:13.866173  9544 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:13.871344  9569 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:13.882735  8500 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:13.883819  9600 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:13.884353  9600 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.884781  9600 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:13.896713  9600 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:13.898483  8283 catalog_manager.cc:5697] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:13.897883  9583 raft_consensus.cc:2955] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:13.901283  9600 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:13.900624  8379 raft_consensus.cc:2955] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:13.904001  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:13.912657  8527 raft_consensus.cc:2955] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:13.929961  8461 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:13.942752  8461 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:01:13.944101  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:13.948540  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:13.956261  8283 catalog_manager.cc:5697] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:13.966635  8500 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:13.967511  9449 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:13.968058  9449 raft_consensus.cc:697] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:13.968864  9449 consensus_queue.cc:237] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:13.976694  9291 raft_consensus.cc:2955] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:14.001533  8284 catalog_manager.cc:5697] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:14.044898  8454 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:14.047113  8284 catalog_manager.cc:5697] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 3 to 5, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 5 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:14.048471  9580 consensus_queue.cc:1059] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:14.049242  9580 consensus_queue.cc:1243] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer 105d6581548546b98eddd4ee7083bb12 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:14.049842  9580 raft_consensus.cc:3055] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:14.050191  9580 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:14.051079  9580 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:14.052099  9580 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:14.062261  8281 catalog_manager.cc:5697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 1 to 3, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:14.081638  8454 consensus_queue.cc:237] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:14.087646  8282 catalog_manager.cc:5697] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:14.101809  9291 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:14.102010  8378 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:14.103381  8527 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:14.103691  9583 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:14.108652  9569 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:14.111675  9632 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:01:14.119782  8461 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:14.123067  9632 consensus_queue.cc:1059] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:14.123973  9632 raft_consensus.cc:3055] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:14.124320  9632 raft_consensus.cc:740] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:14.134081  9632 consensus_queue.cc:260] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:14.135537  9632 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:14.142715  9678 raft_consensus.cc:2955] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:14.165915  8377 raft_consensus.cc:2955] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:14.178000  9291 raft_consensus.cc:2955] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:14.214054  8461 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:14.217059  9647 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:14.220732  8270 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1663cf9302e8495c8762465d306cb479 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:14.227559  8528 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:14.228636  8282 catalog_manager.cc:5697] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index 5 to 6, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:14.231312  9569 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:14.242604  8523 tablet_service.cc:1558] Processing DeleteTablet for tablet 1663cf9302e8495c8762465d306cb479 with delete_type TABLET_DATA_TOMBSTONED (TS b8eb0ad4490645598004d862412f4e31 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:38890
I20260709 13:01:14.268111  9710 tablet_replica.cc:333] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:01:14.269909  9710 raft_consensus.cc:2243] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:14.270789  9710 raft_consensus.cc:2272] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.281315  9449 raft_consensus.cc:1064] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:14.283200  9710 ts_tablet_manager.cc:1916] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:14.284668  8377 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:14.288522  8377 pending_rounds.cc:85] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 1
I20260709 13:01:14.288831  8377 pending_rounds.cc:107] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:14.289110  8377 raft_consensus.cc:2889] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:14.284819  9449 consensus_queue.cc:237] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:14.290970  9569 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:14.320698  9710 ts_tablet_manager.cc:1929] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:01:14.321295  9710 log.cc:1199] T 1663cf9302e8495c8762465d306cb479 P b8eb0ad4490645598004d862412f4e31: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-2-root/wals/1663cf9302e8495c8762465d306cb479
I20260709 13:01:14.323042  8268 catalog_manager.cc:5028] TS b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): tablet 1663cf9302e8495c8762465d306cb479 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:14.326674  9291 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:14.329258  9600 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:14.334777  8377 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:14.335749  8461 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:14.336303  9600 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:14.340031  9559 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:14.351801  9570 raft_consensus.cc:2955] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:14.354403  8461 raft_consensus.cc:2955] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:14.361749  8377 raft_consensus.cc:2955] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:14.371515  8282 catalog_manager.cc:5697] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:14.375263  9291 raft_consensus.cc:2955] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:14.392871  8527 consensus_queue.cc:237] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:14.413164  8461 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:14.414721  8454 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:14.418363  9291 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:14.420910  9570 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:14.421237  9449 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:14.422389  9449 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:14.431922  9600 raft_consensus.cc:2955] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:14.438424  8461 raft_consensus.cc:2955] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:14.445729  8268 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cf1cdd90debd40a6a2361af7491977d6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:14.445533  9291 raft_consensus.cc:2955] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:14.454651  8281 catalog_manager.cc:5697] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index 3 to 4, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:14.478384  8386 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:01:14.478763  8386 pending_rounds.cc:85] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 2
I20260709 13:01:14.478981  8386 pending_rounds.cc:107] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:14.479224  8386 raft_consensus.cc:2889] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:14.483369  8373 tablet_service.cc:1558] Processing DeleteTablet for tablet cf1cdd90debd40a6a2361af7491977d6 with delete_type TABLET_DATA_TOMBSTONED (TS d653e71832b7402b9a03b46249d3b885 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59326
I20260709 13:01:14.486217  9716 tablet_replica.cc:333] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:01:14.486107  9570 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:14.487578  9716 raft_consensus.cc:2243] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:14.488445  9716 raft_consensus.cc:2272] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.494153  9716 ts_tablet_manager.cc:1916] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:14.512475  9716 ts_tablet_manager.cc:1929] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:14.512986  9716 log.cc:1199] T cf1cdd90debd40a6a2361af7491977d6 P d653e71832b7402b9a03b46249d3b885: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-0-root/wals/cf1cdd90debd40a6a2361af7491977d6
I20260709 13:01:14.515648  8271 catalog_manager.cc:5028] TS d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): tablet cf1cdd90debd40a6a2361af7491977d6 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:15.566735  8386 consensus_queue.cc:237] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:15.576288  8527 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:01:15.577747  8351 consensus_peers.cc:597] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5f40fa9720bd41db92cb895437b29f60. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:15.579349  8457 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:15.579489  9719 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:15.580663  9647 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:15.597590  9719 raft_consensus.cc:2955] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:15.599748  8527 raft_consensus.cc:2955] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:15.600368  8454 raft_consensus.cc:2955] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:15.616372  8282 catalog_manager.cc:5697] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 4 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.619779  8386 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:15.627123  8527 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:15.629909  8454 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:01:15.631906  8351 consensus_peers.cc:597] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aee63d7055b1430b8d1edea205bc40f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:15.633037  9647 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:15.634994  9717 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:15.647842  9717 raft_consensus.cc:2955] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:15.650039  8457 raft_consensus.cc:2955] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:15.650137  8527 raft_consensus.cc:2955] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:15.671073  8528 consensus_queue.cc:237] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
W20260709 13:01:15.682775  8500 consensus_peers.cc:597] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 513b83e2d61c4ad7994ad4629a3d0079. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:15.683359  8284 catalog_manager.cc:5697] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.684598  8457 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:15.685609  8377 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:15.686240  9570 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:15.687862  9718 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:15.700338  9718 raft_consensus.cc:2955] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:15.701572  8457 raft_consensus.cc:2955] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:15.705817  8377 raft_consensus.cc:2955] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:15.717972  8377 consensus_queue.cc:237] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:15.724887  8527 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:15.724488  8282 catalog_manager.cc:5697] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
W20260709 13:01:15.726294  8351 consensus_peers.cc:597] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6427ce7790bd4629985d340936d6f356. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:15.727483  9719 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:15.727854  8454 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:15.732441  9717 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:15.741695  9647 raft_consensus.cc:2955] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:15.743568  8527 raft_consensus.cc:2955] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:15.770540  8454 raft_consensus.cc:2955] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:15.775532  8282 catalog_manager.cc:5697] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:16.009196  9737 ts_tablet_manager.cc:933] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631)
I20260709 13:01:16.011790  9737 tablet_copy_client.cc:323] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.193:43631
I20260709 13:01:16.014137  8396 tablet_copy_service.cc:140] P d653e71832b7402b9a03b46249d3b885: Received BeginTabletCopySession request for tablet aee63d7055b1430b8d1edea205bc40f0 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:48484)
I20260709 13:01:16.014739  8396 tablet_copy_service.cc:161] P d653e71832b7402b9a03b46249d3b885: Beginning new tablet copy session on tablet aee63d7055b1430b8d1edea205bc40f0 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:48484: session id = 446d9310dce14ff4afff2dc2d64f68d8-aee63d7055b1430b8d1edea205bc40f0
I20260709 13:01:16.022183  8396 tablet_copy_source_session.cc:215] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:16.026360  9737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee63d7055b1430b8d1edea205bc40f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.046100  9737 tablet_copy_client.cc:806] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:16.046852  9737 tablet_copy_client.cc:670] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:16.053004  9737 tablet_copy_client.cc:538] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:16.063297  9737 tablet_bootstrap.cc:492] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:16.065773  9739 ts_tablet_manager.cc:933] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631)
I20260709 13:01:16.080996  9739 tablet_copy_client.cc:323] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.193:43631
I20260709 13:01:16.082870  8396 tablet_copy_service.cc:140] P d653e71832b7402b9a03b46249d3b885: Received BeginTabletCopySession request for tablet 5f40fa9720bd41db92cb895437b29f60 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:48484)
I20260709 13:01:16.083410  8396 tablet_copy_service.cc:161] P d653e71832b7402b9a03b46249d3b885: Beginning new tablet copy session on tablet 5f40fa9720bd41db92cb895437b29f60 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:48484: session id = 446d9310dce14ff4afff2dc2d64f68d8-5f40fa9720bd41db92cb895437b29f60
I20260709 13:01:16.092612  8396 tablet_copy_source_session.cc:215] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:16.096201  9739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f40fa9720bd41db92cb895437b29f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.106689  9737 tablet_bootstrap.cc:492] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:16.107735  9737 tablet_bootstrap.cc:492] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:16.108522  9737 ts_tablet_manager.cc:1403] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.045s	user 0.026s	sys 0.007s
I20260709 13:01:16.111693  9737 raft_consensus.cc:359] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:16.113682  9737 raft_consensus.cc:740] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:16.114465  9737 consensus_queue.cc:260] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:16.118362  9737 ts_tablet_manager.cc:1434] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:01:16.122502  8396 tablet_copy_service.cc:342] P d653e71832b7402b9a03b46249d3b885: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-aee63d7055b1430b8d1edea205bc40f0 received from {username='slave'} at 127.0.0.1:48484
I20260709 13:01:16.123027  8396 tablet_copy_service.cc:434] P d653e71832b7402b9a03b46249d3b885: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-aee63d7055b1430b8d1edea205bc40f0 on tablet aee63d7055b1430b8d1edea205bc40f0 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:16.134938  9739 tablet_copy_client.cc:806] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:16.141548  9739 tablet_copy_client.cc:670] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:16.144992  9739 tablet_copy_client.cc:538] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:16.152920  9739 tablet_bootstrap.cc:492] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:16.163095  9737 ts_tablet_manager.cc:933] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631)
I20260709 13:01:16.172802  9737 tablet_copy_client.cc:323] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.193:43631
I20260709 13:01:16.176553  8396 tablet_copy_service.cc:140] P d653e71832b7402b9a03b46249d3b885: Received BeginTabletCopySession request for tablet 6427ce7790bd4629985d340936d6f356 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:48484)
I20260709 13:01:16.177168  8396 tablet_copy_service.cc:161] P d653e71832b7402b9a03b46249d3b885: Beginning new tablet copy session on tablet 6427ce7790bd4629985d340936d6f356 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:48484: session id = 446d9310dce14ff4afff2dc2d64f68d8-6427ce7790bd4629985d340936d6f356
I20260709 13:01:16.185403  9739 tablet_bootstrap.cc:492] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:16.186625  9739 tablet_bootstrap.cc:492] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:16.187418  9739 ts_tablet_manager.cc:1403] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.035s	user 0.027s	sys 0.007s
I20260709 13:01:16.190541  9739 raft_consensus.cc:359] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:16.191507  9739 raft_consensus.cc:740] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:16.192203  8396 tablet_copy_source_session.cc:215] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:16.192221  9739 consensus_queue.cc:260] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:16.195775  9737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6427ce7790bd4629985d340936d6f356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.197675  9739 ts_tablet_manager.cc:1434] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:01:16.209149  8396 tablet_copy_service.cc:342] P d653e71832b7402b9a03b46249d3b885: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-5f40fa9720bd41db92cb895437b29f60 received from {username='slave'} at 127.0.0.1:48484
I20260709 13:01:16.209641  8396 tablet_copy_service.cc:434] P d653e71832b7402b9a03b46249d3b885: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-5f40fa9720bd41db92cb895437b29f60 on tablet 5f40fa9720bd41db92cb895437b29f60 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:16.218644  9737 tablet_copy_client.cc:806] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:16.219280  9737 tablet_copy_client.cc:670] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:16.222901  9737 tablet_copy_client.cc:538] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:16.229692  9737 tablet_bootstrap.cc:492] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:16.249010  9737 tablet_bootstrap.cc:492] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:16.249938  9737 tablet_bootstrap.cc:492] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:16.250672  9737 ts_tablet_manager.cc:1403] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 13:01:16.253294  9737 raft_consensus.cc:359] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:16.253945  9737 raft_consensus.cc:740] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:16.254446  9737 consensus_queue.cc:260] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:16.256518  9737 ts_tablet_manager.cc:1434] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:01:16.258308  8396 tablet_copy_service.cc:342] P d653e71832b7402b9a03b46249d3b885: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-6427ce7790bd4629985d340936d6f356 received from {username='slave'} at 127.0.0.1:48484
I20260709 13:01:16.258723  8396 tablet_copy_service.cc:434] P d653e71832b7402b9a03b46249d3b885: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-6427ce7790bd4629985d340936d6f356 on tablet 6427ce7790bd4629985d340936d6f356 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:16.265898  9737 ts_tablet_manager.cc:933] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:16.267807  9737 tablet_copy_client.cc:323] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.195:40767
I20260709 13:01:16.269299  8544 tablet_copy_service.cc:140] P b8eb0ad4490645598004d862412f4e31: Received BeginTabletCopySession request for tablet 513b83e2d61c4ad7994ad4629a3d0079 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:47306)
I20260709 13:01:16.269846  8544 tablet_copy_service.cc:161] P b8eb0ad4490645598004d862412f4e31: Beginning new tablet copy session on tablet 513b83e2d61c4ad7994ad4629a3d0079 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:47306: session id = 446d9310dce14ff4afff2dc2d64f68d8-513b83e2d61c4ad7994ad4629a3d0079
I20260709 13:01:16.277667  8544 tablet_copy_source_session.cc:215] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:16.280696  9737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 513b83e2d61c4ad7994ad4629a3d0079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:16.303252  9737 tablet_copy_client.cc:806] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:16.304934  9737 tablet_copy_client.cc:670] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:16.315328  9737 tablet_copy_client.cc:538] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:16.322466  9737 tablet_bootstrap.cc:492] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:16.340757  9737 tablet_bootstrap.cc:492] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:16.341720  9737 tablet_bootstrap.cc:492] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:16.342386  9737 ts_tablet_manager.cc:1403] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.004s
I20260709 13:01:16.344976  9737 raft_consensus.cc:359] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:16.345820  9737 raft_consensus.cc:740] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:16.346395  9737 consensus_queue.cc:260] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:16.348603  9737 ts_tablet_manager.cc:1434] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:01:16.350965  8544 tablet_copy_service.cc:342] P b8eb0ad4490645598004d862412f4e31: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-513b83e2d61c4ad7994ad4629a3d0079 received from {username='slave'} at 127.0.0.1:47306
I20260709 13:01:16.351413  8544 tablet_copy_service.cc:434] P b8eb0ad4490645598004d862412f4e31: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-513b83e2d61c4ad7994ad4629a3d0079 on tablet 513b83e2d61c4ad7994ad4629a3d0079 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:16.431547  9295 raft_consensus.cc:1217] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:01:16.535789  9295 raft_consensus.cc:1217] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:01:16.694794  9295 raft_consensus.cc:1217] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:01:16.765576  9295 raft_consensus.cc:1217] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:16.874554  9744 raft_consensus.cc:1064] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:16.877352  9744 consensus_queue.cc:237] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:16.885174  8528 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:16.886333  9291 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEARNER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:16.887063  9744 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:16.888247  8461 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:16.888396  9647 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:16.889760  9717 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:16.918831  9647 raft_consensus.cc:2955] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:16.942787  9291 raft_consensus.cc:2955] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:16.948891  8528 raft_consensus.cc:2955] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:16.953725  8461 raft_consensus.cc:2955] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:16.953576  8282 catalog_manager.cc:5697] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.013765  8386 consensus_queue.cc:237] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:17.018851  9291 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:17.020597  8527 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:17.020406  9744 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:17.021871  9717 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:17.027616  9647 raft_consensus.cc:2955] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.029867  9753 raft_consensus.cc:1064] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:17.029446  9295 raft_consensus.cc:2955] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.032456  9753 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:17.038134  8271 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5f40fa9720bd41db92cb895437b29f60 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:17.046178  8284 catalog_manager.cc:5697] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index 5 to 6, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New cstate: current_term: 4 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.059159  8528 raft_consensus.cc:2955] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.065821  8448 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f40fa9720bd41db92cb895437b29f60 with delete_type TABLET_DATA_TOMBSTONED (TS 105d6581548546b98eddd4ee7083bb12 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36438
I20260709 13:01:17.081339  8533 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:17.083108  9295 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:17.083539  9647 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:17.084734  8461 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:17.093008  9717 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:17.102837  9760 tablet_replica.cc:333] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:01:17.104106  9760 raft_consensus.cc:2243] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:17.105175  9760 raft_consensus.cc:2272] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:17.106446  9717 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:17.109333  9760 ts_tablet_manager.cc:1916] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:17.133560  9760 ts_tablet_manager.cc:1929] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:01:17.134161  9760 log.cc:1199] T 5f40fa9720bd41db92cb895437b29f60 P 105d6581548546b98eddd4ee7083bb12: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-1-root/wals/5f40fa9720bd41db92cb895437b29f60
I20260709 13:01:17.135921  8270 catalog_manager.cc:5028] TS 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): tablet 5f40fa9720bd41db92cb895437b29f60 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:17.132877  9759 raft_consensus.cc:2955] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.137297  8457 raft_consensus.cc:2955] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.159420  8284 catalog_manager.cc:5697] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.160105  9295 raft_consensus.cc:2955] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.159472  8528 raft_consensus.cc:2955] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.172206  9731 raft_consensus.cc:1064] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:17.180837  8377 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:17.175280  9731 consensus_queue.cc:237] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:17.207140  9759 raft_consensus.cc:1064] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:17.211820  9759 consensus_queue.cc:237] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:17.231871  8527 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:17.233040  9291 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:17.235280  9759 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:17.236660  9753 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:17.242242  8454 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:17.249905  8533 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:17.252434  9753 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:17.256354  8454 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:17.258942  9296 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:17.262444  9718 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:17.267732  9748 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:17.272291  9293 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:17.278858  8377 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:17.288671  9717 raft_consensus.cc:2955] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.293735  8533 raft_consensus.cc:2955] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.298249  9718 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:17.313565  9647 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:17.315070  8271 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aee63d7055b1430b8d1edea205bc40f0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:17.318632  8283 catalog_manager.cc:5697] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index 4 to 5, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.244930  9759 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 13:01:17.326740  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:17.325984  9717 raft_consensus.cc:2955] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.327668  9291 raft_consensus.cc:2955] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.331670  8528 raft_consensus.cc:2955] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.336643  8448 tablet_service.cc:1558] Processing DeleteTablet for tablet aee63d7055b1430b8d1edea205bc40f0 with delete_type TABLET_DATA_TOMBSTONED (TS 105d6581548546b98eddd4ee7083bb12 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36438
I20260709 13:01:17.345299  9760 tablet_replica.cc:333] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:01:17.346359  9760 raft_consensus.cc:2243] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:17.347159  9760 raft_consensus.cc:2272] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:17.352731  9760 ts_tablet_manager.cc:1916] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:17.381021  8281 catalog_manager.cc:5697] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.379063  9771 raft_consensus.cc:2955] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.404345  9293 raft_consensus.cc:2955] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.413491  8386 raft_consensus.cc:2955] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.417635  8461 raft_consensus.cc:2955] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.419358  9291 raft_consensus.cc:2955] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.420655  8454 raft_consensus.cc:2955] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.439028  9760 ts_tablet_manager.cc:1929] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:01:17.439551  9760 log.cc:1199] T aee63d7055b1430b8d1edea205bc40f0 P 105d6581548546b98eddd4ee7083bb12: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-1-root/wals/aee63d7055b1430b8d1edea205bc40f0
I20260709 13:01:17.441437  8270 catalog_manager.cc:5028] TS 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): tablet aee63d7055b1430b8d1edea205bc40f0 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:17.465359  8282 catalog_manager.cc:5697] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.529103  8533 consensus_queue.cc:237] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:17.535718  9291 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:17.537768  9771 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:17.539863  8461 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:17.545739  9771 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:17.553511  9718 raft_consensus.cc:2955] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.556053  9291 raft_consensus.cc:2955] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.565299  8268 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 513b83e2d61c4ad7994ad4629a3d0079 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:17.566182  8533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18bf9e256e3046b497483817dac46e78"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
mode: GRACEFUL
new_leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
 from {username='slave'} at 127.0.0.1:40160
I20260709 13:01:17.566866  8533 raft_consensus.cc:606] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Received request to transfer leadership to TS 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:17.562201  8461 raft_consensus.cc:2955] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.571681  8282 catalog_manager.cc:5697] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 3 to 4, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.588526  8373 tablet_service.cc:1558] Processing DeleteTablet for tablet 513b83e2d61c4ad7994ad4629a3d0079 with delete_type TABLET_DATA_TOMBSTONED (TS d653e71832b7402b9a03b46249d3b885 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59326
I20260709 13:01:17.601364  9782 tablet_replica.cc:333] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:01:17.602584  9782 raft_consensus.cc:2243] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:17.603422  9782 raft_consensus.cc:2272] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:17.608841  8461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:17.609544  8461 raft_consensus.cc:606] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Received request to transfer leadership to TS 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:17.611351  9782 ts_tablet_manager.cc:1916] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:17.612267  8461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:17.612919  8461 raft_consensus.cc:606] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:01:17.615676  8454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b3df375d584465c8712d996256828cf"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:17.616223  8454 raft_consensus.cc:606] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:01:17.621819  9766 raft_consensus.cc:993] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower 446d9310dce14ff4afff2dc2d64f68d8 to start an election
I20260709 13:01:17.622356  9765 raft_consensus.cc:1081] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Signalling peer 446d9310dce14ff4afff2dc2d64f68d8 to start an election
I20260709 13:01:17.625116  9291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88"
dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
 from {username='slave'} at 127.0.0.1:55734
I20260709 13:01:17.625726  9291 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:17.626049  9291 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:17.636437  9291 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:17.640712  9782 ts_tablet_manager.cc:1929] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:17.641507  9782 log.cc:1199] T 513b83e2d61c4ad7994ad4629a3d0079 P d653e71832b7402b9a03b46249d3b885: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-0-root/wals/513b83e2d61c4ad7994ad4629a3d0079
I20260709 13:01:17.644939  9291 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:17.646152  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:17.646697  8454 raft_consensus.cc:3055] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:17.646958  8454 raft_consensus.cc:740] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:17.647656  8454 consensus_queue.cc:260] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:17.648764  8454 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:17.655993  8454 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 2.
I20260709 13:01:17.657213  9260 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:17.657435  8271 catalog_manager.cc:5028] TS d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): tablet 513b83e2d61c4ad7994ad4629a3d0079 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:17.658147  9641 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:17.658666  9641 raft_consensus.cc:697] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:17.659539  9641 consensus_queue.cc:237] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:17.662043  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:17.662739  8379 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:17.664036  8386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:01:17.664633  8386 raft_consensus.cc:606] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:01:17.668149  8454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:17.668743  8454 raft_consensus.cc:606] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:01:17.671761  8454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:17.672343  8454 raft_consensus.cc:606] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Received request to transfer leadership to TS 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:17.673651  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:01:17.675202  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:17.687881  8379 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 2.
I20260709 13:01:17.692310  8284 catalog_manager.cc:5697] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 1 to 2, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 2 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.752468  9776 raft_consensus.cc:993] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:17.752959  9717 raft_consensus.cc:1081] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:17.754889  8535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38892
I20260709 13:01:17.755458  8535 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:17.755790  8535 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:17.764492  8535 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:17.768674  8535 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:17.769876  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:17.770493  8454 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:17.779302  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:17.780023  8386 raft_consensus.cc:3055] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:17.780341  8386 raft_consensus.cc:740] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:17.781047  8386 consensus_queue.cc:260] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:17.782454  8386 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:17.786141  8454 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:17.791778  8500 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:17.793944  9748 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:17.793994  8386 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:17.794637  9748 raft_consensus.cc:697] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:17.795619  9748 consensus_queue.cc:237] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:17.814695  9765 raft_consensus.cc:993] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:17.815388  9786 raft_consensus.cc:1081] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:17.817520  8386 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b3df375d584465c8712d996256828cf"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:01:17.818115  8386 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:17.818513  8386 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:17.824533  8284 catalog_manager.cc:5697] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 1 to 2, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 2 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.828464  8386 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:17.836483  9718 raft_consensus.cc:993] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31: : Instructing follower 446d9310dce14ff4afff2dc2d64f68d8 to start an election
I20260709 13:01:17.837028  9718 raft_consensus.cc:1081] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Signalling peer 446d9310dce14ff4afff2dc2d64f68d8 to start an election
I20260709 13:01:17.838963  9291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18bf9e256e3046b497483817dac46e78"
dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
 from {username='slave'} at 127.0.0.1:55724
I20260709 13:01:17.839486  9291 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:17.839857  9291 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:17.850159  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:17.850791  8454 raft_consensus.cc:3055] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:17.851107  8454 raft_consensus.cc:740] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:17.851816  8454 consensus_queue.cc:260] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:17.852864  8454 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:17.856586  9291 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:17.861718  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:17.862313  8533 raft_consensus.cc:3055] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:17.862596  8533 raft_consensus.cc:740] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:17.863333  8533 consensus_queue.cc:260] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:17.864158  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:17.864403  8533 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:17.864764  8461 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:17.864903  8454 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:17.866209  8351 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:17.867558  9776 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:17.867753  8386 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:17.868047  9776 raft_consensus.cc:697] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:17.868938  9776 consensus_queue.cc:237] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:17.870630  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:17.871219  8535 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:17.874552  8461 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
I20260709 13:01:17.875825  9260 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:17.876947  9641 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:17.877441  9641 raft_consensus.cc:697] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:17.878314  9641 consensus_queue.cc:237] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:17.890506  8533 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
I20260709 13:01:17.891458  9291 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:17.886291  8535 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:17.902045  8284 catalog_manager.cc:5697] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 2 to 3, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 3 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.911675  8283 catalog_manager.cc:5697] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 2, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.932771  9764 raft_consensus.cc:993] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:17.933269  9764 raft_consensus.cc:1081] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:17.935448  8535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38894
I20260709 13:01:17.936034  8535 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:17.936421  8535 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.942318  8535 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:17.945444  8535 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:17.946472  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:17.946862  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:17.947111  8379 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.947451  8461 raft_consensus.cc:3055] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:17.947770  8461 raft_consensus.cc:740] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:17.949880  8461 consensus_queue.cc:260] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:17.951002  8461 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.956339  8379 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:01:17.957657  8501 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:17.957576  8386 consensus_queue.cc:237] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:17.958580  9748 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:17.959121  9748 raft_consensus.cc:697] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 7 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:17.959828  9748 consensus_queue.cc:237] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:17.964775  8461 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:01:17.965389  9291 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:17.966894  8454 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:17.968251  9776 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:17.970676  9647 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:17.983144  8283 catalog_manager.cc:5697] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 6 to 7, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 7 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.989096  9717 raft_consensus.cc:2955] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:18.001056  8271 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6427ce7790bd4629985d340936d6f356 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:18.000661  9291 raft_consensus.cc:2955] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:17.999028  8461 raft_consensus.cc:2955] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:18.016170  8283 catalog_manager.cc:5697] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index 4 to 5, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:18.032997  8523 tablet_service.cc:1558] Processing DeleteTablet for tablet 6427ce7790bd4629985d340936d6f356 with delete_type TABLET_DATA_TOMBSTONED (TS b8eb0ad4490645598004d862412f4e31 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:38890
I20260709 13:01:18.040830  9791 tablet_replica.cc:333] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:01:18.045148  9791 raft_consensus.cc:2243] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:18.045917  9791 raft_consensus.cc:2272] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:18.049486  9791 ts_tablet_manager.cc:1916] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:18.063481  9791 ts_tablet_manager.cc:1929] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:01:18.063858  9791 log.cc:1199] T 6427ce7790bd4629985d340936d6f356 P b8eb0ad4490645598004d862412f4e31: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-2-root/wals/6427ce7790bd4629985d340936d6f356
I20260709 13:01:18.065465  8268 catalog_manager.cc:5028] TS b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): tablet 6427ce7790bd4629985d340936d6f356 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:18.088656  9766 raft_consensus.cc:993] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: : Instructing follower 446d9310dce14ff4afff2dc2d64f68d8 to start an election
I20260709 13:01:18.089190  9765 raft_consensus.cc:1081] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Signalling peer 446d9310dce14ff4afff2dc2d64f68d8 to start an election
I20260709 13:01:18.090682  9291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be"
dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
 from {username='slave'} at 127.0.0.1:55734
I20260709 13:01:18.091162  9291 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:18.091419  9291 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:18.096344  9291 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:18.098073  9291 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:18.098841  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:18.098955  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:18.099567  8461 raft_consensus.cc:3055] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:18.099663  8533 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:18.099874  8461 raft_consensus.cc:740] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:18.100690  8461 consensus_queue.cc:260] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:18.101601  8461 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:18.107537  8461 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:01:18.109845  9260 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:18.110682  9641 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:18.111171  9641 raft_consensus.cc:697] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:18.111979  8533 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:01:18.112032  9641 consensus_queue.cc:237] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:18.122573  8282 catalog_manager.cc:5697] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 3 to 4, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 4 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:18.166431  9766 raft_consensus.cc:993] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:18.166901  9765 raft_consensus.cc:1081] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:18.168574  8386 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:01:18.169130  8386 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:18.169508  8386 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.176028  8386 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:18.178251  8386 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:18.178481  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:18.179169  8461 raft_consensus.cc:3055] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:18.178763  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:18.179534  8461 raft_consensus.cc:740] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:18.179751  8533 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.180339  8461 consensus_queue.cc:260] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:18.181588  8461 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.186978  8533 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:18.188319  8349 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:18.189047  9647 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:18.189548  9647 raft_consensus.cc:697] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:18.190168  8461 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:18.190212  9647 consensus_queue.cc:237] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:18.198733  8386 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:18.200305  9641 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:18.211114  8282 catalog_manager.cc:5697] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 2, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:18.222062  8461 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:18.225960  9773 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:18.360185  8461 raft_consensus.cc:1275] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:18.361495  9759 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:18.363775  8461 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:18.365263  9718 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:18.375660  8533 raft_consensus.cc:1275] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:18.378954  8457 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:18.379220  9717 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:18.387547  8386 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:18.390257  9718 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:18.391939  9718 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:18.431257  8385 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:18.440522  9748 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:18.452934  8461 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:18.455164  9641 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:18.468129  8535 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:18.469590  9641 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:18.554306  8533 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:18.555596  9807 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:18.558563  8461 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:18.559870  9773 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:18.676280  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:18.716487  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:18.757841  8461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:18.758474  8461 raft_consensus.cc:606] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:01:18.760962  8386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:01:18.761472  8386 raft_consensus.cc:606] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:01:18.763769  8535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
mode: GRACEFUL
new_leader_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:40160
I20260709 13:01:18.764308  8535 raft_consensus.cc:606] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Received request to transfer leadership to TS 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:18.765466  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:01:18.766697  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:18.779345  9772 raft_consensus.cc:993] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31: : Instructing follower 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:18.779862  9748 raft_consensus.cc:1081] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Signalling peer 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:18.781286  8461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:36448
I20260709 13:01:18.781802  8461 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:18.782116  8461 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.787191  8461 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:18.788842  8461 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:18.789529  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:18.789724  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:18.790118  8535 raft_consensus.cc:3055] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:18.790325  9291 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.790488  8535 raft_consensus.cc:740] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:18.791290  8535 consensus_queue.cc:260] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:18.792251  8535 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.798921  8535 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:01:18.798921  9291 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:01:18.800028  8424 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:18.800915  9766 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:18.801433  9766 raft_consensus.cc:697] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:18.802237  9766 consensus_queue.cc:237] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:18.812016  8461 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:18.813210  9759 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:18.814450  8284 catalog_manager.cc:5697] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 1 to 2, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:18.816143  8535 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:18.818780  9647 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:19.096808  9765 raft_consensus.cc:993] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:19.097383  9816 raft_consensus.cc:1081] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:19.098917  8385 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:01:19.099440  8385 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:19.099797  8385 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.102453  8461 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:19.106647  8385 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:19.109613  8385 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:19.109910  8528 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:19.109956  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:19.110703  8533 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.112062  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:19.112794  8461 raft_consensus.cc:3055] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:19.113281  8461 raft_consensus.cc:740] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:19.113933  9816 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:19.114320  8461 consensus_queue.cc:260] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:19.115772  8461 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.116828  8385 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:19.117827  8533 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:19.118400  9765 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:01:19.119346  8426 consensus_peers.cc:597] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: de8d0dfcd55e4b03b9a131362bf19085. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:19.122061  8349 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:19.122915  9819 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:19.123533  8461 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:19.123416  9819 raft_consensus.cc:697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:19.125742  9819 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:19.139216  9817 raft_consensus.cc:2955] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:19.139494  8283 catalog_manager.cc:5697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 2, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.143595  8533 raft_consensus.cc:2955] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:19.143515  8386 raft_consensus.cc:2955] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:19.168064  8461 consensus_queue.cc:237] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:19.171070  8283 catalog_manager.cc:5697] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 4 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:19.186534  8533 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:19.187841  8386 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:19.187942  9766 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:01:19.189227  8426 consensus_peers.cc:597] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba1839dfeba648529deb101072b3ca8c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:19.189602  9817 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:19.199355  9817 raft_consensus.cc:2955] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:19.201560  8386 raft_consensus.cc:2955] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:19.217482  8385 consensus_queue.cc:237] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:19.218152  8284 catalog_manager.cc:5697] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.221660  8533 raft_consensus.cc:2955] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:19.235734  8461 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:19.238794  8351 consensus_peers.cc:597] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c2aa75e5347f4ba5a20776a3b619eb68. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:19.240222  8528 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:19.240763  9759 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:19.243067  9819 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:19.266492  9717 raft_consensus.cc:2955] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:19.268193  8454 raft_consensus.cc:2955] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:19.272289  8528 raft_consensus.cc:2955] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:19.289000  8379 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:19.305150  8528 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:19.306030  8283 catalog_manager.cc:5697] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:19.307224  9828 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:19.315038  8454 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:01:19.318275  8351 consensus_peers.cc:597] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 866f457c2bf048109ab977c2b010de5a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:19.321060  9828 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:01:19.323760  9759 raft_consensus.cc:993] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:19.324409  9819 raft_consensus.cc:1081] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:19.326290  8533 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38892
I20260709 13:01:19.326820  8533 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:19.327157  8533 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.333886  9828 raft_consensus.cc:2955] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:19.335796  8533 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:19.337833  8528 raft_consensus.cc:2955] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:19.339082  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:19.339673  9291 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.339442  8461 raft_consensus.cc:2955] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:19.342697  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:19.343317  8377 raft_consensus.cc:3055] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:19.343636  8377 raft_consensus.cc:740] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:19.344348  8377 consensus_queue.cc:260] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:19.345399  8377 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.349488  9291 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:19.353170  8500 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:19.354080  9831 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:19.354564  9831 raft_consensus.cc:697] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:19.355388  9831 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:19.355976  8377 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:19.359066  8533 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:19.362550  8282 catalog_manager.cc:5697] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 5 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:19.385983  9291 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:19.387653  9766 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:19.399480  8283 catalog_manager.cc:5697] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 3 to 4, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 4 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.409379  8528 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:19.411119  9816 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:19.607214  8528 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:19.608490  9828 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:19.629549  8454 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:19.633805  9819 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:19.733284  9844 ts_tablet_manager.cc:933] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:19.735205  9844 tablet_copy_client.cc:323] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.194:36925
I20260709 13:01:19.737213  8471 tablet_copy_service.cc:140] P 105d6581548546b98eddd4ee7083bb12: Received BeginTabletCopySession request for tablet de8d0dfcd55e4b03b9a131362bf19085 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:53010)
I20260709 13:01:19.737749  8471 tablet_copy_service.cc:161] P 105d6581548546b98eddd4ee7083bb12: Beginning new tablet copy session on tablet de8d0dfcd55e4b03b9a131362bf19085 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:53010: session id = 446d9310dce14ff4afff2dc2d64f68d8-de8d0dfcd55e4b03b9a131362bf19085
I20260709 13:01:19.743223  8471 tablet_copy_source_session.cc:215] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:19.751977  9844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de8d0dfcd55e4b03b9a131362bf19085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:19.763527  9847 ts_tablet_manager.cc:933] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:19.767804  9846 ts_tablet_manager.cc:933] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631)
I20260709 13:01:19.769032  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:19.771000  9847 tablet_copy_client.cc:323] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.194:36925
I20260709 13:01:19.774078  9846 tablet_copy_client.cc:323] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.193:43631
I20260709 13:01:19.776122  8396 tablet_copy_service.cc:140] P d653e71832b7402b9a03b46249d3b885: Received BeginTabletCopySession request for tablet c2aa75e5347f4ba5a20776a3b619eb68 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:48484)
I20260709 13:01:19.776695  8396 tablet_copy_service.cc:161] P d653e71832b7402b9a03b46249d3b885: Beginning new tablet copy session on tablet c2aa75e5347f4ba5a20776a3b619eb68 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:48484: session id = 446d9310dce14ff4afff2dc2d64f68d8-c2aa75e5347f4ba5a20776a3b619eb68
I20260709 13:01:19.775787  8471 tablet_copy_service.cc:140] P 105d6581548546b98eddd4ee7083bb12: Received BeginTabletCopySession request for tablet ba1839dfeba648529deb101072b3ca8c from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:53010)
I20260709 13:01:19.777552  8471 tablet_copy_service.cc:161] P 105d6581548546b98eddd4ee7083bb12: Beginning new tablet copy session on tablet ba1839dfeba648529deb101072b3ca8c from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:53010: session id = 446d9310dce14ff4afff2dc2d64f68d8-ba1839dfeba648529deb101072b3ca8c
I20260709 13:01:19.788622  8396 tablet_copy_source_session.cc:215] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:19.789969  9844 tablet_copy_client.cc:806] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:19.790957  9844 tablet_copy_client.cc:670] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:19.799341  9848 ts_tablet_manager.cc:933] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631)
I20260709 13:01:19.806078  9844 tablet_copy_client.cc:538] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:19.816223  9844 tablet_bootstrap.cc:492] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:19.820756  8471 tablet_copy_source_session.cc:215] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:19.926645  9848 tablet_copy_client.cc:323] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.193:43631
I20260709 13:01:20.015990  9847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1839dfeba648529deb101072b3ca8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:20.043578  9846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2aa75e5347f4ba5a20776a3b619eb68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:20.077963  9295 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:20.082783  9847 tablet_copy_client.cc:806] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:20.083868  9847 tablet_copy_client.cc:670] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:20.085448  9718 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:20.087100  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:20.087133  8396 tablet_copy_service.cc:140] P d653e71832b7402b9a03b46249d3b885: Received BeginTabletCopySession request for tablet 866f457c2bf048109ab977c2b010de5a from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:48484)
I20260709 13:01:20.090126  8396 tablet_copy_service.cc:161] P d653e71832b7402b9a03b46249d3b885: Beginning new tablet copy session on tablet 866f457c2bf048109ab977c2b010de5a from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:48484: session id = 446d9310dce14ff4afff2dc2d64f68d8-866f457c2bf048109ab977c2b010de5a
I20260709 13:01:20.106168  9846 tablet_copy_client.cc:806] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:20.106946  9846 tablet_copy_client.cc:670] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:20.111979  8396 tablet_copy_source_session.cc:215] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:20.114051  8379 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:20.102293  9847 tablet_copy_client.cc:538] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:20.133198  9844 tablet_bootstrap.cc:492] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:20.134814  9844 tablet_bootstrap.cc:492] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:20.136474  9844 ts_tablet_manager.cc:1403] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.320s	user 0.035s	sys 0.013s
I20260709 13:01:20.145668  9847 tablet_bootstrap.cc:492] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:20.149988  9844 raft_consensus.cc:359] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:20.252417  9844 raft_consensus.cc:740] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:20.253300  9844 consensus_queue.cc:260] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
W20260709 13:01:20.241569  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 83750.8us
W20260709 13:01:20.248420  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 118401us
W20260709 13:01:20.237797  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 80353.5us
I20260709 13:01:20.304738  9857 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:20.308725  9848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866f457c2bf048109ab977c2b010de5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:20.324842  9846 tablet_copy_client.cc:538] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:20.344249  9847 tablet_bootstrap.cc:700] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: Time spent opening tablet: real 0.114s	user 0.002s	sys 0.001s
I20260709 13:01:20.346984  9844 ts_tablet_manager.cc:1434] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.210s	user 0.005s	sys 0.006s
I20260709 13:01:20.354257  8471 tablet_copy_service.cc:342] P 105d6581548546b98eddd4ee7083bb12: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-de8d0dfcd55e4b03b9a131362bf19085 received from {username='slave'} at 127.0.0.1:53010
I20260709 13:01:20.354730  8471 tablet_copy_service.cc:434] P 105d6581548546b98eddd4ee7083bb12: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-de8d0dfcd55e4b03b9a131362bf19085 on tablet de8d0dfcd55e4b03b9a131362bf19085 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:20.379994  8460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:20.380910  8460 raft_consensus.cc:606] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:01:20.385538  9846 tablet_bootstrap.cc:492] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:20.390767  8527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67513665d04b44c292143601e7f66ac8"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
mode: GRACEFUL
new_leader_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:40160
I20260709 13:01:20.391621  8527 raft_consensus.cc:606] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Received request to transfer leadership to TS 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:20.392553  9848 tablet_copy_client.cc:806] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:20.393240  9848 tablet_copy_client.cc:670] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
W20260709 13:01:20.393577  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 70164.7us
I20260709 13:01:20.400154  8384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:01:20.401047  8384 raft_consensus.cc:606] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:01:20.403154  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:01:20.404798  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:20.406491  9848 tablet_copy_client.cc:538] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:20.417034  9848 tablet_bootstrap.cc:492] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:20.435961  9846 tablet_bootstrap.cc:492] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:20.437062  9846 tablet_bootstrap.cc:492] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:20.439105  9766 raft_consensus.cc:993] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:20.439647  9846 ts_tablet_manager.cc:1403] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.008s
I20260709 13:01:20.439661  9766 raft_consensus.cc:1081] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:20.442293  8384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:01:20.442993  8384 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:20.443441  8384 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.443267  9846 raft_consensus.cc:359] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:20.444199  9846 raft_consensus.cc:740] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:20.445096  9846 consensus_queue.cc:260] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:20.448319  9846 ts_tablet_manager.cc:1434] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:20.454691  9847 tablet_bootstrap.cc:492] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:20.455180  8384 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:20.455771  9847 tablet_bootstrap.cc:492] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:20.456631  9847 ts_tablet_manager.cc:1403] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.312s	user 0.030s	sys 0.020s
I20260709 13:01:20.458887  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:20.459623  8527 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.458961  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:20.460430  8460 raft_consensus.cc:3055] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.460763  8460 raft_consensus.cc:740] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:20.460597  9847 raft_consensus.cc:359] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:20.461725  9847 raft_consensus.cc:740] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:20.461573  8460 consensus_queue.cc:260] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:20.462618  8460 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.462463  9847 consensus_queue.cc:260] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:20.465583  9847 ts_tablet_manager.cc:1434] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:01:20.467134  8396 tablet_copy_service.cc:342] P d653e71832b7402b9a03b46249d3b885: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-c2aa75e5347f4ba5a20776a3b619eb68 received from {username='slave'} at 127.0.0.1:48484
I20260709 13:01:20.467674  8396 tablet_copy_service.cc:434] P d653e71832b7402b9a03b46249d3b885: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-c2aa75e5347f4ba5a20776a3b619eb68 on tablet c2aa75e5347f4ba5a20776a3b619eb68 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:20.468668  8471 tablet_copy_service.cc:342] P 105d6581548546b98eddd4ee7083bb12: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-ba1839dfeba648529deb101072b3ca8c received from {username='slave'} at 127.0.0.1:53010
I20260709 13:01:20.469141  8471 tablet_copy_service.cc:434] P 105d6581548546b98eddd4ee7083bb12: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-ba1839dfeba648529deb101072b3ca8c on tablet ba1839dfeba648529deb101072b3ca8c with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:20.470521  8527 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:20.473289  8384 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:20.473589  8349 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:20.474603  9647 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:20.475046  9647 raft_consensus.cc:697] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:20.475785  9647 consensus_queue.cc:237] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:20.481981  8460 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:20.496161  9848 tablet_bootstrap.cc:492] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:20.497648  9848 tablet_bootstrap.cc:492] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:20.498435  9848 ts_tablet_manager.cc:1403] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.082s	user 0.026s	sys 0.008s
I20260709 13:01:20.498234  8281 catalog_manager.cc:5697] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 2, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.501947  9848 raft_consensus.cc:359] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:20.502887  9848 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:20.504063  9848 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:20.509548  9848 ts_tablet_manager.cc:1434] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:01:20.514590  8396 tablet_copy_service.cc:342] P d653e71832b7402b9a03b46249d3b885: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-866f457c2bf048109ab977c2b010de5a received from {username='slave'} at 127.0.0.1:48484
I20260709 13:01:20.515094  8396 tablet_copy_service.cc:434] P d653e71832b7402b9a03b46249d3b885: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-866f457c2bf048109ab977c2b010de5a on tablet 866f457c2bf048109ab977c2b010de5a with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:20.541981  9293 raft_consensus.cc:1217] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:01:20.731256  9293 raft_consensus.cc:1217] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEARNER]: Deduplicated request from leader. Original: 5.3->[5.4-5.4]   Dedup: 5.4->[]
I20260709 13:01:20.741266  9861 raft_consensus.cc:993] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31: : Instructing follower 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:20.741772  9854 raft_consensus.cc:1081] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Signalling peer 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:20.746030  9293 raft_consensus.cc:1217] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:20.752076  8461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67513665d04b44c292143601e7f66ac8"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:36448
I20260709 13:01:20.752652  8461 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:20.752969  8461 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:20.759990  8461 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:20.763079  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:20.763845  8378 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:20.766481  8461 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:20.763155  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:20.781183  8535 raft_consensus.cc:3055] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:20.781476  8535 raft_consensus.cc:740] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:20.788998  8535 consensus_queue.cc:260] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:20.790285  8535 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:20.796697  8378 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:20.798269  8427 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:20.799295  9866 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:20.799829  9866 raft_consensus.cc:697] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:20.800364  8535 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:20.800683  9866 consensus_queue.cc:237] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:20.815630  9293 raft_consensus.cc:1217] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:01:20.816727  9647 raft_consensus.cc:993] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:20.817250  9856 raft_consensus.cc:1081] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:20.829067  8535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38892
I20260709 13:01:20.829797  8535 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:20.830178  8535 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:20.837415  8535 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:20.840801  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:20.841450  8384 raft_consensus.cc:3055] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:20.841598  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:20.841790  8384 raft_consensus.cc:740] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:20.842154  8461 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:20.842509  8384 consensus_queue.cc:260] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:20.843567  8384 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:20.845582  8281 catalog_manager.cc:5697] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 2 to 3, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.848940  8461 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:20.839963  8535 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:20.850255  8500 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:20.851701  8384 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:20.851852  9854 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:20.852415  9854 raft_consensus.cc:697] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:20.853224  9854 consensus_queue.cc:237] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:20.871312  8281 catalog_manager.cc:5697] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 2 to 3, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 3 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.930322  8528 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:20.932734  9647 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:20.967058  8461 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:20.969760  9828 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:21.061625  9816 raft_consensus.cc:1064] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:21.064721  9816 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:21.071897  8527 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:21.071957  9293 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEARNER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:21.073422  9816 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:21.074642  8384 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:21.074524  9866 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:21.087214  9817 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:21.104343  9866 raft_consensus.cc:2955] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.107441  8527 raft_consensus.cc:2955] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.115442  8384 raft_consensus.cc:2955] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.127887  9295 raft_consensus.cc:2955] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.144454  8281 catalog_manager.cc:5697] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:21.193300  8461 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:21.199157  8384 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:21.199172  9295 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:21.207011  9828 raft_consensus.cc:1064] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:21.209561  9828 consensus_queue.cc:237] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:21.211018  9766 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:01:21.213703  9817 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:21.221561  9765 raft_consensus.cc:2955] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.223412  9293 raft_consensus.cc:2955] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.228652  8527 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:21.230800  9295 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:21.233250  9828 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:21.235639  9856 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:21.238109  8382 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:21.242228  9866 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:21.244926  8461 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:21.246834  9856 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:21.248792  8270 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet de8d0dfcd55e4b03b9a131362bf19085 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:21.259614  8281 catalog_manager.cc:5697] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index 5 to 6, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New cstate: current_term: 4 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.266647  8384 raft_consensus.cc:2955] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.282476  9828 raft_consensus.cc:2955] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.287452  8523 tablet_service.cc:1558] Processing DeleteTablet for tablet de8d0dfcd55e4b03b9a131362bf19085 with delete_type TABLET_DATA_TOMBSTONED (TS b8eb0ad4490645598004d862412f4e31 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:38890
I20260709 13:01:21.290882  8535 raft_consensus.cc:2955] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.296541  9647 raft_consensus.cc:1064] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:21.298336  9295 raft_consensus.cc:2955] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.299525  9647 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 2, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:21.303773  8528 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:21.309784  9816 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:21.349413  8283 catalog_manager.cc:5697] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.356107  8454 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:21.358234  9892 tablet_replica.cc:333] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:01:21.359797  9854 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:01:21.366545  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 50518.7us
I20260709 13:01:21.371027  8528 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:21.376643  9856 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:21.382436  9295 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEARNER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:21.383566  8382 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:21.384092  8461 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:21.386076  9854 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:21.393664  8454 raft_consensus.cc:2955] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.395292  9900 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:21.402673  9898 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:21.405683  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:21.496378  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 195670us
I20260709 13:01:21.522539  8528 raft_consensus.cc:2955] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.516348  9896 raft_consensus.cc:2955] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.530274  9893 raft_consensus.cc:1064] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:21.532852  9893 consensus_queue.cc:237] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:21.550722  8457 raft_consensus.cc:2955] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.569126  9892 raft_consensus.cc:2243] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:21.569819  9892 raft_consensus.cc:2272] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:21.573271  9892 ts_tablet_manager.cc:1916] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:21.576285  8384 consensus_queue.cc:237] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:21.584358  9295 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:21.588697  9765 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:21.591943  9892 ts_tablet_manager.cc:1929] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:01:21.592540  9892 log.cc:1199] T de8d0dfcd55e4b03b9a131362bf19085 P b8eb0ad4490645598004d862412f4e31: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-2-root/wals/de8d0dfcd55e4b03b9a131362bf19085
I20260709 13:01:21.594482  8268 catalog_manager.cc:5028] TS b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): tablet de8d0dfcd55e4b03b9a131362bf19085 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:21.595299  9293 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:21.595695  9291 raft_consensus.cc:2955] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.598997  9898 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:21.599347  8527 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:01:21.609570  8427 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.7.25.254:44471, user_credentials={real_user=slave}} blocked reactor thread for 55278.9us
I20260709 13:01:21.611876  8281 catalog_manager.cc:5697] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.612648  9866 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:21.615075  8386 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:21.613855  8535 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:21.621754  9898 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:21.624403  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:21.623237  9902 raft_consensus.cc:2955] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.632764  9293 raft_consensus.cc:2955] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.643071  9766 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:21.653409  8535 raft_consensus.cc:2955] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.657872  8284 catalog_manager.cc:5697] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 3 to 4, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.673800  8271 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c2aa75e5347f4ba5a20776a3b619eb68 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:21.697108  8448 tablet_service.cc:1558] Processing DeleteTablet for tablet c2aa75e5347f4ba5a20776a3b619eb68 with delete_type TABLET_DATA_TOMBSTONED (TS 105d6581548546b98eddd4ee7083bb12 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36438
I20260709 13:01:21.714138  9866 raft_consensus.cc:2955] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.718469  9914 tablet_replica.cc:333] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:01:21.724362  9914 raft_consensus.cc:2243] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:21.722163  9295 raft_consensus.cc:2955] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.725250  9914 raft_consensus.cc:2272] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:21.733286  8527 raft_consensus.cc:2955] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.743011  9914 ts_tablet_manager.cc:1916] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:21.749249  8384 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:21.755419  9293 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:21.756155  8386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:01:21.756914  9898 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:01:21.761032  8382 raft_consensus.cc:2955] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.756759  8386 raft_consensus.cc:606] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:01:21.775691  8283 catalog_manager.cc:5697] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.775718  9914 ts_tablet_manager.cc:1929] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:21.783231  9914 log.cc:1199] T c2aa75e5347f4ba5a20776a3b619eb68 P 105d6581548546b98eddd4ee7083bb12: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-1-root/wals/c2aa75e5347f4ba5a20776a3b619eb68
I20260709 13:01:21.785899  8535 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:21.786345  8270 catalog_manager.cc:5028] TS 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): tablet c2aa75e5347f4ba5a20776a3b619eb68 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:21.789659  9898 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:21.792917  8527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45d39340781e466abc648aacd7ee5822"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
mode: GRACEFUL
new_leader_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:40160
I20260709 13:01:21.789599  9895 raft_consensus.cc:2955] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.795287  8533 raft_consensus.cc:2955] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.798561  9293 raft_consensus.cc:2955] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.817113  8457 consensus_queue.cc:237] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:21.824308  8284 catalog_manager.cc:5697] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index 5 to 6, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New cstate: current_term: 5 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.828733  8535 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:21.830562  9295 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:21.830837  9766 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:21.834842  9766 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:21.837564  8271 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 866f457c2bf048109ab977c2b010de5a with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:21.840451  9866 raft_consensus.cc:2955] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.849625  9295 raft_consensus.cc:2955] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.856320  8527 raft_consensus.cc:606] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Received request to transfer leadership to TS 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:21.859647  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:21.860249  8457 raft_consensus.cc:606] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:01:21.862439  8448 tablet_service.cc:1558] Processing DeleteTablet for tablet 866f457c2bf048109ab977c2b010de5a with delete_type TABLET_DATA_TOMBSTONED (TS 105d6581548546b98eddd4ee7083bb12 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36438
I20260709 13:01:21.863924  8270 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ba1839dfeba648529deb101072b3ca8c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:21.864245  8461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:21.864825  8461 raft_consensus.cc:606] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Received request to transfer leadership to TS 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:21.865348  8527 raft_consensus.cc:2955] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:21.873514  8533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
mode: GRACEFUL
new_leader_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:40160
I20260709 13:01:21.874286  8533 raft_consensus.cc:606] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Received request to transfer leadership to TS 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:21.876598  8284 catalog_manager.cc:5697] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index 4 to 5, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.878232  9914 tablet_replica.cc:333] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:01:21.880111  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:21.883358  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:21.883734  9914 raft_consensus.cc:2243] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:21.886857  9914 raft_consensus.cc:2272] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:21.898260  8373 tablet_service.cc:1558] Processing DeleteTablet for tablet ba1839dfeba648529deb101072b3ca8c with delete_type TABLET_DATA_TOMBSTONED (TS d653e71832b7402b9a03b46249d3b885 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:59326
I20260709 13:01:21.900087  9916 tablet_replica.cc:333] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:01:21.902073  9916 raft_consensus.cc:2243] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:21.902776  9916 raft_consensus.cc:2272] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:21.909372  9916 ts_tablet_manager.cc:1916] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:21.999717  9914 ts_tablet_manager.cc:1916] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:22.055228  9916 ts_tablet_manager.cc:1929] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:01:22.057070  9916 log.cc:1199] T ba1839dfeba648529deb101072b3ca8c P d653e71832b7402b9a03b46249d3b885: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-0-root/wals/ba1839dfeba648529deb101072b3ca8c
I20260709 13:01:22.071564  9914 ts_tablet_manager.cc:1929] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.5
I20260709 13:01:22.072675  9914 log.cc:1199] T 866f457c2bf048109ab977c2b010de5a P 105d6581548546b98eddd4ee7083bb12: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-1-root/wals/866f457c2bf048109ab977c2b010de5a
I20260709 13:01:22.077885  8270 catalog_manager.cc:5028] TS 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): tablet 866f457c2bf048109ab977c2b010de5a (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:22.078128  9902 raft_consensus.cc:993] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:22.079602  9900 raft_consensus.cc:1081] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:22.082026  8527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38892
I20260709 13:01:22.082571  8527 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:22.082960  8527 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:22.083571  8271 catalog_manager.cc:5028] TS d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): tablet ba1839dfeba648529deb101072b3ca8c (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:22.094579  8527 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:22.099664  8527 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:22.102443  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:22.103025  8457 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:22.112186  9908 raft_consensus.cc:993] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31: : Instructing follower 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:22.112987  9908 raft_consensus.cc:1081] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Signalling peer 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:22.113556  8457 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:22.117542  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:22.116287  8454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:36448
I20260709 13:01:22.119036  8454 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:22.119402  8454 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.119843  9854 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:22.120450  9854 raft_consensus.cc:697] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:22.121388  9854 consensus_queue.cc:237] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:22.128505  8454 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:22.135048  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:22.135699  8378 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.143785  8378 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:22.145201  8427 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:22.146090  9893 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:22.146744  9893 raft_consensus.cc:697] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:22.148000  9893 consensus_queue.cc:237] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:22.151909  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:22.152654  8378 raft_consensus.cc:3055] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:22.154464  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:22.159080  8527 raft_consensus.cc:3055] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:22.159360  8527 raft_consensus.cc:740] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:22.160008  8527 consensus_queue.cc:260] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:22.160892  8527 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.164513  8284 catalog_manager.cc:5697] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 2 to 3, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.165561  8378 raft_consensus.cc:740] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:22.167560  8461 raft_consensus.cc:1240] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:22.168304  8378 consensus_queue.cc:260] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:22.153587  8454 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:22.169437  8378 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:22.177022  9866 raft_consensus.cc:993] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower 446d9310dce14ff4afff2dc2d64f68d8 to start an election
I20260709 13:01:22.177542  9866 raft_consensus.cc:1081] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Signalling peer 446d9310dce14ff4afff2dc2d64f68d8 to start an election
I20260709 13:01:22.182345  9293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085"
dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
 from {username='slave'} at 127.0.0.1:55734
I20260709 13:01:22.182943  9293 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:22.183300  9293 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.182286  8527 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:22.194181  9293 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:22.191918  8378 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:22.196466  9293 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:22.197361  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:22.198088  8461 raft_consensus.cc:3055] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:22.198457  8461 raft_consensus.cc:740] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:22.199250  8461 consensus_queue.cc:260] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:22.203179  8284 catalog_manager.cc:5697] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 1 to 2, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 2 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.204244  8461 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.199880  9765 raft_consensus.cc:993] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:22.205494  9817 raft_consensus.cc:1081] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:22.207369  8378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:01:22.207888  8378 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:22.208197  8378 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:22.210886  8461 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:22.201699  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:22.211655  8380 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.219161  8378 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:22.222398  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:22.222926  8454 raft_consensus.cc:3055] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:22.223201  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:22.223532  8454 raft_consensus.cc:740] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:22.223883  8527 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:22.224783  9260 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:22.225732  9853 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:22.221340  8380 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:22.223008  8378 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:22.232956  8454 consensus_queue.cc:260] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:22.233372  8527 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:22.235641  8454 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:22.234704  9853 raft_consensus.cc:697] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:22.236064  8349 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:22.236817  9895 raft_consensus.cc:2804] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:22.237320  9895 raft_consensus.cc:697] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:22.238126  9895 consensus_queue.cc:237] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:22.241068  9853 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:22.252774  8284 catalog_manager.cc:5697] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 4 to 5, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 5 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.254058  8454 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:22.265372  9854 raft_consensus.cc:993] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: : Instructing follower 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:22.265826  9854 raft_consensus.cc:1081] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Signalling peer 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:22.267756  8461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45d39340781e466abc648aacd7ee5822"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:36448
I20260709 13:01:22.268388  8461 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:22.268750  8461 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.271027  8284 catalog_manager.cc:5697] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 2, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.278688  8461 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:22.281390  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:22.281981  8380 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.285899  8461 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:22.287525  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:22.288192  8527 raft_consensus.cc:3055] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:22.288877  8527 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:22.290047  8527 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:22.291229  8527 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.292814  8380 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:22.297358  8427 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:22.298221  9817 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:22.298725  9817 raft_consensus.cc:697] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:22.298997  8527 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:22.299624  9817 consensus_queue.cc:237] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:22.311100  8284 catalog_manager.cc:5697] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 2 to 3, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.519245  8380 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:22.520612  9917 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:22.530983  8454 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:22.532419  9917 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:22.557606  8527 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:22.558746  9766 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:22.568521  8378 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:22.571828  9765 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:01:22.618461  8454 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:22.620062  9895 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:22.631613  8527 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:22.634720  9895 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:22.677129  8382 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:22.678434  9853 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:22.704875  8454 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:22.706288  9934 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:22.836848  8535 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:22.838227  9765 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:22.851491  8382 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:22.853248  9765 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:22.884322  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:23.072410  8454 consensus_queue.cc:237] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:23.074741  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:23.110658  8535 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:23.112761  9942 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:01:23.116825  8426 consensus_peers.cc:597] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fd3ca20a5e4646d3b164329f7abcf44a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.137135  9866 raft_consensus.cc:2955] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:23.150949  8535 raft_consensus.cc:2955] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:23.178690  8527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
mode: GRACEFUL
new_leader_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:40160
I20260709 13:01:23.179598  8527 raft_consensus.cc:606] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Received request to transfer leadership to TS 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:23.182233  8380 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:23.187770  9939 raft_consensus.cc:993] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31: : Instructing follower 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:23.189626  8460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:23.190475  8460 raft_consensus.cc:606] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:01:23.192320  9854 raft_consensus.cc:1081] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Signalling peer 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:23.195773  9765 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:23.196029  8460 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:36448
I20260709 13:01:23.196923  8460 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:23.197489  8460 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.198704  8378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b3df375d584465c8712d996256828cf"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:01:23.199611  8378 raft_consensus.cc:606] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:01:23.203629  8529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
mode: GRACEFUL
new_leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
 from {username='slave'} at 127.0.0.1:40160
I20260709 13:01:23.204523  8529 raft_consensus.cc:606] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Received request to transfer leadership to TS 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:23.210490  8459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:23.211328  8459 raft_consensus.cc:606] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:01:23.213112  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:23.221256  8529 consensus_queue.cc:237] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:23.226804  8460 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:23.235896  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:23.235766  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:23.237282  8528 raft_consensus.cc:3055] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:23.237638  8528 raft_consensus.cc:740] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:23.238587  8528 consensus_queue.cc:260] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:23.239879  8528 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.241848  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:23.242522  9293 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.245373  9917 raft_consensus.cc:993] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31: : Instructing follower 446d9310dce14ff4afff2dc2d64f68d8 to start an election
I20260709 13:01:23.235038  8460 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:23.245972  9854 raft_consensus.cc:1081] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Signalling peer 446d9310dce14ff4afff2dc2d64f68d8 to start an election
I20260709 13:01:23.250646  8528 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:23.250726  8380 raft_consensus.cc:2955] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:23.252339  8424 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:23.253754  9765 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:23.254253  9765 raft_consensus.cc:697] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:23.254491  9291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e"
dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
 from {username='slave'} at 127.0.0.1:55724
I20260709 13:01:23.254895  9293 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:23.255082  9291 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:23.255590  9291 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:23.255190  9765 consensus_queue.cc:237] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:23.278443  9291 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:23.295460  8500 consensus_peers.cc:597] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: da34f43baf6c442b83da63228cfeb9a2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.295874  8454 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:23.298379  9939 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:23.299072  8380 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:23.297822  8284 catalog_manager.cc:5697] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:23.302932  9939 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:23.315012  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:23.315689  8378 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:23.321585  8378 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:01:23.321786  9291 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:23.323236  9261 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:23.323890  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:23.324576  8529 raft_consensus.cc:3055] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:23.324714  9934 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:23.325799  9934 raft_consensus.cc:697] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:23.326913  9934 consensus_queue.cc:237] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:23.325215  8529 raft_consensus.cc:740] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:23.329984  8529 consensus_queue.cc:260] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:23.334678  8529 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:23.342069  9854 raft_consensus.cc:2955] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:23.348659  8460 raft_consensus.cc:2955] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:23.355624  8380 raft_consensus.cc:2955] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:23.364490  9942 raft_consensus.cc:993] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:23.365041  9942 raft_consensus.cc:1081] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:23.368155  8378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:01:23.368721  8378 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:23.369050  8378 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.380553  8281 catalog_manager.cc:5697] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 3 to 4, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 4 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:23.378990  8378 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:23.399336  8378 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:23.401839  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:23.402598  8460 raft_consensus.cc:3055] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:23.403294  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:23.403967  8528 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.405802  8454 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:23.410782  8529 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:01:23.410844  8528 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:23.402973  8460 raft_consensus.cc:740] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:23.412756  8349 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:23.414027  9902 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:23.414664  9902 raft_consensus.cc:697] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:23.413300  8460 consensus_queue.cc:260] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:23.415869  9902 consensus_queue.cc:237] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:23.417469  8460 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.426020  8535 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:01:23.428396  8426 consensus_peers.cc:597] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e27bb2ddbf1e4b7daa5333a909bbaf31. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.429854  8282 catalog_manager.cc:5697] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 2 to 3, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:23.431128  9765 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:23.432749  8380 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:23.435120  9817 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:23.454473  8460 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:23.465476  8281 catalog_manager.cc:5697] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 3 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:23.479285  9765 raft_consensus.cc:2955] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:23.481927  8380 raft_consensus.cc:2955] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:23.486732  8535 raft_consensus.cc:2955] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:23.501168  8528 consensus_queue.cc:237] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:23.508472  8460 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:23.509907  8378 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:23.512208  9940 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:23.513041  9939 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:23.513392  8282 catalog_manager.cc:5697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:23.515101  8500 consensus_peers.cc:597] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: da501bdc0de7404f9ecae9db442353dc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:23.548359  8283 catalog_manager.cc:5697] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 2 to 3, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:23.563699  9940 raft_consensus.cc:2955] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:23.563185  8460 raft_consensus.cc:2955] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:23.566584  8378 raft_consensus.cc:2955] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:23.587024  8283 catalog_manager.cc:5697] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:23.615243  9766 raft_consensus.cc:993] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:23.615628  9765 raft_consensus.cc:1081] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:23.616991  8529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38894
I20260709 13:01:23.617555  8529 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:23.617885  8529 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:23.630080  8529 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:23.632035  8529 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:23.634114  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:23.635572  8378 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:23.642122  8378 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:23.633486  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:23.642997  8460 raft_consensus.cc:3055] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:23.643294  8460 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:23.643857  8501 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:23.644019  8460 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:23.644738  9854 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:23.645279  8460 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:23.645298  9854 raft_consensus.cc:697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:23.646436  9854 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:23.654762  8460 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:23.658255  9902 raft_consensus.cc:993] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:23.658752  9902 raft_consensus.cc:1081] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:23.660636  8528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b3df375d584465c8712d996256828cf"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38892
I20260709 13:01:23.661234  8528 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:23.661613  8528 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.667894  8282 catalog_manager.cc:5697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 3 to 4, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 4 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:23.668743  8528 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:23.670935  8528 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:23.671939  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:23.671765  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:23.672883  8460 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.672979  8378 raft_consensus.cc:3055] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:23.673404  8378 raft_consensus.cc:740] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:23.674237  8378 consensus_queue.cc:260] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:23.675460  8378 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.679898  8460 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:23.681280  8500 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:23.681862  8378 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:23.682132  9854 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:23.682996  9854 raft_consensus.cc:697] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:23.683832  9854 consensus_queue.cc:237] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:23.694440  8282 catalog_manager.cc:5697] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 2 to 3, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 3 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:23.729019  9962 ts_tablet_manager.cc:933] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:23.731475  9962 tablet_copy_client.cc:323] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.194:36925
I20260709 13:01:23.733474  8471 tablet_copy_service.cc:140] P 105d6581548546b98eddd4ee7083bb12: Received BeginTabletCopySession request for tablet fd3ca20a5e4646d3b164329f7abcf44a from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:53010)
I20260709 13:01:23.734000  8471 tablet_copy_service.cc:161] P 105d6581548546b98eddd4ee7083bb12: Beginning new tablet copy session on tablet fd3ca20a5e4646d3b164329f7abcf44a from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:53010: session id = 446d9310dce14ff4afff2dc2d64f68d8-fd3ca20a5e4646d3b164329f7abcf44a
I20260709 13:01:23.741914  8471 tablet_copy_source_session.cc:215] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:23.745055  9962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd3ca20a5e4646d3b164329f7abcf44a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:23.759657  9962 tablet_copy_client.cc:806] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:23.760423  9962 tablet_copy_client.cc:670] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:23.770452  9962 tablet_copy_client.cc:538] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:23.780313  9962 tablet_bootstrap.cc:492] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:23.786947  9291 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:23.788545  9942 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:23.817235  9965 ts_tablet_manager.cc:933] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:23.834631  9965 tablet_copy_client.cc:323] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.195:40767
I20260709 13:01:23.835994  9962 tablet_bootstrap.cc:492] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:23.837364  9962 tablet_bootstrap.cc:492] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:23.839084  8544 tablet_copy_service.cc:140] P b8eb0ad4490645598004d862412f4e31: Received BeginTabletCopySession request for tablet da34f43baf6c442b83da63228cfeb9a2 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:47306)
I20260709 13:01:23.839676  8544 tablet_copy_service.cc:161] P b8eb0ad4490645598004d862412f4e31: Beginning new tablet copy session on tablet da34f43baf6c442b83da63228cfeb9a2 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:47306: session id = 446d9310dce14ff4afff2dc2d64f68d8-da34f43baf6c442b83da63228cfeb9a2
I20260709 13:01:23.843434  8528 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:23.844587  9962 ts_tablet_manager.cc:1403] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.065s	user 0.027s	sys 0.019s
I20260709 13:01:23.852025  9962 raft_consensus.cc:359] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:23.853761  9765 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:23.854904  8544 tablet_copy_source_session.cc:215] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:23.852912  9962 raft_consensus.cc:740] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:23.855722  9962 consensus_queue.cc:260] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:23.862010  9962 ts_tablet_manager.cc:1434] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:01:23.882530  8528 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:23.905030  8471 tablet_copy_service.cc:342] P 105d6581548546b98eddd4ee7083bb12: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-fd3ca20a5e4646d3b164329f7abcf44a received from {username='slave'} at 127.0.0.1:53010
I20260709 13:01:23.905804  8471 tablet_copy_service.cc:434] P 105d6581548546b98eddd4ee7083bb12: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-fd3ca20a5e4646d3b164329f7abcf44a on tablet fd3ca20a5e4646d3b164329f7abcf44a with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:23.912698  9965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da34f43baf6c442b83da63228cfeb9a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:23.913700  9934 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:01:23.916031  9962 ts_tablet_manager.cc:933] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:23.953285  8378 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:23.955714  9853 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:23.963511  9962 tablet_copy_client.cc:323] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.194:36925
I20260709 13:01:23.965777  8471 tablet_copy_service.cc:140] P 105d6581548546b98eddd4ee7083bb12: Received BeginTabletCopySession request for tablet e27bb2ddbf1e4b7daa5333a909bbaf31 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:53010)
I20260709 13:01:23.966382  8471 tablet_copy_service.cc:161] P 105d6581548546b98eddd4ee7083bb12: Beginning new tablet copy session on tablet e27bb2ddbf1e4b7daa5333a909bbaf31 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:53010: session id = 446d9310dce14ff4afff2dc2d64f68d8-e27bb2ddbf1e4b7daa5333a909bbaf31
I20260709 13:01:23.980962  9965 tablet_copy_client.cc:806] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:23.995723  9965 tablet_copy_client.cc:670] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:24.001678  9965 tablet_copy_client.cc:538] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:24.006783  9970 ts_tablet_manager.cc:933] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:24.010468  8528 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:24.012097  9902 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:24.014889  9965 tablet_bootstrap.cc:492] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:24.019232  9970 tablet_copy_client.cc:323] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.195:40767
I20260709 13:01:24.018575  8471 tablet_copy_source_session.cc:215] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:24.027688  9962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27bb2ddbf1e4b7daa5333a909bbaf31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:24.032276  8454 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:24.032509  8544 tablet_copy_service.cc:140] P b8eb0ad4490645598004d862412f4e31: Received BeginTabletCopySession request for tablet da501bdc0de7404f9ecae9db442353dc from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:47306)
I20260709 13:01:24.033099  8544 tablet_copy_service.cc:161] P b8eb0ad4490645598004d862412f4e31: Beginning new tablet copy session on tablet da501bdc0de7404f9ecae9db442353dc from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:47306: session id = 446d9310dce14ff4afff2dc2d64f68d8-da501bdc0de7404f9ecae9db442353dc
I20260709 13:01:24.034078  9902 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:24.041112  8544 tablet_copy_source_session.cc:215] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:24.046540  9970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da501bdc0de7404f9ecae9db442353dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:24.104245  9970 tablet_copy_client.cc:806] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:24.112094  9962 tablet_copy_client.cc:806] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:24.112797  9962 tablet_copy_client.cc:670] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:24.104852  9970 tablet_copy_client.cc:670] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:24.116869  8454 raft_consensus.cc:1275] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:24.126145  9970 tablet_copy_client.cc:538] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:24.126667  9854 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:24.139353  9962 tablet_copy_client.cc:538] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:24.145820  9291 raft_consensus.cc:1217] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:01:24.171872  9970 tablet_bootstrap.cc:492] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:24.178052  8378 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:24.181526  9965 tablet_bootstrap.cc:492] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:24.182888  9940 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:24.182694  9965 tablet_bootstrap.cc:492] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:24.190518  8461 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:24.191058  9965 ts_tablet_manager.cc:1403] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.174s	user 0.023s	sys 0.006s
I20260709 13:01:24.194712  9909 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:24.202776  9962 tablet_bootstrap.cc:492] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:24.203303  9965 raft_consensus.cc:359] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:24.206329  9965 raft_consensus.cc:740] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:24.207341  9965 consensus_queue.cc:260] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:24.213896  9965 ts_tablet_manager.cc:1434] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:01:24.215829  8544 tablet_copy_service.cc:342] P b8eb0ad4490645598004d862412f4e31: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-da34f43baf6c442b83da63228cfeb9a2 received from {username='slave'} at 127.0.0.1:47306
I20260709 13:01:24.216338  8544 tablet_copy_service.cc:434] P b8eb0ad4490645598004d862412f4e31: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-da34f43baf6c442b83da63228cfeb9a2 on tablet da34f43baf6c442b83da63228cfeb9a2 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:24.226222  8380 raft_consensus.cc:1275] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:24.232199  9854 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:24.248696  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:24.261641  9962 tablet_bootstrap.cc:492] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:24.262694  9962 tablet_bootstrap.cc:492] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:24.263356  9962 ts_tablet_manager.cc:1403] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.061s	user 0.026s	sys 0.008s
I20260709 13:01:24.266649  9962 raft_consensus.cc:359] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:24.267635  9962 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:24.268280  9962 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:24.275168  9962 ts_tablet_manager.cc:1434] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:01:24.276866  8471 tablet_copy_service.cc:342] P 105d6581548546b98eddd4ee7083bb12: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-e27bb2ddbf1e4b7daa5333a909bbaf31 received from {username='slave'} at 127.0.0.1:53010
I20260709 13:01:24.277360  8471 tablet_copy_service.cc:434] P 105d6581548546b98eddd4ee7083bb12: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-e27bb2ddbf1e4b7daa5333a909bbaf31 on tablet e27bb2ddbf1e4b7daa5333a909bbaf31 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:24.339727  9970 tablet_bootstrap.cc:492] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:24.340559  9970 tablet_bootstrap.cc:492] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:24.341302  9970 ts_tablet_manager.cc:1403] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.170s	user 0.034s	sys 0.023s
I20260709 13:01:24.344383  9970 raft_consensus.cc:359] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:24.345258  9970 raft_consensus.cc:740] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:24.345927  9970 consensus_queue.cc:260] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:24.351084  9970 ts_tablet_manager.cc:1434] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:01:24.357364  8544 tablet_copy_service.cc:342] P b8eb0ad4490645598004d862412f4e31: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-da501bdc0de7404f9ecae9db442353dc received from {username='slave'} at 127.0.0.1:47306
I20260709 13:01:24.357828  8544 tablet_copy_service.cc:434] P b8eb0ad4490645598004d862412f4e31: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-da501bdc0de7404f9ecae9db442353dc on tablet da501bdc0de7404f9ecae9db442353dc with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:24.365031  9295 raft_consensus.cc:1217] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:01:24.403556  9291 raft_consensus.cc:1217] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:01:24.413038  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:24.467871  8380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:01:24.468422  8380 raft_consensus.cc:606] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:01:24.471478  8380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:01:24.472075  8380 raft_consensus.cc:606] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:01:24.474596  8527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
mode: GRACEFUL
new_leader_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:40160
I20260709 13:01:24.475064  8527 raft_consensus.cc:606] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Received request to transfer leadership to TS 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:24.477458  8527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:40160
I20260709 13:01:24.478044  8527 raft_consensus.cc:606] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:01:24.487358  8454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:24.488103  8454 raft_consensus.cc:606] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:01:24.489446  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:24.491091  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:24.531229  9898 raft_consensus.cc:993] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:24.531805  9902 raft_consensus.cc:1081] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:24.533234  8529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38892
I20260709 13:01:24.533769  8529 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:24.534137  8529 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:24.538954  8529 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:24.540385  8529 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:24.541258  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:24.541538  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:24.542068  8380 raft_consensus.cc:3055] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:24.542193  8460 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:24.542433  8380 raft_consensus.cc:740] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:24.543215  8380 consensus_queue.cc:260] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:24.544377  8380 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:24.547330  8460 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:24.548635  8500 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:24.549412  9854 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:24.549826  9854 raft_consensus.cc:697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:24.550590  9854 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:24.552120  8380 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:24.559944  9942 raft_consensus.cc:1064] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:24.564090  8283 catalog_manager.cc:5697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 2 to 3, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 3 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:24.562515  9942 consensus_queue.cc:237] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:24.589258  9866 raft_consensus.cc:993] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:24.589788  9817 raft_consensus.cc:1081] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:24.598049  8529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38894
I20260709 13:01:24.604373  8529 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:24.604809  8529 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:24.642647  9291 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:24.644619  9942 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:24.645047  8380 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:24.649199  8529 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:24.650250  9854 raft_consensus.cc:993] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:24.650697  9854 raft_consensus.cc:1081] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:24.651813  8529 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:24.653303  9942 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:24.653743  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:24.654367  8380 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:24.662258  8384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59328
I20260709 13:01:24.663061  8384 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:24.663507  8384 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:24.681684  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:24.682421  8460 raft_consensus.cc:3055] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:24.681977  8380 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:24.682860  8460 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:24.685913  8501 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:24.683934  8460 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:24.687165  8529 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:24.687060  8384 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:24.690290  8460 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:24.693679  9940 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:24.694289  9940 raft_consensus.cc:697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:24.700637  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:24.701289  8454 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:24.695217  9940 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:24.699113  9817 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:01:24.714430  8460 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:24.715546  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:24.716198  8527 raft_consensus.cc:3055] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:24.716500  8527 raft_consensus.cc:740] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:24.718261  8454 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:24.719918  8351 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:24.721225  9982 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:24.721899  9982 raft_consensus.cc:697] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:24.714447  8384 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:24.725543  8527 consensus_queue.cc:260] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:24.735440  8527 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:24.723084  9982 consensus_queue.cc:237] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
W20260709 13:01:24.772317  9996 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:01:24.772701  9941 raft_consensus.cc:993] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:24.773229  9941 raft_consensus.cc:1081] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:24.776449  8535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38892
I20260709 13:01:24.777102  8535 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:24.777562  8535 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:24.816212  9765 raft_consensus.cc:2955] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:24.817142  8283 catalog_manager.cc:5697] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 3 to 4, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 4 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:24.818045  9291 raft_consensus.cc:2955] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:24.834796  8527 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:24.838697  8535 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:24.840626  8284 catalog_manager.cc:5697] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:24.844388  8535 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:24.844584  8384 raft_consensus.cc:2955] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:24.846159  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:24.846704  8378 raft_consensus.cc:3055] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:24.846992  8378 raft_consensus.cc:740] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:24.847661  8378 consensus_queue.cc:260] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:24.848654  8378 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:24.848762  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:24.849350  8459 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:24.856529  8378 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:24.857120  8535 raft_consensus.cc:2955] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:24.856669  8282 catalog_manager.cc:5697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 3 to 4, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 4 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:24.863788  8501 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:24.864652  9909 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:24.865168  9909 raft_consensus.cc:697] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:24.866004  9909 consensus_queue.cc:237] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:24.867851  8378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59326
I20260709 13:01:24.868512  8378 raft_consensus.cc:606] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Received request to transfer leadership
I20260709 13:01:24.893013  8459 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:24.897643  8380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59326
I20260709 13:01:24.898324  8380 raft_consensus.cc:606] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Received request to transfer leadership
W20260709 13:01:24.905556  8271 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for da34f43baf6c442b83da63228cfeb9a2 already in progress [suppressed 3 similar messages]
I20260709 13:01:24.911475  8459 consensus_queue.cc:237] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:24.918116  9291 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:24.919795  9765 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:24.923427  8282 catalog_manager.cc:5697] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 2 to 3, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 3 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:24.926826  9295 raft_consensus.cc:1217] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:24.928797 10002 raft_consensus.cc:993] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31: : Instructing follower 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:24.929390  9854 raft_consensus.cc:1081] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Signalling peer 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:24.931133  8460 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:36448
I20260709 13:01:24.931648  8460 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:24.931995  8460 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:24.934049  8380 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:24.936986  9817 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:24.939051  9817 raft_consensus.cc:2955] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:24.943322  8460 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:24.946928  8460 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:24.946203  9291 raft_consensus.cc:2955] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:24.949694  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:24.950300  8535 raft_consensus.cc:3055] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:24.950594  8535 raft_consensus.cc:740] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:24.950717  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:24.951344  8382 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:24.951409  8535 consensus_queue.cc:260] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:24.952788  8535 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:24.944692  8380 raft_consensus.cc:2955] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:24.956166  8270 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fd3ca20a5e4646d3b164329f7abcf44a with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:01:24.959853  8271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 54458.6us
I20260709 13:01:24.961635  8378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59326
I20260709 13:01:24.962168  8378 raft_consensus.cc:606] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Received request to transfer leadership
I20260709 13:01:24.964596  8535 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:24.965898  8424 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:24.966810  9817 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:24.967319  8332 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
I20260709 13:01:24.967553  9817 raft_consensus.cc:697] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:01:24.967783  8332 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for da34f43baf6c442b83da63228cfeb9a2 already in progress
W20260709 13:01:24.968132  8332 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for da34f43baf6c442b83da63228cfeb9a2 already in progress
I20260709 13:01:24.969204  9817 consensus_queue.cc:237] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:24.971167  8535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38890
I20260709 13:01:24.971762  8535 raft_consensus.cc:606] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Received request to transfer leadership
I20260709 13:01:24.971953  8282 catalog_manager.cc:5697] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index 5 to 6, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:24.976073  8527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38890
I20260709 13:01:24.976596  8527 raft_consensus.cc:606] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Received request to transfer leadership
I20260709 13:01:24.980726  8535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38890
I20260709 13:01:24.981453  8535 raft_consensus.cc:606] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Received request to transfer leadership
W20260709 13:01:24.992322  8332 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:01:24.992853  8332 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for e27bb2ddbf1e4b7daa5333a909bbaf31 already in progress
W20260709 13:01:24.993224  8332 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for e27bb2ddbf1e4b7daa5333a909bbaf31 already in progress
I20260709 13:01:24.994184  8382 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:25.000075  8384 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:25.002875  9854 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:25.016844  8523 tablet_service.cc:1558] Processing DeleteTablet for tablet fd3ca20a5e4646d3b164329f7abcf44a with delete_type TABLET_DATA_TOMBSTONED (TS b8eb0ad4490645598004d862412f4e31 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:38890
I20260709 13:01:25.027956 10006 tablet_replica.cc:333] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:01:25.035342 10006 raft_consensus.cc:2243] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:25.036260 10006 raft_consensus.cc:2272] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:25.046053 10006 ts_tablet_manager.cc:1916] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:25.058030  8282 catalog_manager.cc:5697] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 3 to 4, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 4 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:25.074725 10006 ts_tablet_manager.cc:1929] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:01:25.075407 10006 log.cc:1199] T fd3ca20a5e4646d3b164329f7abcf44a P b8eb0ad4490645598004d862412f4e31: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-2-root/wals/fd3ca20a5e4646d3b164329f7abcf44a
I20260709 13:01:25.077409  8268 catalog_manager.cc:5028] TS b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): tablet fd3ca20a5e4646d3b164329f7abcf44a (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:25.082007  8459 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:25.083473  9909 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:25.160976  8460 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:25.162552  9909 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:25.168695 10002 raft_consensus.cc:993] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31: : Instructing follower 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:25.169216 10002 raft_consensus.cc:1081] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Signalling peer 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:25.174598  8380 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:25.177132 10002 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:25.180595  8459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:36448
I20260709 13:01:25.183023  8459 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:25.183403  8459 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:25.191920  9295 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Advancing to term 4
I20260709 13:01:25.196337  8460 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:25.200076  9998 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:25.201900  9295 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEARNER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:25.217140  9909 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:25.224691  8459 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:25.226413  9898 raft_consensus.cc:993] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885: : Instructing follower 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:25.226961  9982 raft_consensus.cc:1081] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Signalling peer 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:25.231719  8454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:36446
I20260709 13:01:25.247880  9291 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Advancing to term 4
I20260709 13:01:25.252266  8459 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:25.253631  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:25.254297  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:25.254374  8535 raft_consensus.cc:3055] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:25.254944  8535 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:25.255887  8535 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:25.257098  8535 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:25.254926  8380 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:25.261466  9291 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEARNER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:25.262342  8454 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:25.272764  8454 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:25.274374  8535 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:25.276762  8424 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:25.277712  9817 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:25.278180  9817 raft_consensus.cc:697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:25.278954  9817 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:25.275450  8380 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:25.292424  8454 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:25.294203  9998 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:25.292205  8535 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:25.309072  9998 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:25.311656  8454 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:25.312613  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:25.313273  8527 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:25.318842  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:25.319468  8380 raft_consensus.cc:3055] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:25.319787  8380 raft_consensus.cc:740] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:25.320633  8380 consensus_queue.cc:260] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:25.321761  8527 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:25.321874  8380 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:25.322934  8424 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:25.323876  9942 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:25.324424  9942 raft_consensus.cc:697] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:25.325500  9942 consensus_queue.cc:237] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:25.313694  8281 catalog_manager.cc:5697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 4 to 5, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 5 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:25.336784  8459 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:25.337780  8535 raft_consensus.cc:1240] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:01:25.340814 10002 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:25.345139  8380 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:25.363034  8380 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:25.364727  9939 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:25.381214  8281 catalog_manager.cc:5697] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 4 to 5, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 5 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:25.464778  8380 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:25.466349  9942 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:25.487512  8527 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:25.489632  9942 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:25.491998  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:25.566686 10002 raft_consensus.cc:1064] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:25.569818 10002 consensus_queue.cc:237] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:25.598253  9295 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:25.598429  8459 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:25.603729  9940 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:25.606204  9940 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:25.612655  8380 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:25.613910 10002 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:25.629153  9909 raft_consensus.cc:2955] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:25.632737  9295 raft_consensus.cc:2955] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:25.633038  8380 raft_consensus.cc:2955] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:25.644713  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:25.648363  8281 catalog_manager.cc:5697] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:25.649863  8459 raft_consensus.cc:2955] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:25.660254  8527 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:25.661747  9817 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:25.663930  8529 consensus_queue.cc:237] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:25.678771  9295 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEARNER]: Advancing to term 5
I20260709 13:01:25.688504  9291 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:25.689273  8380 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:25.692744  9939 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:25.698201  9866 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:01:25.702347  8460 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:25.703531  9295 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEARNER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:25.703837  9939 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:25.711113 10025 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:25.719620  8384 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:25.722209  9866 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:25.734725  8459 raft_consensus.cc:2955] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:25.740114  8527 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:25.741777  9942 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:25.752993  9295 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEARNER]: Advancing to term 5
I20260709 13:01:25.753914  9942 raft_consensus.cc:1064] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:25.756414  9942 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:25.765101  9293 raft_consensus.cc:2955] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:25.766875  9295 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEARNER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:25.769491  9866 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:25.777226  8535 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:25.787547  9765 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:25.791602  9293 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEARNER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:25.793043  9817 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:25.794483  8380 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:25.796001  9817 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:25.756129  9909 raft_consensus.cc:2955] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:25.824014  8268 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet da501bdc0de7404f9ecae9db442353dc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:25.825990  9866 raft_consensus.cc:2955] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 4 to 7, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:25.838726  9765 raft_consensus.cc:1064] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:25.841120  9765 consensus_queue.cc:237] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:25.850589  8384 raft_consensus.cc:2955] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 4 to 7, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:25.859086  8529 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:25.860535  8380 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:25.861385  8529 raft_consensus.cc:2955] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 4 to 7, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:25.844235  9295 raft_consensus.cc:2955] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 4 to 7, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:25.863286  8535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
mode: GRACEFUL
new_leader_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:40160
I20260709 13:01:25.864466  8535 raft_consensus.cc:606] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Received request to transfer leadership to TS 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:25.867057  9942 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:25.868718  8459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:25.870069  8459 raft_consensus.cc:606] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:01:25.875123  8459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:25.875823  8459 raft_consensus.cc:606] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:01:25.878326  8459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67513665d04b44c292143601e7f66ac8"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:25.880959  8459 raft_consensus.cc:606] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:01:25.881413  9293 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEARNER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:25.870146  9942 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:25.892773  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:01:25.893384 10002 raft_consensus.cc:993] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31: : Instructing follower 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:25.893889 10002 raft_consensus.cc:1081] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Signalling peer 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:25.894590  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:25.896035  9817 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:25.896781  8459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:36448
I20260709 13:01:25.898072  8459 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:25.900460  8459 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:25.904649  9765 raft_consensus.cc:2955] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:25.889904  8281 catalog_manager.cc:5697] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 3 to 4, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:25.906140  8380 raft_consensus.cc:2955] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:25.921051  8459 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:25.921819  8527 raft_consensus.cc:2955] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:25.923134  8459 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:25.922987  9291 raft_consensus.cc:2955] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:25.925051  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:25.925638  8384 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:25.927235  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:25.927783  8535 raft_consensus.cc:3055] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:25.928087  8535 raft_consensus.cc:740] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:25.928764  8535 consensus_queue.cc:260] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:25.929805  8535 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:25.932596  8384 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:25.934036  8427 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:25.934911  9942 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:25.935711  9942 raft_consensus.cc:697] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:25.936616  9942 consensus_queue.cc:237] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:25.945571  8535 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:25.965523  9942 raft_consensus.cc:993] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:25.966051  9942 raft_consensus.cc:1081] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:25.969014  8282 catalog_manager.cc:5697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index 4 to 7, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:25.970683  8380 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67513665d04b44c292143601e7f66ac8"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:01:25.971328  8380 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:25.971726  8380 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:25.973579  8373 tablet_service.cc:1558] Processing DeleteTablet for tablet da501bdc0de7404f9ecae9db442353dc with delete_type TABLET_DATA_TOMBSTONED (TS d653e71832b7402b9a03b46249d3b885 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59326
I20260709 13:01:25.975425 10028 tablet_replica.cc:333] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:01:25.978389 10028 raft_consensus.cc:2243] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:25.978523  8380 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:25.979337 10028 raft_consensus.cc:2272] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:25.982918  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:25.983424  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:25.984092  8535 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:25.983513  8459 raft_consensus.cc:3055] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:25.984628  8459 raft_consensus.cc:740] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:25.985399  8459 consensus_queue.cc:260] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:25.986462  8459 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:25.986435 10028 ts_tablet_manager.cc:1916] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:25.991573  8284 catalog_manager.cc:5697] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index 3 to 6, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:25.992880  8535 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:25.994467  8349 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:25.995486  9941 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:25.995584  8459 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:25.996058  9941 raft_consensus.cc:697] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:25.997030  9941 consensus_queue.cc:237] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:25.997524  8460 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:26.002341  8384 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:01:26.003044  9291 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:01:26.004122 10025 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:26.005404  8380 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:26.006603 10025 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:26.013211 10027 raft_consensus.cc:2955] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:26.015607 10028 ts_tablet_manager.cc:1929] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:26.016088 10028 log.cc:1199] T da501bdc0de7404f9ecae9db442353dc P d653e71832b7402b9a03b46249d3b885: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-0-root/wals/da501bdc0de7404f9ecae9db442353dc
I20260709 13:01:26.019457  8271 catalog_manager.cc:5028] TS d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): tablet da501bdc0de7404f9ecae9db442353dc (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:26.027375  8270 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e27bb2ddbf1e4b7daa5333a909bbaf31 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:26.035445 10030 raft_consensus.cc:993] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:26.035984 10030 raft_consensus.cc:1081] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:26.035660  8384 raft_consensus.cc:2955] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:26.038079  8380 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:01:26.038712  8380 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:26.039083  8380 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:26.039613  9291 raft_consensus.cc:2955] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:26.042730  8283 catalog_manager.cc:5697] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 3 to 4, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 4 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.046914  8380 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:26.049783  8380 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:26.051047  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:26.051198  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:26.051750  8535 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:26.051784  8459 raft_consensus.cc:3055] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:26.052312  8459 raft_consensus.cc:740] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:26.053064  8459 consensus_queue.cc:260] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:26.054235  8459 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:26.059962  8535 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:26.060263  8460 consensus_queue.cc:237] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:26.062260  8349 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:26.063117  9941 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:26.063664  9941 raft_consensus.cc:697] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:26.064512  9941 consensus_queue.cc:237] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:26.071357  8283 catalog_manager.cc:5697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 7 to 8, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New cstate: current_term: 5 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:26.076661  9293 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:26.077291  8529 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:26.079134  9866 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:26.083027  9817 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:26.088732  9866 raft_consensus.cc:2955] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:26.090395  8529 raft_consensus.cc:2955] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:26.094007  8284 catalog_manager.cc:5697] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 3 to 4, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 4 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.099417  8459 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:26.114135  8523 tablet_service.cc:1558] Processing DeleteTablet for tablet e27bb2ddbf1e4b7daa5333a909bbaf31 with delete_type TABLET_DATA_TOMBSTONED (TS b8eb0ad4490645598004d862412f4e31 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:38890
I20260709 13:01:26.126693  8270 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet da34f43baf6c442b83da63228cfeb9a2 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:26.129745 10032 tablet_replica.cc:333] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:01:26.130985 10032 raft_consensus.cc:2243] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:26.132651 10032 raft_consensus.cc:2272] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:26.135561  9291 raft_consensus.cc:2955] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:26.138819 10032 ts_tablet_manager.cc:1916] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:26.139621  8283 catalog_manager.cc:5697] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index 6 to 7, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New cstate: current_term: 5 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:26.158331  8281 catalog_manager.cc:5697] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 3 to 4, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 4 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.173380  8373 tablet_service.cc:1558] Processing DeleteTablet for tablet da34f43baf6c442b83da63228cfeb9a2 with delete_type TABLET_DATA_TOMBSTONED (TS d653e71832b7402b9a03b46249d3b885 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:59326
I20260709 13:01:26.175457 10028 tablet_replica.cc:333] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:01:26.175809 10032 ts_tablet_manager.cc:1929] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.7
I20260709 13:01:26.176318 10032 log.cc:1199] T e27bb2ddbf1e4b7daa5333a909bbaf31 P b8eb0ad4490645598004d862412f4e31: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-2-root/wals/e27bb2ddbf1e4b7daa5333a909bbaf31
I20260709 13:01:26.176486 10028 raft_consensus.cc:2243] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:26.177392 10028 raft_consensus.cc:2272] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:26.178560  8268 catalog_manager.cc:5028] TS b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): tablet e27bb2ddbf1e4b7daa5333a909bbaf31 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:26.182507 10028 ts_tablet_manager.cc:1916] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:26.199977 10028 ts_tablet_manager.cc:1929] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 13:01:26.200328 10028 log.cc:1199] T da34f43baf6c442b83da63228cfeb9a2 P d653e71832b7402b9a03b46249d3b885: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-0-root/wals/da34f43baf6c442b83da63228cfeb9a2
I20260709 13:01:26.201877  8271 catalog_manager.cc:5028] TS d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): tablet da34f43baf6c442b83da63228cfeb9a2 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:26.287065  9866 raft_consensus.cc:993] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:26.287739 10027 raft_consensus.cc:1081] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:26.289247  8380 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:01:26.289821  8380 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:26.290165  8380 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:26.295305  8380 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:26.298225  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:26.298851  8460 raft_consensus.cc:3055] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:26.298943  8380 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:26.299207  8460 raft_consensus.cc:740] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:26.298542  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:26.300122  8460 consensus_queue.cc:260] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:26.300521  8529 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:26.301404  8460 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:26.307551  8529 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:26.307891  8460 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:26.308836  8349 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:26.310217  9941 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:26.310727  9941 raft_consensus.cc:697] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:26.311731  9941 consensus_queue.cc:237] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:26.325029  8281 catalog_manager.cc:5697] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 2 to 3, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.351814  8380 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:26.353291  9866 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:26.363945  8535 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:26.366263  9942 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:26.435992  8459 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:26.438320  9982 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:26.450161  8535 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:26.451722  9998 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:26.650478  8459 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:26.652217 10041 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:26.661206  8535 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:26.663638  9998 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:26.698256  8535 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:26.699432  9941 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:26.713337  8459 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:26.714932  9982 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:26.895529  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:27.008381  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:27.049976  8380 consensus_queue.cc:237] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:27.057188  8535 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:27.059048  8535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
mode: GRACEFUL
new_leader_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:40160
I20260709 13:01:27.059437  9998 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:27.059738  8459 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:27.059785  8535 raft_consensus.cc:606] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Received request to transfer leadership to TS 105d6581548546b98eddd4ee7083bb12
W20260709 13:01:27.063022  8351 consensus_peers.cc:597] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28d98f2932e74257b6a032b544f7b4bd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.067739 10041 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:27.068450  8380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:01:27.069064  8380 raft_consensus.cc:606] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:01:27.070235  9982 raft_consensus.cc:2955] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:27.073185  8380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:01:27.073797  8380 raft_consensus.cc:606] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:01:27.072008  8529 raft_consensus.cc:2955] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:27.077389  8460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:27.077978  8460 raft_consensus.cc:606] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Received request to transfer leadership to TS 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:27.079267  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:01:27.080965  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:27.088016  8459 raft_consensus.cc:2955] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:27.098807  8281 catalog_manager.cc:5697] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:27.103315  9998 raft_consensus.cc:993] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:27.103915  9998 raft_consensus.cc:1081] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:27.110240  8529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38892
I20260709 13:01:27.110862  8529 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:27.111231  8529 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:27.114370  8460 consensus_queue.cc:237] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:27.118299  8529 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:27.120929  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:27.121152  8529 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:27.121546  8384 raft_consensus.cc:3055] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:27.121850  8384 raft_consensus.cc:740] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:27.122643  8384 consensus_queue.cc:260] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:27.124413  8384 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:27.125327  8426 consensus_peers.cc:597] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 37c1890dcc8947c89b8c213326526c75. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.126271  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:27.126921  8459 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:27.127524  8529 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:27.129017 10048 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:27.133663  8384 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:27.133807  8459 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:27.135349  8501 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:27.136336  9940 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:27.136859  9940 raft_consensus.cc:697] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:27.137761  9940 consensus_queue.cc:237] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:27.141073  8384 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:27.143492 10048 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:27.156152 10025 raft_consensus.cc:2955] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:27.174067  8529 raft_consensus.cc:2955] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:27.190467  8282 catalog_manager.cc:5697] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 3 to 4, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 4 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.195310  8380 raft_consensus.cc:2955] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:27.203809 10058 raft_consensus.cc:993] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12: : Instructing follower 446d9310dce14ff4afff2dc2d64f68d8 to start an election
I20260709 13:01:27.204144  8529 consensus_queue.cc:237] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:27.209482 10048 raft_consensus.cc:1081] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Signalling peer 446d9310dce14ff4afff2dc2d64f68d8 to start an election
I20260709 13:01:27.211252  9291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c"
dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
 from {username='slave'} at 127.0.0.1:55734
I20260709 13:01:27.211767  9291 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:27.212091  9291 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:27.284071  9291 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:27.284104  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 72060us
I20260709 13:01:27.285945  8284 catalog_manager.cc:5697] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:27.309041  9940 raft_consensus.cc:993] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31: : Instructing follower 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:27.309538  9940 raft_consensus.cc:1081] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Signalling peer 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:27.313953  8384 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:27.315521  9940 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:27.321256  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:27.322038  8459 raft_consensus.cc:3055] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:27.322410  8459 raft_consensus.cc:740] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:27.323350  9291 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:27.325239  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:27.325979  8529 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:27.328083 10041 raft_consensus.cc:993] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:27.328610 10041 raft_consensus.cc:1081] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:27.331970  8460 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:27.331913  9939 raft_consensus.cc:2955] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:27.323365  8459 consensus_queue.cc:260] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:27.333731  8460 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:36448
I20260709 13:01:27.334296  8460 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:27.334630  8460 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:27.335212  8535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38892
I20260709 13:01:27.335714  8535 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:27.336038  8535 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:27.336148  8459 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:27.346383  8380 raft_consensus.cc:2955] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:27.348898  8460 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:27.351295  8460 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:27.351452  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:27.352074  8382 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:27.352229  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:27.352809  8527 raft_consensus.cc:3055] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:27.353094  8527 raft_consensus.cc:740] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:27.353802  8527 consensus_queue.cc:260] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:27.354794  8527 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:27.359757  8382 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:01:27.363281  8427 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:01:27.363762  8500 consensus_peers.cc:597] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b3aa2530ec1a42c890e68f3e67582ca0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.348920  8535 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:27.364140 10058 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:27.364670 10058 raft_consensus.cc:697] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:27.364255  8529 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:01:27.361690  8384 consensus_queue.cc:237] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:27.367226  9258 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:27.367832  8527 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:01:27.368040 10047 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:27.368583 10047 raft_consensus.cc:697] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:27.369382  8535 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:27.369433 10047 consensus_queue.cc:237] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:27.365563 10058 consensus_queue.cc:237] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:27.372128  9940 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:27.363458  8282 catalog_manager.cc:5697] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 1 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:27.371660  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:27.376060  8382 raft_consensus.cc:3055] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:27.376423  8382 raft_consensus.cc:740] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:27.382023  8382 consensus_queue.cc:260] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:27.385433  8382 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:27.387822  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:27.356798  8459 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:01:27.388478  8460 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:27.392318  8461 raft_consensus.cc:2955] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:27.399315  8460 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:01:27.400683  8500 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:27.400383  8281 catalog_manager.cc:5697] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 3 to 4, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 4 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.401790 10062 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:27.402280 10062 raft_consensus.cc:697] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:27.403085 10062 consensus_queue.cc:237] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:27.411375  8382 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:01:27.411242  8283 catalog_manager.cc:5697] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 5 to 6, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 6 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:27.419973  8529 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:01:27.421623  8351 consensus_peers.cc:597] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 74f6762ba0124b3a87dd4d54f5693927. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:27.422035  8461 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:27.423273  9982 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:27.425663 10041 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:27.426148  8281 catalog_manager.cc:5697] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 4 to 5, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 5 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:27.456276 10041 raft_consensus.cc:2955] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:27.458674  8529 raft_consensus.cc:2955] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:27.459254  8461 raft_consensus.cc:2955] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:27.487216  8283 catalog_manager.cc:5697] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:27.566851 10069 ts_tablet_manager.cc:933] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631)
I20260709 13:01:27.568647 10069 tablet_copy_client.cc:323] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.193:43631
I20260709 13:01:27.570418  8396 tablet_copy_service.cc:140] P d653e71832b7402b9a03b46249d3b885: Received BeginTabletCopySession request for tablet 28d98f2932e74257b6a032b544f7b4bd from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:48484)
I20260709 13:01:27.571198  8396 tablet_copy_service.cc:161] P d653e71832b7402b9a03b46249d3b885: Beginning new tablet copy session on tablet 28d98f2932e74257b6a032b544f7b4bd from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:48484: session id = 446d9310dce14ff4afff2dc2d64f68d8-28d98f2932e74257b6a032b544f7b4bd
I20260709 13:01:27.576861  8396 tablet_copy_source_session.cc:215] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:27.581422 10069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d98f2932e74257b6a032b544f7b4bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:27.599453 10069 tablet_copy_client.cc:806] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:27.600111 10069 tablet_copy_client.cc:670] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:27.604002 10069 tablet_copy_client.cc:538] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:27.610105  8384 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:27.611382 10062 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:27.614217 10069 tablet_bootstrap.cc:492] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:27.639307  8461 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:27.640841  9940 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:27.671007 10069 tablet_bootstrap.cc:492] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:27.672102 10069 tablet_bootstrap.cc:492] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:27.672883 10069 ts_tablet_manager.cc:1403] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.059s	user 0.020s	sys 0.007s
I20260709 13:01:27.679533 10069 raft_consensus.cc:359] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:27.680545 10069 raft_consensus.cc:740] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:27.681422 10069 consensus_queue.cc:260] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:27.684175 10069 ts_tablet_manager.cc:1434] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:01:27.687852 10075 ts_tablet_manager.cc:933] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:27.694015 10075 tablet_copy_client.cc:323] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.194:36925
I20260709 13:01:27.700173  8471 tablet_copy_service.cc:140] P 105d6581548546b98eddd4ee7083bb12: Received BeginTabletCopySession request for tablet 37c1890dcc8947c89b8c213326526c75 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:53010)
I20260709 13:01:27.700623  8396 tablet_copy_service.cc:342] P d653e71832b7402b9a03b46249d3b885: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-28d98f2932e74257b6a032b544f7b4bd received from {username='slave'} at 127.0.0.1:48484
I20260709 13:01:27.700764  8471 tablet_copy_service.cc:161] P 105d6581548546b98eddd4ee7083bb12: Beginning new tablet copy session on tablet 37c1890dcc8947c89b8c213326526c75 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:53010: session id = 446d9310dce14ff4afff2dc2d64f68d8-37c1890dcc8947c89b8c213326526c75
I20260709 13:01:27.701152  8396 tablet_copy_service.cc:434] P d653e71832b7402b9a03b46249d3b885: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-28d98f2932e74257b6a032b544f7b4bd on tablet 28d98f2932e74257b6a032b544f7b4bd with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:27.710060  8471 tablet_copy_source_session.cc:215] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:27.713438 10075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c1890dcc8947c89b8c213326526c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:27.722448 10069 ts_tablet_manager.cc:933] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:27.726815 10069 tablet_copy_client.cc:323] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.195:40767
I20260709 13:01:27.730712  8544 tablet_copy_service.cc:140] P b8eb0ad4490645598004d862412f4e31: Received BeginTabletCopySession request for tablet b3aa2530ec1a42c890e68f3e67582ca0 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:47306)
I20260709 13:01:27.731292  8544 tablet_copy_service.cc:161] P b8eb0ad4490645598004d862412f4e31: Beginning new tablet copy session on tablet b3aa2530ec1a42c890e68f3e67582ca0 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:47306: session id = 446d9310dce14ff4afff2dc2d64f68d8-b3aa2530ec1a42c890e68f3e67582ca0
I20260709 13:01:27.735603 10075 tablet_copy_client.cc:806] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:27.736266 10075 tablet_copy_client.cc:670] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:27.740483  8544 tablet_copy_source_session.cc:215] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:27.740828 10075 tablet_copy_client.cc:538] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:27.743903 10069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3aa2530ec1a42c890e68f3e67582ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:27.750794 10075 tablet_bootstrap.cc:492] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:27.768102 10069 tablet_copy_client.cc:806] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:27.768719 10069 tablet_copy_client.cc:670] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:27.776086 10069 tablet_copy_client.cc:538] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:27.777447 10075 tablet_bootstrap.cc:492] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:27.778410 10075 tablet_bootstrap.cc:492] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:27.779114 10075 ts_tablet_manager.cc:1403] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.007s
I20260709 13:01:27.783150 10075 raft_consensus.cc:359] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:27.784034 10075 raft_consensus.cc:740] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:27.784713 10075 consensus_queue.cc:260] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:27.787218 10075 ts_tablet_manager.cc:1434] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:01:27.791672 10069 tablet_bootstrap.cc:492] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:27.799729  8471 tablet_copy_service.cc:342] P 105d6581548546b98eddd4ee7083bb12: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-37c1890dcc8947c89b8c213326526c75 received from {username='slave'} at 127.0.0.1:53010
I20260709 13:01:27.800196  8471 tablet_copy_service.cc:434] P 105d6581548546b98eddd4ee7083bb12: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-37c1890dcc8947c89b8c213326526c75 on tablet 37c1890dcc8947c89b8c213326526c75 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:27.801853  8461 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:27.803856  9939 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:27.824574  8535 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:27.825839 10069 tablet_bootstrap.cc:492] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:27.826572  8384 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:27.826825 10069 tablet_bootstrap.cc:492] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:27.827608 10069 ts_tablet_manager.cc:1403] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.036s	user 0.024s	sys 0.004s
I20260709 13:01:27.829099 10047 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:27.829035  9940 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:27.837597 10069 raft_consensus.cc:359] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:27.838740 10069 raft_consensus.cc:740] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:27.839404 10069 consensus_queue.cc:260] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:27.841986 10069 ts_tablet_manager.cc:1434] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:01:27.849202  8544 tablet_copy_service.cc:342] P b8eb0ad4490645598004d862412f4e31: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-b3aa2530ec1a42c890e68f3e67582ca0 received from {username='slave'} at 127.0.0.1:47306
I20260709 13:01:27.849653  8544 tablet_copy_service.cc:434] P b8eb0ad4490645598004d862412f4e31: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-b3aa2530ec1a42c890e68f3e67582ca0 on tablet b3aa2530ec1a42c890e68f3e67582ca0 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:27.874992  8461 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:27.886965 10047 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:27.963492  8382 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:27.964787 10048 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:27.978209  8535 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:27.980120 10058 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:28.030697 10069 ts_tablet_manager.cc:933] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631)
I20260709 13:01:28.032395 10069 tablet_copy_client.cc:323] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.193:43631
I20260709 13:01:28.034324  8396 tablet_copy_service.cc:140] P d653e71832b7402b9a03b46249d3b885: Received BeginTabletCopySession request for tablet 74f6762ba0124b3a87dd4d54f5693927 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:48484)
I20260709 13:01:28.034803  8396 tablet_copy_service.cc:161] P d653e71832b7402b9a03b46249d3b885: Beginning new tablet copy session on tablet 74f6762ba0124b3a87dd4d54f5693927 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:48484: session id = 446d9310dce14ff4afff2dc2d64f68d8-74f6762ba0124b3a87dd4d54f5693927
I20260709 13:01:28.042047  8396 tablet_copy_source_session.cc:215] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:28.048499 10069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f6762ba0124b3a87dd4d54f5693927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:28.070600 10069 tablet_copy_client.cc:806] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:28.071251 10069 tablet_copy_client.cc:670] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:28.075197 10069 tablet_copy_client.cc:538] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:28.082746  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:28.087764 10069 tablet_bootstrap.cc:492] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:28.102101  9291 raft_consensus.cc:1217] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:01:28.133034  9291 raft_consensus.cc:1217] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:28.141006 10069 tablet_bootstrap.cc:492] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:28.142105 10069 tablet_bootstrap.cc:492] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:28.144378 10069 ts_tablet_manager.cc:1403] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.057s	user 0.023s	sys 0.002s
I20260709 13:01:28.147836 10069 raft_consensus.cc:359] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:28.148638 10069 raft_consensus.cc:740] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:28.149296 10069 consensus_queue.cc:260] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:28.151657 10069 ts_tablet_manager.cc:1434] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:01:28.160606  8396 tablet_copy_service.cc:342] P d653e71832b7402b9a03b46249d3b885: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-74f6762ba0124b3a87dd4d54f5693927 received from {username='slave'} at 127.0.0.1:48484
I20260709 13:01:28.161129  8396 tablet_copy_service.cc:434] P d653e71832b7402b9a03b46249d3b885: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-74f6762ba0124b3a87dd4d54f5693927 on tablet 74f6762ba0124b3a87dd4d54f5693927 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:28.279013  9291 raft_consensus.cc:1217] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:28.284538  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:28.346102  8459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:28.346726  8459 raft_consensus.cc:606] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:01:28.350241  8384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:01:28.350805  8384 raft_consensus.cc:606] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:01:28.353709  8535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
mode: GRACEFUL
new_leader_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:40160
I20260709 13:01:28.354254  8535 raft_consensus.cc:606] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Received request to transfer leadership to TS 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:28.355469  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:01:28.357191  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:28.428336  9295 raft_consensus.cc:1217] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:01:28.515733 10041 raft_consensus.cc:993] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:28.516288  9941 raft_consensus.cc:1081] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:28.517851  8535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38892
I20260709 13:01:28.519374  8535 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:28.519723  8535 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:28.527815  8535 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:28.530023  8535 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:28.530134  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:28.530681  8382 raft_consensus.cc:3055] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:28.531176  8382 raft_consensus.cc:740] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:28.531785  8382 consensus_queue.cc:260] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:28.532784  8382 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:28.533469  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:28.534101  8461 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:28.540722  8382 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:28.541982  8501 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:28.542644 10062 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:28.543151 10062 raft_consensus.cc:697] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:28.544024 10062 consensus_queue.cc:237] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:28.549633  8461 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:28.560690  8283 catalog_manager.cc:5697] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 3 to 4, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 4 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.582469 10090 raft_consensus.cc:993] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:28.582988 10025 raft_consensus.cc:1081] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:28.584539  8382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:01:28.585017  8382 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:28.585362  8382 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.590704  8382 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:28.592655  8382 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:28.592932  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:28.593318  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:28.593602  8461 raft_consensus.cc:3055] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:28.593997  8529 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.593954  8461 raft_consensus.cc:740] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:28.594882  8461 consensus_queue.cc:260] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:28.596175  8461 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.604673  8529 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:01:28.606101  8349 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:28.607326  9941 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:28.607828  9941 raft_consensus.cc:697] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:28.608628  9941 consensus_queue.cc:237] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:28.616173  8461 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:01:28.620766  8281 catalog_manager.cc:5697] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 6 to 7, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 7 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.712512 10025 raft_consensus.cc:1064] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:28.715513 10025 consensus_queue.cc:237] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:28.728394  9291 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:28.730057  8382 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:28.730882  8535 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:28.731884 10058 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:28.732715 10048 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:28.739529 10090 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:28.744181  9939 raft_consensus.cc:1064] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
W20260709 13:01:28.744751  9939 raft_consensus.cc:1068] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31: Unable to promote non-voter 446d9310dce14ff4afff2dc2d64f68d8: Service unavailable: leader transfer in progress
I20260709 13:01:28.750530 10090 raft_consensus.cc:2955] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:28.755563  8384 raft_consensus.cc:2955] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:28.771337  8527 raft_consensus.cc:2955] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:28.782783  8281 catalog_manager.cc:5697] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.795708  9295 raft_consensus.cc:2955] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:28.810979  8459 consensus_queue.cc:237] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:28.817147  9295 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:28.817147  8384 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:28.818758 10025 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:28.819607 10090 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:28.828155 10058 raft_consensus.cc:2955] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:28.829408  8384 raft_consensus.cc:2955] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:28.842556  9295 raft_consensus.cc:2955] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:28.847633  8281 catalog_manager.cc:5697] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index 3 to 4, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New cstate: current_term: 1 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:28.859416  8523 tablet_service.cc:1558] Processing DeleteTablet for tablet 37c1890dcc8947c89b8c213326526c75 with delete_type TABLET_DATA_TOMBSTONED (TS b8eb0ad4490645598004d862412f4e31 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38890
I20260709 13:01:28.860844  8270 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 37c1890dcc8947c89b8c213326526c75 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:28.870692 10102 tablet_replica.cc:333] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:01:28.884438 10102 raft_consensus.cc:2243] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:28.885375 10102 raft_consensus.cc:2272] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:28.894076 10102 ts_tablet_manager.cc:1916] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:28.913218 10102 ts_tablet_manager.cc:1929] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:28.913810 10102 log.cc:1199] T 37c1890dcc8947c89b8c213326526c75 P b8eb0ad4490645598004d862412f4e31: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-2-root/wals/37c1890dcc8947c89b8c213326526c75
I20260709 13:01:28.916658  8268 catalog_manager.cc:5028] TS b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): tablet 37c1890dcc8947c89b8c213326526c75 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:28.917290  9939 raft_consensus.cc:993] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31: : Instructing follower 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:28.917740  9939 raft_consensus.cc:1081] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Signalling peer 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:28.919166  8459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:36448
I20260709 13:01:28.919701  8459 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:28.920034  8459 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.926791  8459 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:28.930136  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:28.930721  8382 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.933375  8461 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:28.934518  8459 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:28.934954  9939 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:28.935688  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:28.936282  8529 raft_consensus.cc:3055] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:28.936609  8529 raft_consensus.cc:740] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:28.937364  8382 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:01:28.937376  8529 consensus_queue.cc:260] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:28.938690  8427 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:28.939059  8529 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.940491 10090 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:28.941017 10090 raft_consensus.cc:697] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:28.942140 10090 consensus_queue.cc:237] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:28.956072  8529 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:01:28.971024  8281 catalog_manager.cc:5697] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 1 to 2, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.982453  9982 raft_consensus.cc:1064] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:28.986513  9982 consensus_queue.cc:237] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:28.991779  9295 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Advancing to term 4
I20260709 13:01:28.997697  8382 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:29.000130  9295 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEARNER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:29.001735 10062 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:29.012521  9939 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:29.048332 10062 raft_consensus.cc:1064] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:29.076443  8527 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:29.079429 10062 consensus_queue.cc:237] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:29.081827  9941 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:29.100219  8527 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:29.100522  9295 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEARNER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:29.102609  8459 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:29.102739  9291 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:29.103447  9939 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:29.105857  9941 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:29.106585 10041 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:29.116784  8459 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:29.119268  9939 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:29.128768 10041 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:01:29.133095  8382 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:29.133069  8460 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:29.145258 10062 raft_consensus.cc:2955] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.148764 10114 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:29.153491  9939 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:29.166141  8382 raft_consensus.cc:2955] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.190120  8460 raft_consensus.cc:2955] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:01:29.241951  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 121327us
I20260709 13:01:29.242830  9293 raft_consensus.cc:2955] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.251047  8283 catalog_manager.cc:5697] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index 4 to 6, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:29.292079 10117 raft_consensus.cc:2955] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.308658  9291 raft_consensus.cc:2955] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.323220  8527 raft_consensus.cc:2955] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.329249  8283 catalog_manager.cc:5697] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.344420  8460 raft_consensus.cc:2955] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.347016  9291 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Advancing to term 2
I20260709 13:01:29.351696  8382 consensus_queue.cc:237] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:29.358434  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:29.359119  9293 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:29.361601  9982 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:29.365865  8529 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:29.367477  8535 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:29.369441 10090 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:29.371351  9941 raft_consensus.cc:2955] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.372893  9293 raft_consensus.cc:2955] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.385035 10117 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:29.387104  8283 catalog_manager.cc:5697] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 4 to 5, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.392050  8271 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 74f6762ba0124b3a87dd4d54f5693927 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:29.393133  8382 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:29.395807 10101 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:29.399250  8529 raft_consensus.cc:2955] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.405793  9291 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEARNER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:29.411710  8448 tablet_service.cc:1558] Processing DeleteTablet for tablet 74f6762ba0124b3a87dd4d54f5693927 with delete_type TABLET_DATA_TOMBSTONED (TS 105d6581548546b98eddd4ee7083bb12 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36438
I20260709 13:01:29.411984 10090 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:29.430475 10124 tablet_replica.cc:333] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:01:29.435989 10124 raft_consensus.cc:2243] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.437114 10124 raft_consensus.cc:2272] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.444662 10124 ts_tablet_manager.cc:1916] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:29.468497 10124 ts_tablet_manager.cc:1929] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:01:29.469070 10124 log.cc:1199] T 74f6762ba0124b3a87dd4d54f5693927 P 105d6581548546b98eddd4ee7083bb12: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-1-root/wals/74f6762ba0124b3a87dd4d54f5693927
I20260709 13:01:29.478965 10025 raft_consensus.cc:1064] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:29.484833  8270 catalog_manager.cc:5028] TS 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): tablet 74f6762ba0124b3a87dd4d54f5693927 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:29.506278 10025 consensus_queue.cc:237] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:29.526290  8527 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:29.526401  9291 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEARNER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:29.528120 10048 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:29.528882 10126 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:29.538318  8382 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:29.538709 10126 raft_consensus.cc:2955] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.541559  9291 raft_consensus.cc:2955] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.545818 10025 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:29.551281  8382 raft_consensus.cc:2955] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.569906  8527 raft_consensus.cc:2955] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.570528  8284 catalog_manager.cc:5697] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 2 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.600061  8460 consensus_queue.cc:237] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:29.607734  8527 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:29.607740  9291 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:29.609680 10048 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:29.611860 10126 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:29.616739 10127 raft_consensus.cc:2955] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.619022  8527 raft_consensus.cc:2955] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.637807  8270 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b3aa2530ec1a42c890e68f3e67582ca0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:29.637951  9293 raft_consensus.cc:2955] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.650422  8283 catalog_manager.cc:5697] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index 4 to 5, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New cstate: current_term: 2 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:29.666198  8373 tablet_service.cc:1558] Processing DeleteTablet for tablet b3aa2530ec1a42c890e68f3e67582ca0 with delete_type TABLET_DATA_TOMBSTONED (TS d653e71832b7402b9a03b46249d3b885 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:59326
I20260709 13:01:29.682996 10128 tablet_replica.cc:333] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:01:29.684095 10128 raft_consensus.cc:2243] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.684875 10128 raft_consensus.cc:2272] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.688545 10128 ts_tablet_manager.cc:1916] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:29.708690 10128 ts_tablet_manager.cc:1929] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:01:29.709215 10128 log.cc:1199] T b3aa2530ec1a42c890e68f3e67582ca0 P d653e71832b7402b9a03b46249d3b885: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-0-root/wals/b3aa2530ec1a42c890e68f3e67582ca0
I20260709 13:01:29.712018  8271 catalog_manager.cc:5028] TS d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): tablet b3aa2530ec1a42c890e68f3e67582ca0 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:29.726511  8527 consensus_queue.cc:237] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:29.731562  9293 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:29.731735  8382 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:29.733141 10062 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:29.735610 10062 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:29.746511  9939 raft_consensus.cc:2955] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.749745  8382 raft_consensus.cc:2955] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.753716  9293 raft_consensus.cc:2955] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:29.761175  8268 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 28d98f2932e74257b6a032b544f7b4bd with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:29.765784  8281 catalog_manager.cc:5697] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index 6 to 7, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New cstate: current_term: 4 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:29.781672  8448 tablet_service.cc:1558] Processing DeleteTablet for tablet 28d98f2932e74257b6a032b544f7b4bd with delete_type TABLET_DATA_TOMBSTONED (TS 105d6581548546b98eddd4ee7083bb12 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:36438
I20260709 13:01:29.782892 10124 tablet_replica.cc:333] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:01:29.784046 10124 raft_consensus.cc:2243] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.784942 10124 raft_consensus.cc:2272] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.790110 10124 ts_tablet_manager.cc:1916] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:29.811275  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:29.811395 10124 ts_tablet_manager.cc:1929] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:01:29.812139 10124 log.cc:1199] T 28d98f2932e74257b6a032b544f7b4bd P 105d6581548546b98eddd4ee7083bb12: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-1-root/wals/28d98f2932e74257b6a032b544f7b4bd
I20260709 13:01:29.815166  8270 catalog_manager.cc:5028] TS 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): tablet 28d98f2932e74257b6a032b544f7b4bd (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:01:29.857261  8382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:01:29.857800  8382 raft_consensus.cc:606] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:01:29.860944  8460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30e70dfc88914a66b000a84bef302149"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:29.861533  8460 raft_consensus.cc:606] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:01:29.865262  8535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
mode: GRACEFUL
new_leader_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:40160
I20260709 13:01:29.865870  8535 raft_consensus.cc:606] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Received request to transfer leadership to TS 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:29.868305  8460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:29.868857  8460 raft_consensus.cc:606] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Received request to transfer leadership to TS 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:29.871368  8535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
mode: GRACEFUL
new_leader_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:40160
I20260709 13:01:29.871786  8535 raft_consensus.cc:606] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Received request to transfer leadership to TS 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:29.872853  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:29.874265  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:30.027460 10127 raft_consensus.cc:993] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:30.028000 10126 raft_consensus.cc:1081] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:30.030055  8384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30e70dfc88914a66b000a84bef302149"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:01:30.030532  8384 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:30.030820  8384 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:30.036048  8384 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:30.037936  8384 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:30.038909  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:30.039086  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:30.039455  8527 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:30.039752  8454 raft_consensus.cc:3055] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:30.040056  8454 raft_consensus.cc:740] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:30.040741  8454 consensus_queue.cc:260] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:30.041904  8454 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:30.046259  8527 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:30.046447  8454 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:30.047590  8349 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:30.048307  9982 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:30.048758  9982 raft_consensus.cc:697] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:30.049531  9982 consensus_queue.cc:237] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:30.059937  8284 catalog_manager.cc:5697] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 3 to 4, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 4 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:30.071503  9939 raft_consensus.cc:993] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31: : Instructing follower 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:30.072026 10113 raft_consensus.cc:1081] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Signalling peer 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:30.074016  8460 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:36448
I20260709 13:01:30.074679  8460 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:30.075063  8460 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:30.083657  8460 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:30.086447  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:30.086688  8460 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:30.087172  8384 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:30.088722  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:30.090508  8527 raft_consensus.cc:3055] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:30.090854  8527 raft_consensus.cc:740] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:30.091634  8527 consensus_queue.cc:260] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:30.092770  8527 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:30.094504  8384 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:30.095803  8427 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:30.096726 10127 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:30.097299 10127 raft_consensus.cc:697] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:30.098248 10127 consensus_queue.cc:237] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:30.099171  8527 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:30.108636  8284 catalog_manager.cc:5697] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 2 to 3, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:30.112591 10126 raft_consensus.cc:993] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower 446d9310dce14ff4afff2dc2d64f68d8 to start an election
I20260709 13:01:30.113199 10127 raft_consensus.cc:1081] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Signalling peer 446d9310dce14ff4afff2dc2d64f68d8 to start an election
I20260709 13:01:30.116498  9291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0"
dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
 from {username='slave'} at 127.0.0.1:55734
I20260709 13:01:30.117165  9291 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:30.117538  9291 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:30.125741  9291 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:30.128276  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:30.128428  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:30.128901  8454 raft_consensus.cc:3055] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:30.129055  8527 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:30.129313  8454 raft_consensus.cc:740] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:30.132195  8454 consensus_queue.cc:260] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:30.133379  8454 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:30.138019  8527 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
I20260709 13:01:30.127954  9291 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:30.142331  8454 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
I20260709 13:01:30.144426  9260 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:30.145324 10129 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:30.146064 10129 raft_consensus.cc:697] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:30.146935 10129 consensus_queue.cc:237] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:30.157233  8284 catalog_manager.cc:5697] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 2 to 3, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 3 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:30.214951 10117 raft_consensus.cc:993] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:30.215479 10131 raft_consensus.cc:1081] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:30.217221  8527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38892
I20260709 13:01:30.217746  8527 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:30.218087  8527 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:30.223483  8527 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:30.224997  8527 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:30.225884  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:30.225945  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:30.226547  8384 raft_consensus.cc:3055] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:30.226608  8460 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:30.226881  8384 raft_consensus.cc:740] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:30.227690  8384 consensus_queue.cc:260] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:30.228768  8384 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:30.232538  8460 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:01:30.233637  8500 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:30.233875  8384 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:01:30.234375 10119 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:30.234908 10119 raft_consensus.cc:697] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 8 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:30.235713 10119 consensus_queue.cc:237] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:30.245568  8284 catalog_manager.cc:5697] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 7 to 8, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 8 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:30.359403 10113 raft_consensus.cc:993] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31: : Instructing follower 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:30.359897  9939 raft_consensus.cc:1081] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Signalling peer 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:30.361478  8460 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:36448
I20260709 13:01:30.361929  8460 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:30.362197  8460 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:30.367031  8460 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:30.369709  8460 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:30.370165  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:30.370398  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:30.370790  9291 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:30.371014  8535 raft_consensus.cc:3055] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:30.371412  8535 raft_consensus.cc:740] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:30.372386  8535 consensus_queue.cc:260] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:30.373365  8535 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:30.380637  9291 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:01:30.382562  8426 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:30.382949  8535 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:01:30.383910 10126 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:30.384465 10126 raft_consensus.cc:697] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:30.385439 10126 consensus_queue.cc:237] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:30.641603  8527 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:30.644464  8461 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:01:30.697268  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 45167.2us
I20260709 13:01:30.854410 10142 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:01:31.147161  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 492502us
I20260709 13:01:31.148733  8384 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:01:31.349220  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 485099us
I20260709 13:01:31.507309 10146 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:31.508030 10146 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.639034 10150 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:31.640921 10145 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:31.641585 10145 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:31.642122  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 1602) took 1001 ms. Trace:
I20260709 13:01:31.642608  8533 rpcz_store.cc:276] 0709 13:01:30.640953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.641138 (+1000185us) service_pool.cc:224] Handling call
0709 13:01:31.641470 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.641663 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:31.641690 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:31.641730 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:31.641761 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.641816 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.641946 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:31.644477 10150 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.651678 10146 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:31.651978 10150 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.652307 10146 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:31.652468 10150 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:31.652837 10146 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:31.652961 10150 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.654731 10147 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:31.655267 10150 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:31.655862 10150 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:31.656067 10146 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.655694 10147 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:31.656585 10146 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:31.656443 10150 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.657141 10146 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.661950 10149 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:31.662465 10145 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.662729 10149 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.664789 10151 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:31.665459 10151 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.665871 10129 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:31.666497 10129 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.666960 10146 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:31.667892 10151 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.668673 10129 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:31.670127 10147 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.663715 10145 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:01:31.674769 10150 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.676034 10149 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:31.680128  8349 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.001s	sys 0.004s
W20260709 13:01:31.680514  8349 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.001s	sys 0.004s
I20260709 13:01:31.682958 10117 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:31.683178 10144 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:31.683588 10117 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:31.683758 10144 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:31.685972 10117 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.686213 10144 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.687834 10127 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:31.688465 10127 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:31.688856  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 1.03238e+06us
I20260709 13:01:31.690867 10127 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:31.696048 10154 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:31.696990 10150 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:31.698376 10150 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.700452  8459 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:31.700446 10150 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:01:31.697309  8556 debug-util.cc:398] Leaking SignalData structure 0x7b08002626a0 after lost signal to thread 7274
I20260709 13:01:31.702068  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:31.702456  8556 debug-util.cc:398] Leaking SignalData structure 0x7b0800288360 after lost signal to thread 8318
I20260709 13:01:31.703213 10141 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:31.696635 10154 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:31.703732 10141 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:31.704109  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:31.704772 10119 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:31.705317 10119 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.705741  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:31.706120 10141 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:31.707352 10119 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:31.707508 10141 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:31.707893 10119 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:31.708081  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:31.708001 10141 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.708390 10119 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.709584  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:31.710471 10141 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:31.710918  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:31.714000 10154 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:31.716291  9982 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:31.716768  9982 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:31.717146 10151 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:31.718650  9982 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.719000 10151 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:31.719553 10151 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.721626 10151 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:31.723263  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:31.733991  9939 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:31.734761  9939 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.736578 10119 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:31.736724  9939 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:31.737236 10154 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:31.749608 10154 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:31.750366 10117 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:31.751031 10117 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.752008 10154 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:31.737697 10141 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:31.752795 10141 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:31.754180 10144 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:31.754958 10144 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:31.755605 10141 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:31.741498 10159 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:31.743925 10150 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:31.761027 10150 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.764283 10150 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.765645 10159 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.768111 10159 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:31.774871  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:31.776872  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:31.780393 10151 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:31.781054 10151 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.785526  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:31.786420  8382 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:01:31.787664 10151 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.782233 10148 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:31.789543 10148 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.792168 10148 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:31.803344  8351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.105s	user 0.010s	sys 0.010s
W20260709 13:01:31.803906  8351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.106s	user 0.010s	sys 0.010s
W20260709 13:01:31.804271  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 1.10604e+06us
I20260709 13:01:31.807844 10148 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:31.809331 10148 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:31.809897 10148 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.816409 10156 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:31.818120 10156 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.820425 10156 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:31.817515 10148 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:31.836395  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:31.838927  8380 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:31.840649 10148 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:31.843668 10148 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:31.844657 10139 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:31.845337 10139 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.847371 10160 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:31.847991 10160 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.848922 10148 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.850320 10160 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.844750 10162 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:31.851338 10162 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:31.852320 10155 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.852847 10155 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:31.855043 10162 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.855585 10155 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:31.855685 10160 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:31.856530 10160 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.858933 10160 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:31.858634 10139 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:31.868309 10139 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:31.868930 10139 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:31.871496 10139 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.873950 10146 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.874366 10152 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:31.874477 10146 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:31.875038 10152 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:31.877363 10146 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.877925 10152 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.880376  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:31.880570  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:31.884485  8427 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:31.894696  9982 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:31.908571  9982 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.910846  9982 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:31.896919  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:31.911348 10151 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:31.911985 10151 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.913820 10149 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:31.914304 10149 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:31.914710 10149 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:31.914794 10151 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.915479 10151 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:01:31.916263  8556 debug-util.cc:398] Leaking SignalData structure 0x7b080003c000 after lost signal to thread 8410
I20260709 13:01:31.915952 10151 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.918773 10151 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.921375  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:31.924010  8556 debug-util.cc:398] Leaking SignalData structure 0x7b080020ed40 after lost signal to thread 8485
W20260709 13:01:31.925289  8556 debug-util.cc:398] Leaking SignalData structure 0x7b08002d4b60 after lost signal to thread 8559
W20260709 13:01:31.930025  8556 debug-util.cc:398] Leaking SignalData structure 0x7b0800353440 after lost signal to thread 9320
I20260709 13:01:31.933467 10151 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:31.934230 10151 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.936059  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:31.939591 10151 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.944370 10146 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:31.953922  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:31.956207 10151 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:31.957166 10139 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:31.957638 10151 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.958232 10139 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.947945  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:31.964964  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:31.975754  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:31.956725 10146 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:31.974884  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:31.978662  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:31.979411 10151 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.980921  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:31.982275  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:31.982118 10149 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.983484  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:31.985069 10147 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:31.956104 10144 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.985647 10147 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:31.987551 10146 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:31.987675 10147 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:31.989317 10149 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:31.979507 10139 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:31.990010  8453 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:31.990967  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:31.991559  8458 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:31.991621  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:31.992401  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.001689  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.002540  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:32.003891  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.004747  8379 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:01:32.007534 10156 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:32.007673 10159 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:32.008159  8427 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:32.008389 10159 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:32.026017 10117 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:32.010174  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.008268 10156 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:32.026661 10159 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:32.027204 10159 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:32.027657 10159 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:32.028450 10156 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:32.020498 10165 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:32.012288 10113 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:32.008167 10154 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:32.029251 10113 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:32.031512 10113 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:32.011811 10155 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:32.032227 10155 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:32.032562  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.012718 10141 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:32.034337 10159 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:32.035966  8526 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:32.029327 10154 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:32.037521  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.040211  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.040318  8532 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:32.040894  8526 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 2.
I20260709 13:01:32.037606  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.025775  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.041950  8527 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 1.
I20260709 13:01:32.036791  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.034777  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.041975  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.044443  8535 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 1.
I20260709 13:01:32.041536  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.038596  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.042791  8529 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
I20260709 13:01:32.041497 10154 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:32.046258  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 54163.4us
I20260709 13:01:32.044173  8534 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:01:32.059688  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.060743  9295 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:32.062067  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.062772  8530 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:32.063994  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.064232 10131 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.065146  8351 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:32.034348 10155 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:32.064744 10131 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:32.047367 10149 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:32.074395 10140 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:32.084164 10140 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:32.084612 10140 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:32.034605 10141 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:32.062105 10151 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:32.091455  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.091743 10151 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:32.092275  8531 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:01:32.094318 10151 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:32.097393  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.086918 10155 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.098292 10155 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:32.099063  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:32.100423 10155 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:32.089814 10141 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:32.073310 10143 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:32.088899  8379 consensus_queue.cc:237] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:32.102594 10143 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:32.103483 10117 consensus_queue.cc:1175] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "105d6581548546b98eddd4ee7083bb12" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 13:01:32.105718  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.105834  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.108645 10141 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:32.071593 10149 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:32.109328 10141 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:32.109719 10149 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.111394 10141 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:32.108141 10155 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.112329 10155 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:32.116358  9288 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:32.119453 10143 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:32.123520  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:32.124595  8460 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:32.125541  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.125433  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:32.126415  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.127656  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:32.128166  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:32.130862 10100 consensus_queue.cc:1059] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:32.132393 10100 raft_consensus.cc:3055] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:32.133926  8527 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:32.132980 10100 raft_consensus.cc:740] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:32.133170  8530 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:32.135867 10160 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:32.136606 10160 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:32.137318  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.140196 10100 consensus_queue.cc:260] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:32.142380 10100 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.142967  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:32.055783 10165 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:32.195742  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.188818  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.347296  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.347591  8528 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:32.163568  8284 catalog_manager.cc:5697] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 1 to 2, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:32.149708 10126 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:32.349912  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.350531 10126 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:32.279196  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.281024  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:32.353857  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:01:32.279029  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 132843us
I20260709 13:01:32.150612  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.354679  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.281867  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.150046 10160 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:32.340440  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.162122 10141 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:32.357036 10141 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:32.358253 10126 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:32.359537 10141 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:32.257973 10154 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:01:32.341450  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.341976  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.319943 10150 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.365617  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.152297 10153 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:32.155185 10145 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:32.162542 10143 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:32.361747  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.372386 10153 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:32.370239 10150 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:32.374768 10153 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:32.375051  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.375376 10145 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:32.364336  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.374790 10150 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:32.165424 10155 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:32.378001  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.379540 10143 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:32.149837  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.381773 10143 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:32.184969 10149 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:32.383074 10165 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:32.150208  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.368636  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.368624  8424 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.370311  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.375650 10131 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:32.175065 10140 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:32.384827 10135 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:32.386938  8456 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:32.387539  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.388321  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.340762  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:01:32.390334  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 174881us
I20260709 13:01:32.390611  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:32.396221  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.386425  9258 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:32.403383  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.405587  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.408597  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.412237  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.413033  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.413237  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.416658  8424 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.417455  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.419795  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.395619 10153 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:32.424357  8424 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.427362  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.399372 10147 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.409026 10151 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:32.431382  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.407622 10165 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:32.428828  9295 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:32.434552  9939 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:32.432516  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:32.429692  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:32.435144  9939 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:32.431687  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.430670  9261 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.438381  9939 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:32.438565  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.421052 10139 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:32.423297  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.423077 10146 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:32.395941 10135 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:32.430334 10153 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:32.434988 10147 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:32.440768 10165 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:32.487386  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.440177 10131 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:32.488744  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.488334 10149 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:32.440124 10127 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:01:32.490510  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 60048.4us
I20260709 13:01:32.447497 10151 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:32.521226  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.508741 10131 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:32.521859 10131 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.522311  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.523049 10165 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:32.497332 10140 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:32.524945 10145 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:32.508665 10127 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:32.496832 10146 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:32.518961 10153 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:32.520722 10147 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:32.509171  9261 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.544129  9261 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.545645  9261 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.546391 10100 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:32.547114 10100 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:32.547853 10100 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:32.526152  8351 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:01:32.536969  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 112683us
I20260709 13:01:32.537298 10176 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:32.551479 10143 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:32.551929 10143 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:32.552331 10143 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:32.554311 10173 log.cc:927] Time spent T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:01:32.555944 10135 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:32.497179 10139 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:32.542356 10146 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:32.563577  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:32.539631  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 112365us
I20260709 13:01:32.542090 10127 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.563460  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.565866  9261 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.566651  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.567340  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.572428 10146 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:32.574929  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.576498  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.577159  8424 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.579701 10146 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:32.579891 10135 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:32.582235 10147 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:32.583861  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:01:32.536736  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 150362us
I20260709 13:01:32.585104  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.586383  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:32.560943 10139 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:32.587745  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:32.587890  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:32.588157  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.588521  8454 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:32.588379  8456 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:01:32.584038 10147 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:32.589426 10157 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:32.591666  9258 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:32.592190  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:32.592635  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 167149us
I20260709 13:01:32.593001  8384 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:01:32.592075  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.594777  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.596716 10151 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:32.596789  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.597035  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.597323 10151 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:32.599308 10151 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:32.601369  8424 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.605760  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.606170 10127 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:32.610975  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:32.611182  9258 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:32.612916  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:32.616159  9258 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.617987  9258 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.619494  8424 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.621171  8424 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.622325  8424 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.620515 10129 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:32.625449  8427 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:32.627988  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.630086  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.631255  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.631567  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:32.632139  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.633054  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.640261  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:32.640935  8454 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:32.642650  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.646137  8461 raft_consensus.cc:1240] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:32.617730 10160 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:32.641782  8351 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:32.653216  8454 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:32.655380  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.655539  9258 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:32.658033  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.658556  8351 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:32.659415 10181 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:32.627312 10145 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:32.614154 10131 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:32.689249  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.629029 10157 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:32.626698 10129 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:32.648581 10139 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:32.620275 10135 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:01:32.699640  8528 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:32.687844  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.709537  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:32.710140 10175 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:32.623474 10143 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:32.710475  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:32.712018 10150 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:32.704092 10129 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.727629  8460 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:32.653640 10160 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:32.715399  8459 raft_consensus.cc:1240] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:32.710541 10178 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:32.688550 10144 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:32.713878 10131 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:32.698091 10157 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:32.692559 10145 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:32.743177  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.730556  8351 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:32.736303  9982 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:32.726784  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 103406us
I20260709 13:01:32.747974  8426 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.737951  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.738933  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.751626  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.753960  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.756511  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.729557 10160 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.758914  8426 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:32.761005  8426 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:32.761888  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.729723 10144 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:32.745651 10157 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:32.762394  8426 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:32.744642 10145 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:32.781442  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.783207  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:01:32.766153  8407 debug-util.cc:398] Leaking SignalData structure 0x7b080017aca0 after lost signal to thread 7274
I20260709 13:01:32.735954 10117 consensus_queue.cc:1059] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:01:32.786130  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.786280 10184 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:32.747319 10127 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:32.761053 10149 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:32.788271  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:32.759764 10140 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:32.806252  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.806195 10185 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:32.779425 10144 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:32.807914  9294 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:32.811951  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.789561 10135 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:32.787772 10163 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:32.792230 10139 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:32.797909 10184 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:32.842931  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 187436us
I20260709 13:01:32.786716 10148 consensus_queue.cc:1059] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
W20260709 13:01:32.850824  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 88503.9us
I20260709 13:01:32.850983  9258 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:32.851724  8426 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:01:32.847582  8407 debug-util.cc:398] Leaking SignalData structure 0x7b08001a40a0 after lost signal to thread 8318
I20260709 13:01:32.854306  8426 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.856752  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:32.860046  9258 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.861049  8426 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.861756  9258 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:32.864876 10139 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:01:32.867225  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 79168.2us
W20260709 13:01:32.868583  8351 consensus_peers.cc:597] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 56cc480ba6f642e08bb2e547a0ef50a1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:32.849423 10184 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:32.818579 10151 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:32.852852 10143 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:32.878082  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:32.878945  8460 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 3: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:32.878973  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:32.882918  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:32.883610  8384 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:32.861380 10135 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:32.862449 10150 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:32.866964 10165 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:32.875581 10163 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:32.900415  8407 debug-util.cc:398] Leaking SignalData structure 0x7b080035e0c0 after lost signal to thread 8410
I20260709 13:01:32.892496 10148 raft_consensus.cc:3055] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:32.901120 10194 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:32.903990  9982 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:32.872022 10183 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:32.929639  9982 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:32.932426  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 272785us
W20260709 13:01:32.938653  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 68315.7us
I20260709 13:01:32.871821 10178 consensus_queue.cc:1059] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:01:32.915921 10140 raft_consensus.cc:697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:32.917387 10148 raft_consensus.cc:740] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:32.931171 10183 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:32.911257 10165 raft_consensus.cc:697] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:32.973629  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:33.012544  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:33.014098  8460 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:33.015302  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:32.975196  8407 debug-util.cc:398] Leaking SignalData structure 0x7b080013b0e0 after lost signal to thread 8485
I20260709 13:01:33.023618  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:33.030537  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.975559 10183 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.035982  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:33.022099 10150 consensus_queue.cc:1059] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:01:33.149809  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:33.077596 10164 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:33.105929  8407 debug-util.cc:398] Leaking SignalData structure 0x7b080034b7c0 after lost signal to thread 8559
W20260709 13:01:33.151990  8407 debug-util.cc:398] Leaking SignalData structure 0x7b08000f0540 after lost signal to thread 9320
W20260709 13:01:33.117425 10182 log.cc:927] Time spent T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
W20260709 13:01:33.077739 10180 log.cc:927] Time spent T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c: Append to log took a long time: real 0.189s	user 0.002s	sys 0.000s
I20260709 13:01:33.105482 10165 consensus_queue.cc:237] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:33.049691 10140 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.126384  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:33.038285 10196 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.133s
W20260709 13:01:33.099171 10186 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:01:33.163833  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:33.175930  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:33.178792  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 374003us
I20260709 13:01:33.178951  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:33.177913  9982 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.190769  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:33.099496 10148 consensus_queue.cc:260] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:33.196424  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 334711us
I20260709 13:01:33.184149  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:33.186136 10151 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:33.206414  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:33.207082  9258 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:33.210940  9258 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:33.226104 10129 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:33.212361 10148 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.227877  9293 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:33.240912 10209 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:33.242188 10129 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:33.246527 10188 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:33.246544 10212 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:33.247164 10188 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:33.242654 10160 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:33.253538 10188 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.242199 10209 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.261386 10209 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:33.261478 10184 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.264025 10184 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:33.295338  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:33.297554  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 85441.6us
I20260709 13:01:33.299564  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:33.300324  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:33.301163  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 441338us
I20260709 13:01:33.301782  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:33.307174 10144 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.311362 10144 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:33.301808  8460 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:33.313681 10157 consensus_meta.cc:287] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.526s	user 0.008s	sys 0.002s
I20260709 13:01:33.315550 10160 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:33.319562  8349 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:33.315934  8384 raft_consensus.cc:1240] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:33.331791  9288 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:33.314728 10157 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:33.333617 10184 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:33.334280  9294 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:33.334558 10184 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.335687 10157 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:33.296535  8424 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:33.263811 10183 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:33.303303  8500 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:33.353679  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:33.359156 10127 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:33.360309 10127 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.357354 10201 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:33.366161  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 63124.1us
I20260709 13:01:33.366295  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:33.367298 10200 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:33.367718  8500 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:33.368973  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:33.371702 10214 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:33.366042 10210 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:33.356719 10184 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:33.376137 10183 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:33.379150  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 60238.9us
I20260709 13:01:33.379930  9289 raft_consensus.cc:1240] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:33.380343  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:33.386605  8459 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:33.387070 10209 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:33.388128 10209 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.389595  8452 raft_consensus.cc:1240] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:33.392617 10127 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:33.394692  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:01:33.396255  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 100286us
I20260709 13:01:33.398149  8424 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:33.400427 10147 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:33.400893  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:33.401854  8500 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:33.402127  8380 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:01:33.405310  8454 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:33.396621  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:33.411439 10142 raft_consensus.cc:3055] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:33.412035 10142 raft_consensus.cc:740] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:33.412535  9289 raft_consensus.cc:1240] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:33.413254 10143 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:33.414023  9982 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:33.421743  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:33.413736 10142 consensus_queue.cc:260] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.426926  8424 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:33.431190 10184 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:33.427372  8427 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:01:33.429512  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 67916.2us
I20260709 13:01:32.909905  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:33.444841  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:33.447880  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:33.442586  8284 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53486 (request call id 330) took 1443 ms. Trace:
I20260709 13:01:33.450856  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:33.452154 10220 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:33.414283 10143 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.456862  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:33.457247 10195 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:33.459353  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 79271.8us
I20260709 13:01:33.460254 10142 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.465247 10194 raft_consensus.cc:3055] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:33.465866 10194 raft_consensus.cc:740] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:33.466789  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:33.467581  8379 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:33.466362  8349 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:33.470674  9982 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:33.472185  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:01:33.472381  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 45117.4us
I20260709 13:01:33.472523  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:33.474650 10176 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.474939 10209 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:33.475157 10176 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:33.475651 10176 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.450793 10157 consensus_queue.cc:1059] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:01:33.449244  8284 rpcz_store.cc:276] 0709 13:01:31.999068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.011919 (+ 12851us) service_pool.cc:224] Handling call
0709 13:01:33.442241 (+1430322us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:32.440208 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:32.485935 (+ 45727us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:32.485988 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:01:32.486018 (+    30us) tablet.cc:662] Decoding operations
0709 13:01:32.487122 (+  1104us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:32.487205 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:32.487243 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:01:32.487438 (+   195us) tablet.cc:701] Row locks acquired
0709 13:01:32.487457 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:01:32.487623 (+   166us) write_op.cc:270] Start()
0709 13:01:32.487732 (+   109us) write_op.cc:276] Timestamp: P: 1783602092487577 usec, L: 0
0709 13:01:32.487754 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:01:32.502916 (+ 15162us) log.cc:844] Serialized 533 byte log entry
0709 13:01:33.252899 (+749983us) op_driver.cc:464] REPLICATION: finished
0709 13:01:33.266673 (+ 13774us) write_op.cc:301] APPLY: starting
0709 13:01:33.266739 (+    66us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:33.266808 (+    69us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:33.266894 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:33.267054 (+   160us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:33.267159 (+   105us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:01:33.267185 (+    26us) write_op.cc:312] APPLY: finished
0709 13:01:33.267333 (+   148us) log.cc:844] Serialized 23 byte log entry
0709 13:01:33.267446 (+   113us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:33.267500 (+    54us) write_op.cc:454] Released schema lock
0709 13:01:33.267524 (+    24us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:33.267738 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:33.267754 (+    16us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":54490,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":13578,"apply.run_cpu_time_us":1069,"apply.run_wall_time_us":1068,"num_ops":1,"prepare.queue_time_us":78202,"prepare.run_cpu_time_us":15648,"prepare.run_wall_time_us":158452,"raft.queue_time_us":37630,"raft.run_cpu_time_us":2211,"raft.run_wall_time_us":13760,"replication_time_us":765001,"thread_start_us":185699,"threads_started":4,"wal-append.queue_time_us":123774}]]}
I20260709 13:01:33.498477  8382 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:33.472204  8349 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:33.501322  8424 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:33.508428  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:33.510223  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:33.510988  8384 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:33.513124 10147 consensus_queue.cc:1059] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:33.515070 10165 raft_consensus.cc:3055] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:33.515504 10165 raft_consensus.cc:740] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:33.531186 10163 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:33.534322  8427 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:33.535084  8459 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:01:33.537107 10139 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:33.531188  9258 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:01:33.540800  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 86926.9us
I20260709 13:01:33.541939  8424 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:33.544019  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 71983.1us
I20260709 13:01:33.543907  8424 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:33.547308 10139 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:33.547976 10139 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:33.548463 10139 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:33.549068 10153 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:33.549721  9258 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:01:33.551831 10145 consensus_meta.cc:287] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.763s	user 0.009s	sys 0.009s
I20260709 13:01:33.552269 10145 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.553368 10129 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:33.553800 10195 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:33.554368  8456 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:33.554744 10145 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:33.555387 10202 consensus_queue.cc:1059] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:01:33.550956  9258 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:33.556519 10202 raft_consensus.cc:3055] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:33.556907 10202 raft_consensus.cc:740] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:01:33.563490  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 162041us
I20260709 13:01:33.516660 10165 consensus_queue.cc:260] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:33.567796 10153 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:33.557874 10202 consensus_queue.cc:260] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:33.570276 10165 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.570194 10202 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:33.531937 10163 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:33.577318  8349 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:33.582131  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:33.560264 10157 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:33.589782  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:33.591934 10198 consensus_queue.cc:1059] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:01:33.594174 10194 consensus_queue.cc:260] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:33.583638 10163 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:33.605193 10191 consensus_queue.cc:1059] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:01:33.606446 10191 raft_consensus.cc:3055] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:33.606854 10191 raft_consensus.cc:740] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:33.605449  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:01:33.609462  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.604879 10194 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:33.598678 10195 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:33.619829 10143 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:33.623766  8500 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:33.621253  8283 catalog_manager.cc:5697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 3 to 4, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 4 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:33.633462 10224 ts_tablet_manager.cc:933] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631)
W20260709 13:01:33.635030  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 91318.4us
I20260709 13:01:33.637562 10119 raft_consensus.cc:3055] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:33.638113 10119 raft_consensus.cc:740] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:01:33.638777  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 61675.6us
I20260709 13:01:33.609615 10191 consensus_queue.cc:260] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.639389 10119 consensus_queue.cc:260] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.643093 10220 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:33.644647 10150 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:33.649765 10191 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:33.639920 10176 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.652016  8424 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:33.657646 10119 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:33.658207  8349 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:33.659250 10143 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:33.660914 10188 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:33.662870 10222 log.cc:927] Time spent T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:01:33.663043  9292 raft_consensus.cc:1240] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:33.667876  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 65049.9us
I20260709 13:01:33.668036 10165 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:33.665668  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:33.666250  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:33.664916 10188 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:33.677975 10145 consensus_queue.cc:1059] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:33.680256 10127 raft_consensus.cc:3055] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:33.680730 10127 raft_consensus.cc:740] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:33.681798 10143 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:33.681757 10127 consensus_queue.cc:260] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:33.681921  9258 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:33.684100 10188 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:33.684423 10127 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.689556  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:33.650731 10139 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.696834 10143 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:33.697574 10143 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:33.701100  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.701637  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:33.702513  8382 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:33.704481 10139 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:33.699647 10143 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:33.693625 10176 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:33.715117 10148 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:33.716185  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:33.719797 10148 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:33.720254  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 73805.3us
I20260709 13:01:33.722294  8500 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:33.726985  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:33.726634 10220 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:33.740447  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:33.737533  8500 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:33.742456  8424 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:33.746398 10224 tablet_copy_client.cc:323] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.193:43631
I20260709 13:01:33.753273 10153 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:33.755355  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:33.755606 10119 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:33.765789  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.768936  8424 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:33.755896 10148 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:33.770780 10143 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:33.779143 10192 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:33.782040  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 44579.6us
I20260709 13:01:33.783264  8500 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:33.784165 10191 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:33.784862  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:33.785933  8500 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:33.787783 10220 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:33.788166 10220 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:33.788499 10220 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:33.790875 10143 consensus_queue.cc:1059] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:33.792089 10148 raft_consensus.cc:3055] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:33.792474 10148 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:33.793495 10148 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:33.795696 10148 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:33.797331 10119 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:33.800995 10220 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:33.803104  8382 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:33.804558  8427 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:33.805569 10127 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:33.806257 10127 raft_consensus.cc:697] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:33.807129 10220 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:33.808022  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 44767.4us
I20260709 13:01:33.812830 10119 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:33.807277 10127 consensus_queue.cc:237] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.814782 10143 consensus_queue.cc:1059] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:33.813645 10119 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:33.815701  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.816113 10163 raft_consensus.cc:3055] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:33.816540 10163 raft_consensus.cc:740] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:33.817170 10119 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:33.817693 10163 consensus_queue.cc:260] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:33.822532 10163 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:33.826642  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.829067  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:33.832791  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:33.833505  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:33.837025  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:33.837621 10143 consensus_queue.cc:1059] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:33.838927 10142 raft_consensus.cc:3055] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:33.839005  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:33.842764  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:33.845505  9291 raft_consensus.cc:2393] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 3: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:01:33.839411 10142 raft_consensus.cc:740] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:33.849483  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:33.849498 10142 consensus_queue.cc:260] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:33.850785  8349 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:33.851563 10142 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:33.853699  8530 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:01:33.860533  8349 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:33.870139 10220 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:33.870873 10220 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:33.866995 10198 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:33.877700 10198 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.879640 10201 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:33.880206 10201 raft_consensus.cc:697] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:33.881143 10201 consensus_queue.cc:237] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.876698  8284 catalog_manager.cc:5697] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 2 to 3, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:33.866907 10140 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:33.884155  8535 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:01:33.885432 10198 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:33.886464 10191 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:33.888031 10191 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.890326 10191 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:33.890641 10220 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:33.890455 10198 consensus_queue.cc:1059] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:33.891808  8349 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:33.894421  8500 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:33.899358  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.897215 10163 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:33.903264 10163 raft_consensus.cc:697] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:33.904259 10163 consensus_queue.cc:237] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.908397  8380 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:33.909276 10119 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:33.923136  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:33.925275  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:33.926450  8531 raft_consensus.cc:2393] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 9: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:33.935545  8380 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:33.936674  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:33.937302  8500 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:33.941617  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:33.943849 10165 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:33.944485 10165 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.945844  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:33.946628 10165 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:33.947175  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:33.947616  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:33.949134  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:33.942839  8283 catalog_manager.cc:5697] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 4 to 5, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 5 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:33.952932  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:33.962251  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:33.968348  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:33.972162  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:33.973285  9294 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 3: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:33.974177  9982 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:33.973094  9939 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:33.977727  8455 raft_consensus.cc:1240] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:33.977749  8454 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:33.979235  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:33.979701  9261 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:33.960721 10198 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:33.980433  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:33.983733 10150 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:33.985108  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:33.980913 10198 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:33.962924 10191 consensus_queue.cc:1059] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:01:33.987380 10191 consensus_queue.cc:1243] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer d653e71832b7402b9a03b46249d3b885 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:33.982586  9261 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:33.995585  8351 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:34.001782  8459 raft_consensus.cc:1240] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:33.988135 10198 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:33.989619  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:34.006359  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:34.010597  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:34.011297  8458 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:34.003525 10148 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:34.013345  8526 raft_consensus.cc:1240] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:34.004405 10220 raft_consensus.cc:3055] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:34.005409 10188 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:34.019333  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:34.021929  9261 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:34.001521 10143 consensus_queue.cc:1059] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:01:34.020740 10220 raft_consensus.cc:740] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:34.036662  8396 tablet_copy_service.cc:140] P d653e71832b7402b9a03b46249d3b885: Received BeginTabletCopySession request for tablet 56cc480ba6f642e08bb2e547a0ef50a1 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:48484)
W20260709 13:01:34.037587  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 107226us
I20260709 13:01:34.041669  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:34.042943  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:34.043694  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:34.046483  8351 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:34.047845  9982 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:34.044488  8396 tablet_copy_service.cc:161] P d653e71832b7402b9a03b46249d3b885: Beginning new tablet copy session on tablet 56cc480ba6f642e08bb2e547a0ef50a1 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:48484: session id = 446d9310dce14ff4afff2dc2d64f68d8-56cc480ba6f642e08bb2e547a0ef50a1
I20260709 13:01:34.048830 10220 consensus_queue.cc:260] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:34.050372 10220 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:34.040205 10150 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:01:34.058615  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 100026us
I20260709 13:01:34.055513 10198 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:34.062115  8424 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:34.063674  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:34.071430  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:34.072481  9939 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:34.072889 10142 raft_consensus.cc:3055] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:34.073702 10142 raft_consensus.cc:740] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:34.074728 10142 consensus_queue.cc:260] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:34.075979 10142 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:34.080365  8500 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:34.083499 10153 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:34.084830  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:34.085678 10148 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.086440  9939 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:34.087258  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:34.088013  8457 raft_consensus.cc:606] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:01:34.088379  8457 raft_consensus.cc:614] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:34.060138 10201 raft_consensus.cc:2955] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:34.091380  8459 raft_consensus.cc:2955] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
W20260709 13:01:34.096174 10236 log.cc:927] Time spent T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:01:34.103410 10148 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:34.104669  8531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
mode: GRACEFUL
new_leader_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:40160
I20260709 13:01:34.112527  9939 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:34.113225  9939 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:34.113586 10198 consensus_queue.cc:1059] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:34.114814 10119 raft_consensus.cc:3055] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:34.115217 10119 raft_consensus.cc:740] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:34.105690  8500 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:34.115221  9939 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:34.120941  8424 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:34.121598  8531 raft_consensus.cc:606] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Received request to transfer leadership to TS 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:34.121627 10198 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:34.120944 10119 consensus_queue.cc:260] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:34.124539  8531 raft_consensus.cc:614] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:34.135759 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48470 (request call id 11) took 2050 ms. Trace:
I20260709 13:01:34.125403 10119 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:34.124331  8500 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:34.141610 10198 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:34.141757  8500 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:34.124439 10192 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:34.142781  8381 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:01:34.143123  8500 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:34.143533  8381 raft_consensus.cc:606] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:01:34.131887  8284 catalog_manager.cc:5697] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 2 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:34.145589  8500 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:34.145977 10191 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:34.146710 10191 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:34.147223  8500 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:34.147938 10191 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:34.148454  8500 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:34.125182  8424 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:34.149293 10191 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:34.150296  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:34.153913 10119 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:34.142580 10198 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:34.155151  8460 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:34.154420 10201 rpcz_store.cc:276] 0709 13:01:32.084846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.084992 (+   146us) service_pool.cc:224] Handling call
0709 13:01:32.383378 (+298386us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b5400034e20. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c83fa64d 00007f36c83ddfe9 00007f36c83ddf3e 00007f36c8463888 00007f36c848075c 00007f36c848176a 00007f36c848091b 00007f36c848c03c 00007f36c848b6b3 00007f36cd44bd29
0709 13:01:32.399640 (+ 16262us) log.cc:844] Serialized 499 byte log entry
0709 13:01:34.135501 (+1735861us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":484,"raft.queue_time_us":1457,"raft.run_cpu_time_us":1891,"raft.run_wall_time_us":13982,"spinlock_wait_cycles":6924672,"thread_start_us":120587,"threads_started":1,"wal-append.queue_time_us":124716,"wal-append.run_cpu_time_us":2298,"wal-append.run_wall_time_us":1003270}
I20260709 13:01:34.161712  8459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:34.162979  8459 raft_consensus.cc:606] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:01:34.163647 10148 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:34.164698  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:01:34.165107 10192 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:34.166982  8455 consensus_queue.cc:237] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:34.126178 10237 consensus_queue.cc:1059] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 13:01:34.171792  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 55483.8us
I20260709 13:01:34.172147  8500 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:34.173164 10238 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:34.172809  8396 tablet_copy_source_session.cc:215] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:34.180847 10198 consensus_queue.cc:1059] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:34.181746  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:34.182045 10220 raft_consensus.cc:3055] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:34.182405 10220 raft_consensus.cc:740] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:34.183291 10220 consensus_queue.cc:260] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:34.183841 10224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56cc480ba6f642e08bb2e547a0ef50a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:34.184772  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:34.188802  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:34.189590 10198 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:34.190021  8500 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:34.190757 10198 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:34.191180 10198 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:34.191606 10198 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.195384 10220 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:34.199812  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 44674.2us
I20260709 13:01:34.205330  8283 catalog_manager.cc:5697] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 5 to 6, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 6 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:34.208142  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:34.205329  8424 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:34.207168  8283 catalog_manager.cc:5697] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 8 to 9, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 9 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:34.168967 10237 raft_consensus.cc:3055] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:34.218523  8424 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:34.217273 10165 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:34.221393  8426 consensus_peers.cc:597] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 455c5d2786974d92a3ee8b825edcfaa7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:34.222711  8531 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:34.227118  8424 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:34.227666  8500 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:34.229259  9939 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:34.232136  8500 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:34.222754  8527 raft_consensus.cc:2955] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:34.234539 10176 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:34.240947  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.243095  8381 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:34.243646 10201 raft_consensus.cc:993] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:34.244169 10201 raft_consensus.cc:1081] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:34.230152 10139 consensus_queue.cc:1059] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:01:34.246171 10139 raft_consensus.cc:3055] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:34.246541 10139 raft_consensus.cc:740] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:34.247352 10139 consensus_queue.cc:260] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:34.228950 10165 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:34.252318 10165 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:34.255628 10198 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:34.217549 10237 raft_consensus.cc:740] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:34.257768 10237 consensus_queue.cc:260] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:34.263721  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:34.264788  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:34.266435  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:34.264700 10191 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:34.268468 10198 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:34.259328 10237 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:34.271720  8381 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:34.273428 10192 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:34.277480 10139 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.285002  9294 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:34.286971 10165 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:34.292188  8529 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:34.294773 10202 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:34.300252 10192 raft_consensus.cc:993] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:34.300856 10192 raft_consensus.cc:1081] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:01:34.307402  8382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:01:34.317132  8382 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:34.317539  8382 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.320779  8460 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:34.324494 10163 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.325134 10163 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:34.327487 10143 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:34.329916  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:34.330884  8457 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:34.338940 10224 tablet_copy_client.cc:806] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:34.339686 10224 tablet_copy_client.cc:670] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:34.339962  8379 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:34.342905  8351 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:01:34.348420  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 85067.3us
I20260709 13:01:34.351105 10195 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:34.342476 10163 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:34.356534  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:34.357390  9292 raft_consensus.cc:2393] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 3: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:01:34.361640  8527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38892
I20260709 13:01:34.362201  8527 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:34.362541  8527 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:34.363787 10192 raft_consensus.cc:2955] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:34.365615  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:34.348305 10202 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:01:34.366483  8529 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:34.365895  8532 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:34.348393 10143 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:34.368290 10143 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.368824 10143 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:34.370347  8455 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:34.374974 10140 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:34.378057 10224 tablet_copy_client.cc:538] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:34.372490  8379 raft_consensus.cc:2955] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:34.388204  8500 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:34.394013  8500 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:34.398005  9939 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:34.398713  8500 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:34.403184 10220 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:34.404739  8382 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:34.424536  8527 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:34.437803  8382 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:34.438825  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:34.441818  9291 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.399819 10237 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:34.444116  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:34.447588  8527 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:34.423677 10142 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:01:34.472646  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:34.473446  8378 raft_consensus.cc:3055] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:34.486692  8460 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:34.473711  8378 raft_consensus.cc:740] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:34.503996  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:34.504655  8461 raft_consensus.cc:3055] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:34.504974  8461 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:34.527318 10143 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:34.536157  9291 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:01:34.498322  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:01:34.547945 10249 log.cc:927] Time spent T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.061s	user 0.001s	sys 0.001s
I20260709 13:01:34.546842  9292 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:34.575307  8378 consensus_queue.cc:260] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:34.576812  8378 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:34.603854  8532 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:34.604482  8500 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:34.608594  8378 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
W20260709 13:01:34.612015  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 123799us
I20260709 13:01:34.614880  8461 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:34.616206  8461 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.613112 10198 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:34.622947 10198 raft_consensus.cc:697] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:34.625912 10165 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:34.626456 10165 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:34.628746 10165 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:34.632381  9292 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:34.634023  8500 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:34.634912 10243 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:34.635437 10243 raft_consensus.cc:697] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:34.634684  8283 catalog_manager.cc:5697] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:34.623845 10198 consensus_queue.cc:237] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:34.636528 10243 consensus_queue.cc:237] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:34.643766  8461 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:01:34.654832  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:34.652767 10224 tablet_bootstrap.cc:492] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:34.671358  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:34.672490 10139 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:01:34.702526  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 48199.6us
W20260709 13:01:34.718413  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 63691.2us
I20260709 13:01:34.720279  8531 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:01:34.731257  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 142761us
I20260709 13:01:34.726369 10201 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:34.750134 10143 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:34.797910  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 45286.2us
I20260709 13:01:34.802037  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:34.807204  8531 raft_consensus.cc:2955] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
W20260709 13:01:34.811833  8332 auto_rebalancer.cc:629] Failed to schedule move for tablet 4ef8cc956c764eeeb9389ea099a35006: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:34.822149  8381 consensus_queue.cc:237] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:34.824858 10261 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.826954  8426 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:01:34.827423  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 80165.8us
I20260709 13:01:34.833431  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:34.834064  8528 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:34.835014 10261 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:34.838884 10261 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:34.840764  8528 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:34.850967  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:34.851661  8384 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:34.852962  8427 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:34.853894 10192 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:34.860908 10255 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:01:34.859418  8349 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:34.862568 10255 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:34.856822 10192 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.863616 10192 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:34.863690 10255 raft_consensus.cc:697] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:34.864657 10255 consensus_queue.cc:237] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:34.859047 10127 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:34.872872  8284 catalog_manager.cc:5697] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 2 to 3, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 3 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:34.875301  8284 catalog_manager.cc:5697] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 3 to 4, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 4 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:34.887661  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 135971us
I20260709 13:01:34.884279 10201 raft_consensus.cc:697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:34.891494  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:34.892148  8457 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:34.896008  8535 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:34.906778  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:34.907426  9295 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:34.908180 10192 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:34.890143 10201 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:34.922772 10274 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:34.930867  8457 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:34.948432  8459 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:34.952464  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:34.953189  8380 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:34.959702  8351 consensus_peers.cc:597] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e1d32431b1c45ebad1160a850495e16. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:34.961582 10271 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:34.970404  8380 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:34.971673  8427 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:34.978873 10268 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:34.979486 10268 raft_consensus.cc:697] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:34.992286 10127 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.992877 10127 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:34.995980  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:35.000761 10268 consensus_queue.cc:237] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:35.002677  8531 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:01:35.004258  8424 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:35.003870  8284 catalog_manager.cc:5697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 5 to 6, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 6 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.005756 10261 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:35.006361 10273 ts_tablet_manager.cc:933] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:35.006160 10261 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.007576 10261 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.021781 10192 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:35.022692  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:35.023506  9291 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.029949 10127 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:35.035518  9291 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:35.041146 10261 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:35.045408  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:35.047083  8535 raft_consensus.cc:2955] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:35.043857 10271 raft_consensus.cc:2955] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:35.093276  8284 catalog_manager.cc:5697] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.096812  9291 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:01:35.102903 10127 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.104060 10127 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:35.120954 10127 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:35.122298  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:35.123034  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:35.126015  8531 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:35.123090  9294 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:35.130228  8426 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:35.134392 10273 tablet_copy_client.cc:323] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.194:36925
I20260709 13:01:35.136494  8453 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:35.133457 10254 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.137357 10254 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:35.138517 10238 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:35.139114 10224 tablet_bootstrap.cc:492] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:35.139767 10254 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:35.140174 10224 tablet_bootstrap.cc:492] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:35.140923 10224 ts_tablet_manager.cc:1403] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.522s	user 0.026s	sys 0.006s
I20260709 13:01:35.141372  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:35.142056  8453 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:35.132483 10176 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:35.143162  8351 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:35.144397  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:35.147401  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:35.145364 10274 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:35.155136 10274 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.155543 10274 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.156363  8535 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.160987  8531 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:01:35.161451 10261 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:35.165346  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:35.165952  9294 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.144999 10176 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.173485  8471 tablet_copy_service.cc:140] P 105d6581548546b98eddd4ee7083bb12: Received BeginTabletCopySession request for tablet 455c5d2786974d92a3ee8b825edcfaa7 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:53010)
I20260709 13:01:35.174175  8471 tablet_copy_service.cc:161] P 105d6581548546b98eddd4ee7083bb12: Beginning new tablet copy session on tablet 455c5d2786974d92a3ee8b825edcfaa7 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:53010: session id = 446d9310dce14ff4afff2dc2d64f68d8-455c5d2786974d92a3ee8b825edcfaa7
I20260709 13:01:35.174641 10176 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:35.177642 10270 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.178212 10270 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:35.177866  8283 catalog_manager.cc:5697] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 1 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:35.180521 10270 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:35.186199  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:35.190141  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:35.190852  8528 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:35.191092  8381 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:35.192174  8349 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:35.192757  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:35.193470  9291 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:35.194432 10201 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:35.194859 10201 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.195219 10201 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:35.195592 10238 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:35.200659  9291 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:35.204535 10191 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:35.214811 10274 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:35.220109 10224 raft_consensus.cc:359] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:35.222507  8457 raft_consensus.cc:2955] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:01:35.230396  9294 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:35.224766  9295 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:35.231786  8426 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:35.239704 10238 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:35.237471 10127 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:35.243956 10127 raft_consensus.cc:697] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:35.244740  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:35.245440  8528 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.244908 10127 consensus_queue.cc:237] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:35.247411 10274 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:35.248322  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:35.229856 10224 raft_consensus.cc:740] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:35.252760  8461 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.254328  8471 tablet_copy_source_session.cc:215] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:35.261648 10273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 455c5d2786974d92a3ee8b825edcfaa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.267381  8528 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:35.270851  8349 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:35.272409  8461 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:35.270865  8528 raft_consensus.cc:1275] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:35.250567 10176 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:35.283631  8535 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:35.288022 10255 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:35.279147 10270 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:35.293255 10270 raft_consensus.cc:697] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:35.294239 10270 consensus_queue.cc:237] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:35.298229  8284 catalog_manager.cc:5697] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 2 to 4, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 4 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.310894 10176 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:35.313979  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:35.314575  9291 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:35.282822 10224 consensus_queue.cc:260] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:35.313230  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:35.322978  8531 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:35.325995  8461 raft_consensus.cc:1275] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:35.328616 10254 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:35.331153  8461 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:01:35.334111 10148 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:35.281203 10201 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:35.336699 10238 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:35.337445 10238 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:35.339001 10220 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:35.340255 10220 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:35.343055  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:35.343398 10220 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:35.343740  8529 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:01:35.348304  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:35.349128  9294 raft_consensus.cc:2393] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 6: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:01:35.349556  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:35.350386  8378 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:01:35.355229  9291 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:35.356556  8426 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:35.323194 10224 ts_tablet_manager.cc:1434] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.182s	user 0.003s	sys 0.004s
I20260709 13:01:35.359812  8529 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:01:35.356221  8501 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:35.362903 10192 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:35.390797 10292 ts_tablet_manager.cc:933] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631)
I20260709 13:01:35.374251 10191 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:35.406263  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 48813.4us
I20260709 13:01:35.410454  8349 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:35.410490  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:35.411454  9294 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:35.387514 10201 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:35.423002  9291 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:01:35.402146 10191 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:35.424197 10191 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:35.426769 10271 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:35.429267 10238 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:35.441818  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:35.442487  8380 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:35.443607  8396 tablet_copy_service.cc:342] P d653e71832b7402b9a03b46249d3b885: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-56cc480ba6f642e08bb2e547a0ef50a1 received from {username='slave'} at 127.0.0.1:48484
I20260709 13:01:35.444156  8396 tablet_copy_service.cc:434] P d653e71832b7402b9a03b46249d3b885: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-56cc480ba6f642e08bb2e547a0ef50a1 on tablet 56cc480ba6f642e08bb2e547a0ef50a1 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:35.447325  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:35.448318  9288 raft_consensus.cc:2393] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 2: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:01:35.449833  8531 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:35.394826 10192 raft_consensus.cc:697] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:35.455435 10192 consensus_queue.cc:237] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:35.457448 10142 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:35.458062 10142 raft_consensus.cc:697] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:35.458912 10142 consensus_queue.cc:237] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:35.462329 10100 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:35.462895 10100 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:35.467664  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:35.468357  8453 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
I20260709 13:01:35.474814  9294 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:01:35.464995 10100 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:35.482375  9260 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:35.483749  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:35.484664  8531 raft_consensus.cc:2393] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 3: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:35.491109 10100 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:35.510474  8380 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:01:35.563076  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 118195us
I20260709 13:01:35.526610 10100 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:35.568186  8501 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:35.534942 10292 tablet_copy_client.cc:323] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.193:43631
W20260709 13:01:35.577574  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 83470.4us
W20260709 13:01:35.580076 10295 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:01:35.579248 10100 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.601629  9295 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:35.541802 10268 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:01:35.623046  8396 tablet_copy_service.cc:140] P d653e71832b7402b9a03b46249d3b885: Received BeginTabletCopySession request for tablet 9e1d32431b1c45ebad1160a850495e16 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:48484)
I20260709 13:01:35.623661  8396 tablet_copy_service.cc:161] P d653e71832b7402b9a03b46249d3b885: Beginning new tablet copy session on tablet 9e1d32431b1c45ebad1160a850495e16 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:48484: session id = 446d9310dce14ff4afff2dc2d64f68d8-9e1d32431b1c45ebad1160a850495e16
W20260709 13:01:35.631134 10288 log.cc:927] Time spent T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:01:35.608131 10261 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:01:35.619577 10300 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:35.652725 10300 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:35.653203 10300 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:35.661046 10273 tablet_copy_client.cc:806] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:35.661725 10273 tablet_copy_client.cc:670] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:35.662358 10191 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:35.664784 10191 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:35.673573  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 50623.4us
I20260709 13:01:35.680457  8396 tablet_copy_source_session.cc:215] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:35.678472 10257 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:35.682974 10257 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:35.683465 10100 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:35.686203 10257 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:35.688828  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:35.693025  8456 raft_consensus.cc:2393] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 2: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:35.694394 10273 tablet_copy_client.cc:538] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:35.702105 10292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e1d32431b1c45ebad1160a850495e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.704602 10273 tablet_bootstrap.cc:492] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
W20260709 13:01:35.703054  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 140298us
W20260709 13:01:35.710527  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 142522us
I20260709 13:01:35.727216 10194 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:35.728272 10194 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:35.730489 10194 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:35.731220  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:35.734912  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:35.746179  8378 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:01:35.763693  9291 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:35.763836  8501 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:35.764238 10262 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.764810 10262 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:35.765717 10220 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:35.766249 10220 raft_consensus.cc:697] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 6 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:35.767491 10194 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.767246 10220 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:35.768000 10194 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:35.767683 10262 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:35.768491  8284 catalog_manager.cc:5697] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:35.770015 10100 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:35.770121 10194 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:35.770489  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:35.785501  8528 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:35.786855  8424 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:35.776459  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:35.789280  8531 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:35.776882  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:35.790318  8379 raft_consensus.cc:2393] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 5: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:35.791007  8456 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
I20260709 13:01:35.791951 10303 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:35.793432  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:35.794163  8378 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 2.
I20260709 13:01:35.795372  9261 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:35.797452 10258 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.801007  9260 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:35.826175 10268 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:35.817546 10302 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:35.849503  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:35.850685  9295 raft_consensus.cc:2393] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 6: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:01:35.837524 10194 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:35.878221  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:01:35.878677  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 61515.1us
I20260709 13:01:35.880050  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:35.881150  8531 raft_consensus.cc:2393] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 3: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:35.878968  8528 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:35.850222 10268 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.884068  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:35.856549 10302 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.886921 10194 raft_consensus.cc:697] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:35.826398 10258 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:35.839419 10300 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:35.907706 10300 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:35.918447  8528 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 2.
I20260709 13:01:35.919754  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:35.890410 10268 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:35.890213 10302 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.945794 10194 consensus_queue.cc:237] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:35.891728  9292 raft_consensus.cc:1217] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:01:35.948472 10258 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:35.956374 10261 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.957007 10261 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:35.961434 10261 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:35.973428  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:35.993809  8379 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:36.007711  8528 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:36.019063  8501 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:36.026372  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:36.027295  8528 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
W20260709 13:01:36.029713  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 165192us
I20260709 13:01:36.030355  8349 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:36.032685 10260 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:36.041546  8283 catalog_manager.cc:5697] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:36.047627  8424 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:36.070930  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:36.071696  8381 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:36.053009  8283 catalog_manager.cc:5697] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:36.079101  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 48810.1us
I20260709 13:01:36.064589  9258 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:36.028723 10198 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:36.078518 10176 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:36.085433 10271 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.087622 10271 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:36.088027 10271 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.093639  8531 raft_consensus.cc:1275] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:36.094842  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:36.095749  8529 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
W20260709 13:01:36.076267 10273 log.cc:927] Time spent T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:36.091213 10176 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.082041  8282 catalog_manager.cc:5697] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 5 to 6, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 6 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:36.104545  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:36.100340 10176 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:36.123001  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 58481us
I20260709 13:01:36.116585 10292 tablet_copy_client.cc:806] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:36.121865 10310 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:36.127683 10198 raft_consensus.cc:697] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:36.152581 10310 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:36.198182 10310 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:36.197634 10302 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:36.154484 10292 tablet_copy_client.cc:670] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:36.217993  8526 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:36.235946 10262 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:36.211845 10244 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.249771 10244 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:36.252655 10244 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:36.253861  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:36.254554  8457 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:36.255185 10254 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.255724 10254 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:36.256129  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:36.257943 10254 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:36.258958 10198 consensus_queue.cc:237] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:36.277802 10311 log.cc:927] Time spent T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:01:36.279884 10302 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:36.285231  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:36.221717 10100 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.304657  8532 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:01:36.307739  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 100529us
I20260709 13:01:36.310745  9295 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:01:36.311257  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 159387us
I20260709 13:01:36.314579  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:36.315696  8535 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:36.300269 10305 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:36.332158  8457 raft_consensus.cc:1275] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:36.302228 10100 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:36.322353 10305 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.344074 10305 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:36.321419 10268 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:36.360076  8456 raft_consensus.cc:2393] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 6: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:36.366412 10100 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:36.368269  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:36.370517 10176 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:36.372151  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:36.394515  9295 raft_consensus.cc:2368] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3.
I20260709 13:01:36.374796  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:36.379582  9294 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:36.383679 10273 tablet_bootstrap.cc:492] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:36.396623  8349 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:36.384325 10192 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:36.397452  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:36.398068  8378 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:36.399394 10273 tablet_bootstrap.cc:492] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:36.400293  8349 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:01:36.401001 10321 log.cc:927] Time spent T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.363s	user 0.006s	sys 0.016s
I20260709 13:01:36.401270 10254 consensus_queue.cc:1048] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:36.400060 10305 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:36.403874 10254 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:36.404307 10201 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:36.404747 10201 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.405771 10201 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:36.406245  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:36.406868  8532 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.407711  8284 catalog_manager.cc:5697] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:36.409405  8378 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:01:36.392284  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:36.410540  8535 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:01:36.411299  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:36.413049  8384 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:36.388028 10268 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:36.350826 10271 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:36.414487  8381 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:01:36.415151 10327 raft_consensus.cc:2764] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:01:36.417173 10271 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:36.419611  8532 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:36.398092 10176 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:36.421794  8427 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:36.425122 10273 ts_tablet_manager.cc:1403] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.721s	user 0.036s	sys 0.041s
I20260709 13:01:36.428269  9291 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:36.429209  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:36.432399  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:36.433300  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:36.456960  8533 raft_consensus.cc:2368] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3.
I20260709 13:01:36.437912  8457 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:36.441886  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:36.458813  8379 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.456467 10260 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:36.459841 10260 raft_consensus.cc:697] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:36.443048  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:36.461396  8381 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:01:36.461629 10100 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:36.460848 10310 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:36.467175  9294 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:36.460709 10260 consensus_queue.cc:237] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:36.468984  8379 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
I20260709 13:01:36.443406  8535 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:01:36.450145  8500 leader_election.cc:400] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3.
I20260709 13:01:36.471060 10310 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:36.452279  8424 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:36.474206  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:36.495035  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:36.495659 10273 raft_consensus.cc:359] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:36.496623 10273 raft_consensus.cc:740] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:36.497901 10297 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:01:36.476395  8456 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:36.502754  8535 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:36.504293  9258 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:36.505970  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:36.511659  8349 leader_election.cc:400] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3.
W20260709 13:01:36.514231  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 59536us
I20260709 13:01:36.517139  8349 leader_election.cc:403] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:01:36.492323 10317 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:36.492745 10305 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:36.530422  9261 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:36.543974  9261 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:36.548609  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:36.545524 10324 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:36.550619 10324 raft_consensus.cc:697] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:36.551527 10324 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:36.554864  8527 raft_consensus.cc:1240] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:36.556713 10100 consensus_queue.cc:1059] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:01:36.501533 10297 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:01:36.559813 10100 raft_consensus.cc:3055] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:36.560302 10100 raft_consensus.cc:740] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:36.561472 10317 raft_consensus.cc:697] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:36.562471 10317 consensus_queue.cc:237] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:36.530421 10274 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.565673 10100 consensus_queue.cc:260] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:36.567425 10100 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:36.574029 10292 tablet_copy_client.cc:538] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:36.583726  8456 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:36.589448  8457 raft_consensus.cc:1240] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:01:36.594743  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:36.554512 10310 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:36.441903 10201 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:36.502532 10319 consensus_queue.cc:1048] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 13:01:36.599481 10297 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:36.603832 10302 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:36.629968 10320 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:01:36.630752  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:36.630939 10258 raft_consensus.cc:1064] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:36.631527  8386 raft_consensus.cc:2368] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6.
I20260709 13:01:36.634085 10258 consensus_queue.cc:237] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:36.542376 10273 consensus_queue.cc:260] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:36.639712 10273 ts_tablet_manager.cc:1434] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.183s	user 0.007s	sys 0.001s
I20260709 13:01:36.608105 10310 raft_consensus.cc:697] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:36.640717 10310 consensus_queue.cc:237] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:36.643209 10297 raft_consensus.cc:697] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:36.644210 10297 consensus_queue.cc:237] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:36.649202  8471 tablet_copy_service.cc:342] P 105d6581548546b98eddd4ee7083bb12: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-455c5d2786974d92a3ee8b825edcfaa7 received from {username='slave'} at 127.0.0.1:53010
I20260709 13:01:36.649742  8471 tablet_copy_service.cc:434] P 105d6581548546b98eddd4ee7083bb12: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-455c5d2786974d92a3ee8b825edcfaa7 on tablet 455c5d2786974d92a3ee8b825edcfaa7 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:36.687769  9261 leader_election.cc:400] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6.
I20260709 13:01:36.724032  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:36.724668  8457 raft_consensus.cc:606] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:01:36.780548  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:36.781450  8527 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:36.825726  8527 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
W20260709 13:01:36.792580 10313 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:01:36.841879 10292 tablet_bootstrap.cc:492] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:01:36.843315  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:36.862932  8457 raft_consensus.cc:606] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:01:36.843904 10302 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:01:36.892043 10345 log.cc:927] Time spent T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.142s	user 0.002s	sys 0.000s
I20260709 13:01:36.875952 10201 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:36.889187 10302 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:36.941177 10341 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
W20260709 13:01:36.987020  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 92071.1us
I20260709 13:01:36.959254 10274 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3.
I20260709 13:01:37.023820 10330 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.024608 10330 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:37.049520  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 329500us
I20260709 13:01:37.053687  9292 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:37.055111  8535 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:37.058871  8349 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:37.059864 10349 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:37.060449 10349 raft_consensus.cc:697] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:37.062402 10349 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:37.069955  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:01:37.073287 10343 log.cc:927] Time spent T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:01:37.078783  8378 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:37.084233  8461 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:37.088125 10258 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:37.090963  8380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
new_leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:01:37.091635  8380 raft_consensus.cc:606] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Received request to transfer leadership to TS 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:37.091984  8380 raft_consensus.cc:614] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:37.096014 10330 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:37.096199  8526 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:37.099224  8384 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:37.101930  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:37.110296 10317 raft_consensus.cc:993] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:37.110929 10317 raft_consensus.cc:1081] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:37.121495 10326 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:37.123611  9295 raft_consensus.cc:1217] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:01:37.127611 10100 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:37.108886 10127 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:01:37.135568  8282 catalog_manager.cc:5697] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 1 to 2, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 2 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:37.176994  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 70629.7us
I20260709 13:01:37.098893 10191 consensus_queue.cc:1059] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.150s
I20260709 13:01:37.255271 10191 consensus_queue.cc:1243] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer 446d9310dce14ff4afff2dc2d64f68d8 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:01:37.255975 10191 raft_consensus.cc:3055] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:37.256313 10191 raft_consensus.cc:740] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:37.238058  9288 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEARNER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:37.483855 10304 consensus_queue.cc:1059] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.196s
I20260709 13:01:37.556807  8382 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:37.581974  8460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:37.582669  8460 raft_consensus.cc:606] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Received request to transfer leadership to TS 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:37.585101 10191 consensus_queue.cc:260] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:37.586855 10302 consensus_meta.cc:287] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.602s	user 0.008s	sys 0.001s
I20260709 13:01:37.587312 10302 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:37.619060  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 440371us
W20260709 13:01:37.622977  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 347001us
I20260709 13:01:37.624194 10300 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:37.653189 10292 tablet_bootstrap.cc:492] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:37.654345 10292 tablet_bootstrap.cc:492] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:01:37.655141 10292 ts_tablet_manager.cc:1403] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.814s	user 0.033s	sys 0.026s
I20260709 13:01:37.639940 10300 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:37.683024 10365 log.cc:927] Time spent T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.138s	user 0.000s	sys 0.003s
I20260709 13:01:37.710675 10127 raft_consensus.cc:993] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower 446d9310dce14ff4afff2dc2d64f68d8 to start an election
I20260709 13:01:37.711277 10261 raft_consensus.cc:1081] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Signalling peer 446d9310dce14ff4afff2dc2d64f68d8 to start an election
I20260709 13:01:37.715009 10330 raft_consensus.cc:1064] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
W20260709 13:01:37.715723 10330 raft_consensus.cc:1068] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12: Unable to promote non-voter 446d9310dce14ff4afff2dc2d64f68d8: Service unavailable: leader transfer in progress
W20260709 13:01:37.717772 10361 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.196s	user 0.000s	sys 0.003s
I20260709 13:01:37.727834  8526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38894
I20260709 13:01:37.728638  8526 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:37.729048  8526 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:37.739367 10303 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:37.740136 10303 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:37.793439  8383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
new_leader_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:01:37.794934 10319 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:37.801631 10257 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:37.802318 10257 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:37.803418 10271 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:37.804071 10271 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:37.806705 10271 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:37.813942  8383 raft_consensus.cc:606] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Received request to transfer leadership to TS 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:37.925463 10330 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:37.932144 10363 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:37.935020 10363 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:37.959736 10330 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:37.969534 10302 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:37.972656  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:37.982559  9293 raft_consensus.cc:3055] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:37.982848  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:37.984138  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:37.984625  9293 raft_consensus.cc:740] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:37.973196  8526 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:37.991290  8531 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:38.035379  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.009343  9293 consensus_queue.cc:260] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:38.046481  9293 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:38.208801  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.223541 10148 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:38.225160 10148 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:38.227413 10148 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:38.227031 10292 raft_consensus.cc:359] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:38.229521  8529 raft_consensus.cc:1275] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:38.223698 10331 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:38.230878 10331 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:37.990222 10318 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:38.039776 10257 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:38.047147 10351 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:38.326038  8526 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:38.216347 10363 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:38.215842 10379 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:38.217285 10352 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:38.215596 10176 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:38.214820 10139 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:38.409770 10331 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:38.430117  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.227918 10292 raft_consensus.cc:740] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:01:38.464166 10302 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:38.397720 10351 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:38.559880 10351 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:38.561094  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:01:38.568567  9293 consensus_meta.cc:287] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.521s	user 0.004s	sys 0.004s
I20260709 13:01:38.320894 10318 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:38.493462 10139 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:38.575914 10142 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:38.576618 10356 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:38.577216 10326 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:38.577840 10271 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:38.570983 10302 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:38.579187 10274 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:38.580564 10319 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:38.467242 10176 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:38.583410 10257 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:38.585211 10292 consensus_queue.cc:260] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:38.528013 10127 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:38.553776 10300 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:38.466918 10379 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:38.588568  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:38.545361 10363 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:38.599691  9293 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:01:38.528903 10352 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:38.555035 10331 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:38.673717  9293 pending_rounds.cc:85] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting all ops after (but not including) 6
W20260709 13:01:38.677069  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 131246us
I20260709 13:01:38.633236 10370 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:38.660786 10142 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:38.679610 10352 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:38.679972 10142 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:38.680238 10352 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:38.684576 10261 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:38.685237 10261 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:38.689270 10331 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:38.691049 10360 log.cc:927] Time spent T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 1.164s	user 0.011s	sys 0.018s
I20260709 13:01:38.692273 10331 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:38.694970 10176 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:38.676983  9293 pending_rounds.cc:107] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:01:38.698403  9293 raft_consensus.cc:2889] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:38.661373 10381 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.703294  8528 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:38.633296 10356 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:38.673647 10382 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:38.731735  8459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 1608) took 1662 ms. Trace:
I20260709 13:01:38.735008  8459 rpcz_store.cc:276] 0709 13:01:37.058011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.058225 (+   214us) service_pool.cc:224] Handling call
0709 13:01:37.058521 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:37.058852 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:37.058878 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:37.059408 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:01:37.357975 (+298567us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:37.612667 (+254692us) log.cc:844] Serialized 14 byte log entry
0709 13:01:37.625224 (+ 12557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.625298 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:38.690435 (+1065137us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:01:38.696531 (+  6096us) raft_consensus.cc:1685] finished
0709 13:01:38.720002 (+ 23471us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.720236 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12246,"prepare.queue_time_us":237485,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":12441,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":3550,"spinlock_wait_cycles":3109120,"thread_start_us":488189,"threads_started":2,"wal-append.queue_time_us":466808}
I20260709 13:01:38.687840 10261 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:38.680735 10352 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:38.675429 10300 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:38.663836 10257 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:38.742722 10302 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:38.661267 10274 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:38.634824 10326 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:38.635152 10271 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:38.662891 10127 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:38.765317 10139 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:38.768347 10332 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:38.677335 10363 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:38.663712 10319 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:38.763801  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.807152 10397 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:38.804332 10300 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:38.815450  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.730566 10381 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:38.808167 10360 log.cc:927] Time spent T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:01:38.805522 10302 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:38.848270  9293 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:01:38.699610 10370 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:38.878494  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:38.886819 10142 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:38.899376 10142 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:38.899837 10326 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:38.901526 10387 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:38.882390 10331 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:38.744431 10382 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:38.870200 10268 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:38.900506 10326 raft_consensus.cc:2955] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:38.815585 10332 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:38.997339 10257 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:38.997718 10319 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:38.998528 10139 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:38.875509 10302 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:39.025576  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 347489us
W20260709 13:01:39.054315  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.077769  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 284) took 1251 ms. Trace:
I20260709 13:01:39.078445  8378 rpcz_store.cc:276] 0709 13:01:37.826674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.827327 (+   653us) service_pool.cc:224] Handling call
0709 13:01:38.424621 (+597294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.424890 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:38.818552 (+393662us) log.cc:844] Serialized 14 byte log entry
0709 13:01:39.077237 (+258685us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:39.077315 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:39.077383 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.077482 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.077653 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":135,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":111,"thread_start_us":532532,"threads_started":2}
I20260709 13:01:39.022507 10370 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:38.823621 10397 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:38.941036 10331 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:38.902155 10387 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:39.471204 10261 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:39.482780 10303 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:39.471978 10220 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.431599 10274 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:39.463174  9259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.000s	sys 0.009s
I20260709 13:01:39.554199  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1689) took 1737 ms. Trace:
I20260709 13:01:39.489521 10302 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:39.572203  9259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.003s	sys 0.013s
I20260709 13:01:39.572208  8531 rpcz_store.cc:276] 0709 13:01:37.816610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.818109 (+  1499us) service_pool.cc:224] Handling call
0709 13:01:37.818466 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.036264 (+217798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.553686 (+1517422us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54002baa54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:39.554042 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397026688}
I20260709 13:01:39.545555 10191 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:39.574141 10387 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:39.574282  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.515805 10356 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:39.407341 10352 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:39.575410 10302 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.566771 10220 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:39.312496 10388 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:39.537350  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 1896) took 1606 ms. Trace:
I20260709 13:01:39.576541 10388 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:39.377789 10401 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:39.382328 10395 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:39.566094 10261 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:39.483428 10324 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:39.432436 10127 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:39.407387  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:39.493397 10194 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:39.450441 10300 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:01:39.498222 10404 log.cc:927] Time spent T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:01:39.363132 10379 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:39.374753 10390 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:39.022648 10139 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:39.374807  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 347813us
I20260709 13:01:39.023360 10268 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:39.311945 10373 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:39.312146 10389 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:39.571266  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 1686) took 1779 ms. Trace:
I20260709 13:01:39.312280 10392 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:39.428306 10384 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:39.436947 10301 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:39.392913 10319 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:39.427656 10271 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:39.502187 10351 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:01:39.648061  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:39.648873  8457 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:39.650627  8457 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:39.363399 10254 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:39.576789 10397 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:39.439921 10142 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:39.251313 10292 ts_tablet_manager.cc:1434] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 1.596s	user 0.021s	sys 0.032s
W20260709 13:01:39.659363 10292 ts_tablet_manager.cc:1467] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: Tablet startup took 2003ms
I20260709 13:01:39.659653  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:39.661276  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:39.660830  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:39.577631 10220 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:39.577297  8378 rpcz_store.cc:276] 0709 13:01:37.930775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.226341 (+1295566us) service_pool.cc:224] Handling call
0709 13:01:39.523793 (+297452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.536791 (+ 12998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.536848 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:39.536915 (+    67us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:39.536964 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.537062 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.537260 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12372,"raft.queue_time_us":14393,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":119,"spinlock_wait_cycles":114688}
I20260709 13:01:39.381289 10398 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:01:39.448980 10402 log.cc:927] Time spent T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:01:39.557286 10414 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:39.585654 10194 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:39.585603 10405 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:39.594599 10408 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:39.594906  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 1893) took 1666 ms. Trace:
I20260709 13:01:39.655870 10176 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:39.577780 10401 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:39.616597  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:39.451211 10332 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:39.081360 10318 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:39.583319 10370 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:39.406193 10272 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:39.653522 10413 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:39.657213  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:39.694094  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:39.594942 10139 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:39.658077  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:39.696014  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:39.658535 10261 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:39.658751 10397 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:39.586102 10324 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:39.707345  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:39.617434  8386 rpcz_store.cc:276] 0709 13:01:37.792016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.794745 (+  2729us) service_pool.cc:224] Handling call
0709 13:01:39.023199 (+1228454us) spinlock_profiling.cc:243] Waited 890 us on lock 0x7b5800151e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd45efc0 00007f36cd449929 00007f36cd4493d2 00007f36c69c0bd4
0709 13:01:39.523834 (+500635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.524155 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:39.542626 (+ 18471us) log.cc:844] Serialized 14 byte log entry
0709 13:01:39.570787 (+ 28161us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:39.570863 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:39.570955 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.571049 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.571203 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9075,"prepare.queue_time_us":15883,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":2416,"raft.queue_time_us":1096,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":138,"spinlock_wait_cycles":2097536,"thread_start_us":27677,"threads_started":1,"wal-append.queue_time_us":28651}
I20260709 13:01:39.707978  8529 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
W20260709 13:01:39.463394  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.666261 10254 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:39.612181 10255 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:39.674224  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:39.675364  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:39.673051  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:39.659749 10292 ts_tablet_manager.cc:1469] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: Trace:
0709 13:01:35.358165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.358353 (+   188us) service_pool.cc:224] Handling call
0709 13:01:35.391430 (+ 33077us) ts_tablet_manager.cc:934] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631)
0709 13:01:35.700640 (+309210us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:01:35.910999 (+210359us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:35.911118 (+   119us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:01:36.042711 (+131593us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:01:36.043115 (+   404us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.083274 (+ 40159us) ts_tablet_manager.cc:989] Replica registered.
0709 13:01:36.091954 (+  8680us) inbound_call.cc:177] Queueing success response
0709 13:01:36.841301 (+749347us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:01:37.655463 (+814162us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:01:37.727694 (+ 72231us) tablet_replica.cc:261] Starting instrumentation
0709 13:01:37.728438 (+   744us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":54659,"mutex_wait_us":9883,"raft.queue_time_us":143081,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":147,"tablet-copy.queue_time_us":31723,"tablet-download-pool.queue_time_us":3266,"tablet-download-pool.run_cpu_time_us":1571,"tablet-download-pool.run_wall_time_us":332851,"thread_start_us":241020,"threads_started":3}
I20260709 13:01:39.654436 10373 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:39.663648  9288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 314) took 1662 ms. Trace:
I20260709 13:01:39.596240 10127 consensus_queue.cc:1048] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:01:39.591775 10415 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:39.612133 10274 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:39.678680 10398 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:39.676718 10400 log.cc:927] Time spent T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:01:39.711021 10268 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:39.665052  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:39.672375 10323 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:39.674540 10303 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.756593  8424 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:39.699319 10370 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:39.691597  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:39.693224  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:39.696719  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:39.654422 10319 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:39.759785  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:39.710587 10397 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:39.706432  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:39.578158 10302 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:39.715138  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:39.597934 10390 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:39.781426  8527 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:39.728200 10376 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:39.596073 10395 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:39.696070 10220 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:39.681962 10176 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:39.736052  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 1895) took 1753 ms. Trace:
I20260709 13:01:39.736145  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:39.699544 10300 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:39.694023 10332 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:39.740434  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:39.741993  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:39.681079  8383 rpcz_store.cc:276] 0709 13:01:37.928665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.679336 (+750671us) service_pool.cc:224] Handling call
0709 13:01:38.679629 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.821370 (+141741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.821399 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:38.821438 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:38.821471 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.594633 (+773162us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54003b7754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:39.594720 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.594849 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325501184}
I20260709 13:01:39.667791 10301 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:39.612684 10326 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:39.829049  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 1897) took 1896 ms. Trace:
I20260709 13:01:39.725908 10352 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:39.646193 10392 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:39.673467 10410 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:39.704542  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:39.777328  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:39.759697 10406 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:39.760432 10403 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:39.778393  8526 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:39.783160  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:39.786535 10390 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:39.761121 10407 consensus_queue.cc:1059] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:01:39.733749 10255 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:39.693717 10408 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:39.789498  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:39.728848 10272 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:39.748180 10274 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:39.612417 10389 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:39.829552  8378 rpcz_store.cc:276] 0709 13:01:37.933052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.828068 (+1895016us) service_pool.cc:224] Handling call
0709 13:01:39.828399 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.828575 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.828607 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:39.828666 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:39.828720 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.828795 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.828970 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:39.809068  8377 rpcz_store.cc:276] 0709 13:01:37.929305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.682830 (+753525us) service_pool.cc:224] Handling call
0709 13:01:38.683079 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.815461 (+132382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.815491 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:38.815538 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:38.815571 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.682646 (+867075us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54002cbd54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:39.682693 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.682817 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":303977344}
I20260709 13:01:39.780422 10139 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:39.845530 10326 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:39.647362 10384 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:39.841616  8531 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:39.808274 10412 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:39.806137 10331 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:39.789736 10304 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:39.693498 10405 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:39.838927 10300 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:39.856913  8452 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:01:39.837594 10401 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:39.791255 10303 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:39.830070 10220 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:39.840510 10375 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.145s
I20260709 13:01:39.867657  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:39.867960  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:39.869189  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 158567us
I20260709 13:01:39.903475  8383 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:39.904706  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:39.876255  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1687) took 2060 ms. Trace:
I20260709 13:01:39.867468  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:39.869145 10139 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:39.905465  8383 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:01:39.714668 10413 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:39.837005 10332 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:39.866871  8427 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:39.913443  8378 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
W20260709 13:01:39.913555  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 46808.8us
I20260709 13:01:39.840307 10352 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:39.829497 10376 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:39.682328 10414 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:39.892145 10389 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:39.734510  9288 rpcz_store.cc:276] 0709 13:01:37.984777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.994160 (+  9383us) service_pool.cc:224] Handling call
0709 13:01:38.419001 (+424841us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:38.593886 (+174885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.595359 (+  1473us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:38.817674 (+222315us) log.cc:844] Serialized 556 byte log entry
0709 13:01:38.899235 (+ 81561us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:38.899297 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.899397 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:39.595690 (+696293us) raft_consensus.cc:1685] finished
0709 13:01:39.597540 (+  1850us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.645881 (+ 48341us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":21329,"threads_started":1,"wal-append.queue_time_us":538372}
I20260709 13:01:39.808683 10323 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:39.859409 10410 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:39.897229  8460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 270) took 2063 ms. Trace:
I20260709 13:01:39.951162  8460 rpcz_store.cc:276] 0709 13:01:37.834044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.878363 (+2044319us) service_pool.cc:224] Handling call
0709 13:01:39.896697 (+ 18334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.896872 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.896895 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:39.896943 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:39.896973 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.897031 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.897170 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:39.870509  8458 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:39.907209  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 1899) took 1940 ms. Trace:
I20260709 13:01:39.910974 10418 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:39.905710  8377 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:01:39.911778 10326 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:39.915048  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 1687) took 1935 ms. Trace:
I20260709 13:01:39.958244  8378 rpcz_store.cc:276] 0709 13:01:37.979452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.914263 (+1934811us) service_pool.cc:224] Handling call
0709 13:01:39.914528 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.914688 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.914713 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:39.914753 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:39.914789 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.914848 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.914975 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:39.883672 10194 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:39.961072  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 1688) took 1981 ms. Trace:
I20260709 13:01:39.961649  8377 rpcz_store.cc:276] 0709 13:01:37.979878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.960104 (+1980226us) service_pool.cc:224] Handling call
0709 13:01:39.960469 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.960680 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.960715 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:39.960768 (+    53us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:39.960813 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.960883 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.961007 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:39.754662 10415 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:39.905488  8532 rpcz_store.cc:276] 0709 13:01:37.815871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.816014 (+   143us) service_pool.cc:224] Handling call
0709 13:01:37.987021 (+171007us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:37.987518 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:37.987569 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:38.000805 (+ 13236us) log.cc:844] Serialized 26 byte log entry
0709 13:01:38.737291 (+736486us) spinlock_profiling.cc:243] Waited 9.96 ms on lock 0x7b18003a28e0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c80250d1 00007f36c8440a0f
0709 13:01:39.406433 (+669142us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:39.406478 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.406547 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:39.875869 (+469322us) raft_consensus.cc:1685] finished
0709 13:01:39.875898 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.876172 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1786,"raft.queue_time_us":7006,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":36983,"spinlock_wait_cycles":22908672,"thread_start_us":106496,"threads_started":1,"wal-append.queue_time_us":1478042}
I20260709 13:01:39.909353 10139 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:39.953032  8383 rpcz_store.cc:276] 0709 13:01:37.966710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.906319 (+1939609us) service_pool.cc:224] Handling call
0709 13:01:39.906655 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.906859 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.906895 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:39.906948 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:39.906996 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.907068 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.907163 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:39.965612  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 1901) took 1979 ms. Trace:
I20260709 13:01:39.921033 10407 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:39.960955  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 1689) took 1980 ms. Trace:
I20260709 13:01:39.969463  8378 rpcz_store.cc:276] 0709 13:01:37.980169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.959752 (+1979583us) service_pool.cc:224] Handling call
0709 13:01:39.960216 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.960446 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.960487 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:39.960550 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:39.960597 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.960715 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.960870 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:39.919526 10373 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:39.966202  8383 rpcz_store.cc:276] 0709 13:01:37.986111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.964305 (+1978194us) service_pool.cc:224] Handling call
0709 13:01:39.964712 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.964979 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.965025 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:39.965192 (+   167us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:39.965257 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.965359 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.965528 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:39.860157 10406 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:39.971658  8377 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:40.010725  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 1900) took 2029 ms. Trace:
I20260709 13:01:39.976557  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 1902) took 1966 ms. Trace:
I20260709 13:01:39.981343  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 1903) took 1935 ms. Trace:
I20260709 13:01:40.011264  8377 rpcz_store.cc:276] 0709 13:01:37.981027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.962899 (+1981872us) service_pool.cc:224] Handling call
0709 13:01:39.964599 (+  1700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.010461 (+ 45862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.010669 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:40.011759  8383 rpcz_store.cc:276] 0709 13:01:38.046474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.980210 (+1933736us) service_pool.cc:224] Handling call
0709 13:01:39.980612 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.980854 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.980896 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:39.980959 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:39.981014 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.981119 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.981266 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:39.862890 10403 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:40.011283  8378 rpcz_store.cc:276] 0709 13:01:38.010332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.971436 (+1961104us) service_pool.cc:224] Handling call
0709 13:01:39.975588 (+  4152us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.975853 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.975898 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:39.975965 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:39.976221 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.976306 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.976473 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:40.017912  8533 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:01:40.018447  8533 pending_rounds.cc:85] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 4
I20260709 13:01:40.018714  8533 pending_rounds.cc:107] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:01:40.018977  8533 raft_consensus.cc:2889] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:39.973259 10302 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:39.898599 10412 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:40.003187 10176 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:40.007830 10397 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:40.004591 10194 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.030618  8528 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:40.036993  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.037467 10395 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:40.037755  8532 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:40.041417  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.043498  8532 raft_consensus.cc:2393] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 6: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:40.044433 10302 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:39.974449 10254 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:39.996805 10324 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:40.014264 10370 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:39.995682 10303 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:40.054236  8532 raft_consensus.cc:2955] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:39.899292 10304 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:39.996425 10418 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:40.214192  8351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.000s	sys 0.007s
W20260709 13:01:40.259531  8351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.000s	sys 0.009s
W20260709 13:01:40.260039  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 663884us
I20260709 13:01:40.185456 10255 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:40.263922 10418 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:40.052848 10302 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:40.226369 10332 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:40.267650 10302 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:40.092056  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.093053 10274 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:40.061895 10413 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:40.269212  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.270076  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:01:40.253047  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 338229us
I20260709 13:01:40.270952  8526 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:40.043759 10310 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:40.226107 10410 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:40.273432  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.276647 10304 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:40.048624 10194 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:40.133014 10376 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:40.159958 10301 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:40.272295 10310 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:40.289932  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 1890) took 2486 ms. Trace:
I20260709 13:01:40.295172  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.295426  8427 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:40.321259  8351 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:40.290730 10310 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:01:40.292472  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 251372us
I20260709 13:01:40.292905  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 1889) took 2490 ms. Trace:
W20260709 13:01:40.321946  9261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.127s	user 0.013s	sys 0.012s
I20260709 13:01:40.321898  8427 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:40.326704  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.323378 10260 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:40.210923 10300 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:40.325137 10194 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:40.317714  8379 rpcz_store.cc:276] 0709 13:01:37.803219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.925284 (+122065us) service_pool.cc:224] Handling call
0709 13:01:39.495587 (+1570303us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5800151e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd45efc0 00007f36cd449929 00007f36cd4493d2 00007f36c69c0bd4
0709 13:01:40.287955 (+792368us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b5800151e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360e9c 00007f36c5360a5b 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd45efc0 00007f36cd449929 00007f36cd4493d2 00007f36c69c0bd4
0709 13:01:40.288227 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.289285 (+  1058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.289329 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:40.289499 (+   170us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:40.289566 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.289651 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.289815 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409012736}
I20260709 13:01:40.327703 10127 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:40.328320 10403 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:40.328866 10415 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:40.324908 10352 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:40.325024 10414 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:40.302062 10408 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:40.058285 10272 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:40.301165 10405 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:40.330807 10274 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:40.295387 10384 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:40.336125 10139 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:40.296554 10392 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:40.323787 10119 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.352331 10119 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:40.326907  8427 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:01:40.339485  9261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.013s	sys 0.012s
W20260709 13:01:40.215760  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.325232  8380 rpcz_store.cc:276] 0709 13:01:37.802882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.804747 (+  1865us) service_pool.cc:224] Handling call
0709 13:01:40.292123 (+2487376us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5800151e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd45efc0 00007f36cd449929 00007f36cd4493d2 00007f36c69c0bd4
0709 13:01:40.292360 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.292574 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.292598 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:40.292642 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:40.292678 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.292732 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.292846 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424135552}
I20260709 13:01:40.339923  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.340776  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.340978  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:40.243803 10220 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:40.362192  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.337591 10260 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:40.343402  8351 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:40.336241  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.342835 10403 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:40.338150 10127 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:40.347764 10301 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.185977 10323 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:40.357834  8427 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:40.359407  8454 raft_consensus.cc:1240] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:40.359450 10408 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:40.373534 10301 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:40.373382 10403 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:40.372709 10201 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:40.378077 10201 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:40.378290 10301 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:40.378510 10201 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:40.378775 10403 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:40.362097  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.379588  8531 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:40.380654  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.381276  8531 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:40.363176  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.368772  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.375361 10425 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:40.376111 10408 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:40.382128  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.369629  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:40.383965  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.383030 10425 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:40.383436  9258 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:40.386546  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:40.387465  9293 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:40.373441 10127 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:40.373054 10260 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:40.360636 10119 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:40.391317  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:40.391893  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.385730 10408 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:40.385378 10425 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:40.368850 10330 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:40.373629 10139 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:40.400666  9293 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:01:40.403357  9293 pending_rounds.cc:85] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: Aborting all ops after (but not including) 5
I20260709 13:01:40.384533 10315 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:40.401913  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:40.400995  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:40.403769  9293 pending_rounds.cc:107] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:01:40.391260  8527 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
I20260709 13:01:40.389860 10323 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:40.413462 10323 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:40.413983 10323 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:40.405737  9293 raft_consensus.cc:2889] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:40.407815  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:40.409008  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:40.409140  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:40.410898  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:40.411585  8396 tablet_copy_service.cc:342] P d653e71832b7402b9a03b46249d3b885: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-9e1d32431b1c45ebad1160a850495e16 received from {username='slave'} at 127.0.0.1:48484
I20260709 13:01:40.412318 10382 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:40.418826  8396 tablet_copy_service.cc:434] P d653e71832b7402b9a03b46249d3b885: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-9e1d32431b1c45ebad1160a850495e16 on tablet 9e1d32431b1c45ebad1160a850495e16 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:40.418721  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:40.419730  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:40.398892 10413 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
W20260709 13:01:40.420516  8382 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 1690) took 2440 ms (client timeout 2173 ms). Trace:
I20260709 13:01:40.412380  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:40.426079  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 1685) took 2634 ms. Trace:
I20260709 13:01:40.416852  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:40.415463  8377 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 1.
I20260709 13:01:40.418215  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:40.419957  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:40.427310  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:40.420933  8382 rpcz_store.cc:269] 0709 13:01:37.980471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.087375 (+106904us) service_pool.cc:224] Handling call
0709 13:01:40.419591 (+2332216us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b5800151e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd44b0a0 00007f36cd44a984 00007f36c69c56d4 00007f36c69c5662
0709 13:01:40.420405 (+   814us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43560832}
I20260709 13:01:40.420900  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:01:40.412295  8427 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.238s (SENT) [suppressed 1 similar messages]
I20260709 13:01:40.423491  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:40.426512  8381 rpcz_store.cc:276] 0709 13:01:37.791717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.794451 (+  2734us) service_pool.cc:224] Handling call
0709 13:01:40.425605 (+2631154us) spinlock_profiling.cc:243] Waited 874 us on lock 0x7b5800151e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360eee 0000000000375939 00007f36cd3d41e0 00007f36cd49d0c4 00007f36cd49d131 00007f36cd45efc0 00007f36cd449929 00007f36cd4493d2 00007f36c69c0bd4
0709 13:01:40.425724 (+   119us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.425863 (+   139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.425879 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:40.425908 (+    29us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:40.425927 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.425962 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.426035 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2036480}
I20260709 13:01:40.393966 10406 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:40.421463  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:40.431587  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:40.432331  9293 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:40.442735  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:40.443413  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.444353  9293 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:01:40.446290 10319 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:40.448218  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:40.444666  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.448894  9294 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:40.407976 10315 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:40.455065  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.456238  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.414244 10412 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:40.459137  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.459218  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:40.460079  8528 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:40.461989  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:40.462586  9294 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 1.
I20260709 13:01:40.462423  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.461369  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.465426  8528 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:40.467118  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:40.467813  9294 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:40.454203 10382 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:40.473508  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.448520 10127 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:40.463268 10315 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:40.483707  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:01:40.484745  8385 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48484 (request call id 285) took 2657 ms (client timeout 2016 ms). Trace:
I20260709 13:01:40.475831  8526 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:40.490124  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:40.486112  8385 rpcz_store.cc:269] 0709 13:01:37.827195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.827705 (+   510us) service_pool.cc:224] Handling call
0709 13:01:40.467434 (+2639729us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b5800151e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd44b0a0 00007f36cd44a984 00007f36c69c56d4 00007f36c69c5662
0709 13:01:40.484668 (+ 17234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420905344}
I20260709 13:01:40.493180 10127 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:40.495024  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.497560  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:40.497385  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:40.498759  8528 raft_consensus.cc:2410] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:40.503134  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:40.473496 10319 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:40.511503  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:40.512250  9294 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:40.514006  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:40.514655  9294 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:40.513286  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:01:40.516872  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 104593us
I20260709 13:01:40.545269  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:40.546041  8382 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
I20260709 13:01:40.495975 10382 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:40.558907  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:40.555830  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:40.556813  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:40.560825  8381 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:40.555897  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:40.564080  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 119873us
I20260709 13:01:40.569664  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.573133  8500 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:40.554229 10384 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:40.600705  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:40.576519 10323 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:40.607713 10323 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:40.608265 10384 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:40.610929 10384 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:40.612067 10412 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:40.612497 10381 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:40.613124 10260 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:40.614606 10429 log.cc:927] Time spent T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:01:40.612586 10412 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:40.617599 10412 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:40.618904  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:40.620695  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:40.621954  9288 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:40.623239 10330 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:40.623850 10330 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:40.625511  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:40.626174  8452 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:40.626607 10260 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:40.628131  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:40.628732  8377 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:40.628983  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:40.630118  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:40.631119  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:40.631680  8460 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:01:40.633003  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:40.634865  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:40.632330  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:40.635203  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:40.615470  8455 raft_consensus.cc:3055] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:40.542284 10319 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:40.638796  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 279) took 2961 ms. Trace:
I20260709 13:01:40.638895  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:40.668713  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.669269  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:40.670248  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.670396  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.639703  8458 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:40.589771  8349 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:40.672106  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.172847  8281 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59480 (request call id 198) took 3900 ms. Trace:
I20260709 13:01:40.640661  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.181671  8281 rpcz_store.cc:276] 0709 13:01:37.035020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.035185 (+   165us) service_pool.cc:224] Handling call
0709 13:01:40.934980 (+3899795us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69528,"reported_tablets":4}
I20260709 13:01:40.728782  8377 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
W20260709 13:01:41.067181 10322 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.022s	sys 0.055s
W20260709 13:01:41.186204 10322 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.023s	sys 0.058s
I20260709 13:01:41.187569  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:41.025921 10384 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:40.759392  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:41.189394 10384 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:41.189954  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:40.638309  8457 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 1.
I20260709 13:01:40.642503  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:40.730063  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.836153 10425 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:41.196552  8427 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:40.667522  8533 rpcz_store.cc:276] 0709 13:01:37.677906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.678054 (+   148us) service_pool.cc:224] Handling call
0709 13:01:37.694581 (+ 16527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.019509 (+2324928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.638561 (+619052us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x7b54000aad54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:40.638723 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5342069632}
W20260709 13:01:40.645628  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 50650us
I20260709 13:01:40.816586  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.198881  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:40.639397  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:40.644942  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:40.829653  8284 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53486 (request call id 343) took 4301 ms. Trace:
W20260709 13:01:41.176077  8380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.013s	sys 0.020s
W20260709 13:01:41.200641  8380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.013s	sys 0.020s
I20260709 13:01:40.667006  8381 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:41.182860  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.200578  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:40.663210 10377 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:40.632368 10412 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:40.762604 10148 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:40.663512 10388 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:40.817652  8283 catalog_manager.cc:5697] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 2 to 3, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 3 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:41.194257  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.232193  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.197386 10127 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:40.649632  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:40.759922  8282 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53494 (request call id 324) took 4102 ms. Trace:
I20260709 13:01:40.642211  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.237257  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.238330 10377 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:41.238719  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.240096  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:40.645874 10363 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:40.748893  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:40.642623  9258 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:40.644600  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.202667  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.252302  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:40.649118 10382 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:41.200189  8284 rpcz_store.cc:276] 0709 13:01:36.528667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.543571 (+ 14904us) service_pool.cc:224] Handling call
0709 13:01:40.829556 (+4285985us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117055,"reported_tablets":5,"spinlock_wait_cycles":1280}
I20260709 13:01:41.203729  8453 raft_consensus.cc:2393] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 2: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:41.205261  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:41.205214  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.205220  8456 raft_consensus.cc:2393] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 4: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:41.206231  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:40.756985  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:40.899969 10390 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:01:40.672122  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 82449us
I20260709 13:01:40.641237  8455 raft_consensus.cc:740] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:41.258592  8349 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:01:41.198625  8526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.026s	sys 0.017s
W20260709 13:01:41.259779  8526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.026s	sys 0.017s
I20260709 13:01:41.255125  8459 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:01:40.748875  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:01:41.069196 10349 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.012s	sys 0.019s
I20260709 13:01:41.232362  8283 catalog_manager.cc:5697] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 4 to 6, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 6 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:41.234318 10148 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:41.268493  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.232843  8457 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:01:41.258846  8455 consensus_queue.cc:260] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:41.242370  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:41.271775  8381 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:41.271979  8455 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:40.656925 10398 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:41.240669 10377 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:40.643435 10319 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:41.240801  8454 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:41.223229 10379 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:01:41.242132  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.212126  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:41.286288 10127 raft_consensus.cc:697] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:01:41.286619  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 74546us
I20260709 13:01:41.256783  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.261502  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.263540  8349 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:41.288636  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.289758  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.290254  8349 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:41.290758  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.266245  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.266206  8378 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:40.637059 10408 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:41.236420  8282 rpcz_store.cc:276] 0709 13:01:36.657430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.657612 (+   182us) service_pool.cc:224] Handling call
0709 13:01:40.759836 (+4102224us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:37.641029 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:37.641647 (+   618us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:37.641684 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:01:37.641705 (+    21us) tablet.cc:662] Decoding operations
0709 13:01:37.642051 (+   346us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:37.642123 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:37.642156 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:01:37.642331 (+   175us) tablet.cc:701] Row locks acquired
0709 13:01:37.642350 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:01:37.642496 (+   146us) write_op.cc:270] Start()
0709 13:01:37.642606 (+   110us) write_op.cc:276] Timestamp: P: 1783602097642442 usec, L: 0
0709 13:01:37.642627 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:01:37.643358 (+   731us) log.cc:844] Serialized 533 byte log entry
0709 13:01:38.909602 (+1266244us) op_driver.cc:464] REPLICATION: finished
0709 13:01:40.333173 (+1423571us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b540014ea28. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce8419e1 00007f36ce84064c 00007f36cbebc845 00007f36cbec0d61 00007f36cbec0d19 00007f36cbec0ca9 00007f36cbec0c71 00007f36cbebfe9d 000000000038f354 000000000038f199 00007f36c5398475
0709 13:01:40.333262 (+    89us) write_op.cc:301] APPLY: starting
0709 13:01:40.333364 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:40.333465 (+   101us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:40.333490 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:40.333725 (+   235us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:40.333925 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:01:40.333976 (+    51us) write_op.cc:312] APPLY: finished
0709 13:01:40.334210 (+   234us) log.cc:844] Serialized 23 byte log entry
0709 13:01:40.363124 (+ 28914us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:40.371749 (+  8625us) write_op.cc:454] Released schema lock
0709 13:01:40.374927 (+  3178us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:40.393769 (+ 18842us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:40.393799 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":598093,"apply.run_cpu_time_us":17869,"apply.run_wall_time_us":852907,"num_ops":1,"prepare.queue_time_us":475845,"prepare.run_cpu_time_us":53321,"prepare.run_wall_time_us":146825,"raft.queue_time_us":349524,"raft.run_cpu_time_us":9322,"raft.run_wall_time_us":611142,"replication_time_us":1234782,"spinlock_wait_cycles":37404288,"thread_start_us":1274745,"threads_started":5,"wal-append.queue_time_us":483044,"wal-append.run_cpu_time_us":34225,"wal-append.run_wall_time_us":1775940}]]}
I20260709 13:01:40.650811 10201 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:41.302182  8349 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:41.268337 10425 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:41.283365  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 75156.5us
I20260709 13:01:41.284665  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.285422  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:40.758404 10330 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:41.269869 10349 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.014s	sys 0.021s
I20260709 13:01:41.287355  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:41.316977  8384 raft_consensus.cc:2393] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 3: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:41.317792  8461 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:41.281945 10384 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:41.303553  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.276382 10148 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.300128 10272 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:41.311352  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.267656 10390 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:41.299667 10319 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:41.287212 10127 consensus_queue.cc:237] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:41.324198  8459 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:41.325007  8460 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:41.310588 10392 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:41.335280  8383 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:41.335211  8384 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 1904) took 3128 ms (client timeout 2238 ms). Trace:
I20260709 13:01:41.336131  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.343255  8460 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:41.343292  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:41.337674 10319 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:41.339778 10390 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:41.345623 10319 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:41.346129 10319 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:41.342713  8384 rpcz_store.cc:269] 0709 13:01:38.206462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.226496 (+ 20034us) service_pool.cc:224] Handling call
0709 13:01:40.369434 (+2142938us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b5800151e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd44b0a0 00007f36cd44a984 00007f36c69c56d4 00007f36c69c5662
0709 13:01:41.334939 (+965505us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b5400188654. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:41.335134 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2461497472}
I20260709 13:01:41.286059 10297 consensus_queue.cc:1059] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:01:41.346535  8452 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:01:41.354823 10201 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:41.358520 10408 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:41.360016 10412 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:41.361723 10384 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:41.362322 10384 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:41.362771 10384 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.319998 10349 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:41.365837 10349 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:41.366359 10349 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:41.347317 10392 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:41.369851 10392 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.332490 10272 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:41.373778 10272 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.374184  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.376883  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.379231  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.380115  8459 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 2.
W20260709 13:01:41.388127  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 182115us
W20260709 13:01:41.388931  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 181112us
I20260709 13:01:41.389295  8427 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:41.389873  9261 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:41.390673 10323 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:41.391516  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:41.392331  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:41.392923  8383 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:41.396926 10446 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:41.399780 10446 raft_consensus.cc:697] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:01:41.400661  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 98520.9us
I20260709 13:01:41.408300  8455 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:01:41.400651  9261 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:41.409340  8349 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:41.409726  9261 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:41.411458  9261 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:41.413976  9261 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:41.328910  8424 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:41.436067  9261 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:01:41.438108  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 117382us
I20260709 13:01:41.439316  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:41.440321  8381 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
W20260709 13:01:41.444430  8455 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36448 (request call id 1702) took 1757 ms (client timeout 2240 ms). Trace:
W20260709 13:01:41.444921  8455 rpcz_store.cc:269] 0709 13:01:39.656814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.656954 (+   140us) service_pool.cc:224] Handling call
0709 13:01:40.615329 (+958375us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b540008bea0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c83fcdc0 00007f36c8488e18 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:41.414390 (+799061us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445895552}
I20260709 13:01:41.446717  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:41.413931  8349 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:01:41.448431  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 136301us
I20260709 13:01:41.460547  8378 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:01:41.469674  8383 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
W20260709 13:01:41.444561 10420 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 13:01:41.477803  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 835128us
I20260709 13:01:41.435103 10441 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:41.445017 10323 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:41.445246 10451 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:41.522080  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 94240.2us
W20260709 13:01:41.522678  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 108861us
W20260709 13:01:41.521442  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 97213.7us
I20260709 13:01:41.449604 10444 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:41.531404 10322 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:41.531402  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 95377us
I20260709 13:01:41.532019 10322 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:01:41.524128  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 74531.9us
I20260709 13:01:41.525483 10449 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:41.470933 10382 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:41.555210 10453 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:41.569763 10453 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:41.570188 10453 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:41.536226  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 89600.7us
I20260709 13:01:41.582602  8351 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:41.523409  8349 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:41.542972 10148 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:41.545644  8501 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:41.548288 10330 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:41.602274  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 56706.7us
I20260709 13:01:41.549779 10319 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:41.553304 10459 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:41.553857 10435 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:41.507606 10441 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:41.623277 10441 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:41.623972 10148 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:41.624668 10148 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:41.625015 10148 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:41.625418 10148 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:41.561810  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 208523us
I20260709 13:01:41.629069 10453 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:41.629752  8424 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:41.564895 10446 consensus_queue.cc:237] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:41.631349 10453 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:41.526315 10451 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:41.632794 10148 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:41.633304  8424 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:41.634713  8424 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:41.634975 10148 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:41.633319 10451 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.640381 10451 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:41.641546 10458 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:41.642155 10458 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:41.642547 10458 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.641554 10390 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:41.644315 10390 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:41.644692 10390 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:41.591887  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 68551.6us
I20260709 13:01:41.647210 10435 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:41.593672  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:01:41.600780  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 119043us
I20260709 13:01:41.647806 10435 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.612454  8459 raft_consensus.cc:2955] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:01:41.616245  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 173976us
I20260709 13:01:41.651935  8424 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:41.641718 10469 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:41.652767 10469 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:41.653226 10469 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.553062 10272 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:41.655588 10272 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:41.556685 10322 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.662760  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:41.663446  8529 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:41.534616  9261 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:41.660596  8458 raft_consensus.cc:1240] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:41.664518  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 70954.4us
I20260709 13:01:41.666038  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:41.667558  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:41.657450  8424 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:41.663652  8427 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:41.674134  8384 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:41.678067  8379 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:41.680276  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:41.680500  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:41.682039  8526 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:41.687579  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:41.657315 10459 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:01:41.693372  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 45171.2us
I20260709 13:01:41.620515 10443 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:41.694464 10127 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:41.696717 10127 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:41.697299 10127 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.670321 10408 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:41.589874 10392 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:41.676412 10461 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:41.673658 10201 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:41.706758  8424 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:41.712857  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 189926us
W20260709 13:01:41.707368  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 173192us
I20260709 13:01:41.702042  8427 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:41.677587 10297 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:41.720690  9295 raft_consensus.cc:1240] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:41.721446  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:41.724025  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:41.725008  9293 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:41.729378  9260 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:41.730203  8424 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:41.730930  9260 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:41.733201  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:41.706841 10453 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:41.712102 10330 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:41.705627 10408 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:41.700059 10459 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:41.713474 10323 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:41.708673 10461 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:41.769502  9289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127"
dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
 from {username='slave'} at 127.0.0.1:55734
I20260709 13:01:41.757302  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:41.737571 10453 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:41.798957  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:41.734854 10297 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:41.738721 10448 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:41.800930  9291 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:01:41.776175  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:41.770462 10408 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.807717  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:41.774884 10398 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:41.811103  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:41.777576 10461 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.775167 10440 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:41.774458 10330 raft_consensus.cc:697] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:41.775489 10475 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:41.815289  8532 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 2.
I20260709 13:01:41.802331 10453 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.821997 10451 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:41.822618 10388 raft_consensus.cc:3055] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:41.814836 10323 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:01:41.830698 10330 consensus_queue.cc:237] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:41.835402 10468 log.cc:927] Time spent T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:01:41.839851 10349 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:41.841351 10319 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:41.843614 10297 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:41.809931 10472 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:41.841440 10452 log.cc:927] Time spent T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
W20260709 13:01:41.853534  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 123401us
W20260709 13:01:41.855080  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 118108us
I20260709 13:01:41.856101  8424 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:41.856249  9260 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:41.862517  9260 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:41.870879  8424 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:41.866601 10127 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:41.822613  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:41.827896 10398 raft_consensus.cc:697] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:41.878084  8424 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:41.827412 10388 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:41.879575 10447 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:01:41.876909  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 174954us
I20260709 13:01:41.879415  9260 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:41.947098  8458 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36448 (request call id 1715) took 1292 ms. Trace:
I20260709 13:01:41.893736  8456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36448 (request call id 1716) took 1238 ms. Trace:
I20260709 13:01:41.955621 10127 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:41.950285  8458 rpcz_store.cc:276] 0709 13:01:40.654986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.292840 (+637854us) service_pool.cc:224] Handling call
0709 13:01:41.293105 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.665070 (+371965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.903412 (+238342us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b540019e1d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:41.947038 (+ 43626us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":844726144}
I20260709 13:01:41.859628 10470 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:41.958246  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:41.951066  8456 rpcz_store.cc:276] 0709 13:01:40.655228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.299742 (+644514us) service_pool.cc:224] Handling call
0709 13:01:41.300067 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:41.300367 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:41.300394 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:41.300860 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:01:41.471512 (+170652us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:41.471554 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.471621 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:41.893486 (+421865us) raft_consensus.cc:1685] finished
0709 13:01:41.893521 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.893671 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":42336,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":18122,"thread_start_us":170364,"threads_started":1,"wal-append.queue_time_us":351810}
W20260709 13:01:41.961292  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 81946.3us
I20260709 13:01:41.962863  9260 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:41.964099  9260 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:41.965266  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 299325us
I20260709 13:01:41.897297 10349 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:41.893445 10444 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:41.873389 10323 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:41.970050 10408 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:41.961817 10458 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:41.958110 10463 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:41.978919 10127 consensus_queue.cc:1059] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:01:41.980122  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 102120us
I20260709 13:01:41.976395  8351 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:41.893304  9292 raft_consensus.cc:1217] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:41.983184  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:41.966063  9260 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:41.966317 10472 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:41.988857  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:41.989454  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:41.989724  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:41.990974  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:41.992084  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:41.993260 10379 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:41.993700 10379 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:41.994087 10379 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.989516  8532 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
W20260709 13:01:41.975394 10384 consensus_meta.cc:287] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.001s
W20260709 13:01:41.991148 10471 log.cc:927] Time spent T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:01:42.010628  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:42.007303  8531 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:42.009035  8500 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:42.011469  8426 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:41.966038 10476 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:41.971565 10435 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:42.003700  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:42.021323  9291 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:42.022591  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:42.014469  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:42.016965  8459 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:42.016764  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:42.017988  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:42.027077  8456 raft_consensus.cc:2376] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6. Re-sending same reply.
I20260709 13:01:42.018980  8424 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:41.976595 10297 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:41.967867 10444 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:41.978085 10323 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.023856 10377 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:41.997568 10475 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:42.027796  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:42.010390 10201 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:42.012838  8500 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:42.020231 10451 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:41.996850 10408 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:42.030220  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:42.032763  8426 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:42.034422  8349 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:42.036814  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:42.018764  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:41.978655 10392 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:42.033733 10470 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:42.052945  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 86920.1us
I20260709 13:01:42.071712  9260 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:42.035684 10323 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:42.034004 10444 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:42.023728 10442 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:42.031443 10425 consensus_queue.cc:1059] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:01:42.074990  9260 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:42.054317 10472 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:42.024156 10384 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.034154 10297 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:42.079074  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 103992us
I20260709 13:01:42.073765 10470 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:42.039469  8500 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:42.109143  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:41.982383 10388 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.057505  8349 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:01:42.117110  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 59628us
W20260709 13:01:42.099831  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 67148.9us
I20260709 13:01:42.063381 10363 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:42.102851 10475 consensus_queue.cc:1059] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:42.134352 10363 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:42.134896 10363 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:42.134938 10475 raft_consensus.cc:3055] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:42.135470 10475 raft_consensus.cc:740] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:42.036906 10398 consensus_queue.cc:237] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:42.105499 10460 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:42.137971  8380 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:42.106688 10459 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.107302 10448 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:42.107921 10441 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.073168 10382 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:42.119145 10453 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.122538 10469 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.082808 10148 consensus_queue.cc:1059] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:01:42.055145 10201 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:42.160288 10201 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:42.160934 10201 raft_consensus.cc:3055] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:42.161341 10201 raft_consensus.cc:740] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:42.136348 10475 consensus_queue.cc:260] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.162233 10475 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:42.162176 10201 consensus_queue.cc:260] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:42.163447 10201 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.129736 10435 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:42.130052  8526 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:42.153947 10377 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:42.165668 10377 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:42.166059 10377 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:42.154903 10382 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:42.166666 10382 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.131438 10297 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:42.133788 10319 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:42.169071 10319 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:42.141646 10461 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.133185  8379 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:42.170238  8381 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:42.082991 10442 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.171236 10461 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:42.141026  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 101656us
I20260709 13:01:42.172178  8500 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:42.172327 10442 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:42.079670 10408 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:42.153767  8383 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:42.173007 10408 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:42.173486 10408 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.174291 10459 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:42.175861 10390 consensus_meta.cc:287] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.000s
I20260709 13:01:42.176338 10441 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:42.176312 10390 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:42.147819  8426 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:42.099805 10446 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:42.178844 10446 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:42.179306 10446 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:42.154520 10412 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:01:42.150615  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 115623us
I20260709 13:01:42.116451 10470 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.166244 10379 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.191432  8384 raft_consensus.cc:1240] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:42.169536 10319 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:42.156188  9294 raft_consensus.cc:1240] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:42.176358  8526 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:42.180385  8351 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
W20260709 13:01:42.153147  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 78244.7us
I20260709 13:01:42.194473  9260 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:42.194808  8351 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:42.177052  9289 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:42.198499  9260 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:42.197547 10441 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:42.201951 10472 raft_consensus.cc:2804] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.166283 10322 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.199577  8351 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:42.200111 10461 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:42.207105 10458 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:42.197542  9289 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.209605 10481 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:42.209806  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 62123.4us
I20260709 13:01:42.190963 10442 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:42.231786  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:01:42.230602  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 49795us
I20260709 13:01:42.249213  8426 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:42.204924 10459 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:42.251803 10127 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:42.253199  8351 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:42.255673  8351 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:01:42.251900 10488 log.cc:927] Time spent T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:01:42.259573  9288 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:42.260242 10459 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:42.260279 10323 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.261264 10379 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:42.262661 10323 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:42.260850 10459 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:42.264984  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 246060us
I20260709 13:01:42.266206  8456 raft_consensus.cc:1240] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:42.266294  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:42.266963  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:42.258472  8500 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:42.225800 10472 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:42.283900  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.250772 10442 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:42.263279 10408 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:42.245349 10435 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:42.283823  8377 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:42.276496 10127 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:42.190475 10412 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.286453  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:42.278002 10485 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:42.287853 10472 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.290261  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:42.295426  8379 raft_consensus.cc:2393] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 2: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:42.290822  8457 raft_consensus.cc:1240] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:42.277410 10461 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:42.292785  8380 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:42.261312 10469 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:42.308462  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:42.301136  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:42.293035  8377 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:42.278286 10323 consensus_queue.cc:1059] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:01:42.297374  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.277639 10494 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:42.299826  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:42.300683  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:42.300673  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:42.297673 10127 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:42.305652  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:42.305688  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:42.305994  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:42.326217  8455 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:42.306353  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:42.307578  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:42.294425  9290 raft_consensus.cc:2393] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 5: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:01:42.264034 10398 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:01:42.291463 10442 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.288136 10379 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:42.328559  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:42.294580 10485 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:42.294185  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:42.345618  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:01:42.340665  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 73272.4us
I20260709 13:01:42.350654 10127 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:42.362078  8424 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:42.362758 10127 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:42.296731 10425 consensus_queue.cc:1059] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:01:42.365336  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.366232  8379 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:42.371883  8380 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
W20260709 13:01:42.376353  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 61453.1us
I20260709 13:01:42.376381 10444 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.377970  9293 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:42.380048 10448 raft_consensus.cc:3055] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:42.380456 10448 raft_consensus.cc:740] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:01:42.381352  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.346411 10384 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:42.384846  8380 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:42.343585  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:42.386703 10322 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:42.348985 10485 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:42.263834 10490 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 13:01:42.348172 10379 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:42.390147  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:42.391466  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:42.401404 10490 raft_consensus.cc:3055] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:42.326532 10503 consensus_queue.cc:1059] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:01:42.401700  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:42.402271 10398 consensus_queue.cc:1059] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:42.401855 10490 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:42.403090  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:42.405890  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:42.390228 10453 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:42.397269 10379 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:42.392655 10444 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:42.399598 10390 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:42.412014  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:42.406836 10398 raft_consensus.cc:3055] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:42.407677 10412 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:42.388550 10498 consensus_queue.cc:1059] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:01:42.446192  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:42.447010 10462 raft_consensus.cc:3055] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:42.447438 10462 raft_consensus.cc:740] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:42.450013 10319 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.453513 10495 raft_consensus.cc:1064] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:01:42.455729  8383 raft_consensus.cc:1240] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:42.456179  8427 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:42.409801 10446 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.461695  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:42.462951  8452 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:42.463722 10503 consensus_queue.cc:1059] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:42.464565 10390 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:42.465698  8380 raft_consensus.cc:1275] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:42.468283  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:42.452821 10319 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:42.448388 10462 consensus_queue.cc:260] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.435899 10398 raft_consensus.cc:740] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:42.415470 10448 consensus_queue.cc:260] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.471746 10390 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:42.477535 10390 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:42.477685 10448 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:42.475363  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 51807.1us
I20260709 13:01:42.480520  8500 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:42.497280 10514 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:42.488803  8424 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:42.470351 10408 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:42.403784 10506 consensus_queue.cc:1059] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:01:42.428771 10505 consensus_queue.cc:1059] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:01:42.469069 10469 consensus_queue.cc:1059] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:01:42.499270 10503 consensus_queue.cc:1243] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer 105d6581548546b98eddd4ee7083bb12 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:42.478457 10504 raft_consensus.cc:3055] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:42.509951  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:42.497932 10514 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.503271 10297 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:42.479295 10475 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:01:42.506910 10408 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:42.528236 10511 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:42.528941  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.535534  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.536615  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.538697  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.513157 10504 raft_consensus.cc:740] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:42.525782 10462 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.540092 10511 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.549252 10511 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:42.546968  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.555147  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:42.555382  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:42.555972  9287 raft_consensus.cc:2393] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 6: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:01:42.555766 10377 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:42.556474  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:01:42.558913  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.541292 10412 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:42.562201  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.563316  8379 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:01:42.566140  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:42.566516 10505 consensus_queue.cc:1243] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer 105d6581548546b98eddd4ee7083bb12 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:42.567927  8527 raft_consensus.cc:3055] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:42.552843 10485 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.568372  8527 raft_consensus.cc:740] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:42.568861  8385 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:42.542304 10297 raft_consensus.cc:697] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 6 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:42.572687  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:42.591042  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:42.573060  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.561834 10363 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:42.516862 10472 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.579846  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:42.531685 10495 consensus_queue.cc:237] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.582058  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:42.574539  8530 raft_consensus.cc:3055] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:42.553751 10515 raft_consensus.cc:3055] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:42.569361  8527 consensus_queue.cc:260] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:42.587926  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:42.614022  8527 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.538848 10398 consensus_queue.cc:260] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.575773 10412 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:42.605901  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.608956  8530 raft_consensus.cc:740] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:42.569933 10485 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:42.612946  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 113055us
I20260709 13:01:42.615118  8533 raft_consensus.cc:2393] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 6: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:42.618789  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.611698  8500 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:42.623746  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:42.624037  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:42.624869  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:42.625613  8458 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:01:42.626721  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:42.627290  8535 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.627708  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:42.628296  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.629511  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:42.630581  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:42.631623  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:42.632201  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:42.632479  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:42.613708 10515 raft_consensus.cc:740] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:42.634768  8454 raft_consensus.cc:2393] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:42.630077  8461 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:42.635402  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:42.635557  8456 raft_consensus.cc:2393] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 4: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:42.635943  8531 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.633718  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:42.634327  8458 raft_consensus.cc:2393] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 4: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:42.636704  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:42.638106  8459 raft_consensus.cc:2393] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:42.618175 10377 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:42.629153 10398 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.640198  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.690894  8379 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:01:42.691947 10363 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:42.692111 10412 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:42.694304 10472 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:42.588737 10504 consensus_queue.cc:260] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:42.622342 10446 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:42.689239  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:42.702778  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:42.691977  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.625180 10505 raft_consensus.cc:2804] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.628468  9292 raft_consensus.cc:1240] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:42.701975  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:42.702983  8453 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:01:42.706748  8458 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:42.706915  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:42.641595 10330 raft_consensus.cc:3055] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:42.727370  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:42.708575  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:42.708902  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:42.708019  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:42.717942  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:01:42.723070 10470 consensus_meta.cc:287] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.535s	user 0.011s	sys 0.000s
I20260709 13:01:42.741786  8459 raft_consensus.cc:1240] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:42.743989  9260 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:42.750723  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.751573  8379 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 4: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:42.705108 10505 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:01:42.754947  9261 leader_election.cc:336] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.016s (SENT)
I20260709 13:01:42.758656  9261 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:42.758594  8527 raft_consensus.cc:1275] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:42.724146 10330 raft_consensus.cc:740] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:42.762787  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.762825  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:42.763887  8527 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:42.764001  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.764642  8386 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:01:42.766736 10444 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:42.749933 10477 consensus_queue.cc:1059] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:01:42.767714  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:42.768273 10477 raft_consensus.cc:3055] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:42.768647 10477 raft_consensus.cc:740] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:42.769536 10477 consensus_queue.cc:260] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.770742 10477 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:42.771575  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 1946) took 1101 ms. Trace:
W20260709 13:01:42.755877  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.771991  8381 rpcz_store.cc:276] 0709 13:01:41.670430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.670619 (+   189us) service_pool.cc:224] Handling call
0709 13:01:41.670929 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.170708 (+499779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.771342 (+600634us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54003b7754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:42.771513 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147781504}
I20260709 13:01:42.705119 10459 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:42.752928 10463 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:42.778235  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.779062  8379 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:42.775631  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.689414 10297 consensus_queue.cc:237] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:42.766088 10201 consensus_meta.cc:287] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.003s
I20260709 13:01:42.777186  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.758842 10505 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.786083  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.788332  8531 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:42.791317  8349 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:42.792735  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.793311  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:42.793897  8380 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:42.794679  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:42.795094  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.781253  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:42.797262  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.798621  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:42.799228  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.799331  9293 raft_consensus.cc:2393] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 4: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:01:42.800207  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.798380  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.801637  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:42.802273  8379 raft_consensus.cc:2393] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:42.803159  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.806049  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.756958 10470 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.807580  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.807670  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.810560  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:42.812530  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:42.797461 10148 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:42.814432  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.801869 10514 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:42.822203  8378 raft_consensus.cc:1275] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:42.815389  8386 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:42.793227 10518 consensus_queue.cc:1059] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:01:42.821398  8535 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:42.804466 10330 consensus_queue.cc:260] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.832811  8349 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:42.797791 10515 consensus_queue.cc:260] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.844913  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.821519  8381 raft_consensus.cc:2376] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6. Re-sending same reply.
I20260709 13:01:42.874046  8461 raft_consensus.cc:1240] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:42.873875  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.869530  8527 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:42.851487  8500 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:42.821023  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:42.877607 10518 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:42.878024 10518 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:42.871311 10461 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:42.878516 10502 raft_consensus.cc:3055] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:42.878829 10461 raft_consensus.cc:697] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:42.878343  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:42.882714  8500 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:01:42.868695 10382 consensus_meta.cc:287] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.702s	user 0.012s	sys 0.000s
W20260709 13:01:42.869002 10442 consensus_meta.cc:287] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.505s	user 0.004s	sys 0.008s
I20260709 13:01:42.881997 10490 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:42.904968 10490 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.905405  9290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55734 (request call id 569) took 1177 ms. Trace:
I20260709 13:01:42.878400 10518 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:42.860631 10505 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.827014 10148 raft_consensus.cc:697] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:42.886076  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.886708 10511 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:42.887600  8500 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:42.916880  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.887995  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:42.888463  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.917891  8528 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:42.918618  8381 raft_consensus.cc:1240] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:42.898336 10470 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:42.889678  8529 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:42.890897 10503 raft_consensus.cc:3055] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:01:42.895550 10498 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:01:42.895013 10390 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:42.878986 10502 raft_consensus.cc:740] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:42.930661 10502 consensus_queue.cc:260] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.931397 10390 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:42.931705 10502 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:42.932046  8454 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:42.932762 10148 consensus_queue.cc:237] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.934788  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:42.937743  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:42.938412  8379 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:01:42.939419  8379 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:42.896154  8385 raft_consensus.cc:1240] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:42.897619  8378 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:42.897622  8533 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:42.941335  8526 raft_consensus.cc:2393] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 3: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:42.873442 10459 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:42.899150  8386 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:42.902388  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:42.898624 10515 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.906205  9295 raft_consensus.cc:1240] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:01:42.907953  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 75972.2us
I20260709 13:01:42.920506  8381 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:42.889603  8527 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:42.920708  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.921371  9260 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:42.952919  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:42.924860  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:42.955423  8500 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:42.956624  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:01:42.927597  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.927964  8384 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:42.928979 10377 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:42.929611 10503 raft_consensus.cc:740] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:42.942349  8533 raft_consensus.cc:1240] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:42.884195 10461 consensus_queue.cc:237] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.838271 10521 raft_consensus.cc:3055] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:42.947860  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:42.948012  8378 raft_consensus.cc:1240] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:42.949319  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.949648  8528 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:42.960399  8381 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:42.962023  8500 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:42.910614 10442 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:42.932060 10505 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:42.910827 10382 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:42.996917  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:42.998461  8527 raft_consensus.cc:1240] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:42.998656 10382 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:42.999452  8382 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:42.912855 10379 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:42.967815 10363 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:42.993275  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.993305  8532 raft_consensus.cc:2393] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 4: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:43.002203  8500 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:42.965118 10476 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:42.965695 10513 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:42.959211  9288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 558) took 1243 ms. Trace:
I20260709 13:01:42.947907 10482 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:01:43.018339  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.909649  9290 rpcz_store.cc:276] 0709 13:01:41.727597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.799768 (+ 72171us) service_pool.cc:224] Handling call
0709 13:01:42.905131 (+1105363us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b5400773154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:42.905316 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835520256}
I20260709 13:01:42.962387 10377 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:42.986043  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:43.003997 10503 consensus_queue.cc:260] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:43.053263  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.062837  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.004709 10379 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:43.056105 10505 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:42.967123 10500 consensus_queue.cc:1059] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:01:43.070815  8384 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:42.995239  8459 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:42.968129 10514 consensus_queue.cc:1059] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.124s
I20260709 13:01:42.995204 10442 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:43.091953  8283 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53484 (request call id 333) took 5113 ms. Trace:
W20260709 13:01:43.102227  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.001027 10521 raft_consensus.cc:740] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:42.536175  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:43.161759  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 159606us
I20260709 13:01:43.119194  8455 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
W20260709 13:01:43.126773  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.154557  8453 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:42.967171 10470 consensus_queue.cc:1048] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.171s
I20260709 13:01:43.070863 10377 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:43.057871  9288 rpcz_store.cc:276] 0709 13:01:41.716064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.723473 (+  7409us) service_pool.cc:224] Handling call
0709 13:01:41.772699 (+ 49226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.260010 (+487311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.924749 (+664739us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b540049fcd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:42.954321 (+ 29572us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1059224832}
I20260709 13:01:43.001258 10498 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:01:43.069526  9289 consensus_meta.cc:287] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.805s	user 0.010s	sys 0.002s
I20260709 13:01:43.202844  8349 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:43.202832  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:43.209280  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.210354  8500 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:43.212078 10392 consensus_queue.cc:1059] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:43.211691 10148 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:43.215659  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:43.216391  8453 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:43.221092  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 68081.7us
I20260709 13:01:43.214648 10503 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:43.070943 10482 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:43.203094 10446 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:43.217474 10516 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:43.175747  8283 rpcz_store.cc:276] 0709 13:01:37.979005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.009454 (+ 30449us) service_pool.cc:224] Handling call
0709 13:01:43.091882 (+5082428us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:41.571259 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:41.572035 (+   776us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:41.572073 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:01:41.572090 (+    17us) tablet.cc:662] Decoding operations
0709 13:01:41.572625 (+   535us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:41.572706 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:41.572746 (+    40us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:01:41.573215 (+   469us) tablet.cc:701] Row locks acquired
0709 13:01:41.573237 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:01:41.573444 (+   207us) write_op.cc:270] Start()
0709 13:01:41.573604 (+   160us) write_op.cc:276] Timestamp: P: 1783602101573376 usec, L: 0
0709 13:01:41.573639 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:01:41.574574 (+   935us) log.cc:844] Serialized 913 byte log entry
0709 13:01:42.192595 (+618021us) op_driver.cc:464] REPLICATION: finished
0709 13:01:42.334772 (+142177us) write_op.cc:301] APPLY: starting
0709 13:01:42.334901 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:42.335073 (+   172us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:42.335212 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:42.335666 (+   454us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:42.335927 (+   261us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:01:42.335997 (+    70us) write_op.cc:312] APPLY: finished
0709 13:01:42.336301 (+   304us) log.cc:844] Serialized 29 byte log entry
0709 13:01:42.336512 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:42.336603 (+    91us) write_op.cc:454] Released schema lock
0709 13:01:42.336642 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:42.336999 (+   357us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:42.337030 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":158038,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":134931,"apply.run_cpu_time_us":2234,"apply.run_wall_time_us":2240,"num_ops":2,"prepare.queue_time_us":282477,"prepare.run_cpu_time_us":70899,"prepare.run_wall_time_us":181726,"raft.queue_time_us":117502,"raft.run_cpu_time_us":47816,"raft.run_wall_time_us":88805,"replication_time_us":618753,"thread_start_us":511663,"threads_started":4,"wal-append.queue_time_us":202121}]]}
I20260709 13:01:43.205682 10379 consensus_queue.cc:1059] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:01:43.398355  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:43.399219  8461 raft_consensus.cc:2393] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 4: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
W20260709 13:01:43.399978  8501 leader_election.cc:336] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.518s (SENT)
I20260709 13:01:43.219013 10382 consensus_queue.cc:1059] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:01:43.404191  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:43.410378  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:43.415122 10472 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:43.415928 10472 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:43.419854 10482 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:43.322305 10446 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:43.217917  9289 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:43.421624 10477 consensus_meta.cc:287] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.004s
I20260709 13:01:43.421948  9296 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 3. Ops: []
W20260709 13:01:43.427820 10511 consensus_meta.cc:287] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.502s	user 0.002s	sys 0.004s
W20260709 13:01:43.428262  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.434564 10382 raft_consensus.cc:3055] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:43.457446  8452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36446 (request call id 1668) took 1154 ms. Trace:
I20260709 13:01:43.457827  8529 raft_consensus.cc:1240] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:43.329528 10392 raft_consensus.cc:3055] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:43.464421 10392 raft_consensus.cc:740] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:43.465516 10392 consensus_queue.cc:260] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:43.466859 10392 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:43.469074 10472 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:43.440887 10448 consensus_meta.cc:287] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.963s	user 0.012s	sys 0.000s
I20260709 13:01:43.322096  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:43.454850  8455 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:43.477582  9288 raft_consensus.cc:2393] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 3: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:01:43.456449  8528 raft_consensus.cc:1240] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:43.362501 10476 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:43.479580 10330 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:43.479338 10476 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:43.457949  8452 rpcz_store.cc:276] 0709 13:01:42.303059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.305225 (+  2166us) service_pool.cc:224] Handling call
0709 13:01:43.457290 (+1152065us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54000d5f54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:43.457392 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233514752}
I20260709 13:01:43.457324 10382 raft_consensus.cc:740] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:01:43.482146 10490 consensus_meta.cc:287] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.000s
I20260709 13:01:43.400058 10507 raft_consensus.cc:3055] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:43.458302  8453 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:43.455526 10511 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:43.481813 10476 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:43.482978  8460 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:43.476375  8461 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:43.485968  8526 raft_consensus.cc:1240] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:43.487221  8501 leader_election.cc:336] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.534s (SENT)
W20260709 13:01:43.525874  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 405075us
W20260709 13:01:43.455708 10462 consensus_meta.cc:287] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.875s	user 0.008s	sys 0.003s
I20260709 13:01:43.545709  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:43.529644  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.537489  8424 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:01:43.544010  8501 leader_election.cc:336] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.536s (SENT)
I20260709 13:01:43.548856  8501 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:43.550261  8501 leader_election.cc:336] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.769s (SENT)
I20260709 13:01:43.550796  8501 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:43.552047  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.555684  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 1701) took 1027 ms. Trace:
I20260709 13:01:43.556406  8386 rpcz_store.cc:276] 0709 13:01:42.528487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.829569 (+301082us) service_pool.cc:224] Handling call
0709 13:01:42.898979 (+ 69410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.943838 (+ 44859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.555442 (+611604us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b5400350550. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:43.555607 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67791616}
W20260709 13:01:43.565248  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.570380  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:01:43.570667  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.571435  8532 raft_consensus.cc:2393] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 3: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:01:43.571884  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 350189us
I20260709 13:01:43.572329  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:43.573640  9296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 577) took 1765 ms. Trace:
I20260709 13:01:43.576457  8531 raft_consensus.cc:1240] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:43.574237  9296 rpcz_store.cc:276] 0709 13:01:41.808528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.821595 (+ 13067us) service_pool.cc:224] Handling call
0709 13:01:41.821941 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.422386 (+1600445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.554983 (+132597us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54005348d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:43.573558 (+ 18575us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3678826880}
W20260709 13:01:43.623607  8501 leader_election.cc:336] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.564s (SENT)
I20260709 13:01:43.632493  8501 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:43.482831 10513 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:43.575672 10490 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:43.576483  8424 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:43.625628  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 77095.8us
I20260709 13:01:43.487440 10507 raft_consensus.cc:740] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:01:43.652088  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 75728.1us
I20260709 13:01:43.633447 10511 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:43.658212  8424 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:43.660257  8424 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:43.646220 10513 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:43.544867 10148 raft_consensus.cc:697] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:43.633921 10469 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:01:43.649693 10531 log.cc:927] Time spent T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:01:43.572266 10379 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:43.665534 10127 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:01:43.674542 10495 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.079s	sys 0.149s
I20260709 13:01:43.650991 10483 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:01:43.679137 10495 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.079s	sys 0.149s
I20260709 13:01:43.487828 10382 consensus_queue.cc:260] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:43.634312 10476 consensus_queue.cc:1059] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:01:43.671015 10514 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:43.663180 10482 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:01:43.673671 10518 consensus_meta.cc:287] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.747s	user 0.009s	sys 0.000s
I20260709 13:01:43.656189 10388 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:43.623057 10363 consensus_queue.cc:1059] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:01:43.666635 10522 consensus_queue.cc:1059] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:01:43.677748 10319 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:43.674922 10477 consensus_queue.cc:1059] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:01:43.651398 10448 consensus_queue.cc:1059] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:01:43.656462 10490 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:43.702853 10490 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:43.703591 10382 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.704594 10363 consensus_queue.cc:1243] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer 105d6581548546b98eddd4ee7083bb12 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:43.691049 10148 consensus_queue.cc:237] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:43.691865 10521 consensus_queue.cc:260] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:43.694504  9295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 353) took 1706 ms. Trace:
I20260709 13:01:43.700084 10319 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:43.708035  9295 rpcz_store.cc:276] 0709 13:01:41.987734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.992885 (+  5151us) service_pool.cc:224] Handling call
0709 13:01:42.103145 (+110260us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b5400772fa8. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36cd3aeaa1 00007f36cd429ebc 00007f36cd45f08c 00007f36cd44993b 00007f36cd4493d2 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c
0709 13:01:42.905962 (+802817us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:42.950994 (+ 45032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.694264 (+743270us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b5400773150. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:43.694429 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1853148800}
I20260709 13:01:43.711971 10521 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.716614 10319 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:43.689846 10514 raft_consensus.cc:697] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:43.718490  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 1780) took 1109 ms. Trace:
I20260709 13:01:43.718353 10514 consensus_queue.cc:237] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:43.718863  8528 rpcz_store.cc:276] 0709 13:01:42.609062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.995873 (+386811us) service_pool.cc:224] Handling call
0709 13:01:43.456259 (+460386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.477996 (+ 21737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.718281 (+240285us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b54000f87d0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:43.718428 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1058112896}
I20260709 13:01:43.722002 10481 raft_consensus.cc:3055] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:43.722476 10481 raft_consensus.cc:740] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:43.723268 10481 consensus_queue.cc:260] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:43.724521 10481 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:43.726007 10504 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.736279 10297 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.736864 10297 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:43.737684 10446 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:43.738480  9289 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:43.739279  9289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:55734 (request call id 559) took 2022 ms. Trace:
I20260709 13:01:43.687767 10518 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:43.687227 10507 consensus_queue.cc:260] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:43.684783 10483 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:43.739624 10516 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:43.753364 10502 consensus_meta.cc:287] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.821s	user 0.011s	sys 0.000s
I20260709 13:01:43.759166 10518 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:43.760500 10545 raft_consensus.cc:3055] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:43.760962 10545 raft_consensus.cc:740] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:43.762041 10545 consensus_queue.cc:260] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:43.763402 10545 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:43.792392  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 132042us
W20260709 13:01:43.793397  8349 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.008s	sys 0.004s
W20260709 13:01:43.793929  8349 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.008s	sys 0.004s
W20260709 13:01:43.794420  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 581425us
I20260709 13:01:43.794454  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:43.634948  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:43.795682  8424 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:43.798614  8424 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:43.801479  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:43.802203  8424 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:43.803216  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:43.642647  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:43.806934  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:01:43.809769  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 145508us
I20260709 13:01:43.739765  9289 rpcz_store.cc:276] 0709 13:01:41.716471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.723672 (+  7201us) service_pool.cc:224] Handling call
0709 13:01:43.736553 (+2012881us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54005348d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c847ca3d 00007f36cd44ccd0 00007f36c69d1254 00007f36c69d11e2 00007f36c69d1111 00007f36c69d108c 00007f36c69d0342 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:43.739145 (+  2592us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920069376}
W20260709 13:01:43.814352  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 132524us
I20260709 13:01:43.816172  9260 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:43.817540  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:43.819711  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:43.822978  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 199262us
I20260709 13:01:43.808681  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:01:43.825037  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.831218 10297 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:43.841998 10377 consensus_meta.cc:287] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.002s
I20260709 13:01:43.842724 10377 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:43.828982  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 159934us
I20260709 13:01:43.844689  8533 raft_consensus.cc:1240] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:43.844854  9258 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:43.846489  8526 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:43.847321 10377 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:43.848003  8534 raft_consensus.cc:1240] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:43.842778 10297 consensus_queue.cc:1059] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:01:43.850878 10297 raft_consensus.cc:3055] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:43.851413 10297 raft_consensus.cc:740] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:43.833822  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:43.832078  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:43.833494  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:43.854998  8461 raft_consensus.cc:2393] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 2: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:43.838089 10127 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:43.842742  8381 raft_consensus.cc:2393] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:43.853369  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:01:43.842765  8501 leader_election.cc:336] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.625s (SENT)
I20260709 13:01:43.856320  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:43.856403 10127 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:43.859131 10127 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:43.859627 10127 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:43.860067 10127 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:43.860740  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:43.865985  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:43.867130  8528 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:43.867578  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:43.863041 10390 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:43.863531  8534 raft_consensus.cc:1240] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:43.865058  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:43.860538 10297 consensus_queue.cc:260] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:43.869932 10425 consensus_queue.cc:1059] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:43.870735 10441 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:43.871516 10472 raft_consensus.cc:3055] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:43.890479 10472 raft_consensus.cc:740] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:43.873461 10446 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:43.893850 10446 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:43.895099 10425 raft_consensus.cc:3055] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:43.895401  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:43.895722 10425 raft_consensus.cc:740] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:43.875399 10490 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:43.875630 10522 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:43.876181  8454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36448 (request call id 1751) took 1243 ms. Trace:
I20260709 13:01:43.877787  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 1773) took 1281 ms. Trace:
I20260709 13:01:43.857734  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:43.874670 10483 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:43.755720 10507 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:43.899670  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 52935.8us
I20260709 13:01:43.892246 10472 consensus_queue.cc:260] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:43.899652  8529 rpcz_store.cc:276] 0709 13:01:42.595678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.977911 (+382233us) service_pool.cc:224] Handling call
0709 13:01:43.457628 (+479717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.458338 (+   710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.877268 (+418930us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b54000ab250. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:43.877537 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":922523392}
I20260709 13:01:43.903606 10472 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:43.897330 10503 consensus_meta.cc:287] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.631s	user 0.007s	sys 0.002s
I20260709 13:01:43.896878 10446 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:43.906100  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.906631  8535 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:43.906212 10490 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:43.897390  8386 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:43.900164  8454 rpcz_store.cc:276] 0709 13:01:42.632085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.635331 (+  3246us) service_pool.cc:224] Handling call
0709 13:01:42.637632 (+  2301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.932449 (+294817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.875552 (+943103us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b540019d2d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:43.875914 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676677504}
I20260709 13:01:43.907409 10441 raft_consensus.cc:697] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:01:43.908309 10546 consensus_queue.cc:1175] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "105d6581548546b98eddd4ee7083bb12" responder_term: 4 status { last_received { term: 3 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:43.910375 10441 consensus_queue.cc:237] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:43.911862  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 69284.7us
I20260709 13:01:43.914098  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:43.915103  8454 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.915578  8381 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:43.916657  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:43.911743  8460 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36448 (request call id 1740) took 1288 ms (client timeout 1518 ms). Trace:
W20260709 13:01:43.918387  8460 rpcz_store.cc:269] 0709 13:01:42.623694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.623829 (+   135us) service_pool.cc:224] Handling call
0709 13:01:43.911361 (+1287532us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b540015b8d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:43.911551 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1973957888}
I20260709 13:01:43.919188 10420 raft_consensus.cc:3055] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:43.919708 10420 raft_consensus.cc:740] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:43.922122 10477 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:43.922535 10553 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:43.923316  8501 leader_election.cc:336] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.632s (SENT)
I20260709 13:01:43.923882  8501 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:43.925045  8351 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:01:43.938304  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.939380  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 308) took 1652 ms. Trace:
I20260709 13:01:43.940342  8380 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:43.939893  8382 rpcz_store.cc:276] 0709 13:01:42.286846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.287206 (+   360us) service_pool.cc:224] Handling call
0709 13:01:42.287551 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.999861 (+712310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.938754 (+938893us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b54002f9ed4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:43.939135 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1636733696}
I20260709 13:01:43.924840 10483 consensus_queue.cc:1059] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:01:43.945268 10550 log.cc:927] Time spent T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.137s	user 0.000s	sys 0.002s
I20260709 13:01:43.945616 10517 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:43.945367  8530 consensus_queue.cc:260] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:43.955861 10529 log.cc:927] Time spent T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.869s	user 0.006s	sys 0.004s
I20260709 13:01:43.941396 10319 consensus_queue.cc:1059] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:01:43.960330  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 1962) took 1497 ms. Trace:
I20260709 13:01:43.964226  8377 rpcz_store.cc:276] 0709 13:01:42.462701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.463181 (+   480us) service_pool.cc:224] Handling call
0709 13:01:42.463476 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:43.636004 (+1172528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.636052 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.799556 (+163504us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.810186 (+ 10630us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:43.810264 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.959732 (+149468us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b5400269154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:43.959777 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:43.959821 (+    44us) raft_consensus.cc:1685] finished
0709 13:01:43.959834 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:43.960147 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47445,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":66553,"spinlock_wait_cycles":1771118976,"thread_start_us":411611,"threads_started":2,"wal-append.queue_time_us":7643}
W20260709 13:01:43.949024  8501 leader_election.cc:336] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.656s (SENT)
I20260709 13:01:43.967150  8501 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:43.967377 10461 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.008s	sys 0.014s
I20260709 13:01:43.969686  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1747) took 1347 ms. Trace:
I20260709 13:01:43.970259  8535 rpcz_store.cc:276] 0709 13:01:42.622488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.173575 (+551087us) service_pool.cc:224] Handling call
0709 13:01:43.207747 (+ 34172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.907082 (+699335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.969377 (+ 62295us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b54000aa354. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:43.969610 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1605641984}
I20260709 13:01:43.972245 10297 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:43.963665  8459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36448 (request call id 1761) took 1135 ms. Trace:
I20260709 13:01:43.965837 10490 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:43.961653  8383 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:43.943437 10420 consensus_queue.cc:260] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:43.900024 10425 consensus_queue.cc:260] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:43.985877 10319 raft_consensus.cc:3055] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:43.986418 10319 raft_consensus.cc:740] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:43.986701 10425 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:43.987690 10319 consensus_queue.cc:260] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:43.980490 10382 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:43.981299  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:43.992471 10420 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:43.981671  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 1697) took 1454 ms. Trace:
W20260709 13:01:43.988981 10462 consensus_queue.cc:1175] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d653e71832b7402b9a03b46249d3b885" responder_term: 5 status { last_received { term: 4 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:43.972916  8459 rpcz_store.cc:276] 0709 13:01:42.827739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.158063 (+330324us) service_pool.cc:224] Handling call
0709 13:01:43.158366 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.403404 (+245038us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.403443 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:43.403495 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:43.403535 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.963124 (+559589us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b540040ecd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:43.963198 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:43.963440 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563003776}
I20260709 13:01:43.979250 10127 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:43.996045 10377 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:43.923333 10553 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:44.001492  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 63894.1us
W20260709 13:01:44.002364  8501 leader_election.cc:336] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.670s (SENT)
I20260709 13:01:44.002914  8501 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:43.993654  8383 rpcz_store.cc:276] 0709 13:01:42.527650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.809461 (+281811us) service_pool.cc:224] Handling call
0709 13:01:43.961260 (+1151799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.980237 (+ 18977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.981393 (+  1156us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400269150. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:43.981603 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2647968128}
I20260709 13:01:43.992688 10319 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.004839  8454 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
W20260709 13:01:44.007777  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.007459 10461 consensus_queue.cc:1059] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:01:44.014573  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.016029 10382 raft_consensus.cc:3055] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:44.016587 10382 raft_consensus.cc:740] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:44.017848 10382 consensus_queue.cc:260] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:44.019727 10382 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:44.029930 10532 log.cc:927] Time spent T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.566s	user 0.000s	sys 0.005s
I20260709 13:01:44.030678  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 311) took 1463 ms. Trace:
I20260709 13:01:44.031178  8531 rpcz_store.cc:276] 0709 13:01:42.566699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.902512 (+335813us) service_pool.cc:224] Handling call
0709 13:01:42.906810 (+  4298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.576903 (+670093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.030135 (+453232us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b54000f73d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:44.030460 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1539511680}
I20260709 13:01:44.031826  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 1968) took 1140 ms. Trace:
I20260709 13:01:44.031939  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:44.032248  8379 rpcz_store.cc:276] 0709 13:01:42.891292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.940107 (+ 48815us) service_pool.cc:224] Handling call
0709 13:01:42.940385 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:42.955611 (+ 15226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.955642 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:42.966658 (+ 11016us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.218393 (+251735us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:43.218432 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.218495 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.024176 (+805681us) spinlock_profiling.cc:243] Waited 7.41 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:01:44.031381 (+  7205us) raft_consensus.cc:1685] finished
0709 13:01:44.031399 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.031673 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9081,"raft.queue_time_us":13536,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":29008,"spinlock_wait_cycles":17049984,"thread_start_us":147071,"threads_started":1,"wal-append.queue_time_us":457282}
I20260709 13:01:44.034413 10482 raft_consensus.cc:3055] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:44.034907 10482 raft_consensus.cc:740] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:44.035508  8379 raft_consensus.cc:1240] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:44.035995 10482 consensus_queue.cc:260] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:44.037686  8501 leader_election.cc:336] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.685s (SENT)
I20260709 13:01:44.041899  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:44.046096 10476 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:44.046859 10476 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.047384 10486 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.048105 10486 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.049265 10540 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:44.050148 10540 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.048138  8527 raft_consensus.cc:1275] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:01:44.052793  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.053435 10500 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:44.054023 10482 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.052949  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1751) took 1138 ms. Trace:
I20260709 13:01:44.055830 10127 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:44.054277 10500 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.055670  8527 rpcz_store.cc:276] 0709 13:01:42.914303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.194527 (+280224us) service_pool.cc:224] Handling call
0709 13:01:43.214516 (+ 19989us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.051831 (+837315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.052621 (+   790us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b54002ad0d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:44.052896 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1915616000}
I20260709 13:01:44.060503 10500 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:44.061375 10518 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.061944 10518 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:44.063759 10547 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:01:44.059087  8501 leader_election.cc:336] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.699s (SENT)
I20260709 13:01:44.066864 10546 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:44.065506 10547 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.067611  8379 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:44.069849  8501 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:44.069329 10490 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:44.071110 10490 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:44.071712 10547 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:44.069388 10476 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:44.067589 10546 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.075276 10448 raft_consensus.cc:3055] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:44.075742 10448 raft_consensus.cc:740] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:44.076892 10448 consensus_queue.cc:260] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:44.079775 10392 consensus_meta.cc:287] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.577s	user 0.017s	sys 0.000s
I20260709 13:01:44.080031  9260 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:44.080477 10448 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:44.080576  8385 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:01:44.079803 10486 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:44.082322 10490 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:44.082125  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:44.085222  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:44.087782  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 1777) took 1480 ms. Trace:
I20260709 13:01:44.087958 10521 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:44.088306  8533 rpcz_store.cc:276] 0709 13:01:42.608305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.968060 (+359755us) service_pool.cc:224] Handling call
0709 13:01:42.968284 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.845320 (+877036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.086953 (+241633us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b5400077bd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:44.087722 (+   769us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2014496512}
I20260709 13:01:44.088791 10481 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.089711 10201 raft_consensus.cc:3055] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:44.089437 10481 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.090094 10201 raft_consensus.cc:740] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:44.090348 10476 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:44.091262 10476 raft_consensus.cc:697] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:44.091848 10481 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:44.087798 10546 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:44.091272 10201 consensus_queue.cc:260] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:44.098860  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:44.096951 10201 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:44.104951  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.109328  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:44.102540  8460 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:01:44.112892  8459 raft_consensus.cc:2393] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 4: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:44.113809  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:44.115522  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:44.118287  9260 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:44.119256 10441 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:44.119738 10441 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:44.120144 10441 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:44.099483 10521 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:44.121691  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:44.111140  8349 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:44.126346  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:44.126951  8454 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
W20260709 13:01:44.131073  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.132207 10330 consensus_meta.cc:287] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.652s	user 0.014s	sys 0.007s
I20260709 13:01:44.136373  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:44.137336 10472 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:44.138093 10472 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.141891  8532 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:01:44.142606 10420 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.147156  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:44.150775  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.167443  9258 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:44.168708 10546 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:44.169194 10546 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:44.169606 10546 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:44.153553 10453 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:44.154454 10382 consensus_queue.cc:1059] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:44.155530 10472 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:44.161453 10518 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:44.092381 10476 consensus_queue.cc:237] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:44.171523  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.154704 10392 consensus_queue.cc:1059] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:01:44.170442  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 245689us
I20260709 13:01:44.176198  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:44.176895 10553 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:44.167627  8530 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:44.180418  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:44.186959  9260 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:44.122885 10540 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:44.186319 10382 raft_consensus.cc:3055] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:44.191946 10382 raft_consensus.cc:740] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:44.193802 10382 consensus_queue.cc:260] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.195547 10382 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:44.197346 10539 consensus_queue.cc:1059] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:44.198617  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:44.199280  8459 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:01:44.171743 10453 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:44.198617  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:01:44.201880  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.202117 10319 raft_consensus.cc:3055] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:44.202518 10319 raft_consensus.cc:740] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:44.203408  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:01:44.203905  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 164433us
I20260709 13:01:44.197244  8427 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:44.200169 10453 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.209492 10458 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:44.179147 10517 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:44.218263  8532 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
W20260709 13:01:44.229017  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.229347  9258 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:01:44.202441  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.171613 10420 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:44.229941  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 46824.1us
I20260709 13:01:44.247169  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:44.248425  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:44.249311  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.254331  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:44.250370  8384 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
W20260709 13:01:44.257045  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.260218  8530 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:44.261150  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1741) took 1699 ms. Trace:
I20260709 13:01:44.246094 10553 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:01:44.262102  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.242306 10540 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:44.261132  8460 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
W20260709 13:01:44.264534  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.265897  8427 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:44.261664  8530 rpcz_store.cc:276] 0709 13:01:42.562030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.562135 (+   105us) service_pool.cc:224] Handling call
0709 13:01:42.562383 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.694244 (+1131861us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b540021a5a0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c840306f 00007f36c847bf60 00007f36c847d7de 00007f36c8487b49 00007f36c8488416 00007f36c8484d8f 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62
0709 13:01:43.901232 (+206988us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b540021a5a0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8402520 00007f36c847bf70 00007f36c847d7de 00007f36c8487b49 00007f36c8488416 00007f36c8484d8f 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62
0709 13:01:44.167013 (+265781us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b58004301d0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c83e10aa 00007f36c8463447 00007f36c847bfe7 00007f36c847d7de 00007f36c8487b49 00007f36c8488416 00007f36c8484d8f 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4
0709 13:01:44.260782 (+ 93769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.261048 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":547635584}
I20260709 13:01:44.271255  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:44.274896  8500 leader_election.cc:336] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.518s (SENT)
I20260709 13:01:44.275388  8500 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:44.276929  8527 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:44.277372  8380 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:44.264353 10458 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.258821 10319 consensus_queue.cc:260] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:44.281702  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.283322 10459 consensus_queue.cc:1059] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:44.284943 10459 raft_consensus.cc:3055] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:44.285475 10459 raft_consensus.cc:740] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:44.294588  8427 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:44.283735  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:44.266979 10540 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:01:44.274370 10443 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
W20260709 13:01:44.312037  8501 leader_election.cc:336] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.712s (SENT)
I20260709 13:01:44.312639  8501 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:44.311491  8378 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:44.320375  8530 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 2: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:44.270267 10553 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.304577 10540 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:44.331920  8427 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:44.341519  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:44.341768  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:01:44.343271  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.321259 10517 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:44.311940 10459 consensus_queue.cc:260] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:44.347466 10408 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:44.347901 10408 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.347954 10459 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:44.348294 10408 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.333535 10500 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.349993 10500 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:44.352190 10500 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:44.338649 10446 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:44.356642  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:44.357261 10503 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.352998 10446 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.357925 10503 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.358577 10446 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.360666 10503 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:44.363240 10555 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:44.363786 10555 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:44.363474  8459 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:44.364315 10555 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.365558  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:44.366315 10477 consensus_queue.cc:1059] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:44.367504 10477 raft_consensus.cc:3055] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:44.367827 10477 raft_consensus.cc:740] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:44.347185  8535 raft_consensus.cc:2393] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 5: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:44.368790 10477 consensus_queue.cc:260] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.370903 10477 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:44.374352 10420 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:44.375357 10559 log.cc:927] Time spent T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:44.376902 10472 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:44.377653 10472 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.378230 10522 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.378684  8424 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:44.378789 10522 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:44.380285  8424 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:44.380986 10514 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:01:44.377152 10557 log.cc:927] Time spent T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:01:44.383154 10553 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:44.383428 10472 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:44.383889  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 88148.7us
W20260709 13:01:44.384660  8501 leader_election.cc:336] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.764s (SENT)
I20260709 13:01:44.385069  8501 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:44.388088 10507 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:44.388777 10507 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.380875 10522 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:44.389225 10507 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:44.342998 10545 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:44.390410 10545 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.390776 10545 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:44.397348 10507 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:44.397571  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:44.398182  9290 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:44.400542  9296 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:44.401862  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:44.402623  9287 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:01:44.403637  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:44.404526  9288 raft_consensus.cc:2393] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 5: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
W20260709 13:01:44.375272  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 103715us
I20260709 13:01:44.324096 10518 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:44.409215  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:44.413266  8383 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:44.310899 10458 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.409842  8424 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:44.414397 10500 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:44.414314 10514 consensus_queue.cc:1048] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:01:44.421247 10127 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:44.421283  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:01:44.455297  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 46856.3us
I20260709 13:01:44.457211  8427 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:44.464756 10127 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:44.465229 10127 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.465569 10127 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:44.466447  8501 leader_election.cc:336] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.874s (SENT)
I20260709 13:01:44.416321 10507 consensus_queue.cc:1059] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:01:44.473183  8501 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:44.477814 10544 log.cc:927] Time spent T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:01:44.478454  8501 leader_election.cc:336] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.917s (SENT)
I20260709 13:01:44.479105  8501 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:44.480717  8501 leader_election.cc:336] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.971s (SENT)
I20260709 13:01:44.481242 10552 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:44.483033 10552 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.481307 10518 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:44.485189  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.482095 10297 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:44.487409  8501 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:44.492316 10297 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:44.493796  8461 raft_consensus.cc:1240] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:44.489989 10552 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:44.495651 10297 raft_consensus.cc:3055] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:44.496183 10297 raft_consensus.cc:740] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:44.496260 10408 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:44.500758  8501 leader_election.cc:336] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.984s (SENT)
I20260709 13:01:44.505250 10201 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:44.510674 10382 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:01:44.519572  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 109838us
I20260709 13:01:44.509349 10507 consensus_queue.cc:1059] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:44.552628 10507 raft_consensus.cc:3055] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:44.553112 10507 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:44.554329 10319 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:44.554128 10507 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:44.555503 10507 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.497645 10297 consensus_queue.cc:260] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.557767 10297 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:44.565580  9261 leader_election.cc:336] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.694s (SENT)
I20260709 13:01:44.566169  9261 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:44.461102 10547 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:44.505477 10546 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.503080 10446 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.485311  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:44.448766 10453 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:44.534487 10472 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.535552  8458 raft_consensus.cc:1240] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:44.486915 10458 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:44.537354 10554 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.588992 10453 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:44.590384 10441 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.590525 10554 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.591868  9293 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 7: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:01:44.537962 10330 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:44.539114 10540 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:44.543604  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.545902  8533 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:01:44.546744  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 119649us
W20260709 13:01:44.568290  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.582154 10201 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:44.593052 10554 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:44.612905 10201 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:44.613046  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:44.613685  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:44.614055  8455 raft_consensus.cc:2393] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 4: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:44.571789 10127 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:44.560422 10555 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:44.577363  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 107696us
W20260709 13:01:44.616993  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 116416us
I20260709 13:01:44.556833 10477 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.588235  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:44.588634 10472 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.622152  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:44.622709  8383 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.622422 10477 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.589823  8459 raft_consensus.cc:1240] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:44.607803 10539 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:01:44.624121 10472 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:44.607937  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:44.595551 10408 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:44.570060 10552 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:44.625937  8453 raft_consensus.cc:2368] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5.
I20260709 13:01:44.597693  9295 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:44.600379  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:44.606240  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:44.626994  8531 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:44.627439  8452 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:44.627992  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:44.610352  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:44.628693  8534 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:44.607211 10546 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:44.608721 10446 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:44.619971  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:44.631814  8382 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.625161 10477 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:44.632421  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:44.601413  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:44.633107  8530 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 2.
I20260709 13:01:44.619757 10547 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.603626  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:44.603359  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:44.634202  8458 raft_consensus.cc:2393] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 4: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:44.605743  9291 raft_consensus.cc:1240] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:44.600765  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:44.607007  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:44.621352  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:44.637912  8384 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.617945 10127 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:44.640875  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 55621.8us
I20260709 13:01:44.641656  8424 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:44.596973 10441 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:44.621906 10555 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:44.605224  8284 catalog_manager.cc:5697] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 4 to 6, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 6 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:44.574682 10545 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.636900  9258 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:44.650146  9258 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:44.658380  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:44.658417  9258 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:44.644948  8527 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:01:44.663463  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:44.663916  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:44.669368 10127 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.665887  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:44.673277  9260 leader_election.cc:400] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5.
W20260709 13:01:44.673588  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.673689  9260 leader_election.cc:403] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:01:44.676019  9258 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:44.635685 10547 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:44.678718 10127 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.598744 10540 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:01:44.693068  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.695076  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.679153  8458 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 2.
I20260709 13:01:44.607362  9289 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
W20260709 13:01:44.666855  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.648303  8284 catalog_manager.cc:5697] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index 3 to 4, term changed from 2 to 3, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to <none>, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:44.686355 10127 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:44.667210 10477 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:44.689945  8424 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:44.690564 10514 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:44.680691 10441 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:44.673422 10546 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:44.682137 10539 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.702134  8284 catalog_manager.cc:5697] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 1 to 3, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:44.684970  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:44.671031 10408 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:44.712106  8424 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:44.695147  8381 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:01:44.716674 10127 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:44.720811  8382 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:44.702819 10472 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.722054 10425 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:44.702994 10552 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:44.710944 10477 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.716178 10441 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.718376 10546 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.736497  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:44.751469 10546 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:44.736330 10539 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:44.753926 10539 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:44.733760  8284 catalog_manager.cc:5697] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 2 to 4, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 4 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:44.764055  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:44.764689  8458 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:44.733301 10477 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:44.768875  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:44.775921  8534 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:44.750469 10552 raft_consensus.cc:697] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:01:44.771831  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.773397  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:44.773422  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:44.774160  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:44.746881 10545 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:44.768548  8284 catalog_manager.cc:5697] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 3 to 4, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 4 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:44.786803  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 181169us
I20260709 13:01:44.760519 10441 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:44.788838 10127 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:44.786005  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.787154  8385 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:44.797777  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:44.787475  8383 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:44.790072  8284 catalog_manager.cc:5697] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 2 to 3, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:44.784981  8377 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:44.811205  8527 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:44.822386  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:44.823371  8460 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:44.818909  8284 catalog_manager.cc:5697] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 7 to 8, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 8 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:44.830320  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:44.830519  8427 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:44.835449  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:01:44.836047  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 218255us
I20260709 13:01:44.836774  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:44.835393  8427 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:44.838233  8284 catalog_manager.cc:5697] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 4 to 5, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 5 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:44.840037  8459 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:01:44.824669 10568 log.cc:927] Time spent T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:01:44.844314 10462 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:44.844780 10462 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.845187 10462 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:44.846809  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.847909 10297 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.848517 10297 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:44.842129 10555 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:44.849712 10555 raft_consensus.cc:697] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:44.850684 10555 consensus_queue.cc:237] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.854362  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:44.857182  8427 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:44.855470  8532 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:44.858749  8427 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:44.861331 10127 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:44.861896 10127 raft_consensus.cc:697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:44.853956  8284 catalog_manager.cc:5697] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 1 to 2, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:44.848748 10546 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.871140  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:44.871877  8535 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:44.859476  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:44.874293 10398 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:44.874991 10398 raft_consensus.cc:697] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:44.877771  8452 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:44.878023  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:44.878664  9291 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:44.885427  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:44.886077  8527 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.887533  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:44.888525  8530 raft_consensus.cc:2393] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 5: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:44.889412  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:44.873456 10127 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:44.890141  8531 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:44.892151 10297 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:44.894306 10546 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:44.901746  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.863685 10552 consensus_queue.cc:237] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.862851 10420 consensus_queue.cc:1059] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:01:44.905315 10408 raft_consensus.cc:3055] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:44.905800 10408 raft_consensus.cc:740] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:44.906883 10408 consensus_queue.cc:260] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:44.908434 10408 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.911624  8384 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:44.912590  8458 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:01:44.934587 10462 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:44.936448  8501 leader_election.cc:336] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.060s (SENT)
I20260709 13:01:44.938627  8427 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:44.941959 10330 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:44.943507 10330 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.944017 10330 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:44.945354  8426 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:44.946717 10500 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:44.946805  8426 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:44.947288 10500 raft_consensus.cc:697] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:44.948331 10500 consensus_queue.cc:237] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:44.952170 10472 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5.
I20260709 13:01:44.949265 10486 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.953016 10545 consensus_queue.cc:1059] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:44.949466 10481 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:44.958508  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 44851.1us
I20260709 13:01:44.959337  8424 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:44.950421 10297 consensus_queue.cc:1059] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:44.951629  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:44.970829  8384 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:44.960543  8527 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:44.967945  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:44.876340 10398 consensus_queue.cc:237] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:44.961576 10297 raft_consensus.cc:3055] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:44.968679  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:44.971935  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:44.968816  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:01:44.962679  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 44752.8us
W20260709 13:01:44.962183  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 50978.9us
I20260709 13:01:44.969305 10448 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:44.923836  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:44.993393  8530 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:44.966442  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:44.965338  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:44.994014  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:44.978695  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.968601  9290 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:01:44.981603  9291 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:44.967160  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:45.005043 10522 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:45.005381  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:44.960103 10554 consensus_queue.cc:1059] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:01:45.007004 10554 raft_consensus.cc:3055] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:45.007393 10554 raft_consensus.cc:740] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:44.993920  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:44.996173 10472 consensus_queue.cc:1059] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:01:44.996472  9295 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
W20260709 13:01:45.001417  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.002784 10330 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:45.003916  8500 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:45.004210 10517 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.980384 10425 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:01:45.011957  8527 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:45.012734  8530 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:01:45.008320 10554 consensus_queue.cc:260] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:45.060679  8501 leader_election.cc:336] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.193s (SENT)
I20260709 13:01:45.014513  8384 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:45.052215  9294 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:45.036729  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:45.108335  8381 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
W20260709 13:01:45.036617  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.110284  8427 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:45.111268 10127 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:45.111804 10127 raft_consensus.cc:697] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:44.990043 10297 raft_consensus.cc:740] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:44.991532 10458 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:45.115902  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:45.116495  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:45.120641  8383 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
I20260709 13:01:45.118994  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:44.994338  9287 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:45.122668  8384 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 5: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:44.996903 10482 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:01:45.127672  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 168399us
I20260709 13:01:45.008790 10472 raft_consensus.cc:3055] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:45.128364  9258 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:45.137521  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:01:45.138096  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.138554  8382 raft_consensus.cc:2368] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5.
I20260709 13:01:45.134600  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:45.135762  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:45.134498  8424 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:45.050158 10330 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.148635  8424 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:45.149804  8377 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
I20260709 13:01:45.026948 10462 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:45.155776  8385 raft_consensus.cc:2368] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 2. Current term is 3.
I20260709 13:01:45.137228 10472 raft_consensus.cc:740] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:01:45.157449  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.049832 10443 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:45.118597 10453 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:45.126389 10507 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.160101  8427 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:45.161588  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:01:45.165045  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 149539us
I20260709 13:01:45.013499 10477 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:45.174584  8384 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:45.171947  8500 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:45.162134 10127 consensus_queue.cc:237] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:45.174023  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:45.175984  8382 raft_consensus.cc:2368] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5.
I20260709 13:01:45.168995  8534 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:01:45.114089 10545 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:01:45.113608 10517 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:45.182597  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.155119 10552 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:45.180389  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:45.186692 10509 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:45.189627  9258 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:45.190369  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:45.191237 10576 log.cc:927] Time spent T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:01:45.190668 10297 consensus_queue.cc:260] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:45.194000  8501 leader_election.cc:336] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.203s (SENT)
I20260709 13:01:45.208534  9293 raft_consensus.cc:2393] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 6: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:01:45.148253 10482 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:45.161401 10443 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.201125  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:45.205943  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:45.195751  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:45.203495 10509 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.146492 10458 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:45.160144 10330 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:45.174204 10507 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:45.213286 10540 raft_consensus.cc:3055] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:45.213735 10472 consensus_queue.cc:260] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:45.218140 10448 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:45.221464  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:45.223515 10481 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:45.223358  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:45.224130  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:45.224761 10518 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:45.225620  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:45.227782  8453 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
W20260709 13:01:45.255599  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.178398 10582 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:45.259056  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:45.187040 10453 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:45.280617  8377 raft_consensus.cc:2368] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5.
I20260709 13:01:45.201812 10462 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:45.264266  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:45.258463 10509 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:45.275849  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 81913.7us
I20260709 13:01:45.278950  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:45.256999 10443 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:45.282907  8380 raft_consensus.cc:2368] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5.
I20260709 13:01:45.257403 10552 raft_consensus.cc:697] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:45.279031  8382 raft_consensus.cc:2376] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3. Re-sending same reply.
I20260709 13:01:45.291018  8381 raft_consensus.cc:2393] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 4: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:45.271492 10540 raft_consensus.cc:740] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:45.278738 10448 raft_consensus.cc:697] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:45.286540 10319 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.298496 10592 consensus_queue.cc:1059] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:01:45.298585 10319 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:45.299867 10592 raft_consensus.cc:3055] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:45.300310 10592 raft_consensus.cc:740] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:45.301017 10319 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:45.302505 10448 consensus_queue.cc:237] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:45.296530  8378 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:01:45.310113 10482 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:45.282716 10582 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.311884 10453 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:45.312172 10582 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:45.314419 10330 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:45.282400 10518 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.284065 10462 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:45.315820  8501 leader_election.cc:336] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.217s (SENT)
I20260709 13:01:45.293860 10297 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:45.322536  8384 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
I20260709 13:01:45.317704 10518 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:45.323966  8386 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:45.324185  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:45.325472  8351 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:45.326371 10148 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:45.327100 10148 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:45.310133 10458 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:45.333796 10517 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:45.334583 10477 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:45.336136  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:45.337065  8531 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:45.294902 10472 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:45.343437  9287 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:45.320104 10462 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:45.346127 10443 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:45.348757  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.349704 10540 consensus_queue.cc:260] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:45.295717 10441 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:45.317623 10592 consensus_queue.cc:260] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:45.351579 10589 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:45.308326 10486 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:45.353614 10518 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:45.360023  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:45.430014  8385 raft_consensus.cc:2393] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 3: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:45.360767  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:45.311894 10507 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:45.365396 10477 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:45.369520  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 72179.4us
W20260709 13:01:45.433426  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.364871  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:45.434329  8381 raft_consensus.cc:2393] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 2: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:45.370327 10552 consensus_queue.cc:237] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:45.327397  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:45.388739  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:01:45.398486  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 244785us
I20260709 13:01:45.435322  9294 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:45.424029  8384 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:45.425134  8531 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:01:45.438112  9258 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:45.448832  9294 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
W20260709 13:01:45.450065  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 122730us
I20260709 13:01:45.428694 10408 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:45.451058  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 279175us
I20260709 13:01:45.442785 10540 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:45.457902  8351 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:45.423856 10330 consensus_queue.cc:1059] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:01:45.447600 10476 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:45.465816  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:45.467104  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:45.464385  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:45.468343  9296 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
W20260709 13:01:45.470254  8501 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.620s (SENT) [suppressed 51 similar messages]
W20260709 13:01:45.464434  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.456693 10201 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.478534  8526 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:01:45.479758  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:45.480446  8531 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:45.469446  9289 raft_consensus.cc:2393] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 3: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:01:45.434680 10589 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:45.483342  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:45.486258 10443 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:45.447916 10477 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:45.504987  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.510475  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:45.510454  8533 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:45.512408  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:45.460839 10507 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:01:45.480564 10592 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:45.519567  8529 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
W20260709 13:01:45.583549  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.573875  8349 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:45.459170 10408 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:45.454916 10509 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:45.496511 10127 raft_consensus.cc:3055] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:45.462567 10382 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:01:45.563470  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 53098.1us
I20260709 13:01:45.508657 10500 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:45.576125 10600 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:01:45.513259 10598 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:01:45.447674 10458 raft_consensus.cc:2955] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:45.577687 10441 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:45.579276 10589 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:45.585988 10330 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.572458  8501 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:45.481212 10476 raft_consensus.cc:697] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:01:45.623420  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.656056  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.509555 10201 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
W20260709 13:01:45.626456 10574 log.cc:927] Time spent T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:01:45.599169  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:45.521219 10599 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:45.574128  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:45.572079 10443 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:45.597105 10148 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:45.662739  8453 raft_consensus.cc:1240] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:45.584511 10539 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:45.664620  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:45.597682 10127 raft_consensus.cc:740] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:01:45.667865  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 93806.4us
I20260709 13:01:45.668730  8351 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:45.650194 10448 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.671697  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:45.596729 10583 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:45.679450  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 107052us
W20260709 13:01:45.680792  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 87377us
I20260709 13:01:45.684330 10583 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:45.689263 10453 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.689754 10453 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:45.691901 10453 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:45.694113  8460 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:45.585361 10582 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:45.719146 10582 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:45.682284 10127 consensus_queue.cc:260] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:45.697772 10605 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:45.719964 10605 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.720351 10605 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:45.701189 10319 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:45.705358  8501 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:45.722568  8501 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:45.723821 10554 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:45.673592 10443 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:45.736047 10443 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:45.738405 10462 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:45.695247 10518 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:45.742146  8459 raft_consensus.cc:2393] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 6: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:45.745307  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:45.745594  9296 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:45.745885  9294 raft_consensus.cc:2955] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:01:45.706175  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 50080.3us
W20260709 13:01:45.707201 10595 log.cc:927] Time spent T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:01:45.707993 10201 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:45.665706 10330 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:45.709388  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:45.711061 10477 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:45.711869 10509 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:45.712448 10472 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:45.713212 10476 consensus_queue.cc:237] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:45.674496 10507 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:45.715545 10408 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:45.673732 10148 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.716167  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:45.670848 10599 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:45.757512  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:45.760608 10398 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.771070  8461 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:45.773492  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.773967  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:45.794365  9296 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:45.772884  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:45.796584  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:45.797246  8530 raft_consensus.cc:2393] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 3: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:45.661440 10500 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:45.780501  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:45.781669  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:45.793630  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:45.798651  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:45.776969  8379 raft_consensus.cc:2955] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:45.755790 10319 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.720363 10127 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:45.683897 10448 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:45.792446  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 108023us
I20260709 13:01:45.794973  8459 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:45.801658  8378 raft_consensus.cc:1275] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:45.798914  8386 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:45.774653 10607 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:45.801542  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.805351  8453 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:01:45.805815  8384 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:45.807799  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:45.808857  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:45.783864 10582 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.811546  8530 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:01:45.792630 10148 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:45.817667  8526 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:45.791404  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:45.817907  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:45.812912  8349 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:45.819221  8528 raft_consensus.cc:2410] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:45.819380 10597 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:45.793519 10462 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:45.819991  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:45.821180  8381 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:45.784410 10443 consensus_queue.cc:1059] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:01:45.843317  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:45.823510  8533 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:45.847694 10500 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:45.848455 10583 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:45.824363  8460 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:45.821805 10609 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:01:45.829646  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:45.852295  8459 raft_consensus.cc:2393] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:45.801614 10398 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:45.792971 10599 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:45.854763 10398 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:45.855069  9296 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:01:45.857329  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:45.862951  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:45.864117  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:45.864876  8531 raft_consensus.cc:2393] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 6: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:01:45.865425  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:45.833863 10472 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:45.867475 10605 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:45.818739 10319 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:45.868352 10441 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:45.838832  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:45.870076 10319 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:45.839839 10582 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:45.871428  8386 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:45.871973 10582 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:45.872643  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:45.791801 10477 consensus_queue.cc:1059] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:01:45.844098 10443 raft_consensus.cc:3055] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:45.873262  8452 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:45.875262  8377 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:45.879539 10330 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:45.880571  9258 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:45.881294  8535 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:01:45.878248 10615 log.cc:927] Time spent T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:01:45.874135  8427 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:45.873427  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:45.922055  8380 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:01:45.883761 10605 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:45.884464  8533 raft_consensus.cc:2955] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:45.885517 10148 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:45.888967  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 107352us
I20260709 13:01:45.842275 10448 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:45.878072  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:01:45.889559  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 76812.6us
I20260709 13:01:45.890504  8386 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:45.894754  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:45.905946  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:45.907037  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:45.934059  9294 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:45.934314  8534 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
W20260709 13:01:45.932852  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.918572  8461 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
W20260709 13:01:45.919315  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 105523us
I20260709 13:01:45.913273  8500 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:45.935927  8349 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:01:45.928525  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 48038.1us
I20260709 13:01:45.929431  8424 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:45.936422  9260 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:45.936630  8500 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:45.940026  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:45.940718  9293 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:45.941361 10148 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:45.942219  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 68162.4us
I20260709 13:01:45.949255  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:45.920847 10477 raft_consensus.cc:3055] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:45.951628  8427 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:45.954704 10446 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:45.956111 10507 consensus_queue.cc:1059] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:45.956972 10507 raft_consensus.cc:3055] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:45.957341 10507 raft_consensus.cc:740] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:45.958005  8530 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:01:45.958112 10507 consensus_queue.cc:260] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:45.958935  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:45.959297 10507 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:45.939772 10539 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:45.965477  8532 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:45.967574  8381 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:01:45.914350 10610 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:45.970655  9261 leader_election.cc:336] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.896s (SENT)
I20260709 13:01:45.921173 10443 raft_consensus.cc:740] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:45.947957 10597 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:45.947687 10382 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.982106 10127 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.966014 10477 raft_consensus.cc:740] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:45.983381  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:01:45.988307  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 52507.1us
I20260709 13:01:45.940121 10552 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:45.965631 10297 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:45.965855 10330 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:45.965013 10540 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:45.992478 10127 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:45.977156  9287 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:45.994575  8530 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:45.972704 10500 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:45.970549 10610 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.968329 10609 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:45.981491  9293 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:01:45.976449 10518 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:46.009384 10608 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:01:46.009590 10518 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:46.011538 10477 consensus_queue.cc:260] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:46.012954 10477 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:46.014575 10618 log.cc:927] Time spent T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.061s	user 0.004s	sys 0.000s
I20260709 13:01:45.981949 10605 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:46.018512 10605 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.020524 10607 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:46.002748  8351 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:46.021727 10453 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:01:46.021870  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 44340.9us
I20260709 13:01:45.976392 10555 consensus_queue.cc:1048] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:01:46.022794  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:46.023976  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:46.026950 10443 consensus_queue.cc:260] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.028424 10443 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:46.000178 10597 raft_consensus.cc:697] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 8 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:45.997274 10382 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.029440 10592 raft_consensus.cc:2764] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:01:46.030300 10592 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:46.030138 10597 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:46.030849 10592 raft_consensus.cc:697] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:46.031157 10382 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:46.006585 10127 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:46.001260  8349 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:46.000239 10330 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.032776  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:45.998481 10297 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.052295 10297 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:46.053341 10604 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:46.054008 10604 raft_consensus.cc:697] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:46.055203 10604 consensus_queue.cc:237] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:46.006094 10500 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.057029 10500 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:46.058319  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:46.059003  8535 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:01:46.060316  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:46.061115  9294 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:46.035610 10609 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:45.993335 10448 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:01:46.063549 10609 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:46.064095 10330 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:46.064287 10614 log.cc:927] Time spent T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:01:46.008765 10582 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.066282 10582 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.068429 10582 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:46.008504 10540 raft_consensus.cc:697] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:46.069986 10540 consensus_queue.cc:237] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:45.997648 10612 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:46.042377  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:46.008015 10610 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:46.077639  8532 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:46.081012  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 98302.6us
I20260709 13:01:46.082201  8424 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
W20260709 13:01:46.084064  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 84776.9us
I20260709 13:01:46.087949  8349 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:46.086390  8427 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:46.073871 10612 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.074263 10539 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:46.031788 10592 consensus_queue.cc:237] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:46.107913  8424 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:46.109452  8427 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:46.100628 10539 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.114060 10539 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:46.115285  8426 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:46.097877 10612 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:46.104878 10201 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:46.127916  8424 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:46.112903 10486 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:46.098536 10420 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:01:46.119369 10583 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:46.119182 10608 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:46.135751  8427 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:46.136194 10127 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:46.150345 10127 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.150682 10127 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:46.142292  8351 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:46.144349  8458 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:01:46.132373 10582 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:46.146051 10583 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.151347  8458 pending_rounds.cc:85] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Aborting all ops after (but not including) 6
I20260709 13:01:46.167631 10583 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:46.154019 10608 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.138063 10201 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.159456 10509 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:01:46.185887  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 43705.5us
I20260709 13:01:46.186313 10509 raft_consensus.cc:697] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:46.186683  8351 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:46.187434 10509 consensus_queue.cc:237] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.161298 10408 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:46.161880 10127 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:46.140513 10619 log.cc:927] Time spent T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:01:46.167697  8458 pending_rounds.cc:107] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Aborting uncommitted NO_OP operation due to leader change: 5.7
W20260709 13:01:46.155471 10620 log.cc:927] Time spent T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:01:46.169682  8424 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:46.140024 10490 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:46.206215 10490 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.206688  9294 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:01:46.156447 10621 log.cc:927] Time spent T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:01:46.144207 10458 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:46.139437 10486 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:46.145136 10599 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.200928  8458 raft_consensus.cc:2889] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:46.202539  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:46.203466  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.235422  8532 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
W20260709 13:01:46.236001  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.165429 10582 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.238049  8535 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:46.193289 10201 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:46.190979 10608 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:46.231751  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.224119  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:46.196158 10453 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:46.248605  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 138874us
I20260709 13:01:46.249938  8379 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:01:46.195952 10319 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:46.231727 10482 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:46.236789 10582 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:46.256944  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:46.233785 10486 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:46.206709 10490 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:46.236829 10443 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.183162 10462 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:01:46.251309 10546 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.252888 10446 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:46.254400 10507 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.208822 10408 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.277663  8379 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:46.251629 10552 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:46.235134 10500 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.244927 10481 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 13:01:46.313537  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 84772.4us
I20260709 13:01:46.286109  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.304046  8377 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:46.315356  8381 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:46.321611  8386 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:46.322250  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.323597  8381 raft_consensus.cc:2393] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 4: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:46.323730  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.324882  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.335330  8386 raft_consensus.cc:2393] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 5: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:46.335567  8500 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:46.316529 10507 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:46.343335  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:46.343845  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.344480  8532 raft_consensus.cc:2393] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 4: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:46.346112  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:46.261708 10476 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:01:46.352921  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:46.354447  8534 raft_consensus.cc:2393] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 7: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:46.346645  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:46.345353 10441 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.349691  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:46.342175 10607 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:01:46.352404  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.368350  8529 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:46.276939 10482 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:46.362721  8530 raft_consensus.cc:2393] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 5: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:46.346310  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.377519  8535 raft_consensus.cc:1275] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:46.270489 10608 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
W20260709 13:01:46.380962  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 53059.4us
I20260709 13:01:46.347325 10509 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.387683  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.303383 10546 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:46.314636 10552 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:46.275776 10443 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.404100 10408 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:46.406652 10612 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
W20260709 13:01:46.388164 10622 log.cc:927] Time spent T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:46.409339 10509 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.420809  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:46.423200 10583 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.432387  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.426808  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.433445  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.435462  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:46.436410  8382 raft_consensus.cc:2368] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3.
W20260709 13:01:46.426195 10578 log.cc:927] Time spent T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:01:46.387698 10448 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:01:46.455575  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:46.456786  8384 raft_consensus.cc:2393] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 3: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:01:46.426048 10507 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:46.377694 10441 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:46.384527 10482 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.455580  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:46.464939  8532 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:46.465411  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:46.465994  8384 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:46.462318  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:46.466944  8526 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:46.467537  8383 raft_consensus.cc:2368] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5.
I20260709 13:01:46.469015  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:46.469605  8386 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:46.463393  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.441670 10408 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.478065  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.472376  8382 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:46.475216  8427 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:46.478945  8383 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
W20260709 13:01:46.521116  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 45967.8us
I20260709 13:01:46.442960 10330 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.532552  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.545310  8532 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:46.570541  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.476578 10554 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:46.599790  8384 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
W20260709 13:01:46.574242  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 52295.6us
I20260709 13:01:46.464680 10297 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.521660 10481 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:46.517460 10599 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:46.639165  8501 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:46.647179  8501 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:46.482437 10514 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 13:01:46.482683 10540 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
W20260709 13:01:46.602334 10595 log.cc:927] Time spent T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:01:46.644887  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:46.575021 10608 raft_consensus.cc:2804] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:46.647976  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:46.653985  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.664361  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:46.654965  8386 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
W20260709 13:01:46.657490  9261 leader_election.cc:336] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.659s (SENT)
I20260709 13:01:46.658069  8501 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:46.483675 10408 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:46.669588  8382 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:46.645323 10605 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:46.675959  8501 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:46.603988 10554 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:46.690409  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:46.675942 10628 log.cc:927] Time spent T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:01:46.710904 10509 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:46.662820 10507 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:46.663080 10608 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:46.683697 10477 consensus_meta.cc:287] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.001s
I20260709 13:01:46.691262  8460 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:46.727049  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:46.726984  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:46.712935  9261 leader_election.cc:400] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5.
I20260709 13:01:46.728889  8461 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:46.660529 10500 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:46.690790 10443 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:46.649382 10481 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:46.738451  8460 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:01:46.695992 10638 log.cc:927] Time spent T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:01:46.700560 10635 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
W20260709 13:01:46.751209  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.701568 10583 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:46.702498  8454 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
W20260709 13:01:46.702904 10636 log.cc:927] Time spent T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.207s	user 0.002s	sys 0.000s
I20260709 13:01:46.703511 10605 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:46.704289 10610 consensus_meta.cc:287] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.617s	user 0.007s	sys 0.003s
I20260709 13:01:46.704751 10482 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:46.706571 10633 log.cc:927] Time spent T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:01:46.677896 10643 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:46.727137 10540 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:46.679489 10604 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:46.730613  9261 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:46.728849  8452 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:46.669796 10602 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:46.741988  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:46.740716 10443 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:46.742624 10582 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.743952  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:46.774645  8459 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:01:46.745630 10441 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:46.751806  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:46.684649 10552 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:01:46.755885  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 80030.1us
I20260709 13:01:46.736171 10608 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:46.745011 10539 consensus_meta.cc:287] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.630s	user 0.003s	sys 0.005s
W20260709 13:01:46.761099  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.777925  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:46.662608 10607 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:46.782219  8457 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:46.800796  8458 raft_consensus.cc:1240] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:46.789978  8455 raft_consensus.cc:2393] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 7: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:46.782366  8501 leader_election.cc:400] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3.
I20260709 13:01:46.806993  8501 leader_election.cc:403] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:01:46.767166  8351 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:46.746203 10546 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:46.771698  9261 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:46.772320  8453 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
W20260709 13:01:46.775972  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 118741us
I20260709 13:01:46.776537  8460 raft_consensus.cc:2368] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6.
I20260709 13:01:46.762094 10507 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:46.798092  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:46.765735  8461 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:46.811753  8459 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:46.759073 10610 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.776125 10477 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:46.813422  8427 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:46.797287  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:01:46.799516 10490 consensus_meta.cc:287] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 13:01:46.797276 10330 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:46.772153 10540 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:46.803699 10539 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:46.814602 10201 consensus_meta.cc:287] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.003s
I20260709 13:01:46.843672 10539 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:46.843743 10201 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.798280 10554 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:46.826963  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 55311.9us
I20260709 13:01:46.827700  8456 raft_consensus.cc:2393] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 5: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:46.845043  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:46.851030  8382 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:46.796229 10297 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:46.835206 10477 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:46.835839 10546 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.858147 10546 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:46.836217 10650 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:46.838972 10408 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:46.839517 10481 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:46.840337 10518 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:46.846300  8385 raft_consensus.cc:2368] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8.
W20260709 13:01:46.831202  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 64130.3us
I20260709 13:01:46.847146  8380 raft_consensus.cc:2368] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 6. Current term is 7.
I20260709 13:01:46.848285  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:46.848888  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.848318  9261 leader_election.cc:400] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5.
I20260709 13:01:46.846328  8377 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 6. Ops: []
I20260709 13:01:46.864889  9261 leader_election.cc:403] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:01:46.864655  8381 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:46.867594  8382 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:46.778340 10443 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.862126 10641 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 13:01:46.872911  9261 leader_election.cc:400] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5.
I20260709 13:01:46.874436  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.874752  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:46.876051  8459 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:46.875993  8386 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:46.877027  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 98068.2us
I20260709 13:01:46.773929 10643 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.878077  8501 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:46.879329 10518 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:46.775949 10602 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:46.880937  8501 leader_election.cc:400] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5.
I20260709 13:01:46.881389  8501 leader_election.cc:403] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:01:46.845330 10382 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:46.875316 10650 raft_consensus.cc:697] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:46.881901 10602 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:46.849581 10604 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3.
I20260709 13:01:46.815644 10507 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:46.882443 10650 consensus_queue.cc:237] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:46.846745 10612 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:46.781927  8378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
new_leader_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:01:46.884544  8378 raft_consensus.cc:606] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Received request to transfer leadership to TS 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:46.847143 10610 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:46.887728 10486 consensus_meta.cc:287] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.585s	user 0.012s	sys 0.000s
W20260709 13:01:46.863415 10642 log.cc:927] Time spent T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:01:46.889711 10297 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5.
I20260709 13:01:46.887773  8427 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:46.895277  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:46.896924  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.899588  8427 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:46.900338  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.906395 10648 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:46.906968 10648 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.907294  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:46.884855 10507 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:46.888255 10486 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:46.908126  8378 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 3: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:46.908907  9260 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:46.911552 10486 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:46.912281  9260 leader_election.cc:400] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6.
I20260709 13:01:46.912561  9260 leader_election.cc:403] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:46.917689  8386 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:01:46.914847  9261 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:46.890157 10540 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:46.944003 10653 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:46.861047 10546 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:46.944573 10653 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.948611 10653 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:46.891427 10201 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:46.899462 10582 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:46.938052 10482 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:46.907344 10648 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:46.938511 10448 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:01:46.853780 10490 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:46.938761 10641 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:01:46.988289 10297 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:46.987208 10477 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5.
W20260709 13:01:47.130803  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.988116 10546 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:47.159188  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 260005us
I20260709 13:01:47.232906  9261 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:47.159749  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:47.104326  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:47.104705  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:01:47.133960  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 259673us
I20260709 13:01:47.234138  8532 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:47.134392  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 253564us
I20260709 13:01:47.235947  8501 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:47.193675  8527 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:47.175124  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:47.237291  8528 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:47.194391  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 60527us
W20260709 13:01:47.196280  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.197296  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:47.238857  8535 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:47.218443  8384 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:47.122424 10443 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:47.243772 10605 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:47.244670 10641 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:47.244510 10605 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:47.247447 10605 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:47.248826 10441 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:47.251113  8533 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:47.252388  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:47.229671  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:47.254271  8531 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
I20260709 13:01:47.254851  8381 raft_consensus.cc:2393] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 3: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:47.254974  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:47.006973 10610 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.240878  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:47.241209 10597 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.241669 10656 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.242750 10518 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:47.255877  8527 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:47.277485  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:47.206934 10297 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:47.273720  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:47.261682  8427 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:47.270536  8349 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:47.272007  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:47.272959  9293 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:47.273718  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:47.273748 10482 raft_consensus.cc:697] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:47.275468 10127 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:47.278129  8460 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:47.279583  9296 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
W20260709 13:01:47.280388  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.269881  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:47.281798  8533 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
I20260709 13:01:47.279349  9294 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:47.288468  8532 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:01:47.291548  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:47.281901  9258 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:47.292498  8459 raft_consensus.cc:2393] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 4: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:47.293161  9258 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:47.291705  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:47.115284 10608 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:47.299256  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 44760.2us
I20260709 13:01:47.300637  8534 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:47.295733  8455 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:01:47.302888  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:47.240908 10639 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.309484  9296 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
W20260709 13:01:47.323899  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 62338.6us
I20260709 13:01:47.329941  8349 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:01:47.330015  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 89248.3us
I20260709 13:01:47.284308 10518 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:47.328552  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:47.269367 10398 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:47.339114  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:47.350013  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:47.351641  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:47.352264  8534 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:47.353178  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:47.338521 10555 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:47.355974  8455 raft_consensus.cc:2393] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:47.302706 10441 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:47.291924 10610 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:47.365762  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:47.370146  8531 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:01:47.325359 10632 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:47.323410 10201 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:47.384881 10605 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:47.330222 10540 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:47.363803 10552 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.370836 10441 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.283133 10597 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:47.387197  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:47.411144  9296 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:01:47.390934  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:01:47.392405  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 82447.3us
I20260709 13:01:47.339218 10518 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:47.248487 10648 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:47.340497 10539 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:47.405849  9295 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:47.379366  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:47.385612 10605 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:47.291666 10656 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:47.417029  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:47.405848  9290 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:47.375927 10555 raft_consensus.cc:697] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:01:47.433537  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 54287.3us
W20260709 13:01:47.433565  8501 leader_election.cc:336] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.958s (SENT)
I20260709 13:01:47.435307  8501 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:47.390713 10540 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.438867 10656 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:47.407981 10490 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:47.402676 10632 raft_consensus.cc:697] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:47.410039  9289 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:47.412086 10441 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:47.446816  8528 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:01:47.359683 10639 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:47.376376 10398 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:47.450928  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:47.456678  8530 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:47.454298  8460 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:01:47.442157 10540 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:47.440021 10539 raft_consensus.cc:697] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:47.441977 10507 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:47.412286 10552 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:47.458645  8534 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:47.467718  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:47.459003  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 1769) took 1040 ms. Trace:
I20260709 13:01:47.468590  8459 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:47.458544  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:47.457515  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:47.470721  8455 raft_consensus.cc:2393] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 6: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:47.438885 10648 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:47.470508  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:47.468703  8380 rpcz_store.cc:276] 0709 13:01:46.418985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.420478 (+  1493us) service_pool.cc:224] Handling call
0709 13:01:47.451250 (+1030772us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54003dbdd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:47.458945 (+  7695us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958659328}
I20260709 13:01:47.473742  8528 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 3: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:47.472200  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:47.474225  8534 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:47.470103  8460 raft_consensus.cc:2393] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:47.464834  8531 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:01:47.476147  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:01:47.458081 10644 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.255s	user 0.003s	sys 0.026s
I20260709 13:01:47.458770 10443 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.458535 10656 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:47.482630  8455 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:47.481241  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:47.491278  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:47.467830 10507 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:47.459367 10650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.021s	sys 0.041s
I20260709 13:01:47.497538  8459 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:47.433272 10482 consensus_queue.cc:237] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:47.499876  8530 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:01:47.501668  8534 raft_consensus.cc:2393] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 7: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:01:47.502350  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 169652us
W20260709 13:01:47.510183 10650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.021s	sys 0.042s
I20260709 13:01:47.529304  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:47.530217  9289 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:47.534162  8528 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:01:47.534696  8528 pending_rounds.cc:85] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 5
I20260709 13:01:47.534960  8528 pending_rounds.cc:107] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:01:47.535230  8528 raft_consensus.cc:2889] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:47.514456  8351 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:47.540427  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:47.497216 10507 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:47.541496  8530 raft_consensus.cc:2368] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4.
I20260709 13:01:47.444008 10657 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:01:47.552433  8535 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
W20260709 13:01:47.559193  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 44814.8us
I20260709 13:01:47.493891 10443 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:47.478286 10539 consensus_queue.cc:237] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:47.567343  8380 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:47.567698  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:47.568403  8386 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
I20260709 13:01:47.569272  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:47.568620  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:47.588455  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:47.565304  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 233568us
I20260709 13:01:47.493479 10555 consensus_queue.cc:237] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:47.601914  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:47.602407  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:47.571113  8377 raft_consensus.cc:2376] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3. Re-sending same reply.
I20260709 13:01:47.600729  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:47.603686  8384 raft_consensus.cc:2368] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 2. Current term is 3.
I20260709 13:01:47.561206 10453 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:47.605101  8383 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:47.606081  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:47.606369  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:47.606848  8380 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:47.607959  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:47.608654  8382 raft_consensus.cc:2368] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6.
I20260709 13:01:47.502005 10632 consensus_queue.cc:237] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:47.610476  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:47.609988  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.612828  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:47.613521  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:47.615623 10453 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:47.616098 10605 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:47.590258 10297 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:47.622145 10665 log.cc:927] Time spent T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:01:47.619505  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:47.620450 10443 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:47.621044 10639 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:47.618841  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:47.623941  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:47.618505  8349 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:47.600436 10604 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:47.628188  8385 raft_consensus.cc:2368] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6.
I20260709 13:01:47.611418 10610 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:47.628491  8349 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:01:47.617945 10658 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:01:47.631475  8349 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:47.630101 10453 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:47.630321  9290 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:47.630281 10608 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:47.641301  8349 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:47.633520 10597 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:47.650750 10677 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:47.654362  8535 raft_consensus.cc:1240] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:01:47.637395 10610 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:47.627908 10518 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:47.658725  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:47.660972  8532 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
W20260709 13:01:47.661433 10662 log.cc:927] Time spent T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:01:47.661736 10664 log.cc:927] Time spent T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:01:47.648166  9287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 623) took 1211 ms. Trace:
I20260709 13:01:47.634166 10604 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:47.663071 10319 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:47.684597 10518 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:47.665316 10552 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:47.687651 10441 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:47.665140 10610 raft_consensus.cc:697] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:01:47.691601 10671 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:01:47.671347 10453 raft_consensus.cc:697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:47.720019 10441 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:47.692499 10518 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.725782 10610 consensus_queue.cc:237] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:47.729780  9290 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:47.726006 10453 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:47.684705 10540 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:47.694056 10319 raft_consensus.cc:697] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:47.748806  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:47.749789  8529 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:47.751399  8349 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:47.759625  9291 raft_consensus.cc:2368] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5.
W20260709 13:01:47.761374  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.761323 10448 consensus_meta.cc:287] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.757s	user 0.012s	sys 0.000s
I20260709 13:01:47.734912 10518 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:47.776010 10540 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:47.777979 10448 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6.
I20260709 13:01:47.778364 10319 consensus_queue.cc:237] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:47.758899 10667 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:47.795506  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:47.795619  8529 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:01:47.796341  8532 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:47.798681  9293 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:01:47.758661 10382 consensus_queue.cc:1059] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:01:47.800597  9258 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:47.793958 10667 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.813014 10667 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:47.813215 10382 raft_consensus.cc:3055] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:47.813882 10382 raft_consensus.cc:740] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:47.815062 10382 consensus_queue.cc:260] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:47.818408 10443 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:01:47.805441 10653 consensus_meta.cc:287] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.848s	user 0.013s	sys 0.000s
I20260709 13:01:47.816761 10382 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:47.826892  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 64249.5us
I20260709 13:01:47.806766 10540 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:47.830045 10518 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:47.830585 10540 raft_consensus.cc:697] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:47.830657 10597 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:47.832471 10597 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:47.669497  9287 rpcz_store.cc:276] 0709 13:01:46.430431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.432088 (+  1657us) service_pool.cc:224] Handling call
0709 13:01:46.470520 (+ 38432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.649382 (+178862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.656270 (+  6888us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:46.702345 (+ 46075us) spinlock_profiling.cc:243] Waited 7.69 ms on lock 0x7b1800459040. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c5398522 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:01:47.276643 (+574298us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b2c00047b98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2
0709 13:01:47.329254 (+ 52611us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.614147 (+284893us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:47.623543 (+  9396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.627025 (+  3482us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.632565 (+  5540us) raft_consensus.cc:1685] finished
0709 13:01:47.632594 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.641586 (+  8992us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121018,"raft.queue_time_us":127537,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":29464,"spinlock_wait_cycles":31300224,"thread_start_us":178785,"threads_started":1,"wal-append.queue_time_us":240258}
I20260709 13:01:47.804020 10677 raft_consensus.cc:697] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:01:47.835023  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.835299  8532 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:47.836933  9258 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:47.840448 10641 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:47.841063 10641 raft_consensus.cc:697] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:47.842126 10641 consensus_queue.cc:237] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:47.846695 10604 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:47.848930 10675 log.cc:927] Time spent T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.148s	user 0.000s	sys 0.002s
I20260709 13:01:47.848457 10507 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:47.851641 10507 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:47.856350 10661 log.cc:927] Time spent T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.637s	user 0.001s	sys 0.000s
I20260709 13:01:47.819144 10443 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:47.827730 10653 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:47.893265  9294 raft_consensus.cc:2368] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5.
I20260709 13:01:47.863116 10540 consensus_queue.cc:237] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:47.888852 10597 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:47.899645  8458 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 1689) took 1305 ms. Trace:
I20260709 13:01:47.900331  8458 rpcz_store.cc:276] 0709 13:01:46.593927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.594090 (+   163us) service_pool.cc:224] Handling call
0709 13:01:46.594469 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.806685 (+212216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.899315 (+1092630us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b540019cdd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:47.899560 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":473954560}
I20260709 13:01:47.905361 10443 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:47.911434 10643 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:47.908475 10667 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:47.919332  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:47.920215  8534 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:47.928896 10623 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.580s	user 0.090s	sys 0.138s
I20260709 13:01:47.926266 10667 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:47.929361 10623 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.580s	user 0.090s	sys 0.138s
I20260709 13:01:47.930826  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:47.931434  8531 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:47.932391  8534 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:47.933189 10653 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:47.933673  8349 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:47.934540 10612 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:47.934983 10612 raft_consensus.cc:697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:47.935704 10398 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:47.935781 10612 consensus_queue.cc:237] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:47.940047  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:47.940769  8458 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:47.943069  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:47.943812  8461 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:47.944878 10656 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:47.945457 10656 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:47.947489 10656 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:47.949734 10660 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.726s	user 0.003s	sys 0.000s
I20260709 13:01:47.892243 10677 consensus_queue.cc:237] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:47.962764  8531 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:47.963973  9260 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:47.963973  9258 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:47.962937  8461 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:47.968437 10554 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:47.971618 10554 raft_consensus.cc:697] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:47.972792 10554 consensus_queue.cc:237] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:47.967867 10546 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:47.974391 10546 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.974815 10546 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:48.015832 10682 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.136s	user 0.000s	sys 0.002s
I20260709 13:01:48.031261  8501 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:48.041427  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.039113 10656 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:48.096658  8458 raft_consensus.cc:1240] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:48.097025  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:48.100884  8456 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:01:48.111007  8461 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:48.114882  8351 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:48.118101  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:48.119032  8454 raft_consensus.cc:2393] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 7: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:48.120229  8351 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:48.093171 10462 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.145066  8456 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
W20260709 13:01:48.167135  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.176774  8454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
W20260709 13:01:48.168582  8501 leader_election.cc:336] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.553s (SENT)
W20260709 13:01:48.118268 10664 log.cc:927] Time spent T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.095s	user 0.003s	sys 0.027s
I20260709 13:01:48.126401  8351 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:48.178153  8454 raft_consensus.cc:606] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:01:48.206393  8501 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.207327 10656 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:48.210341  8500 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:01:48.212332  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 85980.6us
I20260709 13:01:48.214160  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:48.214417  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:48.214772  8426 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.216496  8500 leader_election.cc:400] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5.
I20260709 13:01:48.216847  8500 leader_election.cc:403] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:48.110486 10667 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:48.216012  8426 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:48.217805  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:01:48.176949 10670 log.cc:927] Time spent T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:01:48.178539 10696 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:01:48.126552 10319 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:48.170640 10554 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:48.219190  8500 leader_election.cc:400] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5.
W20260709 13:01:48.127876 10693 log.cc:927] Time spent T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 13:01:48.213507 10694 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:01:48.126740 10666 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:48.221791 10443 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:48.281242 10453 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.282442 10443 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:48.264806  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:48.282996 10443 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:48.283294  9289 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:48.255067 10609 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:48.282998 10453 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:48.284907 10699 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:01:48.286254 10453 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:48.221902 10539 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:48.287189 10539 raft_consensus.cc:697] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:48.288000 10201 raft_consensus.cc:993] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885: : Instructing follower 105d6581548546b98eddd4ee7083bb12 to start an election
I20260709 13:01:48.259735  8500 leader_election.cc:403] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:48.288561 10201 raft_consensus.cc:1081] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Signalling peer 105d6581548546b98eddd4ee7083bb12 to start an election
W20260709 13:01:48.288723  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 69652.9us
I20260709 13:01:48.289110  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:48.167315 10546 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:48.264357 10676 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.291635 10676 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:48.242988 10507 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:01:48.252688 10486 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:48.295190 10676 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:48.295331 10486 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:48.295707 10507 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5.
I20260709 13:01:48.244441 10604 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5.
I20260709 13:01:48.269354  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:48.271175  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:48.268522 10610 consensus_queue.cc:1059] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:48.243239 10612 consensus_queue.cc:1059] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:01:48.298200  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.271397  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.298976 10610 raft_consensus.cc:3055] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:48.299393 10610 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:48.299803  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.300364 10610 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:48.300926  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.301632 10610 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:48.221649 10597 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:01:48.273285  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.303342  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.304260  8284 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53486 (request call id 344) took 3922 ms. Trace:
I20260709 13:01:48.304369  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.304869 10382 raft_consensus.cc:3055] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:48.305361 10382 raft_consensus.cc:740] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:48.305753  8452 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:48.304894  8456 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:48.306574  8456 raft_consensus.cc:606] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Received request to transfer leadership to TS 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:48.307606 10609 raft_consensus.cc:697] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:48.272610  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.311338  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.311810  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:48.312094  8380 raft_consensus.cc:2368] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6.
I20260709 13:01:48.312953  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.278227 10681 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.262091 10657 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.274755  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.313022  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:48.281176  8281 catalog_manager.cc:5697] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 3 to 4, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 4 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:48.319857  8281 catalog_manager.cc:5697] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 3 to 4, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 4 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:48.295765  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:48.321712  8454 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:01:48.295857 10486 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:48.268407  8386 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:48.324846 10382 consensus_queue.cc:260] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:48.326221  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.326846  8386 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:48.327602  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.327936  9289 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:01:48.328362  8386 raft_consensus.cc:2410] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:48.271690  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:48.329319  8379 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:48.298511  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:48.272965  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.180284 10462 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:48.330435  8377 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
W20260709 13:01:48.330551  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 111215us
W20260709 13:01:48.343808  9261 leader_election.cc:336] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.996s (SENT)
I20260709 13:01:48.298206  8534 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:48.344175  8527 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:48.344175  9261 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.315672  8385 raft_consensus.cc:2393] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 4: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:48.302086  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.292254 10546 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:48.305023  8383 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:48.313655  8381 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:48.321967  8281 catalog_manager.cc:5697] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 1 to 3, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 3 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:48.348488  8380 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
W20260709 13:01:48.333930  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.333997  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:48.334707  8454 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:01:48.350240  8531 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:48.346571  8424 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.254938 10667 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:48.356128  8424 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.356459  9260 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:48.360438  8424 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:48.360858  8530 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:48.335266 10382 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:48.362401  8424 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.308583 10609 consensus_queue.cc:237] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:48.262171 10554 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:48.314464 10657 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:48.355703 10522 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.358095 10420 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:48.366994 10477 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:01:48.372757  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:48.378201  8531 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:01:48.376425 10552 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.359628 10514 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:01:48.379436 10552 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:48.351372 10653 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:48.382488 10552 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:48.371434 10398 consensus_queue.cc:1048] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:01:48.364185 10655 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:48.382581 10554 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:48.384541  9261 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:48.366652 10639 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:48.387740  8424 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.364298 10481 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:48.313900 10681 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:48.392571 10681 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:48.354796 10666 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:01:48.288095 10539 consensus_queue.cc:237] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:48.394954 10453 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:48.395433 10319 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.395449 10453 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:48.396023 10319 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:48.397753 10453 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:48.401373  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:48.403069  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:48.403523  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:48.404361  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:48.404994  8532 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:48.404969 10612 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:48.406471 10453 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:48.406885 10453 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:48.407260 10453 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:48.407296  8526 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:48.408403 10632 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:48.383832 10546 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:48.408946 10632 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:48.410398 10666 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:48.411070 10632 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:48.411159 10676 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:48.408432  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:48.411795 10676 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:48.413231  8384 raft_consensus.cc:2376] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4. Re-sending same reply.
I20260709 13:01:48.414510  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:48.415335  8461 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:48.420742  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:48.424127  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:48.424744  8382 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:48.425606  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.356799  9287 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:48.435786  8349 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:48.438144  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:48.433606  8379 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:48.445294  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:48.446022  8532 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
W20260709 13:01:48.447983  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 63511.8us
I20260709 13:01:48.449435  9261 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.449698  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:48.450677  8379 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:48.387146 10667 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:48.363590 10677 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:48.304668  8284 rpcz_store.cc:276] 0709 13:01:44.382270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.382547 (+   277us) service_pool.cc:224] Handling call
0709 13:01:48.304176 (+3921629us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:45.511169 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:45.701597 (+190428us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:45.701648 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:01:45.701690 (+    42us) tablet.cc:662] Decoding operations
0709 13:01:45.702736 (+  1046us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:45.702833 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:45.702862 (+    29us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:01:45.703690 (+   828us) tablet.cc:701] Row locks acquired
0709 13:01:45.703757 (+    67us) write_op.cc:260] PREPARE: finished
0709 13:01:45.703936 (+   179us) write_op.cc:270] Start()
0709 13:01:45.704087 (+   151us) write_op.cc:276] Timestamp: P: 1783602105703853 usec, L: 0
0709 13:01:45.704129 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:01:45.704847 (+   718us) log.cc:844] Serialized 3628 byte log entry
0709 13:01:46.279865 (+575018us) op_driver.cc:464] REPLICATION: finished
0709 13:01:46.847471 (+567606us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c537b0ac 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36cbebbef0
0709 13:01:47.590700 (+743229us) write_op.cc:301] APPLY: starting
0709 13:01:47.611231 (+ 20531us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:47.616949 (+  5718us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:47.616991 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:47.619876 (+  2885us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:47.620217 (+   341us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:01:47.620261 (+    44us) write_op.cc:312] APPLY: finished
0709 13:01:47.620604 (+   343us) log.cc:844] Serialized 71 byte log entry
0709 13:01:47.660163 (+ 39559us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:47.667338 (+  7175us) write_op.cc:454] Released schema lock
0709 13:01:47.667418 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:47.929980 (+262562us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:47.930016 (+    36us) write_op.cc:454] Released schema lock
0709 13:01:48.322400 (+392384us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b540014ebd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c848232a 00007f36c8407f14 00007f36c8407ec3 00007f36c8407e38 00007f36c8407df3 00007f36c84070dc 00007f36c8430e16 00007f36c8418cbb 00007f36c840339d 00007f36c8406d75
Metrics: {"mutex_wait_us":4487,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":1229543,"apply.run_cpu_time_us":20656,"apply.run_wall_time_us":106398,"num_ops":9,"prepare.queue_time_us":337552,"prepare.run_cpu_time_us":32812,"prepare.run_wall_time_us":361573,"raft.queue_time_us":157763,"raft.run_cpu_time_us":245200,"raft.run_wall_time_us":2092092,"replication_time_us":549921,"spinlock_wait_cycles":36939392,"thread_start_us":1889554,"threads_started":5,"wal-append.queue_time_us":264899,"wal-append.run_cpu_time_us":29998,"wal-append.run_wall_time_us":1193163}]]}
W20260709 13:01:48.454284  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 66634.5us
I20260709 13:01:48.458700  9260 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:48.466756  9261 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.459286  8351 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:48.468967  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:48.469607  8384 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:48.470860  8379 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:01:48.471685  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.472165  8379 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:01:48.437570 10546 raft_consensus.cc:697] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:48.483491  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.485001  8385 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 6: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:48.452059 10592 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:48.458030 10425 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:48.436297 10522 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:48.501102  8384 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:48.478652  8424 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.488377 10711 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:48.464768 10481 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.448333 10477 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:48.490597  8382 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:48.464629 10639 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.464174 10653 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.457576 10681 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:48.479144 10448 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:48.499804 10708 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:01:48.477890 10441 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:48.512495  8424 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.513798 10477 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:48.597764 10681 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.597929  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:48.598187 10681 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:48.599709 10408 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:48.601002  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 88609.3us
I20260709 13:01:48.601841  8424 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.598078 10477 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:48.604660 10639 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:48.607491 10420 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:48.608129 10639 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:48.608994 10408 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:48.509893 10592 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:48.544267  8531 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:48.615273  8424 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.535624 10704 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:01:48.617967 10420 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:48.618919 10420 raft_consensus.cc:697] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:48.620059 10420 consensus_queue.cc:237] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:48.491706 10612 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:48.639237  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 158165us
I20260709 13:01:48.640815  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:48.641984  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:48.642903  8382 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:48.642639  8531 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:01:48.641006  8424 leader_election.cc:400] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4.
W20260709 13:01:48.644613  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 177911us
I20260709 13:01:48.645701  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.536106 10319 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:48.597039 10448 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.511262 10514 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:48.644336  8424 leader_election.cc:403] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:01:48.649199  8501 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.489818 10677 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:48.652185  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:48.538076 10676 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:48.655516  8452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:36446
I20260709 13:01:48.655707  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:48.656147  8452 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:48.656492  8457 raft_consensus.cc:2393] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 4: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:48.656884  8501 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.645347 10425 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:01:48.658387 10597 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:48.659312 10597 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:48.643743 10443 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:48.656522  8452 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:48.538859 10657 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:48.662050  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.652215  9261 leader_election.cc:400] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6.
I20260709 13:01:48.630944 10612 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:48.515142 10481 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:48.635584 10554 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:01:48.683360  8457 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:48.687577  8501 leader_election.cc:400] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6.
I20260709 13:01:48.687963  8501 leader_election.cc:403] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:48.690799 10481 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:48.691497 10481 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4.
I20260709 13:01:48.652716 10448 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:48.697433  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.697336  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.698850  8379 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:48.653803 10441 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:48.718971  8386 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
W20260709 13:01:48.722306 10705 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:01:48.636310 10653 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:48.647924 10546 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:48.728801 10653 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:48.685544 10612 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:48.680684 10486 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:48.740513  8382 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:48.745713  8501 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:48.744163  9261 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.746399  8461 raft_consensus.cc:1275] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:48.747328 10604 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:48.747725 10604 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.748070 10604 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:48.749533  8501 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:48.750402 10656 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:48.750735  8501 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:48.750934 10656 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:48.751459 10656 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:48.755239  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:48.756017  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:48.755208  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:48.756682  8456 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:48.757263  8461 raft_consensus.cc:2393] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 4: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:48.687386 10443 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:48.759039  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:48.760897  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:48.763659  8531 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
I20260709 13:01:48.717350 10592 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:48.767650  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:48.769042  8452 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:48.771260  8380 raft_consensus.cc:2410] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:01:48.764745  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 123870us
I20260709 13:01:48.773802  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:48.773973  9261 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.739117 10507 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6.
I20260709 13:01:48.777815  8458 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:48.779105 10552 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:48.778756  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:48.771261 10641 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:01:48.781353 10443 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:48.781561 10716 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:48.781841 10443 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:48.782403 10443 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:48.782189 10448 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:48.776258  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:48.785584  8349 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:48.781409  9261 leader_election.cc:400] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6.
I20260709 13:01:48.786826  9261 leader_election.cc:403] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:48.776266  8461 raft_consensus.cc:1240] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:48.777773  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:48.790591  8349 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:48.800858  8424 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.800722  8382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67513665d04b44c292143601e7f66ac8"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
new_leader_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:01:48.802053  8382 raft_consensus.cc:606] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Received request to transfer leadership to TS 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:48.802390  8382 raft_consensus.cc:614] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:48.789459  8378 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:01:48.798468  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:48.804126  8457 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:48.809055  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 58387.2us
I20260709 13:01:48.810760  8501 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:48.811683  8501 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:48.816562  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:48.775817 10453 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:48.818193 10201 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.818743 10201 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:48.819775 10462 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:48.821277  8385 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:48.824194  8452 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:48.827800  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:48.829797  8500 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.762609 10597 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:01:48.794479 10716 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:01:48.841917  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:48.806641 10717 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:48.843799 10717 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:48.844277 10717 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:48.844767 10726 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:48.845394 10726 raft_consensus.cc:697] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:48.839071  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:48.846315 10726 consensus_queue.cc:237] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:48.846907 10486 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:48.847747 10656 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:48.842713  8531 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:48.849256 10453 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:48.820964 10201 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:48.815291 10610 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:48.850237 10610 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:48.850663 10610 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:48.851469  8500 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:48.803380 10514 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:48.857463 10507 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:48.859752 10539 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:01:48.847841 10681 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:48.849341 10597 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:48.868675  8531 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:48.836007  8351 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:48.870705  8457 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
W20260709 13:01:48.881345  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 52624.1us
I20260709 13:01:48.882176  9260 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:48.884254 10546 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:48.884953 10546 raft_consensus.cc:697] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:48.886087 10546 consensus_queue.cc:237] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:48.884987  8532 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:01:48.893275  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 57331.9us
I20260709 13:01:48.896464  8351 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:48.900677  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:48.901417  8530 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:48.902105  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:48.903820  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:48.904881  8529 raft_consensus.cc:2410] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:01:48.988044  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 96072.3us
I20260709 13:01:48.989276  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:48.990877  8531 raft_consensus.cc:1240] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:48.880101 10597 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.025202  8427 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:49.026340  8457 raft_consensus.cc:1275] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:48.841838 10667 consensus_queue.cc:1048] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.155s
I20260709 13:01:49.040899  8458 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:48.909792 10319 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:48.842293 10632 consensus_queue.cc:1059] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.153s
I20260709 13:01:49.038213  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:49.045773  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:49.043080  8457 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:48.988814 10382 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:49.037840 10453 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.016546 10448 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:49.041476 10609 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.039705 10597 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:49.036738  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.077186  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 265519us
I20260709 13:01:49.088552  8501 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:49.021929 10462 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:01:49.062588  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:01:49.080758  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 229348us
I20260709 13:01:49.127485  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:49.128925  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:49.132334  9291 raft_consensus.cc:1240] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:49.031353 10680 consensus_queue.cc:1059] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:01:49.143913  9295 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:49.152351  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:49.064138 10712 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:49.073495 10554 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.168757  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:49.153792  9291 raft_consensus.cc:2410] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:01:49.170493  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:49.171200  9291 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.080930 10726 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:49.087463 10653 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:49.088887 10677 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:49.194324  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:49.204077  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:49.207221  8458 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
I20260709 13:01:49.208176  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:49.204882  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:49.205574  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:49.211063  8460 raft_consensus.cc:2393] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:49.205192  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:49.217588  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:49.218668  8460 raft_consensus.cc:2368] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6.
I20260709 13:01:49.221201  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:49.153823 10632 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.243034 10656 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:49.243722  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:49.168227 10448 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.274194 10728 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:49.274612 10448 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:49.276727 10725 log.cc:927] Time spent T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
W20260709 13:01:49.244836 10722 log.cc:927] Time spent T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 13:01:49.244562  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:49.085772 10453 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:49.279074  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:49.279318  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:49.279466 10453 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:49.279901  8456 raft_consensus.cc:2393] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:49.155364 10639 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:49.280304 10639 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.280643  9294 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 1 LEARNER]: Advancing to term 3
I20260709 13:01:49.280716 10639 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:49.281541 10443 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:49.284397 10443 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:49.287868  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:49.291441 10507 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:49.297950 10507 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.262755  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:49.314476  8460 raft_consensus.cc:2376] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4. Re-sending same reply.
I20260709 13:01:49.263793  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:49.140769 10609 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:49.316391  8454 raft_consensus.cc:2393] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:49.178871 10712 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:49.203348 10727 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:49.273672 10632 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:49.167888 10441 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:01:49.327395  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 302317us
I20260709 13:01:49.328295  8427 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:49.240183 10653 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:49.183151 10554 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:49.240548 10486 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:49.288694 10639 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:49.304266  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:49.306311 10448 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:49.254846  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:49.189957 10477 consensus_meta.cc:287] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.587s	user 0.009s	sys 0.002s
I20260709 13:01:49.306507 10681 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:49.222504 10733 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:49.390911  9295 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:01:49.315616  8426 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:49.392403  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 76879.3us
I20260709 13:01:49.272329  9291 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:49.319813  8424 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:49.316515 10612 consensus_meta.cc:287] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.001s
I20260709 13:01:49.321770  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:49.316807 10604 consensus_meta.cc:287] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.568s	user 0.005s	sys 0.006s
I20260709 13:01:49.323307  9294 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:49.316252 10610 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:49.360021 10398 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:49.362957  9296 raft_consensus.cc:2410] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:01:49.371224  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 160602us
W20260709 13:01:49.397864  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 78168.9us
I20260709 13:01:49.398620  8424 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:49.348649 10420 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:49.400203  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:01:49.371767  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 229140us
I20260709 13:01:49.388926  8427 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:49.333225  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:49.349123  8455 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:49.413568  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:49.418546  9294 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:49.318743 10507 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:49.416438  8500 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:49.415055 10420 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.412947 10604 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:49.423013 10420 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:49.397384 10612 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:49.425515  9287 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:49.427295 10612 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:49.429752 10723 log.cc:927] Time spent T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:01:49.384533 10657 raft_consensus.cc:476] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Not starting pre-election -- already a leader
W20260709 13:01:49.468497  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 52161.1us
I20260709 13:01:49.468809  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:49.469565  8526 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:49.436640  9291 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
W20260709 13:01:49.433264  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 44465.3us
I20260709 13:01:49.469856  8500 leader_election.cc:400] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6.
I20260709 13:01:49.471768  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:49.467680  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:49.473248  9294 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:01:49.418570 10408 raft_consensus.cc:993] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:49.433157  8528 raft_consensus.cc:2393] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 3: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:49.433656  8424 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:49.424880 10604 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:49.364084 10441 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:49.332331 10727 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:49.367403 10486 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:49.395963 10731 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:49.473034 10514 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:49.468698 10681 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:49.398303 10425 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:49.432967 10598 raft_consensus.cc:2804] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:49.467697 10733 raft_consensus.cc:697] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:49.395506 10477 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:49.420130 10462 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:49.481182 10736 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:49.520718  8455 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
W20260709 13:01:49.524441  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 321361us
I20260709 13:01:49.528192  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:49.529063  8534 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:49.529472  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:49.530110  8377 raft_consensus.cc:3055] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:49.530571  8377 raft_consensus.cc:740] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:49.531450  8377 consensus_queue.cc:260] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:49.532454 10477 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:49.532750 10522 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:49.533334 10727 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:49.535027 10727 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.535401  9293 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.535538 10727 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:49.538046 10507 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:49.540180  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:49.499645 10514 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.544160  9293 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:49.509872 10425 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:49.521968 10716 consensus_meta.cc:287] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.650s	user 0.007s	sys 0.003s
I20260709 13:01:49.509676 10737 raft_consensus.cc:1081] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:01:49.497684 10604 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:49.598248  8527 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:49.502406 10731 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:49.490379 10655 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:01:49.511452 10681 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:49.902351  8384 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:01:49.900998  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 375) took 1161 ms. Trace:
W20260709 13:01:49.654294  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 260618us
I20260709 13:01:49.907660  8384 pending_rounds.cc:85] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 4
I20260709 13:01:49.918455  8379 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:49.918864  8384 pending_rounds.cc:107] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:01:49.919219  8384 raft_consensus.cc:2889] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:49.762622  8526 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:01:49.907843  8535 rpcz_store.cc:276] 0709 13:01:48.739967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.740126 (+   159us) service_pool.cc:224] Handling call
0709 13:01:48.760668 (+ 20542us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.290163 (+529495us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b18004189c0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c802d4bc 00007f36c537b48b 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5395455 00007f36c847d060 00007f36c847dbfb 00007f36c848864b
0709 13:01:49.290295 (+   132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.290319 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.290844 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.473235 (+182391us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:49.473274 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.473337 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.544725 (+ 71388us) raft_consensus.cc:1685] finished
0709 13:01:49.544752 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.900906 (+356154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":443,"raft.queue_time_us":23080,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":14538,"spinlock_wait_cycles":33912192,"thread_start_us":233843,"threads_started":2,"wal-append.queue_time_us":242752}
W20260709 13:01:49.837706 10597 consensus_meta.cc:287] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.685s	user 0.009s	sys 0.001s
I20260709 13:01:49.901945 10610 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:49.835740 10420 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:49.858657 10736 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:49.907608 10507 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.914275 10748 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:49.520999 10443 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:49.626097  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 126637us
I20260709 13:01:49.664160 10727 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:49.535395 10676 raft_consensus.cc:3055] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:49.902848  9258 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:49.599448 10712 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:01:49.654734 10666 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.001s	sys 0.012s
I20260709 13:01:49.526559 10598 raft_consensus.cc:697] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:01:49.700837 10726 consensus_meta.cc:287] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.003s
I20260709 13:01:50.011076 10726 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:49.928601  9296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55720 (request call id 364) took 1094 ms. Trace:
I20260709 13:01:49.599773 10716 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6.
I20260709 13:01:49.929805  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:01:49.689658 10735 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
W20260709 13:01:49.686390 10739 log.cc:927] Time spent T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:01:49.623874 10514 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:49.909225 10425 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.034114 10425 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:50.034978  8453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 371) took 1250 ms. Trace:
I20260709 13:01:50.035411  8453 rpcz_store.cc:276] 0709 13:01:48.784820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.784943 (+   123us) service_pool.cc:224] Handling call
0709 13:01:48.813871 (+ 28928us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:48.833848 (+ 19977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.833877 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:48.864066 (+ 30189us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.074274 (+210208us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:49.074331 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.074420 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.034520 (+960100us) raft_consensus.cc:1685] finished
0709 13:01:50.034540 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.034885 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64866,"raft.queue_time_us":23548,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":3756,"thread_start_us":209720,"threads_started":1,"wal-append.queue_time_us":525673}
W20260709 13:01:49.938673  8532 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.013s	sys 0.019s
W20260709 13:01:50.037299  8532 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.013s	sys 0.019s
I20260709 13:01:49.939189  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:50.038414  8457 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
W20260709 13:01:49.900998  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 467395us
I20260709 13:01:49.666694 10441 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:49.668157 10486 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:49.698238 10632 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:49.692881 10609 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:49.925654 10747 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.922492 10554 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:50.040319 10656 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:50.040187 10747 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:49.926198 10749 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:49.929618 10719 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.005s	sys 0.018s
I20260709 13:01:49.970920  8500 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:01:50.044907 10719 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.007s	sys 0.021s
I20260709 13:01:50.044832 10749 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:50.045459  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 74714us
I20260709 13:01:50.011420  9290 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:01:50.046568 10726 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:50.046804  8500 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:50.040220  8424 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:50.048518  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:49.946475 10610 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:50.050655 10610 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:49.914813 10604 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:50.054240 10717 consensus_meta.cc:287] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.210s	user 0.008s	sys 0.004s
I20260709 13:01:50.054754 10747 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:50.054706 10717 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:50.055239 10604 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:49.991351  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38894 (request call id 1838) took 1090 ms. Trace:
I20260709 13:01:49.991503  8458 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:50.055895  8379 raft_consensus.cc:1240] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:49.926895 10597 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:50.056131  8528 rpcz_store.cc:276] 0709 13:01:48.901219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.903352 (+  2133us) service_pool.cc:224] Handling call
0709 13:01:49.991100 (+1087748us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b5400097254. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:49.991245 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1018455936}
I20260709 13:01:50.057228 10731 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:50.057454 10610 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:50.058358 10597 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:50.058589  8500 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:50.059082 10597 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:50.059386 10726 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:50.059662 10597 raft_consensus.cc:697] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 6 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:50.059828 10726 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:50.060246 10726 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:49.997189 10707 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:01:50.002017  8351 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:50.061671  8533 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 13:01:50.062157  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 60235.8us
I20260709 13:01:50.060659 10597 consensus_queue.cc:237] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:50.062995  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:49.513515 10738 consensus_queue.cc:1059] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.431s
I20260709 13:01:49.997911 10737 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:01:49.943343 10676 raft_consensus.cc:740] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:50.015599  9295 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:50.081410  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:50.017817  9293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55720 (request call id 362) took 1202 ms. Trace:
I20260709 13:01:49.692080 10733 consensus_queue.cc:237] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:49.946731 10742 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:50.011884  9296 rpcz_store.cc:276] 0709 13:01:48.826828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.827019 (+   191us) service_pool.cc:224] Handling call
0709 13:01:49.128725 (+301706us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5800220e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd44b0a0 00007f36cd44a984 00007f36c69c56d4 00007f36c69c5662
0709 13:01:49.920447 (+791722us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b540049fcd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:49.920573 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":530654976}
I20260709 13:01:50.011380 10598 consensus_queue.cc:237] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:50.094251  9289 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:01:50.091605 10741 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:50.095139 10741 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.095489 10741 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:50.021126  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:50.021734 10639 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:50.089955 10745 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:01:49.997272 10681 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:50.023854  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:50.102269 10420 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:50.104842 10554 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.074365 10632 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:50.105615 10554 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:50.024442  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:50.107738  8385 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:50.025584  9288 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:49.940897 10748 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:49.977362 10477 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:49.938144 10507 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:50.009277 10666 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.005s	sys 0.029s
I20260709 13:01:49.974220  8456 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:50.049350 10727 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:50.049383  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1833) took 1150 ms. Trace:
I20260709 13:01:50.065246 10610 raft_consensus.cc:2764] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:01:50.127789  9295 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:50.066234  8500 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:01:50.130357  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 64216us
I20260709 13:01:50.066931 10717 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:49.935591 10736 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:49.944239 10443 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:50.069464  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:50.141703  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:50.069375  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:50.142269  8456 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:50.077020  8460 raft_consensus.cc:1240] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:50.080216  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:50.086036  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:50.144136  8383 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:50.087491  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:50.088407  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:50.089315  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:50.083909  9293 rpcz_store.cc:276] 0709 13:01:48.815514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.816292 (+   778us) service_pool.cc:224] Handling call
0709 13:01:50.017638 (+1201346us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b54004b8cd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:50.017754 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1651435904}
I20260709 13:01:50.145730  8386 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:01:50.070501 10609 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:50.071273 10747 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.093765  8380 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:50.022051  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:50.108525  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:50.115527 10477 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.008404  8427 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:50.064914 10425 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:50.119140  8532 rpcz_store.cc:276] 0709 13:01:48.898897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.899074 (+   177us) service_pool.cc:224] Handling call
0709 13:01:48.918493 (+ 19419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:48.987807 (+ 69314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.987840 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.016227 (+ 28387us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.332253 (+316026us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:50.037717 (+705464us) log.cc:844] Serialized 14 byte log entry
0709 13:01:50.037954 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.038033 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.049158 (+ 11125us) raft_consensus.cc:1685] finished
0709 13:01:50.049181 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.049324 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74343,"prepare.queue_time_us":689689,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":262572,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":45214,"thread_start_us":893943,"threads_started":2,"wal-append.queue_time_us":426888}
I20260709 13:01:50.147061  8527 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:50.148707  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:50.117743 10731 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.163765  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:50.162875  8456 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:50.119941  9291 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:50.159631  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:50.167062  9293 raft_consensus.cc:2393] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 6: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:50.118464 10408 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:01:50.160596  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 152250us
I20260709 13:01:50.169932  8452 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:50.170894  8527 raft_consensus.cc:1275] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:50.164145  8532 raft_consensus.cc:1275] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:50.150012  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:50.171838  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:50.115327 10319 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:01:50.140889 10604 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:50.180459  8534 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:50.123453 10745 consensus_queue.cc:1059] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:01:50.185549  8461 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:50.187134  8526 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:50.188488  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:50.114051 10742 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:50.190392  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:50.160455 10477 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:50.140249 10681 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:01:50.163949  9290 raft_consensus.cc:1240] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:50.194435  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:50.188897  8424 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:50.208324  8526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38894
W20260709 13:01:50.207858  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 75072.1us
I20260709 13:01:50.208878  8526 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:50.209266  8526 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:50.210729  8385 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:01:50.181022  8383 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:01:50.195472  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:50.202682 10554 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:50.163699 10747 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:50.193838 10604 raft_consensus.cc:697] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:50.163403 10420 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:50.211326  9261 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:50.213060  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:50.216346  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:50.219431  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:50.227268  8384 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
I20260709 13:01:50.222867  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:50.223572  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:50.251138  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:50.205646 10727 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.252447  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:50.244180  8526 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:50.261607  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:50.273022  8532 raft_consensus.cc:2368] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 3. Current term is 4.
W20260709 13:01:50.275177  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 63984.6us
I20260709 13:01:50.266541  8530 raft_consensus.cc:1240] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:50.276412  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 68742.7us
I20260709 13:01:50.276965  8530 raft_consensus.cc:3055] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:50.277491  8530 raft_consensus.cc:740] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:50.182780 10408 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:50.278446  8530 consensus_queue.cc:260] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:50.260697  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:50.267385  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:50.267961  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 51741.9us
I20260709 13:01:50.280364  8378 raft_consensus.cc:2410] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:01:50.268128  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:50.150159 10676 consensus_queue.cc:260] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:50.219064 10745 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:50.269181  8456 raft_consensus.cc:1240] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:50.269647  8381 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
W20260709 13:01:50.270028  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 81181.6us
I20260709 13:01:50.178714 10731 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:50.279698  8530 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:50.280507  8351 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:50.196455 10743 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:01:50.281996  9258 leader_election.cc:400] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 3. Current term is 4.
I20260709 13:01:50.249533 10632 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:50.282018  9261 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:50.288743  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:50.289934  9258 leader_election.cc:403] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:01:50.291851  8351 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:50.274317 10712 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:50.272058 10717 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:50.329001  8534 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:50.270610 10609 consensus_queue.cc:1059] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:01:50.332898  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:50.333491 10748 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:50.334201  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:01:50.334548 10765 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:01:50.335355  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:50.285022 10420 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:50.336510  8452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:01:50.322836 10610 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:50.338620  8452 raft_consensus.cc:606] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:01:50.339146  8452 raft_consensus.cc:614] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:50.288604 10738 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:50.324900  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:50.389408  8378 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 1.
I20260709 13:01:50.262305 10737 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:01:50.274688 10727 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:50.296801  8424 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:50.294377  8384 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:50.327610  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 49349.8us
I20260709 13:01:50.342289  8530 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:01:50.326133 10767 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:50.295054  9261 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:50.393105  8530 pending_rounds.cc:85] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 6
I20260709 13:01:50.393424  8530 pending_rounds.cc:107] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:01:50.393630  8530 raft_consensus.cc:2889] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:50.390800  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:50.395720  8534 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:01:50.276657 10514 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:50.329106 10676 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:50.324606 10448 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 3. Current term is 4.
I20260709 13:01:50.339396 10486 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:01:50.335359 10726 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:50.334245 10742 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:50.417264  9287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 636) took 1205 ms. Trace:
I20260709 13:01:50.417768  9287 rpcz_store.cc:276] 0709 13:01:49.212128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.426379 (+214251us) service_pool.cc:224] Handling call
0709 13:01:49.925876 (+499497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.937925 (+ 12049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.940633 (+  2708us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:49.947799 (+  7166us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:49.955910 (+  8111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.985612 (+ 29702us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.417013 (+431401us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b540049fcd0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:50.417201 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140168960}
I20260709 13:01:50.419926  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:50.420388  9296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 372) took 1095 ms. Trace:
I20260709 13:01:50.387907 10604 consensus_queue.cc:237] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:50.420828  9296 rpcz_store.cc:276] 0709 13:01:49.325440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.121602 (+796162us) service_pool.cc:224] Handling call
0709 13:01:50.122062 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.122564 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.122604 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:50.129525 (+  6921us) log.cc:844] Serialized 26 byte log entry
0709 13:01:50.210345 (+ 80820us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:50.268714 (+ 58369us) log.cc:844] Serialized 14 byte log entry
0709 13:01:50.268992 (+   278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.270444 (+  1452us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.420144 (+149700us) raft_consensus.cc:1685] finished
0709 13:01:50.420167 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.420326 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":61536,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":2903,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":12134,"spinlock_wait_cycles":9170176,"thread_start_us":28811,"threads_started":1,"wal-append.queue_time_us":257045}
I20260709 13:01:50.423002  8535 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:50.423519 10643 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:50.396976 10738 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:50.425480 10681 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.426162 10681 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:50.397927 10767 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:50.429404  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:50.388516 10632 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:50.436017  8453 raft_consensus.cc:2393] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 3: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:50.436369  8532 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:50.432669  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:50.437219  8378 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:50.434002  8529 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:50.343145 10420 raft_consensus.cc:697] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:50.283612 10766 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.130s
I20260709 13:01:50.391206 10716 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:01:50.441663  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 149816us
I20260709 13:01:50.294781 10745 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:50.417002 10726 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:50.408095 10747 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:50.463587  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:50.457644  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:50.465996  8529 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:50.448320  8384 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:50.332067 10741 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:50.339545 10717 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:50.430719  9287 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:50.434196 10767 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:50.473497  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:50.496819  8384 raft_consensus.cc:2393] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 4: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:50.497576  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:50.498090  8384 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:50.498417  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:50.498683  8386 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:01:50.475466 10768 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:01:50.475375 10719 consensus_queue.cc:1059] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:50.480471 10738 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:50.481216  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:50.483641 10717 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:50.483498  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:50.514035  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 121705us
W20260709 13:01:50.483850  8349 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.657s (SENT) [suppressed 22 similar messages]
I20260709 13:01:50.486377 10727 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:01:50.488972 10715 log.cc:927] Time spent T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 1.412s	user 0.001s	sys 0.022s
I20260709 13:01:50.490535 10514 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:50.491106  8383 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:50.492148 10745 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:50.479202 10776 raft_consensus.cc:3055] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:50.494019 10741 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:50.575237  8383 raft_consensus.cc:2410] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:01:50.494848 10731 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:50.465152 10736 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:50.495167 10749 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:50.465447 10716 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:50.455343 10632 raft_consensus.cc:697] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:50.541616 10743 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:50.507011  9294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 392) took 1182 ms. Trace:
I20260709 13:01:50.507608  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:50.508630  8501 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:01:50.617281  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 108729us
I20260709 13:01:50.512336  8529 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:50.619298  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:50.619822  8529 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:50.514210  8385 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 8: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:50.460824 10425 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:50.625622 10736 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.626133 10736 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:50.626570 10736 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.626230 10717 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
W20260709 13:01:50.521066  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.629295 10632 consensus_queue.cc:237] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:50.525146  8384 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:01:50.631470  8384 raft_consensus.cc:1240] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:50.525916  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 229186us
I20260709 13:01:50.534991  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:50.578293  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:50.579695  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:50.618409  8501 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:50.582973  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:50.586719  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:50.624907  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:50.634761  8534 raft_consensus.cc:2393] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 8: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:50.587536 10408 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:50.641877  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:50.633162  8452 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 2.
I20260709 13:01:50.643290  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:50.593954 10552 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:50.594316 10420 consensus_queue.cc:237] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:50.571588 10776 raft_consensus.cc:740] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:50.599478  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1836) took 1698 ms. Trace:
I20260709 13:01:50.496016 10443 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:01:50.571708 10769 log.cc:927] Time spent T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.271s	user 0.001s	sys 0.001s
I20260709 13:01:50.647338  8349 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:50.614344 10610 raft_consensus.cc:697] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:50.615079  9294 rpcz_store.cc:276] 0709 13:01:49.324138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.031252 (+707114us) service_pool.cc:224] Handling call
0709 13:01:50.059817 (+ 28565us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.060199 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.060227 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:50.060763 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:01:50.152825 (+ 92062us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:50.152852 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.152894 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.506799 (+353905us) raft_consensus.cc:1685] finished
0709 13:01:50.506817 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.506952 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1185,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":130,"thread_start_us":91708,"threads_started":1,"wal-append.queue_time_us":208679}
I20260709 13:01:50.642283 10726 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:50.593519 10681 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:50.644666  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:01:50.645742  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.646903  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:50.647704  8379 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
W20260709 13:01:50.648150  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 475690us
I20260709 13:01:50.656003  8533 rpcz_store.cc:276] 0709 13:01:48.900571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.901388 (+   817us) service_pool.cc:224] Handling call
0709 13:01:48.901722 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.062088 (+1160366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.599049 (+536961us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002baa54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:50.599385 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2667001728}
I20260709 13:01:50.686190  8379 pending_rounds.cc:85] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 5
I20260709 13:01:50.686547  8379 pending_rounds.cc:107] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:01:50.660486  8529 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:01:50.686844  8379 raft_consensus.cc:2889] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:50.687628  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:50.688409  8529 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:50.686857  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:50.699545  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:50.700223  8534 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:50.614807 10719 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:01:50.702963  8529 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:01:50.705989  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:50.706655  8529 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:01:50.708035  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:50.709414  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:50.711529  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:50.679859 10717 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:50.714977  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:50.714202  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:50.655931 10741 consensus_queue.cc:1059] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:01:50.722117  8535 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:50.718999  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:50.677670 10755 consensus_queue.cc:1059] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:01:50.725670  8535 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:50.726413  8529 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:50.709319 10726 raft_consensus.cc:697] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:50.716830 10716 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:50.740785 10777 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:01:50.741180  8534 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:01:50.728266 10766 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.720466 10745 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:01:50.718914 10477 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:50.787879  9288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 368) took 1897 ms. Trace:
I20260709 13:01:50.787878  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:50.789304  8455 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36448 (request call id 1802) took 1584 ms (client timeout 1750 ms). Trace:
W20260709 13:01:50.789710  8459 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36448 (request call id 1801) took 1585 ms (client timeout 1529 ms). Trace:
W20260709 13:01:50.793288  8459 rpcz_store.cc:269] 0709 13:01:49.204565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.204675 (+   110us) service_pool.cc:224] Handling call
0709 13:01:50.787718 (+1583043us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b5800110a98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd44b0a0 00007f36cd44a984 00007f36c69c56d4 00007f36c69c5662
0709 13:01:50.789595 (+  1877us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2640128}
W20260709 13:01:50.789698  8455 rpcz_store.cc:269] 0709 13:01:49.204846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.204959 (+   113us) service_pool.cc:224] Handling call
0709 13:01:50.788996 (+1584037us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540041a854. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:50.789236 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312388480}
I20260709 13:01:50.788486  9288 rpcz_store.cc:276] 0709 13:01:48.892097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.896323 (+  4226us) service_pool.cc:224] Handling call
0709 13:01:50.025204 (+1128881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.117054 (+ 91850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.787648 (+670594us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b54004b8cd0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:50.787812 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2190484352}
I20260709 13:01:50.806151  8385 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:50.728793 10776 consensus_queue.cc:260] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:50.808368 10653 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:50.809218 10539 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.744422 10610 consensus_queue.cc:237] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:50.809764 10539 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:50.813915 10726 consensus_queue.cc:237] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:50.814536  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:50.815304  8534 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 4: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:01:50.817538 10773 log.cc:927] Time spent T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.482s	user 0.001s	sys 0.001s
I20260709 13:01:50.819248  8526 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:50.811915 10539 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:50.830636  8377 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:50.842504  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 547481us
W20260709 13:01:50.847203  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.848428 10711 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:01:50.866896 10639 raft_consensus.cc:3055] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:50.867437 10639 raft_consensus.cc:740] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:50.868306 10639 consensus_queue.cc:260] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:50.870030 10776 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:50.833900 10767 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:50.872447 10477 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:50.786890 10766 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:50.872864  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.873823  8281 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59480 (request call id 200) took 5548 ms. Trace:
I20260709 13:01:50.833629 10598 raft_consensus.cc:3055] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:50.904381  8377 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:01:50.874842  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:50.828193  8282 catalog_manager.cc:5697] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 3 to 2, leader changed from <none> to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:50.845242  9261 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:50.937860  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 2098) took 1400 ms. Trace:
I20260709 13:01:50.938376  8377 rpcz_store.cc:276] 0709 13:01:49.529034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.529213 (+   179us) service_pool.cc:224] Handling call
0709 13:01:50.830337 (+1301124us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b58006401d0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c83e10aa 00007f36c8463447 00007f36c847bfe7 00007f36c847d7de 00007f36c848927c 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c
0709 13:01:50.929725 (+ 99388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064750464}
W20260709 13:01:50.938565  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 93395.8us
I20260709 13:01:50.947212  9261 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:50.940266  8282 catalog_manager.cc:5697] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 2 to 3, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.958952  8282 catalog_manager.cc:5697] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 3 to 4, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 4 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.962796  8282 catalog_manager.cc:5697] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 4 to 5, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 5 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:50.940166 10704 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:01:50.936364 10598 raft_consensus.cc:740] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:50.928757  8281 rpcz_store.cc:276] 0709 13:01:45.325521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.325795 (+   274us) service_pool.cc:224] Handling call
0709 13:01:50.873693 (+5547898us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:48.682465 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:48.683035 (+   570us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:48.683068 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:01:48.683086 (+    18us) tablet.cc:662] Decoding operations
0709 13:01:48.731696 (+ 48610us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:48.731748 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:48.731780 (+    32us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:01:48.732107 (+   327us) tablet.cc:701] Row locks acquired
0709 13:01:48.732126 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:01:48.732281 (+   155us) write_op.cc:270] Start()
0709 13:01:48.732397 (+   116us) write_op.cc:276] Timestamp: P: 1783602108732232 usec, L: 0
0709 13:01:48.732418 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:01:48.733107 (+   689us) log.cc:844] Serialized 1293 byte log entry
0709 13:01:49.531437 (+798330us) op_driver.cc:464] REPLICATION: finished
0709 13:01:50.049701 (+518264us) write_op.cc:301] APPLY: starting
0709 13:01:50.049792 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:50.049954 (+   162us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:50.050070 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:50.050559 (+   489us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:50.050753 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:01:50.050817 (+    64us) write_op.cc:312] APPLY: finished
0709 13:01:50.051030 (+   213us) log.cc:844] Serialized 35 byte log entry
0709 13:01:50.051210 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:50.051307 (+    97us) write_op.cc:454] Released schema lock
0709 13:01:50.051352 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:50.051728 (+   376us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:50.051761 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":79867,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":518004,"apply.run_cpu_time_us":1976,"apply.run_wall_time_us":1975,"num_ops":3,"prepare.queue_time_us":204541,"prepare.run_cpu_time_us":17644,"prepare.run_wall_time_us":331245,"raft.queue_time_us":262010,"raft.run_cpu_time_us":23471,"raft.run_wall_time_us":335930,"replication_time_us":798864,"thread_start_us":763148,"threads_started":4,"wal-append.queue_time_us":489116}]]}
I20260709 13:01:50.962296 10554 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:01:50.944157 10639 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:50.957356 10477 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:50.959137 10448 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:50.986718 10604 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:51.009196 10604 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:51.010666 10766 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:50.980511 10443 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:51.012408 10443 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:51.014955 10767 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:51.015897 10443 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:51.005263 10507 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:51.006129  9290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 394) took 1681 ms. Trace:
I20260709 13:01:51.020659  8382 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:01:51.024276  8379 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:51.025559 10767 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:51.008227 10477 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:51.136200 10477 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.087015 10761 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:01:51.085188  9296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.021s	sys 0.033s
W20260709 13:01:51.141557  9296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.023s	sys 0.034s
I20260709 13:01:51.080456  8427 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:51.095392  9292 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:51.131839 10319 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:01:51.094924  9289 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55720 (request call id 358) took 2300 ms (client timeout 1657 ms). Trace:
I20260709 13:01:51.086352 10598 consensus_queue.cc:260] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:51.030246 10747 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.029s	sys 0.025s
I20260709 13:01:51.155810  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:51.070098 10507 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:51.024811 10604 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:51.192981  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:01:51.200966  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 120589us
I20260709 13:01:51.086875 10736 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:51.197985  8382 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
W20260709 13:01:51.194581 10747 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.029s	sys 0.030s
I20260709 13:01:51.204445  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:51.205837 10756 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:51.206674  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:51.022583  9290 rpcz_store.cc:276] 0709 13:01:49.324799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.047120 (+722321us) service_pool.cc:224] Handling call
0709 13:01:50.139971 (+ 92851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.218830 (+ 78859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.005849 (+787019us) spinlock_profiling.cc:243] Waited 88.5 ms on lock 0x7b5400708fd0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:51.006047 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203528960}
I20260709 13:01:51.207551  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:51.175402 10767 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:51.193030 10748 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.200059 10448 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:51.231406  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:01:51.232295  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.137665 10761 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:51.098167 10443 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:51.232066 10756 raft_consensus.cc:697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:01:51.241595  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.242058  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:51.243664  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:51.284186  9291 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:51.251766  9294 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:01:51.202258  8427 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
W20260709 13:01:51.287487  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 85328.5us
W20260709 13:01:51.270022  8386 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.022s	sys 0.042s
W20260709 13:01:51.291631  8386 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.022s	sys 0.042s
I20260709 13:01:51.196583 10319 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:51.201378 10507 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:51.191421  9289 rpcz_store.cc:269] 0709 13:01:48.794168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.804332 (+ 10164us) service_pool.cc:224] Handling call
0709 13:01:51.093646 (+2289314us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540053d754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:51.094789 (+  1143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2719433088}
W20260709 13:01:51.300226  8352 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.000s	sys 0.025s
W20260709 13:01:51.300711  8352 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.000s	sys 0.025s
W20260709 13:01:51.302380  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.295948 10756 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:51.319576  9291 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:01:51.250676  9288 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
W20260709 13:01:51.341869  8500 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.023s	sys 0.022s
W20260709 13:01:51.342372  8500 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.023s	sys 0.022s
W20260709 13:01:51.342700  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 710978us
I20260709 13:01:51.292493  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:01:51.338726  8527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.015s	sys 0.033s
W20260709 13:01:51.368892  8527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.015s	sys 0.033s
I20260709 13:01:51.268565 10748 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:51.297413 10639 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:51.311510 10656 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.280941 10448 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:51.286178 10443 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:51.310672 10481 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:01:51.372364 10737 consensus_queue.cc:1059] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:01:51.404579  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:51.411836  8453 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.003s	sys 0.037s
I20260709 13:01:51.417621  8382 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:51.418823  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:51.382381  9287 raft_consensus.cc:2376] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6. Re-sending same reply.
I20260709 13:01:51.414618  8427 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:51.378118 10764 consensus_queue.cc:1059] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:01:51.391763 10639 raft_consensus.cc:697] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:51.428917  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:01:51.426688  8453 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.003s	sys 0.038s
I20260709 13:01:51.423338  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:51.396900 10522 consensus_queue.cc:1059] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
W20260709 13:01:51.461526  8424 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.012s	sys 0.026s
W20260709 13:01:51.461918  8424 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.012s	sys 0.026s
I20260709 13:01:51.462183 10539 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:51.464444  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:51.396036 10656 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:51.476756  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:51.427074 10741 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:01:51.448930 10398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.015s	sys 0.030s
W20260709 13:01:51.480101  8349 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.029s	sys 0.060s
I20260709 13:01:51.449743 10784 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:51.482045  8349 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.030s	sys 0.060s
W20260709 13:01:51.487811  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 802707us
I20260709 13:01:51.487435  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:51.488516  8349 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:51.483469  8458 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:01:51.486182  8456 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.015s	sys 0.026s
W20260709 13:01:51.490319  8456 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.016s	sys 0.027s
W20260709 13:01:51.461928 10632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.007s	sys 0.018s
I20260709 13:01:51.491464  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:51.459517  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:01:51.497845  8426 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.012s	sys 0.015s
I20260709 13:01:51.494733  8454 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:51.497174  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:51.491889  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:51.498525  8426 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.012s	sys 0.015s
W20260709 13:01:51.485844 10398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.016s	sys 0.031s
W20260709 13:01:51.503921  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 786336us
I20260709 13:01:51.490072  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:51.508781  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:51.488149 10784 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:51.481141 10738 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.011s	sys 0.014s
I20260709 13:01:51.487242 10736 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:51.494331 10655 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:01:51.495193 10632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.007s	sys 0.018s
W20260709 13:01:51.496095 10420 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.007s	sys 0.017s
I20260709 13:01:51.534545  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:51.535420  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:51.535450  8458 raft_consensus.cc:2393] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:01:51.511531 10776 consensus_meta.cc:287] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.583s	user 0.006s	sys 0.005s
I20260709 13:01:51.538160  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:51.544982  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:51.546550  8534 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:51.528591 10738 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.012s	sys 0.015s
I20260709 13:01:51.541287  8526 raft_consensus.cc:1240] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:51.489144 10741 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:51.511963 10767 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:51.504498 10522 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:01:51.532778 10770 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.014s	sys 0.014s
I20260709 13:01:51.555430 10319 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:51.529021 10784 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.521374 10761 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:51.558353 10798 consensus_queue.cc:1059] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:01:51.564426  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:51.565171 10798 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:51.538930 10420 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.007s	sys 0.017s
I20260709 13:01:51.571004  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:51.534324 10481 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:51.565935 10798 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.588374  8534 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:01:51.560235 10770 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.015s	sys 0.015s
I20260709 13:01:51.540558 10736 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:51.573789  8425 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.014s	sys 0.009s
W20260709 13:01:51.562906 10790 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:01:51.580408 10462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.000s	sys 0.023s
W20260709 13:01:51.599017  8425 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.014s	sys 0.010s
I20260709 13:01:51.561071 10748 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:51.557578 10539 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:01:51.561790 10448 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:51.583094 10507 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:51.553054 10781 consensus_queue.cc:1059] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:01:51.581547 10319 raft_consensus.cc:3055] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:51.565184  9289 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:01:51.559242  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:01:51.610723 10794 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:01:51.603947 10736 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:51.614893 10656 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:51.539892 10655 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:51.616248  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:51.593858 10798 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.654032  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:51.645819  9287 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:51.657261 10655 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:51.631281 10319 raft_consensus.cc:740] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:01:51.608649 10462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.000s	sys 0.024s
W20260709 13:01:51.636603  8383 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.014s	sys 0.025s
W20260709 13:01:51.659813  8383 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.014s	sys 0.026s
I20260709 13:01:51.659265 10319 consensus_queue.cc:260] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:51.639236  8531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.008s	sys 0.020s
I20260709 13:01:51.573110 10522 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:51.660713 10319 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.628566 10748 consensus_queue.cc:1059] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:01:51.662053 10522 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:51.593243 10481 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:51.663059  9292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 366) took 2822 ms. Trace:
I20260709 13:01:51.663772 10736 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:51.664024 10481 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:51.664532 10736 raft_consensus.cc:3055] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:01:51.664959  8531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.009s	sys 0.020s
I20260709 13:01:51.559063 10639 consensus_queue.cc:237] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:51.665199  8380 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:01:51.669724  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.673367  9294 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:01:51.677960 10425 raft_consensus.cc:3055] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:51.683030 10425 raft_consensus.cc:740] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:51.684103 10425 consensus_queue.cc:260] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:51.684126  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:51.692755 10398 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:51.695535  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 1804) took 1604 ms. Trace:
I20260709 13:01:51.640312 10443 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:51.696171  8386 rpcz_store.cc:276] 0709 13:01:50.090802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.500984 (+410182us) service_pool.cc:224] Handling call
0709 13:01:50.504859 (+  3875us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.505255 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.505296 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:50.529906 (+ 24610us) log.cc:844] Serialized 26 byte log entry
0709 13:01:50.592494 (+ 62588us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b180041fda0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c80250d1 00007f36c8440a0f
0709 13:01:51.293002 (+700508us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:51.293043 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.293136 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:51.695181 (+402045us) raft_consensus.cc:1685] finished
0709 13:01:51.695208 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.695463 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35496,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":3526,"spinlock_wait_cycles":29999488,"thread_start_us":700319,"threads_started":1,"wal-append.queue_time_us":914694}
I20260709 13:01:51.703853  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:51.699544  8377 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.077s	sys 0.077s
W20260709 13:01:51.706022  8377 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.077s	sys 0.077s
I20260709 13:01:51.664923 10736 raft_consensus.cc:740] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:01:51.715729  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 62903.7us
I20260709 13:01:51.663471  9292 rpcz_store.cc:276] 0709 13:01:48.840334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.841390 (+  1056us) service_pool.cc:224] Handling call
0709 13:01:51.094869 (+2253479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.182683 (+ 87814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.662811 (+480128us) spinlock_profiling.cc:243] Waited 2.24 s on lock 0x7b540053d750. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:51.662974 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5162214144}
I20260709 13:01:51.716869  8424 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:51.719265  8424 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:51.711802 10643 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.711261 10398 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:51.723120  8381 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.007s	sys 0.016s
W20260709 13:01:51.728278  8381 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.008s	sys 0.016s
W20260709 13:01:51.703266 10733 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.365s	user 0.019s	sys 0.006s
W20260709 13:01:51.720992 10726 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.004s	sys 0.029s
W20260709 13:01:51.741392  8282 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.003s	sys 0.026s
I20260709 13:01:51.720273 10522 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:01:51.734548 10733 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.411s	user 0.019s	sys 0.006s
W20260709 13:01:51.733808 10726 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.005s	sys 0.029s
I20260709 13:01:51.807619  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:51.800815 10443 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:51.809834 10443 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:51.812158 10443 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:51.736135 10643 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:51.818986 10643 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:51.826427  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:51.827883  8378 raft_consensus.cc:2393] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 3: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:51.831290 10764 raft_consensus.cc:3055] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:51.831777 10764 raft_consensus.cc:740] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:51.808513 10801 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:51.833002 10801 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:51.834684 10801 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:51.836630 10795 log.cc:927] Time spent T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.213s	user 0.002s	sys 0.000s
I20260709 13:01:51.720573 10462 consensus_queue.cc:1059] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:01:51.837958 10737 raft_consensus.cc:3055] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:51.838438 10737 raft_consensus.cc:740] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:51.839844 10737 consensus_queue.cc:260] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:51.842092 10737 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:51.843304 10784 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:51.844084  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 392) took 1325 ms. Trace:
I20260709 13:01:51.844599  8527 rpcz_store.cc:276] 0709 13:01:50.518966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.519157 (+   191us) service_pool.cc:224] Handling call
0709 13:01:50.519580 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.520029 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.520070 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:50.539460 (+ 19390us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.369953 (+830493us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:51.369993 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.370063 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:51.835576 (+465513us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:01:51.843797 (+  8221us) raft_consensus.cc:1685] finished
0709 13:01:51.843818 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.844028 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16515,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":32115,"spinlock_wait_cycles":6197504,"thread_start_us":767920,"threads_started":1,"wal-append.queue_time_us":965911}
I20260709 13:01:51.847132 10598 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:51.847546 10425 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.743005 10398 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:51.850279  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38894 (request call id 1855) took 1199 ms. Trace:
I20260709 13:01:51.851066 10398 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:51.852753  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:51.720587 10610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.015s	sys 0.029s
W20260709 13:01:51.801805  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 82605.3us
W20260709 13:01:51.802501  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 501014us
W20260709 13:01:51.779589  8282 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.003s	sys 0.029s
I20260709 13:01:51.805611  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:01:51.855808 10477 consensus_meta.cc:287] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.719s	user 0.013s	sys 0.000s
I20260709 13:01:51.805703 10522 raft_consensus.cc:697] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:01:51.875361  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 69825.3us
I20260709 13:01:51.876574  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:51.876892  8500 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:51.784017 10736 consensus_queue.cc:260] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:51.850761  8533 rpcz_store.cc:276] 0709 13:01:50.650442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.686613 (+ 36171us) service_pool.cc:224] Handling call
0709 13:01:51.850068 (+1163455us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400097254. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:51.850216 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2650691840}
I20260709 13:01:51.786576  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:51.781032 10666 raft_consensus.cc:3055] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:51.879856  8426 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:51.789634  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:51.781836 10747 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.008s	sys 0.017s
I20260709 13:01:51.879823  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:01:51.881302  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 478160us
I20260709 13:01:51.885358  8457 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.870777  9287 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:01:51.889174  8500 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:51.889374  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:51.872460 10610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.060s	user 0.015s	sys 0.029s
I20260709 13:01:51.895434  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:51.893234  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.807245 10741 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:51.917574  8378 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:01:51.920295  8457 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:01:51.921435  8384 raft_consensus.cc:1240] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:51.972702  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 52654.2us
W20260709 13:01:51.973778 10756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.010s	sys 0.040s
W20260709 13:01:51.970042  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 80962.6us
W20260709 13:01:51.985613  8453 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.014s	sys 0.038s
I20260709 13:01:51.881472 10477 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:51.971915 10736 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.898150 10726 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:01:51.974124  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 94364us
I20260709 13:01:51.978794  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:51.974218  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 89570.8us
I20260709 13:01:51.882266 10666 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:01:52.018180  8349 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.000s	sys 0.043s
W20260709 13:01:52.257050  8349 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.000s	sys 0.043s
I20260709 13:01:52.041146 10522 consensus_queue.cc:237] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:51.882367 10733 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:51.832650 10764 consensus_queue.cc:260] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:52.031665  8427 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:01:52.266808  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 235196us
I20260709 13:01:52.031852  8378 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:51.973654 10731 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:01:52.034057  8351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.013s	sys 0.032s
W20260709 13:01:52.270289  8351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.014s	sys 0.032s
W20260709 13:01:52.270882  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 780838us
I20260709 13:01:52.039384  8500 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:52.272514  8426 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:01:52.272706  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 233393us
W20260709 13:01:52.038291  8453 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.019s	sys 0.038s
W20260709 13:01:52.079375  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.040634 10653 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:52.170742 10448 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:01:52.038233 10756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.012s	sys 0.042s
W20260709 13:01:52.225652  9296 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.048s	user 0.028s	sys 0.076s
W20260709 13:01:52.234220  8377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.031s	sys 0.027s
I20260709 13:01:51.991289 10802 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:52.237872  8379 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.030s	sys 0.070s
W20260709 13:01:52.279125  8379 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.031s	sys 0.071s
I20260709 13:01:52.238003  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:52.253347  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.969561 10604 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:01:52.257725  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 763085us
W20260709 13:01:52.278815  9296 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.101s	user 0.028s	sys 0.077s
W20260709 13:01:52.278837  8377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.032s	sys 0.028s
I20260709 13:01:52.281677  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:52.282173  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2119) took 1263 ms. Trace:
I20260709 13:01:52.282553  8377 rpcz_store.cc:276] 0709 13:01:51.018905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.020478 (+  1573us) service_pool.cc:224] Handling call
0709 13:01:51.020943 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.024089 (+  3146us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:51.706605 (+682516us) log.cc:844] Serialized 14 byte log entry
0709 13:01:52.281837 (+575232us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:52.281887 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:52.281938 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.282006 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.282116 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":463274,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":2500,"thread_start_us":1211741,"threads_started":2}
I20260709 13:01:52.284823  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:52.286666  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:52.288836  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:52.290066  8377 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.291208  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:52.217133 10798 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:52.286551  8500 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:52.300200  8380 raft_consensus.cc:1240] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:01:52.302167 10798 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:52.302253  8500 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:52.237462 10755 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:52.296363  8351 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:52.303483 10755 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:52.305981  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:52.276731 10800 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.429s	user 0.000s	sys 0.001s
I20260709 13:01:52.320593  8500 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:52.276053 10655 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:52.322005  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 49566.9us
I20260709 13:01:52.346451  8377 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:52.350294  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:52.345021  8453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 1750) took 1803 ms. Trace:
I20260709 13:01:52.281546 10712 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:52.291865 10787 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:52.361605  8384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 1810) took 2252 ms. Trace:
I20260709 13:01:52.346206 10655 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.364589 10655 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:52.366806 10810 log.cc:927] Time spent T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:01:52.367981  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 394) took 1572 ms. Trace:
I20260709 13:01:52.368355  8531 rpcz_store.cc:276] 0709 13:01:50.796067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.796211 (+   144us) service_pool.cc:224] Handling call
0709 13:01:50.796578 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.796920 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.796948 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:50.797538 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.665653 (+868115us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:51.665700 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.665766 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.367778 (+702012us) raft_consensus.cc:1685] finished
0709 13:01:52.367798 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.367923 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":112,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":867778,"threads_started":1,"wal-append.queue_time_us":1194180}
I20260709 13:01:52.369519 10726 consensus_queue.cc:1059] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:01:52.370860 10817 log.cc:927] Time spent T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:01:52.310957 10745 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:01:52.371531 10514 raft_consensus.cc:3055] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:52.371937 10514 raft_consensus.cc:740] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:52.310537 10666 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:52.374469 10666 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:52.305179 10539 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:01:52.371034 10803 log.cc:927] Time spent T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.391s	user 0.000s	sys 0.000s
I20260709 13:01:52.322557 10704 consensus_queue.cc:1048] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:01:52.385277 10766 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:52.386170  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:52.360124 10643 consensus_queue.cc:1059] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:01:52.387581  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:52.388762  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:52.389361  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:52.389928 10770 raft_consensus.cc:3055] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:52.390321 10770 raft_consensus.cc:740] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:52.390421  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:52.391801  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:52.389489  8379 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 9: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:52.362176  8384 rpcz_store.cc:276] 0709 13:01:50.109424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.632196 (+522772us) service_pool.cc:224] Handling call
0709 13:01:50.632468 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.029902 (+1397434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.361371 (+331469us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54003b5e54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:52.361547 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2963838208}
I20260709 13:01:52.372838  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2124) took 1349 ms. Trace:
I20260709 13:01:52.345340 10731 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:52.395303  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:52.394728  8383 rpcz_store.cc:276] 0709 13:01:51.023067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.024326 (+  1259us) service_pool.cc:224] Handling call
0709 13:01:51.024601 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.024899 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.024926 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.025513 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.438530 (+413017us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b48002dc558. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36cd3aeaa1 00007f36cd3a5b37 00007f36cd3a59ca 00007f36cd49d26f 00007f36cd49cf37 00007f36cd4b155c 00007f36cd4b1508 00007f36cd4b1488 00007f36cd4b1443 00007f36cd4b06ec 00007f36cc3daa96
0709 13:01:51.660178 (+221648us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:51.660219 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.660284 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.370133 (+709849us) spinlock_profiling.cc:243] Waited 6.05 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:01:52.372603 (+  2470us) raft_consensus.cc:1685] finished
0709 13:01:52.372623 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.372772 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2653,"raft.run_cpu_time_us":3595,"raft.run_wall_time_us":411160,"spinlock_wait_cycles":79156864,"thread_start_us":634265,"threads_started":1,"wal-append.queue_time_us":949174}
I20260709 13:01:52.405633  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:52.399370  8378 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:01:52.399746  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:52.400766  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:52.402952  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:52.270961 10398 consensus_queue.cc:1059] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:01:52.394973  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:52.320026 10443 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:52.294711 10821 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:52.415838 10731 raft_consensus.cc:3055] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:52.288687 10804 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:01:52.291399 10653 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:52.295548 10448 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:52.438871 10448 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:52.294565 10420 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 13:01:52.294767 10604 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:52.326149 10820 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:52.425644 10808 log.cc:927] Time spent T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:01:52.422850 10731 raft_consensus.cc:740] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:52.391196 10770 consensus_queue.cc:260] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:52.418907 10816 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
W20260709 13:01:52.457361  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.291664 10747 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:01:52.436679 10653 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:52.353140 10806 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:52.459167  8456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 1744) took 1949 ms. Trace:
W20260709 13:01:52.460289  9260 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.008s	sys 0.023s
W20260709 13:01:52.463837  9260 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.008s	sys 0.023s
I20260709 13:01:52.463913  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:52.405417 10798 consensus_queue.cc:1059] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:01:52.469888  8532 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:01:52.461743  8456 rpcz_store.cc:276] 0709 13:01:50.509578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.509734 (+   156us) service_pool.cc:224] Handling call
0709 13:01:50.510033 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.510352 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.510386 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:50.569828 (+ 59442us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.498365 (+928537us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:51.500525 (+  2160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.500631 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.458935 (+958304us) raft_consensus.cc:1685] finished
0709 13:01:52.458958 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.459101 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":700,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":58321,"thread_start_us":857601,"threads_started":1,"wal-append.queue_time_us":1204342}
W20260709 13:01:52.461220  8386 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.016s	sys 0.014s
I20260709 13:01:52.403720 10712 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:52.372742 10514 consensus_queue.cc:260] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:52.473142  8386 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.016s	sys 0.014s
W20260709 13:01:52.466892 10639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.043s	sys 0.081s
W20260709 13:01:52.469586  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 590933us
I20260709 13:01:52.454547 10820 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:52.492465  9258 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:52.515470 10755 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:52.503628 10820 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.517212 10731 consensus_queue.cc:260] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:52.461681 10806 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:52.494925  9260 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:01:52.479067 10639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.043s	sys 0.081s
I20260709 13:01:52.451665 10784 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:52.504820 10443 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.527729  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2122) took 1507 ms. Trace:
I20260709 13:01:52.511438 10477 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:52.528327  8381 rpcz_store.cc:276] 0709 13:01:51.020011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.026020 (+  6009us) service_pool.cc:224] Handling call
0709 13:01:51.026404 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.027879 (+  1475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.027922 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.143508 (+115586us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.728764 (+585256us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:51.728806 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.728881 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.527474 (+798593us) raft_consensus.cc:1685] finished
0709 13:01:52.527503 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.527654 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1062,"raft.queue_time_us":1173,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":21602,"thread_start_us":534280,"threads_started":1,"wal-append.queue_time_us":1000076}
W20260709 13:01:52.538478  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 43659.3us
W20260709 13:01:52.548979 10822 log.cc:927] Time spent T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:01:52.551620 10604 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:52.555742  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1863) took 1003 ms. Trace:
W20260709 13:01:52.556589 10813 log.cc:927] Time spent T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:01:52.525467 10806 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.591173  9292 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:52.518996 10552 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:01:52.570159  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 279648us
W20260709 13:01:52.602388 10801 consensus_meta.cc:287] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.767s	user 0.007s	sys 0.007s
I20260709 13:01:52.602938 10801 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:52.606384 10425 consensus_meta.cc:287] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.758s	user 0.014s	sys 0.001s
I20260709 13:01:52.606231 10552 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:01:52.608414 10811 log.cc:927] Time spent T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.418s	user 0.001s	sys 0.001s
I20260709 13:01:52.539345 10443 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:52.552855 10756 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.589319  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:52.629663  8424 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:52.590420  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:52.545892 10767 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:52.633610  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 255543us
W20260709 13:01:52.639122  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 287022us
W20260709 13:01:52.643059  8349 connection.cc:256] RPC call timeout handler was delayed by -1.5159481690000121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 13:01:52.645427  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 370506us
I20260709 13:01:52.580837  8526 rpcz_store.cc:276] 0709 13:01:51.552792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.555336 (+  2544us) service_pool.cc:224] Handling call
0709 13:01:51.557037 (+  1701us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.557746 (+   709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.557784 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.566971 (+  9187us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.824784 (+257813us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b18003b1d60. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c80250d1 00007f36c8440a0f
0709 13:01:52.266600 (+441816us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:52.266639 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.266705 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.552157 (+285452us) raft_consensus.cc:1685] finished
0709 13:01:52.552186 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.555628 (+  3442us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":73357,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":3960,"spinlock_wait_cycles":11936000,"thread_start_us":441577,"threads_started":1,"wal-append.queue_time_us":897332}
I20260709 13:01:52.665145  8500 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:52.596268 10655 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:52.668962  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:52.669605  8381 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:52.675915 10787 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:52.676473 10787 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:52.676651  8381 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:52.353549  8453 rpcz_store.cc:276] 0709 13:01:50.541398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.643176 (+101778us) service_pool.cc:224] Handling call
0709 13:01:50.643505 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.643952 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:51.453131 (+809179us) log.cc:844] Serialized 14 byte log entry
0709 13:01:52.321624 (+868493us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:52.344727 (+ 23103us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:52.344772 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.344849 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.344955 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56229,"prepare.queue_time_us":354856,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":34,"raft.queue_time_us":85529,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":1594494,"threads_started":2}
I20260709 13:01:52.680898  8384 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:52.683540 10731 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:52.685387  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:52.651232  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 91114.7us
I20260709 13:01:52.696439  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:52.697263  8526 raft_consensus.cc:2393] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 5: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:52.699755  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:52.580204 10477 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:52.701200  8500 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:52.710664  9294 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:52.710752  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:01:52.712711  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 356774us
I20260709 13:01:52.716884  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:52.717224  9261 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:52.717836  9294 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.724481  8456 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:01:52.728863  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:52.729600  8461 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:52.708705  9296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 380) took 2558 ms. Trace:
W20260709 13:01:52.730818  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 101259us
I20260709 13:01:52.730640  9296 rpcz_store.cc:276] 0709 13:01:50.150008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.438181 (+288173us) service_pool.cc:224] Handling call
0709 13:01:50.438463 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.142008 (+703545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.142040 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.174571 (+ 32531us) log.cc:844] Serialized 26 byte log entry
0709 13:01:52.281357 (+1106786us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:52.525238 (+243881us) log.cc:844] Serialized 14 byte log entry
0709 13:01:52.708383 (+183145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.708482 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.708523 (+    41us) raft_consensus.cc:1685] finished
0709 13:01:52.708538 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.708652 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":265318,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":182882,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":4879,"thread_start_us":2217812,"threads_started":4,"wal-append.queue_time_us":1315807}
I20260709 13:01:52.649228 10712 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:52.742498  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:52.746114  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:52.746707  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:52.747530  8530 raft_consensus.cc:2410] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:52.734242  8526 raft_consensus.cc:1240] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:52.736304  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:52.661288 10767 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:52.738188  9295 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:52.739569  9261 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:52.627516 10420 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:52.704207 10539 raft_consensus.cc:697] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:52.751220  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:52.751478  9294 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:52.754065  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:52.708019 10736 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:52.649847 10755 consensus_queue.cc:1059] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:01:52.757818  8427 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:52.755381  8501 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:52.737450 10726 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:52.667685 10425 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:01:52.729697 10801 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:52.657215 10756 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:52.756510 10767 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:52.737509 10850 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:52.760813  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:52.790431  8526 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:01:52.766790  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:52.767225  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:52.767648  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:52.768537  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:52.743742 10639 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:52.761772 10448 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:01:52.740548 10855 log.cc:927] Time spent T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:01:52.770572  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:52.771781  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:52.772629 10726 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:52.772532  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:52.772378 10319 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:52.775563  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:52.771224  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:52.756055  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.777972  8351 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:52.750707 10408 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:52.762861  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 185399us
I20260709 13:01:52.787950 10761 consensus_queue.cc:1059] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:01:52.752075 10793 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:01:52.769558  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:52.859311  8381 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
W20260709 13:01:52.806044 10737 consensus_meta.cc:287] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.963s	user 0.011s	sys 0.002s
I20260709 13:01:52.802132  9290 raft_consensus.cc:1240] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:52.764530 10802 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.741060  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:52.809269 10604 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:52.848290 10726 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:52.844007  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.847675  8380 raft_consensus.cc:2393] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 5: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:01:52.855825  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 142047us
I20260709 13:01:52.859476  9260 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:52.761896 10736 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:01:52.860474  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 150501us
I20260709 13:01:52.761569 10420 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:52.763322 10838 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.777247 10804 consensus_queue.cc:1059] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
W20260709 13:01:52.862628  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 84714.7us
W20260709 13:01:52.861903  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.811328 10836 raft_consensus.cc:3055] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:52.810065 10443 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:52.901454 10747 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.852859 10801 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:01:52.910843  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 155517us
W20260709 13:01:52.952044  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 136882us
W20260709 13:01:52.914999  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 55593us
I20260709 13:01:52.957401  8426 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:52.958112  9260 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:01:52.900873 10795 log.cc:927] Time spent T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:01:52.916208  8349 leader_election.cc:336] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.657s (SENT)
I20260709 13:01:52.900203 10825 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:52.860234 10639 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:01:52.961783  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:52.964190  8501 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:52.916630 10736 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:52.858743 10408 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:52.851945 10319 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:52.966689  8458 raft_consensus.cc:1275] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:52.852128 10787 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:52.968266  8454 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:01:52.969969  9260 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:52.972877  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 56694.4us
I20260709 13:01:52.920866 10653 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:52.920411 10604 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.961371 10398 raft_consensus.cc:3055] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:52.993558  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:53.008358  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:53.010188  8535 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:01:52.973474 10836 raft_consensus.cc:740] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:52.972080 10443 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:53.032209  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 62345.4us
W20260709 13:01:53.030053  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.011479  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:52.992239  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:53.039350  9260 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:53.008407  8381 raft_consensus.cc:2376] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5. Re-sending same reply.
I20260709 13:01:52.970717 10825 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:52.975131  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:52.980641 10632 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:53.042245  8501 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:53.043689  8526 raft_consensus.cc:2393] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 5: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:52.977764 10852 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:52.911330 10539 consensus_queue.cc:237] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:52.913857 10802 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:53.058512  8380 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 7: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:53.064785 10801 raft_consensus.cc:697] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:53.066627  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:53.011240 10821 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.066301  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:53.069988  8459 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:01:53.008121 10398 raft_consensus.cc:740] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:52.961784 10747 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:52.950596 10838 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:53.028178  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:53.077273 10554 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.083458  8454 raft_consensus.cc:2393] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 4: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:53.090445  9261 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:53.034160 10737 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.030757 10655 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:53.041664 10850 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:52.987270 10804 consensus_queue.cc:1059] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:01:53.048555 10825 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:53.043452 10755 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:53.045714  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:53.093137  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:53.071202 10653 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:53.029668 10604 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:53.090113 10733 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.046383 10443 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:53.113682  9261 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:53.097558 10793 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:53.119678 10847 log.cc:927] Time spent T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.165s	user 0.001s	sys 0.001s
I20260709 13:01:53.113875 10755 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:53.124912  9261 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:53.126402  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:53.127045  8460 raft_consensus.cc:2376] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6. Re-sending same reply.
I20260709 13:01:53.127231 10861 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:53.128389 10712 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:53.128566 10666 consensus_meta.cc:287] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.754s	user 0.007s	sys 0.005s
I20260709 13:01:53.128850 10712 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:53.129273  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:53.129442  8385 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:01:53.130262 10408 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:53.130568  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:53.118606 10448 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.126333  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:53.132243  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:53.132678 10731 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:53.133293  9289 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:53.135313 10838 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:53.136637 10820 consensus_meta.cc:287] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.618s	user 0.004s	sys 0.004s
I20260709 13:01:53.101192 10836 consensus_queue.cc:260] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:53.138152 10747 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:53.139111 10443 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:53.121951 10653 raft_consensus.cc:697] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:53.139631  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:53.117130 10398 consensus_queue.cc:260] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:53.140719 10653 consensus_queue.cc:237] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:53.148523  8426 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:53.132406 10822 log.cc:927] Time spent T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.390s	user 0.000s	sys 0.004s
I20260709 13:01:53.129297 10712 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.155951 10755 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:53.157683 10639 raft_consensus.cc:3055] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:53.158110 10639 raft_consensus.cc:740] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:53.180538 10850 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.181528 10850 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:53.184968 10850 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:53.097790 10554 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:53.136664 10841 log.cc:927] Time spent T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 13:01:53.349968  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.141050 10398 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:53.159241 10552 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:53.135319 10604 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:53.159224 10704 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:53.142557 10802 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:53.381268 10639 consensus_queue.cc:260] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:53.112200 10801 consensus_queue.cc:237] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:53.369593  9260 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:53.163003 10731 raft_consensus.cc:697] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:53.166621 10781 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.366045 10745 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.427047  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 367) took 2008 ms. Trace:
W20260709 13:01:53.429936  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 60433.1us
I20260709 13:01:53.207031 10420 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:53.365902 10666 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:53.367908 10448 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.373037 10848 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:53.123456 10733 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:53.440109  8382 rpcz_store.cc:276] 0709 13:01:51.418852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.434443 (+ 15591us) service_pool.cc:224] Handling call
0709 13:01:51.434861 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.435245 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.435449 (+   204us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.447428 (+ 11979us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.871501 (+424073us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:51.884311 (+ 12810us) log.cc:844] Serialized 14 byte log entry
0709 13:01:51.884700 (+   389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.884799 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:53.132119 (+1247320us) spinlock_profiling.cc:243] Waited 8.2 ms on lock 0x7b240013dac8. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c521e9c4 00007f36c521cacb 00007f36c53d7dc9 00007f36c53d7a55 00007f36c53d709d 00007f36c800910e 00007f36c802088c 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221
0709 13:01:53.395269 (+263150us) raft_consensus.cc:1685] finished
0709 13:01:53.426789 (+ 31520us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.426979 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41169,"prepare.queue_time_us":15981,"prepare.run_cpu_time_us":9574,"prepare.run_wall_time_us":92461,"raft.queue_time_us":3775,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":28669,"spinlock_wait_cycles":18867584,"thread_start_us":423658,"threads_started":1,"wal-append.queue_time_us":899975}
I20260709 13:01:53.137070 10820 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:53.476289  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.479156  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.438719 10477 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:53.428354  9290 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:53.502177 10462 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:53.502579 10731 consensus_queue.cc:237] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:53.524590  8531 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:53.462862  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:53.486402 10448 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:53.566036 10784 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:53.567236 10448 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:53.570593 10554 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:53.494907 10319 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:53.428623 10704 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:53.463729 10745 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:53.614108 10859 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.463s	user 0.000s	sys 0.001s
W20260709 13:01:53.616535 10806 consensus_meta.cc:287] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.025s	user 0.010s	sys 0.000s
I20260709 13:01:53.486802 10848 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:53.558915 10770 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:53.618999 10820 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:53.533485 10870 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.477989 10666 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:53.635017  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.651132 10610 raft_consensus.cc:3055] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:53.525717 10462 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:53.721805 10733 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:53.709996 10610 raft_consensus.cc:740] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:53.713721 10764 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:53.707751 10870 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:53.756983 10767 consensus_meta.cc:287] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.951s	user 0.009s	sys 0.003s
W20260709 13:01:53.733071 10851 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.028s	sys 0.021s
I20260709 13:01:53.652892 10806 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:53.763427 10838 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:53.830751  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.835816  8379 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:53.810518 10767 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:53.840118  9287 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:53.840353  8385 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 1828) took 1546 ms (client timeout 1564 ms). Trace:
W20260709 13:01:53.840827  8385 rpcz_store.cc:269] 0709 13:01:52.294484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.305722 (+ 11238us) service_pool.cc:224] Handling call
0709 13:01:53.840191 (+1534469us) spinlock_profiling.cc:243] Waited 823 ms on lock 0x7b540013e7d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:01:53.840295 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1892052352}
I20260709 13:01:53.768921 10848 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:53.808900 10851 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.030s	sys 0.021s
I20260709 13:01:53.840778 10767 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:53.850980 10736 consensus_meta.cc:287] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.843s	user 0.008s	sys 0.005s
I20260709 13:01:53.891855 10756 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:53.905561 10462 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:53.823606 10838 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:53.927963  9295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 389) took 1145 ms. Trace:
I20260709 13:01:53.931340  9295 rpcz_store.cc:276] 0709 13:01:52.782177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.782696 (+   519us) service_pool.cc:224] Handling call
0709 13:01:52.783040 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:52.783500 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.783539 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:52.784131 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:01:52.858623 (+ 74492us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:52.908752 (+ 50129us) log.cc:844] Serialized 14 byte log entry
0709 13:01:52.917149 (+  8397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.917234 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:53.142704 (+225470us) spinlock_profiling.cc:243] Waited 5.27 ms on lock 0x7b180033eb00. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c5398557 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:01:53.921229 (+778525us) spinlock_profiling.cc:243] Waited 7.11 ms on lock 0x7b180033eb00. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:01:53.927704 (+  6475us) raft_consensus.cc:1685] finished
0709 13:01:53.927728 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.927895 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8535,"prepare.queue_time_us":52845,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":13161,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":33240,"spinlock_wait_cycles":28470784,"thread_start_us":73890,"threads_started":1,"wal-append.queue_time_us":192691}
I20260709 13:01:53.873661 10870 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:53.943781  9287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 391) took 1143 ms. Trace:
I20260709 13:01:53.822911 10610 consensus_queue.cc:260] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:53.941308 10712 consensus_meta.cc:287] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.782s	user 0.011s	sys 0.000s
I20260709 13:01:53.944419  9287 rpcz_store.cc:276] 0709 13:01:52.800961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.814829 (+ 13868us) service_pool.cc:224] Handling call
0709 13:01:52.911059 (+ 96230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.840711 (+929652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.942193 (+101482us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b54004ea7d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:53.943693 (+  1500us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2135942912}
I20260709 13:01:53.993525 10806 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:53.994482 10666 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:53.918951 10736 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:53.996991 10736 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:53.968152 10745 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:53.999650 10838 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:54.000212 10726 consensus_meta.cc:287] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 1.045s	user 0.011s	sys 0.001s
W20260709 13:01:54.002750 10552 consensus_meta.cc:287] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.611s	user 0.003s	sys 0.006s
I20260709 13:01:54.003274 10552 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:53.990947 10610 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:54.012435  9294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 392) took 1153 ms. Trace:
I20260709 13:01:54.013005  9294 rpcz_store.cc:276] 0709 13:01:52.859486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.859634 (+   148us) service_pool.cc:224] Handling call
0709 13:01:52.859982 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:52.862615 (+  2633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.862643 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:52.911073 (+ 48430us) log.cc:844] Serialized 26 byte log entry
0709 13:01:52.983627 (+ 72554us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:52.983673 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.983749 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:54.012133 (+1028384us) raft_consensus.cc:1685] finished
0709 13:01:54.012164 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.012353 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3077,"raft.queue_time_us":16573,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":14009,"thread_start_us":61230,"threads_started":1,"wal-append.queue_time_us":1021620}
I20260709 13:01:54.026057 10787 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:54.027294  9291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 654) took 1445 ms. Trace:
I20260709 13:01:53.988576 10712 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:54.039671  9291 rpcz_store.cc:276] 0709 13:01:52.581738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.581872 (+   134us) service_pool.cc:224] Handling call
0709 13:01:52.582251 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.747601 (+165350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.747630 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:52.747672 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:52.747714 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.026952 (+1279238us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54007a0154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:54.027019 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.027210 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379802880}
I20260709 13:01:54.000669 10726 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:54.042649 10726 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:54.043390 10712 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:54.045290  9288 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:54.045725  9296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 390) took 1255 ms. Trace:
I20260709 13:01:54.046221  9296 rpcz_store.cc:276] 0709 13:01:52.790517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.791444 (+   927us) service_pool.cc:224] Handling call
0709 13:01:52.791817 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.814062 (+ 22245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.814096 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:52.814177 (+    81us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:52.814218 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.045436 (+1231218us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b54004ed4d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:54.045494 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.045645 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50691840}
I20260709 13:01:54.048053  8527 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:54.051260  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 1837) took 1056 ms. Trace:
I20260709 13:01:54.051609  8379 rpcz_store.cc:276] 0709 13:01:52.994441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.994653 (+   212us) service_pool.cc:224] Handling call
0709 13:01:52.995058 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.836353 (+841295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.051047 (+214694us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54003dc2d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:54.051206 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1933016960}
I20260709 13:01:54.061496 10842 raft_consensus.cc:1064] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
W20260709 13:01:54.062469  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.062808 10704 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:54.070640  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 408) took 1682 ms. Trace:
I20260709 13:01:54.071377  8531 rpcz_store.cc:276] 0709 13:01:52.387947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.393510 (+  5563us) service_pool.cc:224] Handling call
0709 13:01:52.393859 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.525102 (+1131243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.070284 (+545182us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000ac154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:54.070549 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2599900544}
W20260709 13:01:54.075146  8535 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.052s	sys 0.076s
W20260709 13:01:54.075410  8501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.025s	user 0.001s	sys 0.001s
W20260709 13:01:54.075675  8535 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.979s	user 0.052s	sys 0.076s
W20260709 13:01:54.075733  8501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.001s	sys 0.001s
W20260709 13:01:54.076514  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 1.03422e+06us
W20260709 13:01:54.077905  8530 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.018s	user 0.020s	sys 0.046s
W20260709 13:01:54.078313  8530 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.020s	sys 0.046s
I20260709 13:01:54.079670 10821 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:01:54.080157  8529 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.037s	user 0.014s	sys 0.014s
W20260709 13:01:54.080562  8529 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.014s	sys 0.014s
I20260709 13:01:54.080305 10821 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:54.081902  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 1898) took 1072 ms. Trace:
I20260709 13:01:54.082516  8529 rpcz_store.cc:276] 0709 13:01:53.009042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.010051 (+  1009us) service_pool.cc:224] Handling call
0709 13:01:53.032902 (+ 22851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:54.081055 (+1048153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:54.081116 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:54.081175 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:54.081216 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.081309 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.081452 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10053,"raft.queue_time_us":93777,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":58,"thread_start_us":1037426,"threads_started":1}
W20260709 13:01:54.082019  8452 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.065s	sys 0.081s
W20260709 13:01:54.089818  8452 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.065s	sys 0.081s
W20260709 13:01:54.119000  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.136492  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 1901) took 1125 ms. Trace:
I20260709 13:01:54.146641  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:54.151816  8526 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
W20260709 13:01:54.121414 10825 consensus_meta.cc:287] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.007s	user 0.012s	sys 0.002s
W20260709 13:01:54.121670 10398 consensus_meta.cc:287] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.747s	user 0.012s	sys 0.001s
I20260709 13:01:54.153446  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:54.155011  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:54.155750  8526 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:01:54.137022  8535 rpcz_store.cc:276] 0709 13:01:53.029915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.030111 (+   196us) service_pool.cc:224] Handling call
0709 13:01:53.030454 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:53.057921 (+ 27467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.057955 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:53.058474 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:01:54.076219 (+1017745us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:54.076273 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.076375 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:54.136199 (+ 59824us) raft_consensus.cc:1685] finished
0709 13:01:54.136220 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.136416 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96069,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"thread_start_us":978957,"threads_started":1,"wal-append.queue_time_us":991040}
I20260709 13:01:54.156744  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:01:54.162170  8427 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.195s	user 0.004s	sys 0.034s
W20260709 13:01:54.162770  8427 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.195s	user 0.004s	sys 0.035s
W20260709 13:01:54.163152  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 1.19594e+06us
I20260709 13:01:54.164809 10853 consensus_queue.cc:1059] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:01:54.160724  9258 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:54.168992  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:54.169870  8379 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:54.170743  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:54.171555  8385 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
W20260709 13:01:54.176050  8455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.067s	user 0.007s	sys 0.023s
W20260709 13:01:54.176579  8455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.067s	user 0.007s	sys 0.023s
I20260709 13:01:54.179877 10704 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:54.180737 10704 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:54.204260  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.205871  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 45212.5us
I20260709 13:01:54.206317  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 1897) took 1197 ms. Trace:
I20260709 13:01:54.206804  8527 rpcz_store.cc:276] 0709 13:01:53.008780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.009129 (+   349us) service_pool.cc:224] Handling call
0709 13:01:53.009381 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:54.048487 (+1039106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.204933 (+156446us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400095e54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:54.206222 (+  1289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2388114304}
I20260709 13:01:54.146175 10781 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.204229 10858 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.145857 10880 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:54.242262  8424 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.426s	user 0.000s	sys 0.031s
W20260709 13:01:54.242744  8424 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.427s	user 0.000s	sys 0.031s
I20260709 13:01:54.266197  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:54.317751  8531 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
W20260709 13:01:54.298400  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.224009  8528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.194s	user 0.013s	sys 0.021s
W20260709 13:01:54.224839  8532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.137s	user 0.011s	sys 0.024s
W20260709 13:01:54.323378  8528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.294s	user 0.013s	sys 0.021s
W20260709 13:01:54.323501  8532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.236s	user 0.011s	sys 0.024s
I20260709 13:01:54.326568  8526 raft_consensus.cc:3055] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:54.327209  8526 raft_consensus.cc:740] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:54.245452 10848 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:54.166921 10825 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:54.351727 10869 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:54.352524 10869 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:54.355497 10869 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:54.356303  8534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.240s	user 0.010s	sys 0.015s
W20260709 13:01:54.358011  8534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.242s	user 0.010s	sys 0.016s
I20260709 13:01:54.357023  8427 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:01:54.263834 10845 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.206s	user 0.009s	sys 0.031s
I20260709 13:01:54.338368 10848 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:54.336004  8526 consensus_queue.cc:260] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:54.390481  8526 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:54.340837 10398 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:54.346191 10764 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.391885 10837 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:54.392234 10514 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:54.245328 10880 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:54.381119 10408 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:54.245056 10781 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:54.447062  8526 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:01:54.447696  8526 pending_rounds.cc:85] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 6
I20260709 13:01:54.448031  8526 pending_rounds.cc:107] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:01:54.448356  8526 raft_consensus.cc:2889] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:54.378773 10869 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:01:54.468704  8500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.422s	user 0.013s	sys 0.025s
W20260709 13:01:54.469985  8500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.423s	user 0.013s	sys 0.025s
W20260709 13:01:54.471138  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 1.43552e+06us
I20260709 13:01:54.473595  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:54.492815  8500 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:54.397464 10848 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:54.584275  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 91548.1us
I20260709 13:01:54.416303 10408 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:54.412678 10522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.379s	user 0.011s	sys 0.023s
I20260709 13:01:54.303385 10858 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:54.585970  8500 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:54.326985  9261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.010s	sys 0.014s
W20260709 13:01:54.381953 10845 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.340s	user 0.010s	sys 0.031s
I20260709 13:01:54.610950 10881 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:54.341562 10731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.015s	sys 0.009s
W20260709 13:01:54.613072  9261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.150s	user 0.010s	sys 0.014s
I20260709 13:01:54.465286 10880 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:54.411371 10398 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:54.414394 10764 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:54.613253 10408 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.611089 10736 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:54.641263 10865 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:54.678160 10398 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:54.680836 10764 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:54.681816 10881 raft_consensus.cc:697] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:01:54.658329 10522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.629s	user 0.015s	sys 0.031s
I20260709 13:01:54.583659 10869 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:54.476513 10837 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:54.660615 10731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.015s	sys 0.010s
W20260709 13:01:54.628275 10801 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.000s	sys 0.013s
W20260709 13:01:54.695106 10801 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.000s	sys 0.014s
W20260709 13:01:54.691032 10770 consensus_meta.cc:287] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 1.017s	user 0.002s	sys 0.012s
I20260709 13:01:54.683311 10881 consensus_queue.cc:237] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:54.717064 10869 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:54.710827 10825 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:54.718041 10837 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:54.719548 10858 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:01:54.224514  8349 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.143s	user 0.006s	sys 0.027s
W20260709 13:01:54.765992  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.766706  8349 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.685s	user 0.006s	sys 0.027s
W20260709 13:01:54.766934  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.767230  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 1.68552e+06us
I20260709 13:01:54.769562  8349 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:01:54.240111  8351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.166s	user 0.000s	sys 0.036s
I20260709 13:01:54.776822  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:54.777648  8351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.704s	user 0.000s	sys 0.036s
W20260709 13:01:54.778497  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 1.70456e+06us
W20260709 13:01:54.782298  8379 consensus_meta.cc:287] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.612s	user 0.013s	sys 0.027s
I20260709 13:01:54.782362  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:54.783200  8379 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:01:54.784435  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:54.778399  8377 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:54.785714  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:54.786049  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:54.784817  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:54.790548  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:54.791633  8383 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:54.792433  8455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 398) took 1723 ms. Trace:
I20260709 13:01:54.793561  8384 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:54.789459  8379 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:01:54.792927  8455 rpcz_store.cc:276] 0709 13:01:53.068335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.071818 (+  3483us) service_pool.cc:224] Handling call
0709 13:01:53.072168 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:53.072515 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.072553 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:53.087291 (+ 14738us) log.cc:844] Serialized 26 byte log entry
0709 13:01:54.177053 (+1089762us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:54.177854 (+   801us) log.cc:844] Serialized 14 byte log entry
0709 13:01:54.297315 (+119461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.297432 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:54.791825 (+494393us) raft_consensus.cc:1685] finished
0709 13:01:54.791869 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.792160 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105249,"prepare.queue_time_us":216,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":103091,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":41302,"thread_start_us":1067481,"threads_started":1,"wal-append.queue_time_us":1596391}
I20260709 13:01:54.797261  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:54.798462  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.799636  8457 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.815s	user 0.032s	sys 0.032s
W20260709 13:01:54.800199  8457 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.816s	user 0.032s	sys 0.032s
W20260709 13:01:54.598965  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.841527  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:54.842623  9260 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.402s	user 0.019s	sys 0.076s
W20260709 13:01:54.843201  9260 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.402s	user 0.019s	sys 0.076s
I20260709 13:01:54.843885  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1870) took 2102 ms. Trace:
W20260709 13:01:54.801779  8452 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.017s	sys 0.044s
W20260709 13:01:54.688191 10539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.147s	user 0.030s	sys 0.040s
I20260709 13:01:54.625656  8500 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:54.799353  8349 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:01:54.802551  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:54.867570  8452 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.018s	sys 0.045s
W20260709 13:01:54.663833  8533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.577s	user 0.083s	sys 0.176s
I20260709 13:01:54.873211  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:54.880595  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:01:54.902565  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 121829us
W20260709 13:01:54.908162  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.907430  8458 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:01:54.844451  8534 rpcz_store.cc:276] 0709 13:01:52.741658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.745841 (+  4183us) service_pool.cc:224] Handling call
0709 13:01:52.746159 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:52.755299 (+  9140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.755333 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:53.109711 (+354378us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b1800134140. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53662a6 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a
0709 13:01:53.115661 (+  5950us) log.cc:844] Serialized 26 byte log entry
0709 13:01:54.358507 (+1242846us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:54.358660 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.358758 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:54.843048 (+484290us) raft_consensus.cc:1685] finished
0709 13:01:54.843101 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.843625 (+   524us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9251,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":6114,"spinlock_wait_cycles":7863040,"thread_start_us":1242394,"threads_started":1,"wal-append.queue_time_us":1615874}
I20260709 13:01:54.897286 10609 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.928308 10845 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.920354  8455 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:01:54.633751 10704 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:54.938395  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1875) took 2111 ms. Trace:
W20260709 13:01:54.953177  8382 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.007s	sys 0.024s
W20260709 13:01:54.953890  8382 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.008s	sys 0.024s
W20260709 13:01:54.957255  8533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.817s	user 0.083s	sys 0.177s
I20260709 13:01:54.958750  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 1895) took 1950 ms. Trace:
W20260709 13:01:54.960162  8380 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.003s	sys 0.020s
I20260709 13:01:54.959234  8533 rpcz_store.cc:276] 0709 13:01:53.008213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.008330 (+   117us) service_pool.cc:224] Handling call
0709 13:01:53.008630 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:53.008958 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.008983 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:53.029577 (+ 20594us) log.cc:844] Serialized 26 byte log entry
0709 13:01:54.958151 (+1928574us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:54.958271 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.958379 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:54.958460 (+    81us) raft_consensus.cc:1685] finished
0709 13:01:54.958472 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.958679 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114989,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":132,"thread_start_us":1871379,"threads_started":1,"wal-append.queue_time_us":1601184}
W20260709 13:01:54.960757  8380 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.003s	sys 0.020s
W20260709 13:01:54.961253  8530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.013s	sys 0.013s
I20260709 13:01:54.961432 10639 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:54.962015  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.963054 10737 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:54.963480 10882 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:54.964610 10882 consensus_queue.cc:1048] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:54.968575 10781 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:54.973100 10908 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.977195 10900 consensus_queue.cc:1059] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:01:54.977777  8461 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:54.978585  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:54.981674 10848 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:54.940920 10784 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:54.940840 10845 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:54.950522  8528 rpcz_store.cc:276] 0709 13:01:52.765424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.765701 (+   277us) service_pool.cc:224] Handling call
0709 13:01:52.766002 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:52.968052 (+202050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.968114 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:52.979020 (+ 10906us) log.cc:844] Serialized 26 byte log entry
0709 13:01:54.324089 (+1345069us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:54.324149 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.324251 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:54.822201 (+497950us) raft_consensus.cc:1685] finished
0709 13:01:54.822250 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.876691 (+ 54441us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24972,"raft.queue_time_us":143278,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":4930,"thread_start_us":1495886,"threads_started":2,"wal-append.queue_time_us":1707837}
I20260709 13:01:54.986831  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:54.993026  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 367275us
W20260709 13:01:54.953212 10539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.352s	user 0.030s	sys 0.041s
I20260709 13:01:54.994408 10770 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:55.009943  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 1893) took 1914 ms. Trace:
I20260709 13:01:55.010046 10770 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.010754  8532 rpcz_store.cc:276] 0709 13:01:53.007543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.007707 (+   164us) service_pool.cc:224] Handling call
0709 13:01:53.010978 (+  3271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:53.011297 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.011337 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:53.011792 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:01:54.324335 (+1312543us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:54.324398 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.324498 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:54.882000 (+557502us) raft_consensus.cc:1685] finished
0709 13:01:54.884982 (+  2982us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.921826 (+ 36844us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115391,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":83,"thread_start_us":1236503,"threads_started":1,"wal-append.queue_time_us":1657740}
I20260709 13:01:55.013360 10839 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:55.014576  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:55.014773  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 140865us
I20260709 13:01:54.995586  8452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 399) took 1927 ms. Trace:
I20260709 13:01:54.996110 10764 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:54.951134  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:54.884124 10408 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:54.998795  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:54.953274  8501 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.008s	sys 0.019s
W20260709 13:01:54.961715  8530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.013s	sys 0.013s
I20260709 13:01:55.002003 10609 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:54.964048 10737 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:54.938737 10825 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.998622 10448 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:55.024325  8384 raft_consensus.cc:2393] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 3: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:55.016487  8452 rpcz_store.cc:276] 0709 13:01:53.068638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.068823 (+   185us) service_pool.cc:224] Handling call
0709 13:01:53.069168 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.069416 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:54.090476 (+1021060us) log.cc:844] Serialized 14 byte log entry
0709 13:01:54.994938 (+904462us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:54.995054 (+   116us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:54.995189 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.995334 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.995510 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9685,"prepare.queue_time_us":769942,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":24134,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":24712,"thread_start_us":1820550,"threads_started":2,"wal-append.queue_time_us":623823}
I20260709 13:01:55.028793 10913 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:55.029285 10825 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.029857 10913 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:55.025357  8501 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.009s	sys 0.019s
I20260709 13:01:54.945528 10858 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:55.067404  8461 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:55.068466  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:55.061468  8459 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:01:55.070101  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.080865 10737 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:55.074184  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 839995us
I20260709 13:01:55.085336  8384 raft_consensus.cc:1240] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:55.087072 10848 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:55.088321 10770 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:55.091856 10764 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.095687 10764 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:55.100518  8460 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 2.
W20260709 13:01:55.106619  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 85299us
I20260709 13:01:55.116432  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:55.110700 10821 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:55.109117 10784 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:55.066622 10858 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.127597  8459 raft_consensus.cc:2376] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6. Re-sending same reply.
I20260709 13:01:55.072642 10908 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.135200  8383 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:01:55.122349 10861 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.143538 10821 consensus_queue.cc:1059] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:55.145319 10839 raft_consensus.cc:3055] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:55.146090 10839 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:55.150144 10408 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:55.151430  8500 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:55.148190 10839 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.152868 10784 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:55.115980 10448 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.156798 10861 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:55.005631  9296 raft_consensus.cc:2955] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:01:55.160959  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:55.161670  8452 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:01:55.169868  8461 raft_consensus.cc:1240] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:55.170241  8424 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:55.169852 10908 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:55.173059 10448 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:55.174237  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:55.177528  8427 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:01:55.179071  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 381334us
I20260709 13:01:55.182495 10900 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.193607 10865 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:55.194715 10865 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.193914 10900 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.195343 10865 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:55.197410  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:55.197738 10604 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:55.198390  8534 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:55.198697 10604 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:55.200446 10610 consensus_meta.cc:287] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.189s	user 0.004s	sys 0.017s
I20260709 13:01:55.179549 10848 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:55.201757 10848 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.202584 10861 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:55.203619 10900 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:55.205010  8424 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:55.205102  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:55.206259 10408 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:55.206306  9291 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:01:55.207095 10864 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:55.207199  8424 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:55.182327 10767 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:55.210434  8378 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:01:55.210978  8378 pending_rounds.cc:85] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 3
I20260709 13:01:55.210318 10767 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.211256  8378 pending_rounds.cc:107] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:01:55.204272 10848 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:55.211621  8378 raft_consensus.cc:2889] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:55.215468  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 77507.7us
I20260709 13:01:55.173063 10825 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:55.211261 10836 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.197821 10913 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:55.225512 10770 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:55.229522  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2154) took 1060 ms. Trace:
I20260709 13:01:55.227941  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2156) took 1054 ms. Trace:
I20260709 13:01:55.231016 10882 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:55.233901 10839 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:55.243098  9258 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:01:55.243175 10876 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.008s	sys 0.008s
I20260709 13:01:55.243691  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:01:55.255252  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 48237.4us
I20260709 13:01:55.245725 10767 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:55.247397 10865 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:55.252489  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:55.241253  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 1902) took 2210 ms. Trace:
W20260709 13:01:55.255679 10876 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.008s	sys 0.009s
I20260709 13:01:55.236802  8382 rpcz_store.cc:276] 0709 13:01:54.169732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.169846 (+   114us) service_pool.cc:224] Handling call
0709 13:01:54.170146 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:54.170337 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:54.954528 (+784191us) log.cc:844] Serialized 14 byte log entry
0709 13:01:55.163508 (+208980us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:55.185187 (+ 21679us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:55.192660 (+  7473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.214387 (+ 21727us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.224229 (+  9842us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11023,"prepare.queue_time_us":860425,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":2947,"raft.queue_time_us":78,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":3812,"spinlock_wait_cycles":15744,"thread_start_us":987070,"threads_started":2}
I20260709 13:01:55.261720 10848 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:55.262797  8526 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:55.262984  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 85690.1us
I20260709 13:01:55.263168 10848 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.263706 10848 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:55.257532 10864 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:55.266795  8427 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:55.257866 10604 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:01:55.273212  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 122139us
I20260709 13:01:55.262045  8530 rpcz_store.cc:276] 0709 13:01:53.031367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.031603 (+   236us) service_pool.cc:224] Handling call
0709 13:01:53.059024 (+ 27421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:54.078708 (+1019684us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:54.078747 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:54.079283 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:01:55.044318 (+965035us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:55.230472 (+186154us) log.cc:844] Serialized 14 byte log entry
0709 13:01:55.233610 (+  3138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.233828 (+   218us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:55.233876 (+    48us) raft_consensus.cc:1685] finished
0709 13:01:55.233895 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.241153 (+  7258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83206,"raft.run_cpu_time_us":501,"raft.run_wall_time_us":16955,"thread_start_us":2074770,"threads_started":3,"wal-append.queue_time_us":888598}
I20260709 13:01:55.236194  8380 rpcz_store.cc:276] 0709 13:01:54.169025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.169865 (+   840us) service_pool.cc:224] Handling call
0709 13:01:54.170153 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:54.170337 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:54.961483 (+791146us) log.cc:844] Serialized 14 byte log entry
0709 13:01:55.163451 (+201968us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:55.185822 (+ 22371us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:55.212899 (+ 27077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.221978 (+  9079us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.229454 (+  7476us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13531,"prepare.queue_time_us":874542,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":6317,"raft.queue_time_us":1814,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":639,"spinlock_wait_cycles":65664,"thread_start_us":981364,"threads_started":2,"wal-append.queue_time_us":265483}
I20260709 13:01:55.273977  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:55.280580  8427 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:55.279830 10770 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:55.289218 10877 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:01:55.289885 10770 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.290498 10770 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:55.292961 10845 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:55.293431  8457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 1759) took 2339 ms. Trace:
I20260709 13:01:55.293862  8457 rpcz_store.cc:276] 0709 13:01:52.953939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.957144 (+  3205us) service_pool.cc:224] Handling call
0709 13:01:52.957427 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.968095 (+ 10668us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:54.801063 (+1832968us) log.cc:844] Serialized 14 byte log entry
0709 13:01:55.105352 (+304289us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:55.113892 (+  8540us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:55.126067 (+ 12175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.293069 (+167002us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b540041b254. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:55.293152 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.293346 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":871052,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":1757,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":9068,"spinlock_wait_cycles":24086912,"thread_start_us":2036346,"threads_started":2,"wal-append.queue_time_us":283105}
I20260709 13:01:55.297199 10864 raft_consensus.cc:697] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:55.298547  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:55.298909 10864 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.299705 10604 consensus_queue.cc:1059] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:55.286725  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:01:55.276068 10914 log.cc:927] Time spent T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.111s	user 0.001s	sys 0.001s
I20260709 13:01:55.302383  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:55.275884 10858 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:55.318244  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:55.318799  8528 raft_consensus.cc:2393] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 4: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:55.319639  9288 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 6: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:01:55.297281  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:55.308722  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 55200.6us
I20260709 13:01:55.302223  9258 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:55.316494  8526 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:01:55.320361  8386 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
W20260709 13:01:55.321586  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 48133.2us
I20260709 13:01:55.321903 10877 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:55.322335 10877 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:55.322440 10793 raft_consensus.cc:3055] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:55.322819 10877 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:55.322881 10793 raft_consensus.cc:740] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:55.324071 10793 consensus_queue.cc:260] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.325340 10784 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:55.325578 10819 raft_consensus.cc:3055] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:55.326063 10819 raft_consensus.cc:740] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:55.326123  8452 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:55.315855 10604 raft_consensus.cc:3055] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:55.326994 10604 raft_consensus.cc:740] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:55.321512  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:55.327283 10819 consensus_queue.cc:260] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.328227  8459 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:55.328896 10784 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.331277 10784 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:55.331825 10793 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:55.334728  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:55.336679 10882 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:55.337227 10882 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:55.337325  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:55.338274  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:55.338390  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:55.339401  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:55.339555  8459 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:55.330019 10819 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.340826 10604 consensus_queue.cc:260] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:55.342260 10604 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:55.345566  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 78417us
I20260709 13:01:55.346527  8424 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:55.347707 10408 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:55.348115 10408 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:55.348482 10408 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.357920  8349 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:55.361021 10826 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.361764 10826 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:55.364164 10826 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:55.365249  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 49411.2us
I20260709 13:01:55.366328 10609 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:55.368445 10826 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:55.370182  9258 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:55.370448  8426 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:55.372471 10552 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:01:55.375648 10514 consensus_meta.cc:287] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.960s	user 0.014s	sys 0.009s
W20260709 13:01:55.376072  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 74421.2us
W20260709 13:01:55.379299  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.379385 10552 raft_consensus.cc:697] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:55.380683 10552 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.385860  8500 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:55.386142  8533 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:01:55.388427  9258 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:55.389487 10712 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:55.389883 10712 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.390071 10839 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:55.390410 10712 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:55.372188 10877 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.394260  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:55.394409  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:55.394928  8533 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:55.395339  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:55.396338  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:55.400487  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:55.401531  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:55.402401  9294 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:55.404109 10425 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.404558  8533 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:01:55.404778 10425 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.406301 10882 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:55.407847  8427 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:55.415050  9258 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:55.389820  8500 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:55.419387  8456 raft_consensus.cc:2410] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:01:55.419579  9288 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:01:55.422288 10764 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:55.422746 10764 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.423105 10764 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:55.423574 10425 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:55.429021 10712 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.429495 10913 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:55.430028 10913 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.275476 10842 consensus_queue.cc:237] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.430411 10913 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:55.435557 10764 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:55.438256 10764 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:55.449877  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.450554  8454 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:55.440207 10913 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.440558  8427 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:55.441672 10609 consensus_queue.cc:1059] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:55.411767 10877 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:55.461198  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 71505.8us
I20260709 13:01:55.465691  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.467530  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.469254  8378 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:55.452320 10610 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.472023  8379 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:01:55.474108  8386 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:01:55.472819  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:01:55.474619  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 59646us
I20260709 13:01:55.448182 10408 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:55.485210  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.489447  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:55.490212  8533 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:55.490651  8427 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:55.494436  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:55.494962 10522 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:55.495448 10522 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.495842 10522 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:55.482815 10764 raft_consensus.cc:3055] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:55.496479 10764 raft_consensus.cc:740] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:01:55.496729  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 150320us
I20260709 13:01:55.498075 10850 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:55.497732 10764 consensus_queue.cc:260] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:55.475281 10793 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:55.500038 10448 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:55.498386 10836 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:55.502202  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:55.503033  8456 raft_consensus.cc:2410] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:55.505678 10883 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.505798 10610 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.506480 10883 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:55.508630 10883 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:55.505726 10826 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:55.467447 10839 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:55.510699  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:55.511494  9288 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:55.499092 10764 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:55.513808  8380 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
W20260709 13:01:55.504061 10639 consensus_meta.cc:287] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.542s	user 0.014s	sys 0.000s
I20260709 13:01:55.497733  8424 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:55.520996  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:55.522691  8533 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:01:55.520522  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.525995  8378 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:55.526257  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:55.526435  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:55.526895  8377 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:55.527141  9295 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:55.529358  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.530583  8454 raft_consensus.cc:1240] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:55.502694 10836 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.481633 10712 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:55.505817  8349 connection.cc:256] RPC call timeout handler was delayed by -1.3752650250000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
I20260709 13:01:55.543915  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:55.540159  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.508968 10610 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:55.533854  9258 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:55.534096  8460 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:01:55.552495  9295 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:55.510164 10826 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:55.549376  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:55.518808 10850 raft_consensus.cc:697] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:55.548561  8378 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:55.540979 10836 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:55.568514  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:55.569300  8454 raft_consensus.cc:2368] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5.
I20260709 13:01:55.565578  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:55.566757  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:55.500818 10448 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.554721 10639 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.533744 10609 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:01:55.571710  8382 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 1.
I20260709 13:01:55.532604 10522 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:55.539839 10793 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.567147 10767 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:55.575485  8349 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.872s (SENT) [suppressed 16 similar messages]
I20260709 13:01:55.592743  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.593730  8380 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:01:55.587671 10408 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:55.571523 10784 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:55.614348  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 116786us
I20260709 13:01:55.615501 10801 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:55.615804  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.574839 10848 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.633903 10784 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:55.635062 10875 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.635613 10875 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.636111 10448 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:55.637916 10875 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:55.643115 10793 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:55.646003 10826 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:55.654589 10770 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:55.655861  8452 raft_consensus.cc:2368] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6.
I20260709 13:01:55.657152  9291 raft_consensus.cc:1240] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:55.658846 10848 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:55.607745 10767 raft_consensus.cc:697] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:55.673512  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:55.630417 10913 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:55.680934  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 105490us
W20260709 13:01:55.677424  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 112759us
W20260709 13:01:55.670297 10922 log.cc:927] Time spent T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:01:55.605819 10639 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.689416  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:55.689883 10639 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:55.690873  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:55.691735  8526 raft_consensus.cc:2393] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 7: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:55.692932  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:55.694343  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.694969  8381 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:01:55.678156 10850 consensus_queue.cc:237] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.700449  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:55.700978  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:55.701752  8532 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:55.705385  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:55.701016  8378 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:55.681578  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:01:55.714246  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.715145  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:55.715981  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:55.716117  8454 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:01:55.717454  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:55.718462  9260 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:55.719499  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:55.719755  8380 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:55.720153  8456 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:01:55.722568  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:55.723183  9295 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:55.725423  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:55.726063  9287 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:55.726547  8528 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:01:55.683869  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.717581  8460 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:55.720777  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.729559  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.682150  8377 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:01:55.738727  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:55.743280  8378 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:55.749706  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.751214  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:55.753048  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:55.753698  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:55.755342  9294 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.683902 10848 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.759788  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.745839  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:55.761894  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:55.762729  8533 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:55.756860  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.765202  8386 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:01:55.769186  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:55.769445  9258 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:55.770375  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.771821 10908 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:55.773936  8384 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:55.774500  8526 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:55.775301 10848 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.771908  8534 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:55.776901  8385 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:01:55.777678 10848 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:55.787779  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.788470  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:55.788618  8377 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:01:55.790201  8380 raft_consensus.cc:2410] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:01:55.791760  8385 raft_consensus.cc:2368] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5.
I20260709 13:01:55.787659  8530 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:01:55.800350 10839 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:55.801009 10839 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:55.801213 10767 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:55.802148  8531 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:55.947695  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:55.857403  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:55.787736 10712 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:55.868443  9294 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:55.951278  8530 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
W20260709 13:01:55.907891  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 197472us
I20260709 13:01:55.945472  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:55.812801  8426 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:55.840807  8532 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
W20260709 13:01:55.843897  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 51489.3us
W20260709 13:01:55.845031  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 126635us
W20260709 13:01:55.864934  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.858156  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:55.813220  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.927804  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:55.974582  9296 raft_consensus.cc:1240] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:55.983035  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:55.797317  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:55.983716  8380 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:55.987399  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 174708us
I20260709 13:01:55.990648  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:55.991925  8532 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:55.993597  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.957016  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:55.825276 10604 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:01:55.995595  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.876579 10522 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:55.855196 10839 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:55.997414  8529 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:01:55.988611  8426 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:56.015777  8533 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:55.876927  9288 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:56.021250  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:55.956773 10712 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:56.014914  8380 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:01:56.033123  8385 raft_consensus.cc:2393] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 6: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:55.855463  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:56.051604  9260 leader_election.cc:400] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5.
W20260709 13:01:56.055450  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 67076.7us
I20260709 13:01:56.058483  9260 leader_election.cc:403] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:01:55.808486 10930 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.234s
I20260709 13:01:56.011556  9287 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:56.063628  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 51338.2us
I20260709 13:01:56.064312  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:56.057560  8531 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:01:56.065024  8385 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:01:56.034632 10712 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:56.024344 10865 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:56.079519  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:56.017472 10850 consensus_queue.cc:1059] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:01:56.062402 10882 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:56.083168 10784 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.063421 10609 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:01:56.099387  8500 connection.cc:256] RPC call timeout handler was delayed by -1.4285711580000111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
I20260709 13:01:56.075309 10448 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5.
W20260709 13:01:56.112248  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.059662 10839 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:56.077507 10604 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
W20260709 13:01:56.116379  8500 connection.cc:256] RPC call timeout handler was delayed by -1.4168711579999922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 13:01:56.155829  8500 connection.cc:256] RPC call timeout handler was delayed by -1.397071158000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 13:01:56.156353  8500 connection.cc:256] RPC call timeout handler was delayed by -1.3574711580000098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
I20260709 13:01:56.124915  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:56.130276 10870 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:56.130640 10784 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:56.140189 10609 raft_consensus.cc:697] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:56.141641  8529 raft_consensus.cc:1240] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:56.143769  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.116214  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.052274 10826 consensus_queue.cc:1059] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:01:56.203233  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:56.204918  8533 raft_consensus.cc:3055] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:56.205340  8533 raft_consensus.cc:740] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:56.172852 10870 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:56.213651  8531 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:01:56.171344 10408 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:56.149451 10865 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:56.244335  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:56.224169 10870 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.247076  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.247239  8533 consensus_queue.cc:260] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:56.264861  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:56.274705 10755 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.275360 10755 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:56.277578  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.278463  8535 raft_consensus.cc:2393] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 4: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:01:56.279582 10936 log.cc:927] Time spent T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:01:56.281270 10953 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:56.281968 10953 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:56.284204 10953 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:01:56.286506 10941 log.cc:927] Time spent T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 13:01:56.296653 10836 consensus_meta.cc:287] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.000s
I20260709 13:01:56.298089 10604 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:56.299868  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.300284  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.301261  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:56.259778 10949 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:56.301321  8530 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 2.
I20260709 13:01:56.302265 10949 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:56.302861  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:56.303409  8530 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:56.304580 10949 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:56.222321 10839 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:56.306284  8534 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.307535 10839 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:56.309726  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.311193  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:56.311874  8529 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:56.262786 10609 consensus_queue.cc:237] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:56.318149  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:01:56.319427  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 48000.4us
I20260709 13:01:56.322244  8534 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:56.323537  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:56.329468  8383 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:56.332581 10842 raft_consensus.cc:3055] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:56.333379 10842 raft_consensus.cc:740] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:56.335419  8531 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:56.334685 10842 consensus_queue.cc:260] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:56.336506  8533 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:56.327862 10937 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
W20260709 13:01:56.327821  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 308017us
I20260709 13:01:56.340790  8427 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:56.241799 10408 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:56.342573 10801 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:56.343165 10801 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.343506 10408 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:56.343648 10801 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:56.348336  8530 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:01:56.353207 10755 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:56.354462 10942 log.cc:927] Time spent T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:01:56.356199  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.360488  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:01:56.361716 10944 log.cc:927] Time spent T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.145s	user 0.000s	sys 0.004s
I20260709 13:01:56.362035  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:56.362674  9293 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:56.363294  8531 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:56.363560  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:56.364099  9296 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:56.366747  8383 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:01:56.363042  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.370172 10784 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:56.372620  9291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 393) took 1084 ms. Trace:
I20260709 13:01:56.373409  9291 rpcz_store.cc:276] 0709 13:01:55.293256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.299371 (+  6115us) service_pool.cc:224] Handling call
0709 13:01:55.299777 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.657576 (+357799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.372341 (+714765us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b5400708fd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:56.372529 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":821366528}
W20260709 13:01:56.375566  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 310569us
I20260709 13:01:56.376144 10884 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:01:56.376622 10938 log.cc:927] Time spent T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.245s	user 0.001s	sys 0.001s
I20260709 13:01:56.377393 10755 raft_consensus.cc:3055] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:56.377763 10755 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:56.378695  9260 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:01:56.378592 10755 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:56.379947  8427 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:56.381033  8427 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:56.386569  9296 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
W20260709 13:01:56.386894  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.336814 10842 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.408035  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:01:56.384968  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.409852  9258 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:56.410354  8427 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:56.412518 10819 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:56.413003 10819 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:56.413432 10819 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.392630 10864 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:56.402812 10784 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:56.433521  8533 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:01:56.436128  8533 pending_rounds.cc:85] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 2
I20260709 13:01:56.393814 10836 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:56.446061 10836 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:56.441603  8533 pending_rounds.cc:107] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:56.446833  8533 raft_consensus.cc:2889] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:56.453305  8380 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:56.454735  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:56.420080 10865 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:56.459286  8385 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:01:56.431214 10913 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:56.461781  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:56.407212 10875 consensus_queue.cc:1059] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:01:56.413435 10653 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:01:56.440593 10864 raft_consensus.cc:697] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:56.476629  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:56.480156  8378 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:56.478519  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:56.456259 10900 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:56.452951 10877 raft_consensus.cc:3055] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:56.466656 10784 raft_consensus.cc:697] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:56.503809  8385 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:01:56.475090 10913 raft_consensus.cc:697] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:01:56.508396  8500 connection.cc:256] RPC call timeout handler was delayed by -1.2296711580000306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
I20260709 13:01:56.483536 10877 raft_consensus.cc:740] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:01:56.510031  8500 connection.cc:256] RPC call timeout handler was delayed by -1.177471158000003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
I20260709 13:01:56.512423  8379 raft_consensus.cc:3055] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:56.514356  8379 raft_consensus.cc:740] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:56.512598  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:56.515406  8500 connection.cc:256] RPC call timeout handler was delayed by -1.1558711580000249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
W20260709 13:01:56.515959  8500 connection.cc:256] RPC call timeout handler was delayed by -1.1432711580000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
I20260709 13:01:56.517771  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:56.514510  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:56.526811  8378 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:01:56.505199 10875 consensus_queue.cc:1243] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer 446d9310dce14ff4afff2dc2d64f68d8 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:56.528424  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:56.529263  8460 raft_consensus.cc:2393] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 8: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:56.531200  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:56.531453 10784 consensus_queue.cc:237] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:56.532486  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:56.534132  8461 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:56.535421  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:56.536031  8526 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:01:56.537348  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:56.534196  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:56.537509  8530 pending_rounds.cc:85] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 4
I20260709 13:01:56.538864  8527 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:56.539077  8530 pending_rounds.cc:107] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:01:56.539392  8530 raft_consensus.cc:2889] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:56.544335  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.545161  8531 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:56.546151  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:56.546486  8526 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:01:56.546770  8531 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:56.547573  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.548169  8526 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:01:56.551301  8283 catalog_manager.cc:5697] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 5 to 6, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 6 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:56.556748  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 48779.5us
I20260709 13:01:56.557581  8427 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:56.558531  8427 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:56.561317 10835 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:56.561750 10835 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.562148 10835 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.562242  8531 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:01:56.566236 10712 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:56.567639  8424 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:56.569276 10781 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:56.569478  9290 raft_consensus.cc:2393] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:01:56.569749 10781 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:56.570240 10781 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.571094 10764 raft_consensus.cc:3055] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:56.571539 10764 raft_consensus.cc:740] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:56.572202  9287 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:01:56.533658  8379 consensus_queue.cc:260] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:56.494657 10900 raft_consensus.cc:697] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:01:56.574445  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:56.584074  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:56.575687  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:56.585261  8458 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
W20260709 13:01:56.576228  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.586530  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.587240  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.589450  8379 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:56.580204  8529 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:01:56.591889  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:56.581559  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 201478us
I20260709 13:01:56.592355  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.592774  8453 raft_consensus.cc:2410] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:01:56.593271  8531 raft_consensus.cc:2393] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 8: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:56.594390  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:56.588430  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:56.591355  8528 raft_consensus.cc:2376] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5. Re-sending same reply.
I20260709 13:01:56.561741 10875 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:56.572476 10764 consensus_queue.cc:260] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:56.600747  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.603192  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.604869  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:56.607378  8458 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:01:56.608587  8424 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
W20260709 13:01:56.608775  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 171185us
I20260709 13:01:56.602106 10770 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:56.621929  8424 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:56.627126  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:56.628476  8531 raft_consensus.cc:2368] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8.
I20260709 13:01:56.603405 10712 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:56.612434 10875 raft_consensus.cc:697] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:01:56.636700  8282 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53484 (request call id 334) took 12208 ms (client timeout 15000 ms). Trace:
I20260709 13:01:56.637110 10875 consensus_queue.cc:237] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:56.638914  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.639635  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:01:56.650260  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 139702us
I20260709 13:01:56.641096  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:01:56.647972  8501 leader_election.cc:336] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.564s (SENT)
I20260709 13:01:56.616916 10522 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:56.614928 10957 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:56.640944  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.641355  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.643174  8527 raft_consensus.cc:2368] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7.
I20260709 13:01:56.660722  8529 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:56.608894 10639 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:01:56.632112 10877 consensus_queue.cc:260] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:56.667228  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 45424us
I20260709 13:01:56.668085  8424 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:56.669299  8424 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:56.668991 10900 consensus_queue.cc:237] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:56.670552 10639 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:56.670970 10639 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:56.671411 10639 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:56.671476  8424 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:56.672580  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:56.673440  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.674628  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.675374  8534 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:56.676098  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:56.676748  8534 raft_consensus.cc:2393] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 5: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:56.635370 10764 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.680148  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.680498 10755 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.686393  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.687070 10877 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:56.687932  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.654472 10425 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:56.681414  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:56.729569 10425 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:56.730211 10425 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.730686 10957 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:56.674562  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.732025  8528 raft_consensus.cc:2393] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 2: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:56.733142  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.734094  8528 raft_consensus.cc:2393] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 5: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:56.734594 10737 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:56.736549  8349 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:56.737293 10737 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:56.737790 10737 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.738433  8349 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:56.739214 10610 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:56.734645 10930 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:56.739859 10610 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:56.660861  8532 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:01:56.741263  8349 leader_election.cc:400] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8.
W20260709 13:01:56.734757  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 63378.9us
I20260709 13:01:56.618743 10864 consensus_queue.cc:237] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:56.633138 10870 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:56.683300 10801 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:56.679468  8379 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:56.632921 10913 consensus_queue.cc:237] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:56.730302  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 78965.7us
I20260709 13:01:56.741799  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.745234  8424 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:56.745750  8532 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:01:56.746626 10801 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:56.747045  8351 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:56.747956  8526 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:01:56.665881  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:01:56.689564  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.750520  8531 raft_consensus.cc:2368] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 9. Current term is 10.
W20260709 13:01:56.714349  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 244555us
I20260709 13:01:56.660600 10522 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:56.734962  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:56.751902  8528 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:56.716143 10819 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:56.716903 10639 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:56.717711  8527 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:01:56.719523 10781 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:56.640491  8282 rpcz_store.cc:269] 0709 13:01:44.373433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.374107 (+   674us) service_pool.cc:224] Handling call
0709 13:01:56.549075 (+12174968us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:52.448162 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:52.546396 (+ 98234us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:52.546453 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:01:52.546494 (+    41us) tablet.cc:662] Decoding operations
0709 13:01:52.547344 (+   850us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:52.547422 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:52.547462 (+    40us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:01:52.548052 (+   590us) tablet.cc:701] Row locks acquired
0709 13:01:52.548073 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:01:52.548294 (+   221us) write_op.cc:270] Start()
0709 13:01:52.548454 (+   160us) write_op.cc:276] Timestamp: P: 1783602112548226 usec, L: 0
0709 13:01:52.548487 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:01:52.574947 (+ 26460us) log.cc:844] Serialized 1741 byte log entry
0709 13:01:54.341547 (+1766600us) op_driver.cc:464] REPLICATION: finished
0709 13:01:55.090721 (+749174us) spinlock_profiling.cc:243] Waited 97.1 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c537b0ac 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36cbebbef0
0709 13:01:55.299206 (+208485us) write_op.cc:301] APPLY: starting
0709 13:01:55.299366 (+   160us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:55.299570 (+   204us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:55.299620 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:55.300525 (+   905us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:55.300878 (+   353us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:01:55.300923 (+    45us) write_op.cc:312] APPLY: finished
0709 13:01:55.301341 (+   418us) log.cc:844] Serialized 41 byte log entry
0709 13:01:55.464940 (+163599us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:55.517148 (+ 52208us) write_op.cc:454] Released schema lock
0709 13:01:55.525372 (+  8224us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:55.558691 (+ 33319us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:55.562017 (+  3326us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":164341,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":941517,"apply.run_cpu_time_us":11273,"apply.run_wall_time_us":231380,"num_ops":4,"prepare.queue_time_us":1356810,"prepare.run_cpu_time_us":143165,"prepare.run_wall_time_us":370060,"raft.queue_time_us":1140577,"raft.run_cpu_time_us":19028,"raft.run_wall_time_us":1044635,"replication_time_us":1699535,"spinlock_wait_cycles":223444224,"thread_start_us":2808323,"threads_started":5,"wal-append.queue_time_us":524696,"wal-append.run_cpu_time_us":54564,"wal-append.run_wall_time_us":2956714}]]}
I20260709 13:01:56.713680  9260 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
W20260709 13:01:56.770082  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 56529.7us
I20260709 13:01:56.725494  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:56.771977  8529 raft_consensus.cc:2368] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5.
I20260709 13:01:56.747995 10408 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:56.749744  8424 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:56.700323  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:56.741657  8349 leader_election.cc:403] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:01:56.753041  8426 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:56.747002  8532 raft_consensus.cc:1240] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:56.766037  8531 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:56.794035  8527 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:56.795485  8527 raft_consensus.cc:1240] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:56.796275  8454 raft_consensus.cc:1240] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:56.734987 10835 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:56.800014  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:56.800858 10819 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:56.801430 10835 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:56.780891 10610 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:56.802294 10610 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.802641 10610 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.803419 10425 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:56.804754  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:56.805449  8458 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:01:56.806365  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:56.808192  8453 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
W20260709 13:01:56.797735  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 235465us
W20260709 13:01:56.809762  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 60104.1us
I20260709 13:01:56.811378  8424 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:56.758435 10522 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:56.816488  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:56.817940  8453 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:01:56.826694  8424 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:56.829945  8455 raft_consensus.cc:1240] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:56.830040  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:56.833707  8500 leader_election.cc:336] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.529s (SENT)
I20260709 13:01:56.836407  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:01:56.837524  8460 raft_consensus.cc:2368] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 6. Current term is 7.
I20260709 13:01:56.838371 10930 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:56.838963  9260 leader_election.cc:400] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 6. Current term is 7.
I20260709 13:01:56.839279  9260 leader_election.cc:403] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:01:56.839262 10884 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:56.839989 10639 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:56.812112 10767 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:56.841398 10767 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.841189 10737 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:56.841823 10767 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:56.843397 10737 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:56.843999 10842 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8.
I20260709 13:01:56.843845  8424 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:56.846144 10930 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:56.847111 10930 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:56.849898  9296 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:01:56.850376  9296 pending_rounds.cc:85] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting all ops after (but not including) 7
I20260709 13:01:56.850098  8424 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:56.851197 10408 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:56.853680 10408 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:56.854296 10408 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:56.854858 10408 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.857599  8501 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:56.858664 10959 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:56.859208 10959 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.859745  8501 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:56.860531 10821 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:56.806540 10755 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:56.860920 10821 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.861414 10821 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.861471 10755 raft_consensus.cc:697] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:56.862491 10755 consensus_queue.cc:237] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:56.865671  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:56.866353  9295 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:56.866590 10781 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:01:56.869127  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 47573.6us
I20260709 13:01:56.869549 10870 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:56.870764 10870 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:56.873665  8459 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:56.850690  9296 pending_rounds.cc:107] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:01:56.859593 10865 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:56.874768  9296 raft_consensus.cc:2889] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:56.874677  8532 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:56.874001  9261 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:56.899777  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 49769.3us
W20260709 13:01:56.904835  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 285439us
I20260709 13:01:56.918434  8528 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
W20260709 13:01:56.919107  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 178058us
W20260709 13:01:56.920567  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.873869  8427 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:56.812647 10784 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:56.930553  8351 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:01:56.941432  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 67715.5us
I20260709 13:01:56.943120  9295 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:01:56.859612 10959 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:56.955147  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:56.954751  8427 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:56.958591  8460 raft_consensus.cc:2368] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3.
W20260709 13:01:56.967049  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 93125.7us
I20260709 13:01:56.974004 10842 raft_consensus.cc:2764] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:01:56.975127 10968 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:56.975754 10968 raft_consensus.cc:697] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:56.976799 10968 consensus_queue.cc:237] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:56.977372 10947 consensus_queue.cc:1059] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.212s
I20260709 13:01:56.978689 10947 raft_consensus.cc:3055] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:56.979038 10947 raft_consensus.cc:740] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:56.979849 10947 consensus_queue.cc:260] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:56.982923  8378 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:56.945793 10835 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:56.983402  8351 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:56.991600  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:56.996074  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:56.997514 10956 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:56.998140 10956 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.998571 10956 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.999462  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:01:57.001775  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 194825us
I20260709 13:01:57.002686  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:57.009269  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:56.959455 10712 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.957039  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:57.024725  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:57.025606  8380 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.020659  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:57.026880  8378 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.983956 10947 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:56.981240 10962 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 6. Current term is 7.
I20260709 13:01:56.956092 10653 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:01:57.030918  9261 leader_election.cc:400] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5.
I20260709 13:01:57.004789 10835 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:57.038928  8500 leader_election.cc:336] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.542s (SENT)
I20260709 13:01:57.031966 10875 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
W20260709 13:01:57.050920  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.018975 10845 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:57.053464 10826 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:57.057956 10961 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:57.061234  8500 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:57.063409  8500 leader_election.cc:336] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.750s (SENT)
I20260709 13:01:57.065253 10963 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:01:57.073261  8528 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:57.074602  8528 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:01:57.063319  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 157978us
I20260709 13:01:57.076036  8424 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:01:57.076438  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:01:57.080814  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 71643.5us
I20260709 13:01:57.089506  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:57.092788 10610 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:57.108608 10610 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:57.054100 10835 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:57.077280 10955 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:01:57.112449 10969 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:01:57.125783  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 46286.2us
I20260709 13:01:57.079679 10845 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:57.030166 10712 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:57.144850  9261 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:57.153429 10408 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:01:57.155122  8454 raft_consensus.cc:1240] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:57.160512  8378 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
W20260709 13:01:57.180435  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 98545.9us
W20260709 13:01:57.184392  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.191059 10408 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:57.207149 10610 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:57.207782 10610 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:57.208287 10610 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.209826 10884 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:01:57.210505 10884 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.213750  8351 leader_election.cc:400] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6.
I20260709 13:01:57.214186  8351 leader_election.cc:403] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:01:57.128218 10865 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:57.229499 10957 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6.
I20260709 13:01:57.220348  8380 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
W20260709 13:01:57.234220  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 108613us
I20260709 13:01:57.237128  9261 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:01:57.158512 10845 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:57.205070 10955 raft_consensus.cc:697] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:01:57.214848 10963 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:57.259963  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.230748 10821 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:57.220582 10819 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:01:57.264441 10653 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:57.302899  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 381216us
I20260709 13:01:57.261188 10877 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:01:57.303896 10653 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:57.334677  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 112307us
I20260709 13:01:57.330673  8349 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:57.342512  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:57.344218  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:57.345849  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:57.347183  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:57.347999  8379 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 6: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:57.348706  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:57.350179  8453 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:57.352198  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:57.353824  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:57.354605  8379 raft_consensus.cc:2393] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 8: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
W20260709 13:01:57.354468  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 133236us
I20260709 13:01:57.349666  8384 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
W20260709 13:01:57.371192  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 134195us
I20260709 13:01:57.371994  9261 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:57.374750  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:57.374963  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:57.376001  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:57.349303 10653 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:57.375094  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:57.419394  8427 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:01:57.419554  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 47625.4us
W20260709 13:01:57.420112  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 43676.5us
I20260709 13:01:57.426611  9261 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:57.597761  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:57.945916  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 519357us
W20260709 13:01:57.426963  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 50854.4us
I20260709 13:01:57.946945  8427 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:01:57.947660  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.435966  8377 raft_consensus.cc:2393] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:57.948078  9261 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:57.427055 10408 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:57.491494  8381 raft_consensus.cc:2393] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 7: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
W20260709 13:01:57.963377  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.367161 10639 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:01:57.944533  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 636237us
I20260709 13:01:57.981712  8500 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:57.990231  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:01:57.990875  8378 consensus_meta.cc:287] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.644s	user 0.010s	sys 0.000s
W20260709 13:01:57.954013 10959 consensus_meta.cc:287] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.965s	user 0.008s	sys 0.004s
I20260709 13:01:57.991336  8378 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
W20260709 13:01:57.831926 10767 consensus_meta.cc:287] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.990s	user 0.010s	sys 0.001s
W20260709 13:01:57.518687 10979 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 13:01:57.834722 10981 log.cc:927] Time spent T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.472s	user 0.000s	sys 0.001s
I20260709 13:01:58.002338 10821 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:01:57.833510 10977 log.cc:927] Time spent T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.533s	user 0.001s	sys 0.000s
W20260709 13:01:58.013615 10990 log.cc:927] Time spent T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.456s	user 0.000s	sys 0.000s
I20260709 13:01:58.014226 10997 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:58.014583 10826 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.014992 10997 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:01:58.006331  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:58.015136 10826 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:58.015507 10997 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:58.016034  8386 raft_consensus.cc:2393] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 3: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:58.016875  8457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 420) took 1281 ms. Trace:
W20260709 13:01:57.834087 10975 log.cc:927] Time spent T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.530s	user 0.000s	sys 0.001s
I20260709 13:01:58.018675  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2225) took 1011 ms. Trace:
I20260709 13:01:58.019335 10995 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:58.019171  8382 rpcz_store.cc:276] 0709 13:01:57.006855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.006987 (+   132us) service_pool.cc:224] Handling call
0709 13:01:57.013895 (+  6908us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.033452 (+ 19557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.033499 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:57.041376 (+  7877us) log.cc:844] Serialized 26 byte log entry
0709 13:01:57.264733 (+223357us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:57.264795 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.264889 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.018461 (+753572us) raft_consensus.cc:1685] finished
0709 13:01:58.018482 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.018621 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12188,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":12197,"thread_start_us":221746,"threads_started":1,"wal-append.queue_time_us":325797}
I20260709 13:01:58.020041 10995 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:57.423830 10970 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:57.757409 10842 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:58.008785 10978 log.cc:927] Time spent T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.744s	user 0.001s	sys 0.000s
W20260709 13:01:58.013703 10989 log.cc:927] Time spent T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:01:58.008754  8384 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:58.024453 10821 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.024856  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 1932) took 1295 ms. Trace:
I20260709 13:01:58.024987 10821 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:57.376973 10955 consensus_queue.cc:237] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:58.025951 10988 log.cc:927] Time spent T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.256s	user 0.000s	sys 0.000s
I20260709 13:01:58.025413  8529 rpcz_store.cc:276] 0709 13:01:56.729844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.794210 (+ 64366us) service_pool.cc:224] Handling call
0709 13:01:56.825921 (+ 31711us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.826138 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.826161 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:56.853491 (+ 27330us) log.cc:844] Serialized 26 byte log entry
0709 13:01:57.178864 (+325373us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:57.178924 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.179026 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.024631 (+845605us) raft_consensus.cc:1685] finished
0709 13:01:58.024653 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.024790 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":324847,"threads_started":1,"wal-append.queue_time_us":439653}
I20260709 13:01:58.027426 10821 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:58.027667 10826 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:58.028012 10821 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:57.968092 10952 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:58.029793 10952 raft_consensus.cc:697] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:01:58.029939 10980 log.cc:927] Time spent T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.548s	user 0.000s	sys 0.000s
I20260709 13:01:58.009331 10959 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:58.030866 10952 consensus_queue.cc:237] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:58.033857  8377 raft_consensus.cc:1275] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:58.017616  8457 rpcz_store.cc:276] 0709 13:01:56.735597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.736648 (+  1051us) service_pool.cc:224] Handling call
0709 13:01:56.736956 (+   308us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:56.737339 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.737372 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:56.737951 (+   579us) log.cc:844] Serialized 52 byte log entry
0709 13:01:56.944159 (+206208us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:57.245791 (+301632us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.246854 (+  1063us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.247137 (+   283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.247205 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.016661 (+769456us) raft_consensus.cc:1685] finished
0709 13:01:58.016682 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.016815 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":292841,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":89,"raft.queue_time_us":3304,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":4109,"spinlock_wait_cycles":27403776,"thread_start_us":448089,"threads_started":2,"wal-append.queue_time_us":484676}
I20260709 13:01:58.032799 10959 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:58.037722 10959 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.038267 10959 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:58.040567 10959 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:58.028627 10821 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:57.501884 10819 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.633634 10712 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:01:58.051087  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 68368.4us
W20260709 13:01:58.036865 10956 consensus_meta.cc:287] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.038s	user 0.008s	sys 0.004s
I20260709 13:01:58.051606  9293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 687) took 1224 ms. Trace:
W20260709 13:01:58.044895 10610 consensus_meta.cc:287] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.836s	user 0.009s	sys 0.000s
I20260709 13:01:57.829715 10999 consensus_queue.cc:1059] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.271s
W20260709 13:01:58.534426  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.541810  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 489630us
W20260709 13:01:58.532418  8379 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.006s	sys 0.014s
I20260709 13:01:58.157774 10408 raft_consensus.cc:697] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:01:58.127082  8351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.017s	sys 0.087s
W20260709 13:01:58.487465  8534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.009s	sys 0.009s
W20260709 13:01:58.553429  8351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.178s	user 0.032s	sys 0.113s
W20260709 13:01:58.554245  8534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.010s	sys 0.010s
W20260709 13:01:58.554665  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 1.19724e+06us
I20260709 13:01:58.555987  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 1934) took 1825 ms. Trace:
W20260709 13:01:58.547358  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 599299us
W20260709 13:01:58.553517  8379 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.007s	sys 0.014s
I20260709 13:01:58.082178  8500 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:58.556591  8534 rpcz_store.cc:276] 0709 13:01:56.730446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.807496 (+ 77050us) service_pool.cc:224] Handling call
0709 13:01:56.807836 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.808085 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:56.957597 (+149512us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.725898 (+768301us) spinlock_profiling.cc:243] Waited 8.55 ms on lock 0x7b1800316180. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c802523a 00007f36c848fa2a
0709 13:01:58.555459 (+829561us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.555541 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:58.555637 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.555734 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.555919 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108555,"prepare.queue_time_us":186781,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":158,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"spinlock_wait_cycles":19672448,"thread_start_us":829124,"threads_started":1}
W20260709 13:01:58.223016 10522 consensus_meta.cc:287] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 1.353s	user 0.010s	sys 0.002s
I20260709 13:01:58.057688  9293 rpcz_store.cc:276] 0709 13:01:56.826738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.827067 (+   329us) service_pool.cc:224] Handling call
0709 13:01:56.827380 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.918526 (+ 91146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.918570 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:56.947753 (+ 29183us) log.cc:844] Serialized 26 byte log entry
0709 13:01:57.336285 (+388532us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:57.736445 (+400160us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.051134 (+314689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.051246 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.051312 (+    66us) raft_consensus.cc:1685] finished
0709 13:01:58.051331 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.051518 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6874,"prepare.queue_time_us":681563,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":273186,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":50055,"thread_start_us":990606,"threads_started":3,"wal-append.queue_time_us":588329}
I20260709 13:01:58.046227 10961 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:58.238229 10947 consensus_meta.cc:287] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.195s	user 0.008s	sys 0.003s
I20260709 13:01:58.566273  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:01:58.390872 10884 consensus_meta.cc:287] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 1.180s	user 0.009s	sys 0.004s
I20260709 13:01:58.567732  9290 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:58.556787 10610 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:58.573581  8271 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 56cc480ba6f642e08bb2e547a0ef50a1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d653e71832b7402b9a03b46249d3b885 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:01:58.575824 10976 log.cc:927] Time spent T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 1.269s	user 0.002s	sys 0.009s
I20260709 13:01:58.576010  8384 raft_consensus.cc:1275] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:58.575623 10552 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:01:58.577307  9259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.014s	sys 0.019s
I20260709 13:01:58.579958 10864 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:58.580297 10653 consensus_meta.cc:287] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 1.071s	user 0.006s	sys 0.003s
I20260709 13:01:58.597791  8349 leader_election.cc:400] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7.
I20260709 13:01:58.441741 11005 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.007761 10639 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:58.483788 10900 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.511795 10826 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:58.565809 10408 consensus_queue.cc:237] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:58.340711 11001 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.584743  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 1866) took 1227 ms. Trace:
I20260709 13:01:58.210253 11000 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:01:58.586377  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 576899us
I20260709 13:01:58.592667 10999 raft_consensus.cc:3055] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:58.362720 10712 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:58.381529 10848 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:01:58.583137 10835 consensus_meta.cc:287] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 1.417s	user 0.008s	sys 0.006s
W20260709 13:01:58.595935  9259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.014s	sys 0.019s
I20260709 13:01:58.045569 10865 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:58.598489  8349 leader_election.cc:403] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:01:58.550335 10956 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:58.081233 10819 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:58.046455 10767 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:58.603148  9291 raft_consensus.cc:1240] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:58.588683  9295 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:58.607338  8500 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:01:58.603879  8379 rpcz_store.cc:276] 0709 13:01:57.356946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.367322 (+ 10376us) service_pool.cc:224] Handling call
0709 13:01:57.367672 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.819576 (+451904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.819622 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:57.962994 (+143372us) log.cc:844] Serialized 26 byte log entry
0709 13:01:58.558143 (+595149us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:58.558182 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.558257 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.580687 (+ 22430us) raft_consensus.cc:1685] finished
0709 13:01:58.580719 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.580929 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":461270,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":166,"thread_start_us":980022,"threads_started":2,"wal-append.queue_time_us":567748}
I20260709 13:01:58.600831 11015 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:58.583428 10522 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:58.603312 10845 consensus_meta.cc:287] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.339s	user 0.010s	sys 0.003s
I20260709 13:01:58.589717 10884 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:58.606204 10999 raft_consensus.cc:740] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:58.622692  8500 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:58.611217 10821 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:58.630714  8380 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:58.601058 10864 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:58.601224 11005 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:58.605139 10900 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:58.606415 10826 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:01:58.639185  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 45408.6us
I20260709 13:01:58.625810  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:58.627406 10983 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:58.611452 10712 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:58.613447 10848 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:58.613914 10835 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:58.631191 10865 raft_consensus.cc:697] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:58.626387 11008 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7.
I20260709 13:01:58.610244 11001 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:58.648779  9288 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:58.632226 11015 raft_consensus.cc:697] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:58.661476  8454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 1782) took 1729 ms. Trace:
I20260709 13:01:58.612501 11000 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:58.609946 10653 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:58.662730  8349 connection.cc:256] RPC call timeout handler was delayed by -1.6630868519999922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
W20260709 13:01:58.666138  8349 connection.cc:256] RPC call timeout handler was delayed by -1.6558868519999805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
I20260709 13:01:58.663511  8454 rpcz_store.cc:276] 0709 13:01:56.931730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.932096 (+   366us) service_pool.cc:224] Handling call
0709 13:01:56.932463 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.155563 (+223100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.656275 (+1500712us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54001e87d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:58.661403 (+  5128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":511592832}
W20260709 13:01:58.666695  8349 connection.cc:256] RPC call timeout handler was delayed by -1.6081868520000171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
I20260709 13:01:58.649957 10821 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:58.667165  8349 connection.cc:256] RPC call timeout handler was delayed by -1.6052366860000689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
I20260709 13:01:58.627780 10845 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:58.700034 11015 consensus_queue.cc:237] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:58.702354  9293 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 5: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:01:58.703393  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:01:58.707258  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:01:58.707772  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.709184  8528 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:01:58.793433  8529 raft_consensus.cc:2393] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 6: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:01:58.793561  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.711125  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:58.794149  8457 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:01:58.711191  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:58.710505  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:58.785808 11023 consensus_queue.cc:1048] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:58.784618 10767 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:58.786548 10819 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:58.790215  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:58.719683  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:58.812774  8526 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:58.665880 10983 raft_consensus.cc:697] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 7 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:01:58.720644  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:01:58.719929 11016 log.cc:927] Time spent T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c: Append to log took a long time: real 0.057s	user 0.002s	sys 0.000s
I20260709 13:01:58.782730  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:58.790983  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 122892us
W20260709 13:01:58.825662  8349 connection.cc:256] RPC call timeout handler was delayed by -1.5316868520000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 13:01:58.826375  8349 connection.cc:256] RPC call timeout handler was delayed by -1.26258685199997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
W20260709 13:01:58.826849  8349 connection.cc:256] RPC call timeout handler was delayed by -1.23457866199999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20830000000000004s for a response
I20260709 13:01:58.789152 10610 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:58.782303  9296 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:01:58.790078  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 76711.8us
I20260709 13:01:58.783703 10784 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.785205 10956 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:58.795198  8534 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:58.713349  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:01:58.797873  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:01:58.797300  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 109580us
I20260709 13:01:58.797920  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:58.803128  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:58.792745 10653 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:58.814731  8453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 1783) took 1865 ms. Trace:
I20260709 13:01:58.825800  8460 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 6: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:58.787061  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:58.811353 11021 log.cc:927] Time spent T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:01:58.830652  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:58.834504  8461 raft_consensus.cc:1275] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:58.883286  8459 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 4: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:01:58.883412  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:58.883980  8532 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.856093  8453 rpcz_store.cc:276] 0709 13:01:56.949543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.950332 (+   789us) service_pool.cc:224] Handling call
0709 13:01:56.985753 (+ 35421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.350688 (+364935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.814439 (+1463751us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b540019d7d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:58.814657 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":837534080}
I20260709 13:01:58.885661  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:58.882128  8529 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.882297  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:58.790315 11013 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.124s
I20260709 13:01:58.824524 10947 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.895305  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:58.891557  8379 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:58.894927  8527 raft_consensus.cc:2393] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 3: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:01:58.881213  8455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 1778) took 2085 ms. Trace:
I20260709 13:01:58.924947  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:01:58.923607  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:58.893842 10408 consensus_queue.cc:1048] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:01:58.924916  8455 rpcz_store.cc:276] 0709 13:01:56.795865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.795974 (+   109us) service_pool.cc:224] Handling call
0709 13:01:56.828006 (+ 32032us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.830563 (+  2557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.871611 (+2041048us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b540037a854. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:58.881140 (+  9529us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3834112}
W20260709 13:01:58.894441  8349 leader_election.cc:336] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.862s (SENT)
I20260709 13:01:58.887786  8351 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:58.928537  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:01:58.928076  8349 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:01:58.908879  8526 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:01:58.931756  8382 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:01:58.929317  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:58.932931  8377 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:01:58.933683  8384 raft_consensus.cc:2368] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 6. Current term is 7.
I20260709 13:01:58.935591  8534 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:01:58.833287 10610 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:58.930780  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:01:58.942787  8526 raft_consensus.cc:1275] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:58.948660  8534 raft_consensus.cc:1275] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:58.887871 10639 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:58.871068 11011 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:58.895633 10956 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:01:58.953786 11018 log.cc:927] Time spent T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:01:58.954059 10826 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:58.957584  9287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55734 (request call id 686) took 2123 ms. Trace:
I20260709 13:01:58.837458 10784 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:58.888199 10865 consensus_queue.cc:237] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:58.890609 10999 consensus_queue.cc:260] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:59.291013  9261 leader_election.cc:336] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.558s (SENT)
W20260709 13:01:59.049448  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.058213  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 465) took 1058 ms. Trace:
I20260709 13:01:59.214875  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:59.061676  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 121108us
W20260709 13:01:59.210122  8501 connection.cc:256] RPC call timeout handler was delayed by -1.1506545560000063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
I20260709 13:01:59.267941  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 1855) took 1926 ms. Trace:
W20260709 13:01:59.395190  8501 connection.cc:256] RPC call timeout handler was delayed by -1.112854556000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19390000000000002s for a response
W20260709 13:01:59.041441  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 338088us
I20260709 13:01:59.042843  8529 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:58.969887  8532 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:01:58.944284 10522 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:59.248327  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:01:59.188441  8382 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:59.394212  8530 rpcz_store.cc:276] 0709 13:01:58.000226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.000341 (+   115us) service_pool.cc:224] Handling call
0709 13:01:58.017733 (+ 17392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:58.029476 (+ 11743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.029506 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:58.030014 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:01:58.487912 (+457898us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:58.487972 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.488067 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:59.057912 (+569845us) raft_consensus.cc:1685] finished
0709 13:01:59.057934 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.058130 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11305,"raft.queue_time_us":79765,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":97165,"thread_start_us":457429,"threads_started":1,"wal-append.queue_time_us":597900}
I20260709 13:01:59.121717  8424 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:01:59.405911  9293 raft_consensus.cc:2393] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 4: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:01:59.395309  8351 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:01:59.396279  8500 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:01:59.038123  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 73741.7us
I20260709 13:01:59.407851  8351 leader_election.cc:400] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3.
I20260709 13:01:59.408177  8351 leader_election.cc:403] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:59.419821  8528 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:59.395437  8380 rpcz_store.cc:276] 0709 13:01:57.341852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.341967 (+   115us) service_pool.cc:224] Handling call
0709 13:01:57.342244 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.631194 (+1288950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.267556 (+636362us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54003dccd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:01:59.267851 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2962651904}
I20260709 13:01:58.947959 10900 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:58.981642 11033 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:01:59.255522 10835 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:59.259163 10997 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:58.982707 11001 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:59.029846 11011 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:59.445396 11001 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:59.446165 11001 raft_consensus.cc:697] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:01:58.978883 10957 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:58.963354 10884 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:59.230336 10877 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.055836 10653 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.060518 10845 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:59.369415 11038 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.938318 10947 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:59.049542 10712 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:01:59.061061 11005 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:59.062150 10848 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:01:59.426981  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 136023us
I20260709 13:01:59.434672  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:01:59.320745 10755 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.247556 11032 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:59.437819  8377 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:59.438485 10955 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.979635  9288 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:01:59.405515 10826 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:59.150202 11029 consensus_queue.cc:1059] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.289s
I20260709 13:01:59.362231  9287 rpcz_store.cc:276] 0709 13:01:56.826451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.902699 (+ 76248us) service_pool.cc:224] Handling call
0709 13:01:58.700564 (+1797865us) spinlock_profiling.cc:243] Waited 7.3 ms on lock 0x7b5800220e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360eee 0000000000375939 00007f36cd3d41e0 00007f36cd49d0c4 00007f36cd49d131 00007f36cd44b0a0 00007f36cd44a984 00007f36c69c56d4 00007f36c69c5662
0709 13:01:58.950266 (+249702us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16800128}
I20260709 13:01:59.057219 10983 consensus_queue.cc:237] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:59.350605 10770 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:59.441004  8381 raft_consensus.cc:3055] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:59.396728 11037 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:59.442339 10999 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.443037 11013 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:59.226925 10425 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:01:59.442922 11033 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:01:58.950400 11002 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.772s
I20260709 13:01:59.100569 10952 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:01:59.260169 10995 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:01:59.368563 11000 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:01:59.433001  8531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.000s	sys 0.045s
I20260709 13:01:58.949681 10610 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:01:59.274163 11008 consensus_queue.cc:1059] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.173s
I20260709 13:01:58.997290 10956 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:00.083206  8351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.018s	sys 0.005s
W20260709 13:02:00.315131  8351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.020s	sys 0.011s
W20260709 13:02:00.315532  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 907748us
W20260709 13:01:59.670675  8349 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.004s	sys 0.004s
W20260709 13:02:00.316046  8349 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.378s	user 0.004s	sys 0.017s
I20260709 13:01:59.692569 11009 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:00.316639  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 1.4341e+06us
W20260709 13:01:59.887651  8425 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.007s	sys 0.005s
W20260709 13:02:00.317744  8425 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.013s	sys 0.008s
W20260709 13:01:59.837497  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 441572us
W20260709 13:02:00.318810  8501 leader_election.cc:336] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.631s (SENT)
I20260709 13:02:00.319387  8455 raft_consensus.cc:1240] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:00.319766  8501 connection.cc:256] RPC call timeout handler was delayed by -1.0291545559999804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260709 13:02:00.320298  8501 connection.cc:256] RPC call timeout handler was delayed by -1.0148393540000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
I20260709 13:02:00.321195  8381 raft_consensus.cc:740] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:00.321475  8455 raft_consensus.cc:1240] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:00.321630 11005 consensus_queue.cc:1059] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:00.322516 11005 consensus_queue.cc:1059] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:00.323273 11005 consensus_queue.cc:1243] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer 105d6581548546b98eddd4ee7083bb12 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:02:00.006093  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 257203us
W20260709 13:02:00.254444  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 1.13272e+06us
W20260709 13:02:00.325766  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 929472us
I20260709 13:02:00.326999  8424 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:00.338826  9293 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:00.010504  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2228) took 2065 ms. Trace:
I20260709 13:02:00.329360  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:00.181511  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 354415us
I20260709 13:01:59.449836  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:00.022222  8499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.006s	sys 0.009s
I20260709 13:01:59.450274  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:00.342046  8499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.007s	sys 0.014s
W20260709 13:02:00.181450  8379 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.010s	sys 0.009s
W20260709 13:01:59.598636  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 67283.4us
W20260709 13:02:00.343353  8379 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.010s	sys 0.015s
I20260709 13:02:00.343818  8424 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
W20260709 13:02:00.320828  8501 connection.cc:256] RPC call timeout handler was delayed by -1.0023847399999681s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
I20260709 13:02:00.281383  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:00.345968  8386 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:00.346509  8531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.453s	user 0.006s	sys 0.055s
I20260709 13:02:00.347802  8426 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:00.353936 10639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.004s	sys 0.000s
W20260709 13:02:00.354614 10639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.004s	sys 0.000s
I20260709 13:02:00.355800 10639 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:00.340204  8385 rpcz_store.cc:276] 0709 13:01:57.945134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.945256 (+   122us) service_pool.cc:224] Handling call
0709 13:01:57.967264 (+ 22008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.967506 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:58.006040 (+ 38534us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.252506 (+1246466us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b18002eccc0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c802523a 00007f36c848fa2a
0709 13:02:00.010006 (+757500us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:00.010081 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:00.010159 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.010250 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.010421 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":43153,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":661131,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":10455424,"thread_start_us":640600,"threads_started":2,"wal-append.queue_time_us":2281702}
I20260709 13:02:00.361189  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:00.317312  8349 leader_election.cc:336] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.872s (SENT)
W20260709 13:02:00.369213  8535 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.332s	user 0.007s	sys 0.016s
W20260709 13:02:00.369838  8535 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.333s	user 0.007s	sys 0.016s
W20260709 13:02:00.329166  9261 connection.cc:256] RPC call timeout handler was delayed by -1.0669363150000208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2674s for a response
I20260709 13:02:00.323339 10877 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:01:59.636031 11016 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.008s	sys 0.032s
W20260709 13:02:00.378604  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.378849  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1918) took 1672 ms. Trace:
I20260709 13:02:00.381143  8424 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:00.382449  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:01:59.937311 10821 consensus_meta.cc:287] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 1.255s	user 0.015s	sys 0.003s
I20260709 13:02:00.323872 11005 consensus_queue.cc:1059] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:02:00.275965 11058 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.411950  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:01:59.734843 11024 log.cc:927] Time spent T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:01:59.449529 11011 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:00.387786  8382 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.000s	sys 0.010s
I20260709 13:01:59.769675 10522 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.363108 10767 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.386222  8501 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:00.128405 10968 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:00.419421  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:00.376507 10639 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:00.438755  8383 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:01:59.766860 11034 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.421499  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:01:59.635216 10993 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.009s	sys 0.016s
I20260709 13:02:00.424265  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:00.424165  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:01:59.826637 11035 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:00.382915 10848 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.425498 10877 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:00.425918  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:00.426489  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 109206us
I20260709 13:02:00.426723  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:00.446286  8459 raft_consensus.cc:2393] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 9: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:00.426947 10821 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:00.022395 10784 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:00.372376 11000 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:02:00.429694 11005 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:00.430593  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:00.022750 11036 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3.
I20260709 13:02:00.275328  9288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55720 (request call id 403) took 1657 ms. Trace:
I20260709 13:01:59.924156 10900 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:00.431713  8382 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.000s	sys 0.015s
I20260709 13:02:00.426508  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:00.275838 11001 consensus_queue.cc:237] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:00.347122 10957 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.412477  8531 rpcz_store.cc:276] 0709 13:01:58.706112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.706262 (+   150us) service_pool.cc:224] Handling call
0709 13:01:58.783665 (+ 77403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.783879 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:58.893232 (+109353us) log.cc:844] Serialized 14 byte log entry
0709 13:02:00.378244 (+1485012us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:00.378532 (+   288us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:00.378596 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.378665 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.378784 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28217,"prepare.queue_time_us":273223,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"spinlock_wait_cycles":115811072,"thread_start_us":1562275,"threads_started":2,"wal-append.queue_time_us":876160}
I20260709 13:02:00.006125 10835 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.362735 10884 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:00.371807 10995 raft_consensus.cc:3055] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:00.377807 11025 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:00.412166 11016 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.428s	user 0.018s	sys 0.044s
I20260709 13:02:00.438053  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:00.527392  8385 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:02:00.372932 11057 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:00.425272  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:00.420424  8380 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:01:59.577675 10961 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.855s
I20260709 13:02:00.317287 10770 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:00.317178 11009 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:00.444984  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:00.446554  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:00.273275 10653 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:00.432731 11058 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:00.370597 11029 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
W20260709 13:02:00.463099  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.461869  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:00.441764 10993 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.338s	user 0.016s	sys 0.034s
W20260709 13:02:00.432479  8426 connection.cc:256] RPC call timeout handler was delayed by -1.1491467300000409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3235s for a response
I20260709 13:02:00.363808 10755 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:00.442647 11008 raft_consensus.cc:3055] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:00.492566 11005 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:00.364074 10952 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:00.469352  9288 rpcz_store.cc:276] 0709 13:01:58.612106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.612685 (+   579us) service_pool.cc:224] Handling call
0709 13:02:00.269673 (+1656988us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:00.468736 10865 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:00.438697 10522 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:00.483490  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:00.385914 11060 consensus_queue.cc:1048] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:02:00.377388 10955 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:00.606950 11070 log.cc:927] Time spent T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:02:00.607111 10522 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:00.608192  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:00.521211  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 154804us
I20260709 13:02:00.438302 11045 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:02:00.530471  8458 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:00.443389 10767 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:00.478649 11035 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:00.379403 11038 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:00.370752 11037 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:00.489132 10957 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:00.445907 10968 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:00.486202 10639 raft_consensus.cc:697] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:00.450102 10848 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:00.539968  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 127985us
W20260709 13:02:00.542021  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 161233us
I20260709 13:02:00.543915  8452 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:00.425918  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:00.608880  8460 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:00.615649  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:00.620188  8455 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:00.622305  8424 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:00.624361  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:00.449682 11034 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:00.523638 11050 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:00.490321 10900 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:00.545220  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:00.545692 11051 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:00.570091 11008 raft_consensus.cc:740] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:00.545809  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:00.666917  8453 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:00.668359  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2246) took 1219 ms. Trace:
I20260709 13:02:00.668936  8379 rpcz_store.cc:276] 0709 13:01:59.449306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.449476 (+   170us) service_pool.cc:224] Handling call
0709 13:01:59.449811 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.343831 (+894020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.343867 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:00.378320 (+ 34453us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.518188 (+139868us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:00.519319 (+  1131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.520560 (+  1241us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.668110 (+147550us) raft_consensus.cc:1685] finished
0709 13:02:00.668138 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.668293 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":822863,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":15052,"thread_start_us":984187,"threads_started":2,"wal-append.queue_time_us":240559}
I20260709 13:02:00.546438 11009 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:00.546646 10956 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:00.548557 10653 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:00.550834  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1920) took 1844 ms. Trace:
I20260709 13:02:00.554114 10947 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:00.558254 10610 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:00.558420  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:00.520831 10995 raft_consensus.cc:740] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:00.470310  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2242) took 1067 ms. Trace:
W20260709 13:02:00.597962  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 211795us
I20260709 13:02:00.600769  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:00.695924  8456 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:00.599854 11046 log.cc:927] Time spent T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:02:00.520404 10835 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:00.616333  8452 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:02:00.544555  8383 raft_consensus.cc:2393] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 6: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:00.635903  9260 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:00.637313  8500 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:00.534404 11057 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:00.608956 10955 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:00.661288 11051 raft_consensus.cc:697] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:00.663309  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 480) took 1239 ms. Trace:
I20260709 13:02:00.663522  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:00.663650  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:00.537467 11025 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:00.673713  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:00.676748  8530 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:02:00.685313  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 253060us
I20260709 13:02:00.652088 10764 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:00.693449  8459 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:02:00.713546  8526 rpcz_store.cc:276] 0709 13:01:59.423643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.423804 (+   161us) service_pool.cc:224] Handling call
0709 13:01:59.424229 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.254391 (+830162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.254428 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:00.270071 (+ 15643us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.419670 (+149599us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:00.420210 (+   540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.420808 (+   598us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.663080 (+242272us) raft_consensus.cc:1685] finished
0709 13:02:00.663107 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.663253 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":407051,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":11137,"thread_start_us":314717,"threads_started":2,"wal-append.queue_time_us":371130}
I20260709 13:02:00.692842  8460 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
W20260709 13:02:00.691635  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 52911.9us
I20260709 13:02:00.695658  8382 rpcz_store.cc:276] 0709 13:01:59.403083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.403878 (+   795us) service_pool.cc:224] Handling call
0709 13:01:59.404179 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.404402 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:59.800546 (+396144us) log.cc:844] Serialized 14 byte log entry
0709 13:02:00.469833 (+669287us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:00.469884 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:00.469961 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.470058 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.470235 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1056613,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":68,"raft.queue_time_us":18905,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":210,"thread_start_us":1020656,"threads_started":2,"wal-append.queue_time_us":734920}
I20260709 13:02:00.716738  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:00.680622  8535 rpcz_store.cc:276] 0709 13:01:58.706781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.708035 (+  1254us) service_pool.cc:224] Handling call
0709 13:01:58.789597 (+ 81562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:58.948032 (+158435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.948064 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:58.948517 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.370330 (+1421813us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:00.370370 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.370432 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.550607 (+180175us) raft_consensus.cc:1685] finished
0709 13:02:00.550632 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.550772 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2220,"raft.queue_time_us":25953,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":3937,"thread_start_us":1469629,"threads_started":2,"wal-append.queue_time_us":1454977}
I20260709 13:02:00.696907  8501 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:00.702072  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 66266.8us
I20260709 13:02:00.689870 11059 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:00.705710  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:00.628182 10865 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:00.711048 11039 log.cc:927] Time spent T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.696s	user 0.003s	sys 0.012s
I20260709 13:02:00.712400 11037 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:00.719127  9260 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.832s (SENT) [suppressed 33 similar messages]
W20260709 13:02:00.705520  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 68314.9us
I20260709 13:02:00.716316  8453 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:02:00.720715  8383 raft_consensus.cc:2410] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:00.714347 11050 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:00.713195 10835 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:00.727176  8501 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:00.734896  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:00.735750  8500 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:00.736955  8500 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:00.746789  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:00.747234  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:00.747344  8500 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:00.748641  8535 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.720966 11065 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.747531  8383 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:00.750813  8378 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 13:02:00.736549 10764 raft_consensus.cc:697] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:00.729030 10610 consensus_queue.cc:1059] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:02:00.738139 10947 consensus_queue.cc:1059] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.104s
I20260709 13:02:00.880707  8452 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 3. Current term is 4. Ops: []
W20260709 13:02:00.933231  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.756340  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:00.885059  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:01.004810  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 277657us
I20260709 13:02:01.004853  8460 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:02:01.005573  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:01.005887  8378 pending_rounds.cc:85] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 7
I20260709 13:02:01.006222  8378 pending_rounds.cc:107] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:02:01.006253  8383 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 3.
I20260709 13:02:01.006492  8456 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
W20260709 13:02:01.003857  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 256571us
I20260709 13:02:00.873495  8531 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:01.007447  8500 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:00.983883  8386 consensus_meta.cc:287] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.610s	user 0.011s	sys 0.000s
I20260709 13:02:01.008740  8386 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:00.735473 10983 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:01.015681  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:00.743189 11035 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:00.746984 11002 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:01.006620  8378 raft_consensus.cc:2889] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:00.756855  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:01.014622  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:01.016673  8383 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:01.023336  8534 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
W20260709 13:02:01.016927  8386 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 2247) took 1434 ms (client timeout 1877 ms). Trace:
W20260709 13:02:01.023993  8386 rpcz_store.cc:269] 0709 13:01:59.575201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.577357 (+  2156us) service_pool.cc:224] Handling call
0709 13:02:01.009350 (+1431993us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:01.021520  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 249762us
W20260709 13:02:00.752542 11062 log.cc:927] Time spent T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:02:01.025200  8349 leader_election.cc:336] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.521s (SENT)
I20260709 13:02:01.024387  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:01.025666  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:01.025915  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:01.026486  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:01.028456  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2251) took 1451 ms. Trace:
I20260709 13:02:01.028497  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:01.029055  8386 rpcz_store.cc:276] 0709 13:01:59.576619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.027651 (+1451032us) service_pool.cc:224] Handling call
0709 13:02:01.027968 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.028157 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.028180 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.028222 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:01.028259 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.028310 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.028404 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.029569  8456 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:02:01.032611  8386 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:00.741724 11057 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:00.743014 11025 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:01.036988  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 280187us
W20260709 13:02:01.051712  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.754558 11013 raft_consensus.cc:3055] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:00.751950 10755 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:00.885936 11077 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:00.751585 11058 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:00.734817 10995 consensus_queue.cc:260] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:00.751564 10900 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:00.886569 11000 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:00.883387 10826 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.881479 10848 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:00.755059 10845 raft_consensus.cc:3055] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:00.755035 10864 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:00.754442 11005 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:00.919754 10968 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:00.875664 10767 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:00.750579 11085 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:00.824697 10999 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:00.753500 10865 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:01.057610  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 350906us
I20260709 13:02:01.060456  8534 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:01.060545  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:01.054870  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2252) took 1457 ms. Trace:
I20260709 13:02:01.052858  8383 raft_consensus.cc:2410] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:01.101143  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:01.061492  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:01.050076 10947 raft_consensus.cc:3055] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:00.824920 10956 consensus_queue.cc:1059] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.232s
I20260709 13:02:00.749960 11080 consensus_queue.cc:1048] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.307s
I20260709 13:02:00.739988 11051 consensus_queue.cc:237] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:02:01.022370 11035 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:01.050894 10610 raft_consensus.cc:3055] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:01.109761 11038 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:00.750470 11067 consensus_queue.cc:1059] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.422s
I20260709 13:02:00.749483 10639 consensus_queue.cc:237] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:00.826395 11065 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:00.750694 11078 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.395s
I20260709 13:02:01.056131 11013 raft_consensus.cc:740] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:01.114112 11036 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
W20260709 13:02:01.114356  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 106966us
W20260709 13:02:01.125866  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 111483us
I20260709 13:02:01.104192 11002 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.806701 11008 consensus_queue.cc:260] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:01.148773 10610 raft_consensus.cc:740] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:00.762434 11059 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:01.129566  8386 rpcz_store.cc:276] 0709 13:01:59.576893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.030834 (+1453941us) service_pool.cc:224] Handling call
0709 13:02:01.031104 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.033810 (+  2706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.034090 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.131657  8456 raft_consensus.cc:2376] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7. Re-sending same reply.
I20260709 13:02:01.133287  8427 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:01.108426 11058 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:01.139370  8534 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:01.121673 10845 raft_consensus.cc:740] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:01.125098 11034 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:01.126030 11085 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.077404 11091 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:01.164846  8531 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:01.168783  8500 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:01.135232 10947 raft_consensus.cc:740] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:01.177274  8501 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:01.119695 10826 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:01.146912 11086 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.141621 10764 consensus_queue.cc:237] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:01.145920 10999 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:01.148630 11035 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:01.272428  8385 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:02:01.179546  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:01.187685  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:01.249789  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2250) took 1673 ms. Trace:
W20260709 13:02:01.192348  8458 consensus_meta.cc:287] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.000s
I20260709 13:02:01.358518  8456 raft_consensus.cc:2376] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5. Re-sending same reply.
I20260709 13:02:01.358937  8458 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:02:01.308344  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2253) took 1731 ms. Trace:
W20260709 13:02:01.289490  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 159615us
I20260709 13:02:01.360478  8386 rpcz_store.cc:276] 0709 13:01:59.581847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.180032 (+1598185us) service_pool.cc:224] Handling call
0709 13:02:01.307642 (+127610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.307884 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.307922 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.307976 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:01.308031 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.308101 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.308257 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.361953 10408 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:01.362365  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 185133us
W20260709 13:02:01.345584  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 176871us
I20260709 13:02:01.362471 10408 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:01.412755  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:01.413565  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.290508 11009 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:01.293869 11005 raft_consensus.cc:3055] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:02:01.236019 11090 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:02:01.416625  8454 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.000s	sys 0.050s
W20260709 13:02:01.235389 11089 log.cc:927] Time spent T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:02:01.363716  8501 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:01.420815  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.415087  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2254) took 1808 ms. Trace:
I20260709 13:02:01.174860 11008 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:01.439754  8454 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.000s	sys 0.051s
I20260709 13:02:01.465541  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:01.466601  8386 rpcz_store.cc:276] 0709 13:01:59.606942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.413609 (+1806667us) service_pool.cc:224] Handling call
0709 13:02:01.414411 (+   802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.414639 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.414676 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.414735 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:01.414791 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.414875 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.415015 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:01.466354  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.468364  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2255) took 1775 ms. Trace:
W20260709 13:02:01.466954  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 103357us
I20260709 13:02:01.357975  8382 rpcz_store.cc:276] 0709 13:01:59.576314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.728323 (+1152009us) service_pool.cc:224] Handling call
0709 13:02:00.748705 (+ 20382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.748907 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:00.812398 (+ 63491us) log.cc:844] Serialized 14 byte log entry
0709 13:02:01.249308 (+436910us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.249387 (+    79us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:01.249454 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.249546 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.249713 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6166,"prepare.queue_time_us":63050,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":76192,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":7990,"spinlock_wait_cycles":12264704,"thread_start_us":430215,"threads_started":2,"wal-append.queue_time_us":353221}
I20260709 13:02:01.347551 11085 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:01.358237 11097 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:01.468803  8386 rpcz_store.cc:276] 0709 13:01:59.693505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.467588 (+1774083us) service_pool.cc:224] Handling call
0709 13:02:01.467886 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.468064 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.468092 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.468132 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:01.468170 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.468220 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.468315 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.421514 11034 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:01.469165  8501 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:02:01.476858  8535 consensus_meta.cc:287] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.727s	user 0.004s	sys 0.004s
I20260709 13:02:01.364863 11096 consensus_queue.cc:1059] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.122s
I20260709 13:02:01.478874  8535 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:01.479430  8382 raft_consensus.cc:1275] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:01.421712 11005 raft_consensus.cc:740] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:01.480923  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2256) took 1748 ms. Trace:
I20260709 13:02:01.482013  8459 raft_consensus.cc:1240] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:01.482177  8424 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:01.484081  8382 rpcz_store.cc:276] 0709 13:01:59.732996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.470323 (+1737327us) service_pool.cc:224] Handling call
0709 13:02:01.479221 (+  8898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.480707 (+  1486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.480883 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.418521 10864 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:02:01.469820 11091 raft_consensus.cc:697] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:01.359189 11086 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:01.472688 11050 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:01.501744  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:01.504199  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2258) took 1740 ms. Trace:
I20260709 13:02:01.507754  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:01.512147  8533 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:01.511768  8382 rpcz_store.cc:276] 0709 13:01:59.763501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.484853 (+1721352us) service_pool.cc:224] Handling call
0709 13:02:01.503510 (+ 18657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.503756 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.503793 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.503863 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:01.503920 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.503991 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.504122 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.503137  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:01.508149  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2249) took 1932 ms. Trace:
I20260709 13:02:01.514261  8379 rpcz_store.cc:276] 0709 13:01:59.576023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.678751 (+1102728us) service_pool.cc:224] Handling call
0709 13:02:00.679038 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.679283 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.679300 (+    17us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:00.690829 (+ 11529us) log.cc:844] Serialized 26 byte log entry
0709 13:02:01.136385 (+445556us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:01.136433 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.136512 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:01.507914 (+371402us) raft_consensus.cc:1685] finished
0709 13:02:01.507943 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.508090 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"spinlock_wait_cycles":5036800,"thread_start_us":412294,"threads_started":1,"wal-append.queue_time_us":716618}
I20260709 13:02:01.287191 11013 consensus_queue.cc:260] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:01.496335  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:01.478178 11034 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:01.475333 11009 raft_consensus.cc:697] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:01.516438  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:01.235500 10610 consensus_queue.cc:260] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:01.520438  8533 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:01.488525 11000 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:01.521921  8382 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:01.490537 10968 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:01.488233 10865 raft_consensus.cc:3055] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:01.543764  8379 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:01.514358 11057 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:01.525135  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 1872) took 1187 ms. Trace:
I20260709 13:02:01.519573 11099 consensus_queue.cc:1059] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:02:01.523422 11000 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:01.531838  8560 heartbeater.cc:646] Failed to heartbeat to 127.7.25.254:44471 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.7.25.254:44471 timed out after 15.000s (SENT)
I20260709 13:02:01.522333 11034 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:01.532977 10968 raft_consensus.cc:697] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:01.533847  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 481) took 2107 ms. Trace:
I20260709 13:02:01.472576 10845 consensus_queue.cc:260] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:01.539830 11002 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:01.526664 11013 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:01.511441 11050 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:01.546653 10999 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:01.548142  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:01.518720  8458 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:02:01.549399  8382 rpcz_store.cc:276] 0709 13:02:00.337758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.512816 (+1175058us) service_pool.cc:224] Handling call
0709 13:02:01.521766 (+  8950us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.524909 (+  3143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.525065 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.570863  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:01.532442  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:01.571799  8533 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:01.572074  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:01.572911  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:01.573503  8533 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:01.574326  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:01.554971 11000 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:01.575519 11092 log.cc:927] Time spent T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.409s	user 0.000s	sys 0.003s
I20260709 13:02:01.576669  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:01.577541  8526 raft_consensus.cc:2368] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3.
W20260709 13:02:01.525909 10957 consensus_meta.cc:287] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.859s	user 0.004s	sys 0.008s
I20260709 13:02:01.557770  8527 rpcz_store.cc:276] 0709 13:01:59.425997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.879586 (+453589us) service_pool.cc:224] Handling call
0709 13:01:59.885583 (+  5997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.289330 (+403747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.289371 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:00.289439 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:00.289487 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.533602 (+1244115us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b540024c2d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:01.533650 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.533781 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":910743424}
I20260709 13:02:01.543586 10865 raft_consensus.cc:740] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:01.560359 11099 raft_consensus.cc:3055] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:01.556803 11057 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:01.560590 11087 consensus_queue.cc:1059] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:02:01.563133 10968 consensus_queue.cc:237] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:01.563980 11009 consensus_queue.cc:237] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:01.578648  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:01.580022  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:01.581526 10957 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:01.585273  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:01.586072  8459 raft_consensus.cc:2410] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:02:01.586789 10957 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:01.586992 11091 consensus_queue.cc:237] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:01.588071  8526 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:01.586833  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:01.581655 11099 raft_consensus.cc:740] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:01.588922  8459 raft_consensus.cc:2368] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5.
I20260709 13:02:01.589145  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:01.590333  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:01.591092 11086 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:01.591843  8459 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:02:01.592005 11085 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:01.576725 11035 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:01.593467  8459 raft_consensus.cc:1240] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:01.593791  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:01.577898 11050 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:01.614640  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:01.618506  8530 raft_consensus.cc:2376] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3. Re-sending same reply.
I20260709 13:02:01.616809  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 404) took 2710 ms. Trace:
I20260709 13:02:01.614193  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:01.619771  8459 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:01.620385  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:01.619297  8378 rpcz_store.cc:276] 0709 13:01:58.886064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.886230 (+   166us) service_pool.cc:224] Handling call
0709 13:01:58.886553 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.022887 (+2136334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.595907 (+573020us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b54003b5e54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:01.596123 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4286519040}
I20260709 13:02:01.621613  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:01.622200  8530 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:02:01.623447  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:01.623979  8530 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:01.624691  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:01.625689  8528 raft_consensus.cc:2410] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:02:01.625852  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:01.625669  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 95269.7us
I20260709 13:02:01.626638  8527 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:01.627475  8349 leader_election.cc:400] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 2 pre-election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 2. Current term is 3.
I20260709 13:02:01.629346  8455 raft_consensus.cc:1240] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:01.581641 11032 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:01.628683  8349 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:01.593001 11033 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:01.641451  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:01.594241 10865 consensus_queue.cc:260] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:01.642916  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:01.643630  8459 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:01.643848  8527 raft_consensus.cc:2410] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:02:01.645215 11085 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:01.644896  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:01.650383 11035 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:01.655711  8349 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:01.636693 11033 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:01.633610 11032 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:01.660843 11057 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:01.658057 11086 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:01.656260 11034 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:01.679898  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:01.683786  8378 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:01.669512 11033 raft_consensus.cc:697] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:01.686142 10639 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:01.688462  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:01.690884  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:01.691648  8378 raft_consensus.cc:2393] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 4: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:01.692819  8427 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:01.695503 11051 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:01.695966 11051 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.696329 11051 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:01.655961 11099 consensus_queue.cc:260] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:01.698328 10826 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:01.698822 11099 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:01.700464 11098 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.278s	user 0.000s	sys 0.003s
I20260709 13:02:01.701602 11065 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:01.697943 11059 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:01.700143 11050 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:01.720626  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.721490  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.721927  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.724027 10994 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.726801 10994 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:01.707536 11032 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:01.736423 11050 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:01.737300  8526 raft_consensus.cc:2393] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 7: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:01.739158  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:01.739488 10994 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:01.739996  8529 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:02:01.742928  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:01.743867  8529 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:01.744976  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:01.735862 11105 log.cc:927] Time spent T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:01.742516  8349 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:01.750741  8349 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:01.753567  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:01.754570  8529 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:02:01.755726  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:01.756484  8529 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:01.758467  8349 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:01.760674  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 69837.9us
I20260709 13:02:01.763132  8349 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:01.760041 10994 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:01.723315 11000 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:01.765986  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:01.981247  8385 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 1873) took 1643 ms (client timeout 2059 ms). Trace:
I20260709 13:02:01.990914  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:01.802724  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2248) took 2227 ms. Trace:
I20260709 13:02:01.996769  8532 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
W20260709 13:02:01.996995  8385 rpcz_store.cc:269] 0709 13:02:00.338027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.534815 (+196788us) service_pool.cc:224] Handling call
0709 13:02:01.981025 (+1446210us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b54001667d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:01.981175 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1441327360}
I20260709 13:02:01.860478  8454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 425) took 1454 ms. Trace:
I20260709 13:02:01.803305  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:01.759984 11059 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:01.998471  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:01.998972  8454 rpcz_store.cc:276] 0709 13:02:00.406302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.407122 (+   820us) service_pool.cc:224] Handling call
0709 13:02:00.407540 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.706206 (+298666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.706240 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:00.718592 (+ 12352us) log.cc:844] Serialized 26 byte log entry
0709 13:02:01.467106 (+748514us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:01.467159 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.816277 (+349118us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b540040d8d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:01.816352 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:01.816428 (+    76us) raft_consensus.cc:1685] finished
0709 13:02:01.816449 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.860360 (+ 43911us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":857,"raft.queue_time_us":4805,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":171,"spinlock_wait_cycles":684007808,"thread_start_us":746033,"threads_started":1,"wal-append.queue_time_us":770561}
I20260709 13:02:02.001221 11057 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:01.803862 11033 consensus_queue.cc:237] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:02.002378 11057 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:02.004649 11057 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:01.997186  8377 rpcz_store.cc:276] 0709 13:01:59.575706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.289720 (+714014us) service_pool.cc:224] Handling call
0709 13:02:00.305931 (+ 16211us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.674801 (+368870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.674843 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:00.692461 (+ 17618us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.726627 (+ 34166us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:00.726673 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.783370 (+1056697us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b540013d8d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:01.783428 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:01.783488 (+    60us) raft_consensus.cc:1685] finished
0709 13:02:01.783514 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.802627 (+ 19113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":823,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":15987,"spinlock_wait_cycles":847441664,"thread_start_us":12749,"threads_started":1,"wal-append.queue_time_us":104650}
I20260709 13:02:01.991348  8529 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:02.007444  8453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53010 (request call id 445) took 1228 ms. Trace:
W20260709 13:02:01.982024 11111 log.cc:927] Time spent T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.178s	user 0.006s	sys 0.012s
I20260709 13:02:01.761945 11087 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:01.977341 11099 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:01.764824 11065 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:01.766851 10826 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:01.861297 11086 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.019901  8532 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:02.019948  8529 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:02.008673  8453 rpcz_store.cc:276] 0709 13:02:00.771378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.878686 (+107308us) service_pool.cc:224] Handling call
0709 13:02:01.803117 (+924431us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b5800110a98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd44b0a0 00007f36cd44a984 00007f36c69c56d4 00007f36c69c5662
0709 13:02:01.999439 (+196322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6798080}
I20260709 13:02:02.000396 11059 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:02.029309  8377 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:02.029959  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:02.024758 11065 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:02.031692  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:02.030740  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:02.019923 11087 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:02.038087  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:02.028577 11059 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:02.027423 10826 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.041656  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:02.006795 10994 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:02.035099 11065 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:02.042330  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 407) took 1311 ms. Trace:
I20260709 13:02:02.039561 11087 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:02.030646 11086 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:02.026688 11099 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:02.052088  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:02.058358  8532 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:02.058432 11012 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:02.058794  9296 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:02.059259  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:02.054324  8382 rpcz_store.cc:276] 0709 13:02:00.731238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.571113 (+839875us) service_pool.cc:224] Handling call
0709 13:02:01.578423 (+  7310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:01.578768 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.578786 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:01.587697 (+  8911us) log.cc:844] Serialized 26 byte log entry
0709 13:02:01.707518 (+119821us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b18002b0240. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c80250d1 00007f36c8440a0f
0709 13:02:01.745513 (+ 37995us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:01.745574 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.745672 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:02.040512 (+294840us) raft_consensus.cc:1685] finished
0709 13:02:02.040527 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.042268 (+  1741us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":3321,"spinlock_wait_cycles":3744000,"thread_start_us":37661,"threads_started":1,"wal-append.queue_time_us":215861}
I20260709 13:02:02.059837  8532 raft_consensus.cc:2376] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7. Re-sending same reply.
I20260709 13:02:02.042975 10826 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:02.059028 11012 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:02.063037  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:02.063273  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:02.063839  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47306 (request call id 493) took 1058 ms. Trace:
I20260709 13:02:02.064200  8532 rpcz_store.cc:276] 0709 13:02:01.005451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.062791 (+1057340us) service_pool.cc:224] Handling call
0709 13:02:02.063782 (+   991us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.070812  9290 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:02.041263 11051 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:02.073755 10994 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:02.074024 11051 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:02.056661 10845 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:02.075210  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:02.079147  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:02.081624  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47306 (request call id 494) took 1049 ms. Trace:
I20260709 13:02:02.083628  8532 rpcz_store.cc:276] 0709 13:02:01.032096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.078797 (+1046701us) service_pool.cc:224] Handling call
0709 13:02:02.081544 (+  2747us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.085676  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:02.086751  8532 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:02.087870  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:02.088770  9287 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:02.089254  9288 raft_consensus.cc:2393] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 9: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:02.082966 10994 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:02.094786  8531 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38894 (request call id 1932) took 1439 ms (client timeout 1671 ms). Trace:
W20260709 13:02:02.095405  8531 rpcz_store.cc:269] 0709 13:02:00.655727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.663267 (+  7540us) service_pool.cc:224] Handling call
0709 13:02:02.094587 (+1431320us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540024c554. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:02.094704 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364710144}
I20260709 13:02:02.096164  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:02.096545  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:02.097405  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:02.097977  8535 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:02:02.098233  8531 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:02:02.098453  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47306 (request call id 489) took 1234 ms. Trace:
I20260709 13:02:02.098754  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38894 (request call id 1946) took 1397 ms. Trace:
I20260709 13:02:02.099354  8531 rpcz_store.cc:276] 0709 13:02:00.701675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.096312 (+1394637us) service_pool.cc:224] Handling call
0709 13:02:02.098704 (+  2392us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.101493  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:02.102005 11012 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:02.102890  8531 raft_consensus.cc:2410] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:02.103868  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:02.104405  8531 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:02.105466  8531 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:02.106004  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1934) took 1449 ms. Trace:
I20260709 13:02:02.106305  8531 rpcz_store.cc:276] 0709 13:02:00.656258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.104982 (+1448724us) service_pool.cc:224] Handling call
0709 13:02:02.105298 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.105787 (+   489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.105957 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.107399  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:02.107515 10955 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:02.111210  8533 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:02.112020  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1937) took 1455 ms. Trace:
I20260709 13:02:02.112386  8533 rpcz_store.cc:276] 0709 13:02:00.656987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.110595 (+1453608us) service_pool.cc:224] Handling call
0709 13:02:02.110875 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.111662 (+   787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.111949 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.129999 10865 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:02.132922  8452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 428) took 1711 ms. Trace:
I20260709 13:02:02.133466  8452 rpcz_store.cc:276] 0709 13:02:00.421443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.708082 (+286639us) service_pool.cc:224] Handling call
0709 13:02:00.880464 (+172382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.003378 (+122914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.132604 (+1129226us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b540019dcd0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:02.132782 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":395453696}
I20260709 13:02:02.136196  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1938) took 1479 ms. Trace:
W20260709 13:02:02.136657  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.137315  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.114651  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:02.116953 11113 log.cc:927] Time spent T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:02:02.140203  9288 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 5: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:02.122560  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:02.142558 11005 consensus_queue.cc:260] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:02.144094 11005 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:02.146457 11034 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:02.149688  8380 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48484 (request call id 409) took 1417 ms (client timeout 1867 ms). Trace:
I20260709 13:02:02.136659  8533 rpcz_store.cc:276] 0709 13:02:00.657231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.127989 (+1470758us) service_pool.cc:224] Handling call
0709 13:02:02.135634 (+  7645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.135847 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.135872 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.135914 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:02.135949 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.136015 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.136139 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.152329  8533 raft_consensus.cc:1275] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:02:02.150334  8380 rpcz_store.cc:269] 0709 13:02:00.731862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.881780 (+149918us) service_pool.cc:224] Handling call
0709 13:02:01.502987 (+621207us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b5800151e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd44b0a0 00007f36cd44a984 00007f36c69c56d4 00007f36c69c5662
0709 13:02:02.149432 (+646445us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400269b54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:02.149607 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329748480}
I20260709 13:02:02.126684 11000 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:02.098796  8535 rpcz_store.cc:276] 0709 13:02:00.864327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.097173 (+1232846us) service_pool.cc:224] Handling call
0709 13:02:02.098400 (+  1227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.139278  8349 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:02.152907  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1941) took 1494 ms. Trace:
W20260709 13:02:02.168093  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.182897  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 43724.6us
I20260709 13:02:02.182529  8533 rpcz_store.cc:276] 0709 13:02:00.658018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.151693 (+1493675us) service_pool.cc:224] Handling call
0709 13:02:02.151998 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.152647 (+   649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.152857 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.183948  8349 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:02.095405 11099 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:02.201066 11091 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:02.107556  8531 raft_consensus.cc:1275] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:02.201632 11091 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:02.210098 11099 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:02.210307 11091 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:02.207286  8457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 426) took 1799 ms. Trace:
I20260709 13:02:02.211120  8457 rpcz_store.cc:276] 0709 13:02:00.408011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.425995 (+ 17984us) service_pool.cc:224] Handling call
0709 13:02:00.426256 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.560475 (+134219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.560520 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:00.560580 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:00.560640 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.206975 (+1646335us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54000d34d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:02.207046 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.207207 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308067712}
I20260709 13:02:02.215665  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2259) took 1598 ms. Trace:
I20260709 13:02:02.216279  8379 rpcz_store.cc:276] 0709 13:02:00.617526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.520471 (+902945us) service_pool.cc:224] Handling call
0709 13:02:01.520730 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.544212 (+ 23482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.215319 (+671107us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b54002c8154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:02.215582 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52245248}
I20260709 13:02:02.224053  8384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2239) took 2830 ms. Trace:
I20260709 13:02:02.210958 11099 raft_consensus.cc:697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:02.230885 10770 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:02.231586  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1947) took 1520 ms. Trace:
I20260709 13:02:02.232065  8535 rpcz_store.cc:276] 0709 13:02:00.711243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.197629 (+1486386us) service_pool.cc:224] Handling call
0709 13:02:02.231037 (+ 33408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.231212 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.231234 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.231274 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:02.231310 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.231373 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.231473 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.224640  8384 rpcz_store.cc:276] 0709 13:01:59.393900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.400263 (+  6363us) service_pool.cc:224] Handling call
0709 13:01:59.430504 (+ 30241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.411201 (+980697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.411243 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:00.411295 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:00.411352 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.223692 (+1812340us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b5400351454. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:02.223764 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.223975 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2254726912}
I20260709 13:02:02.231248 11099 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:02.244983  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.247660  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.250507 11086 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:02.247723  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1935) took 1547 ms. Trace:
I20260709 13:02:02.252923  8531 rpcz_store.cc:276] 0709 13:02:00.656531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.106988 (+1450457us) service_pool.cc:224] Handling call
0709 13:02:02.107269 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.203806 (+ 96537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.204086 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.244668  9258 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:02.265367  8530 raft_consensus.cc:2368] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5.
I20260709 13:02:02.266029 10408 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:02.267154  8532 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:02.269742  8381 consensus_queue.cc:260] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:02.281529  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.094684 10994 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:02.247691 10610 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:02.295717  9261 connection.cc:256] RPC call timeout handler was delayed by -1.5468578100000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
W20260709 13:02:02.297062  9261 leader_election.cc:336] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.946s (SENT)
I20260709 13:02:02.298840  8381 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:02.299448  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:02.300151  8531 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:02:02.273731 10995 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:02.305460  9261 connection.cc:256] RPC call timeout handler was delayed by -1.3952280350000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
W20260709 13:02:02.305971  9261 connection.cc:256] RPC call timeout handler was delayed by -1.2629280350000158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 13:02:02.306303  9261 connection.cc:256] RPC call timeout handler was delayed by -1.1936280350000175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
W20260709 13:02:02.306686  9261 connection.cc:256] RPC call timeout handler was delayed by -1.0559280350000222s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.202s for a response
I20260709 13:02:02.309505  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:02.318089 10947 consensus_queue.cc:260] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:02.321421  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 487) took 1496 ms. Trace:
I20260709 13:02:02.321858  8529 rpcz_store.cc:276] 0709 13:02:00.825478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.320387 (+1494909us) service_pool.cc:224] Handling call
0709 13:02:02.320720 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.320931 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.320959 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.320995 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:02.321023 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.321244 (+   221us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.321361 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.323335  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:02.323995  8531 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:02.327255  9296 raft_consensus.cc:1240] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:02.329530  9296 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:02:02.330510  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 146667us
I20260709 13:02:02.335952  8349 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:02.300034 10996 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.338809  8349 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:02.304814 11012 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:02.280360 10968 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:02:02.271250 11037 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 13:02:02.342970  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 126503us
I20260709 13:02:02.347954  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:02.343271  8529 raft_consensus.cc:1240] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:02.350857  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 488) took 1507 ms. Trace:
I20260709 13:02:02.351307  8529 rpcz_store.cc:276] 0709 13:02:00.843319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.325743 (+1482424us) service_pool.cc:224] Handling call
0709 13:02:02.343051 (+ 17308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.350539 (+  7488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.350789 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.306020 10997 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.346004  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:02.357717 10971 consensus_queue.cc:1059] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:02.359344 10971 raft_consensus.cc:3055] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:02.357749  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 492) took 1362 ms. Trace:
I20260709 13:02:02.360646  8532 rpcz_store.cc:276] 0709 13:02:00.995825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.356832 (+1361007us) service_pool.cc:224] Handling call
0709 13:02:02.357181 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.357392 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.357418 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.357458 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:02.357499 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.357568 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.357692 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.338338 11086 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:02.360664  9258 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:02.366789  9261 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:02.345783  8349 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:02.368383  9261 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:02.369374 10877 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:02.371181 10877 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:02.372015 10877 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:02.372432 10877 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:02.377130 10877 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:02.375643 11085 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:02.366828 10997 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:02.344971 11038 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:02.344615 11012 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.379065  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:02.345402  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:02.424157  8528 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:02.424881  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1953) took 1370 ms. Trace:
I20260709 13:02:02.425233  8528 rpcz_store.cc:276] 0709 13:02:01.054528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.423591 (+1369063us) service_pool.cc:224] Handling call
0709 13:02:02.423921 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.424635 (+   714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.424829 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.382484  8529 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:02.393038  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:02.364480  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:02.359706 10971 raft_consensus.cc:740] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:02.457983  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 495) took 1298 ms. Trace:
I20260709 13:02:02.458426  8530 rpcz_store.cc:276] 0709 13:02:01.159401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.457196 (+1297795us) service_pool.cc:224] Handling call
0709 13:02:02.457511 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.457681 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.457703 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.457740 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:02.457771 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.457822 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.457925 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.460788  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1955) took 1301 ms. Trace:
I20260709 13:02:02.461737  8530 rpcz_store.cc:276] 0709 13:02:01.159927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.460028 (+1300101us) service_pool.cc:224] Handling call
0709 13:02:02.460302 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.460469 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.460493 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.460531 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:02.460566 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.460615 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.460736 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:02.404415  8283 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53494 (request call id 325) took 17454 ms (client timeout 15000 ms). Trace:
I20260709 13:02:02.426724  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1954) took 1366 ms. Trace:
I20260709 13:02:02.466887  8528 rpcz_store.cc:276] 0709 13:02:01.060745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.425965 (+1365220us) service_pool.cc:224] Handling call
0709 13:02:02.426238 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.426426 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.426451 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.426492 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:02.426530 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.426580 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.426676 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.469101  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 496) took 1292 ms. Trace:
I20260709 13:02:02.430657  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:02.434967 10408 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.443524  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 486) took 1677 ms. Trace:
I20260709 13:02:02.345943 10996 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:02.472029  8535 rpcz_store.cc:276] 0709 13:02:00.765765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.233413 (+1467648us) service_pool.cc:224] Handling call
0709 13:02:02.240719 (+  7306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.306112 (+ 65393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.306146 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.306206 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:02.306253 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.443175 (+136922us) spinlock_profiling.cc:243] Waited 65.1 ms on lock 0x7b54002aeed4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:02.443249 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.443446 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149843840}
I20260709 13:02:02.452593  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 491) took 1475 ms. Trace:
I20260709 13:02:02.483434  9293 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:02.483210  8529 rpcz_store.cc:276] 0709 13:02:00.977571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.352236 (+1374665us) service_pool.cc:224] Handling call
0709 13:02:02.382312 (+ 30076us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.426359 (+ 44047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.452507 (+ 26148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.469537  8528 rpcz_store.cc:276] 0709 13:02:01.177049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.468181 (+1291132us) service_pool.cc:224] Handling call
0709 13:02:02.468481 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.468691 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.468728 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.468781 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:02.468829 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.468892 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.469021 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.474270 10408 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:02.464571  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1956) took 1290 ms. Trace:
I20260709 13:02:02.472827  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:02:02.476404  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 101342us
I20260709 13:02:02.389887 10952 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:02.487301  8530 rpcz_store.cc:276] 0709 13:02:01.174689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.463281 (+1288592us) service_pool.cc:224] Handling call
0709 13:02:02.463624 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.464157 (+   533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.464195 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.464252 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:02.464305 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.464377 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.464507 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.395516 11038 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:02.426000 11012 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:02.441987 10770 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:02.501601  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 111720us
I20260709 13:02:02.503203  8424 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:02.504133  8534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38894 (request call id 1936) took 1847 ms (client timeout 1877 ms). Trace:
I20260709 13:02:02.504297  8424 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:02.504670  8534 rpcz_store.cc:269] 0709 13:02:00.656762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.024140 (+367378us) service_pool.cc:224] Handling call
0709 13:02:02.503987 (+1479847us) spinlock_profiling.cc:243] Waited 34.4 ms on lock 0x7b54002baa54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:02.504081 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79155072}
I20260709 13:02:02.505661  8424 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
W20260709 13:02:02.466810  8283 rpcz_store.cc:269] 0709 13:01:44.949600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.949892 (+   292us) service_pool.cc:224] Handling call
0709 13:02:02.404298 (+17454406us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:57.290993 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:57.963039 (+672046us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:57.999702 (+ 36663us) write_op.cc:435] Acquired schema lock
0709 13:01:58.005918 (+  6216us) tablet.cc:662] Decoding operations
0709 13:01:58.020578 (+ 14660us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:58.020657 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:58.020686 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:01:58.020964 (+   278us) tablet.cc:701] Row locks acquired
0709 13:01:58.021013 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:01:58.021206 (+   193us) write_op.cc:270] Start()
0709 13:01:58.021373 (+   167us) write_op.cc:276] Timestamp: P: 1783602118021139 usec, L: 0
0709 13:01:58.021399 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:01:58.022429 (+  1030us) log.cc:844] Serialized 538 byte log entry
0709 13:02:00.460375 (+2437946us) op_driver.cc:464] REPLICATION: finished
0709 13:02:00.825015 (+364640us) write_op.cc:301] APPLY: starting
0709 13:02:00.863201 (+ 38186us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:00.971467 (+108266us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:01.021424 (+ 49957us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:01.102041 (+ 80617us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:01.122152 (+ 20111us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:02:01.128691 (+  6539us) write_op.cc:312] APPLY: finished
0709 13:02:01.152433 (+ 23742us) log.cc:844] Serialized 23 byte log entry
0709 13:02:01.170187 (+ 17754us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:01.170272 (+    85us) write_op.cc:454] Released schema lock
0709 13:02:01.170309 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:01.244414 (+ 74105us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b180021e080. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c802d4bc 00007f36c537b48b 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5395455 00007f36c8402190 00007f36c83fbae7 00007f36c83fadd9
0709 13:02:01.415836 (+171422us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:01.418446 (+  2610us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":392381,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":267490,"apply.run_cpu_time_us":25344,"apply.run_wall_time_us":593272,"num_ops":1,"prepare.queue_time_us":603225,"prepare.run_cpu_time_us":29240,"prepare.run_wall_time_us":1297295,"raft.queue_time_us":1419394,"raft.run_cpu_time_us":38342,"raft.run_wall_time_us":280734,"replication_time_us":2415583,"spinlock_wait_cycles":10702976,"thread_start_us":2476923,"threads_started":4,"wal-append.queue_time_us":583510,"wal-append.run_cpu_time_us":74930,"wal-append.run_wall_time_us":3685185}]]}
I20260709 13:02:02.452291 11086 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:02:02.491403 11089 log.cc:927] Time spent T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:02:02.511905  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:02.493508  9290 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:02:02.535742  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 189987us
W20260709 13:02:02.579859  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 74301.9us
I20260709 13:02:02.580447  8349 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:02.537588  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 50201.6us
I20260709 13:02:02.536041  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:02.582056  8383 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:02:02.502313 11038 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:02.592319  8530 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:02.593945  8534 raft_consensus.cc:1240] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:02.594604  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 68777.7us
I20260709 13:02:02.601815  8535 raft_consensus.cc:1240] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:02.518677 10639 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:02.525372 10952 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:02.577382 11085 raft_consensus.cc:697] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:02:02.630813  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.620069 11059 consensus_meta.cc:287] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.564s	user 0.012s	sys 0.002s
I20260709 13:02:02.590190 10993 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:02.525520 10770 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:02.619361 11088 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:02.636821  8427 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:02.649451  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 281082us
I20260709 13:02:02.624614 10639 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:02.631814 10952 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:02.650992  8424 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:02.705206 10639 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:02.706110  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 55203.4us
I20260709 13:02:02.707373  8424 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:02.696321  8384 raft_consensus.cc:1275] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:02.708253 11037 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:02.711642 11037 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:02.659009  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:02:02.698273  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 61531us
I20260709 13:02:02.698935 10408 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:02.702219  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 190414us
W20260709 13:02:02.702695  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 173996us
I20260709 13:02:02.716583 11037 consensus_queue.cc:1048] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:02.707993 11127 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:02.718498  8351 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:02.705348 10952 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:02.720201  8351 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:02.714408 11045 raft_consensus.cc:2764] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:02:02.717391 10408 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.726691 10408 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.708734  8424 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:02.735946  8383 raft_consensus.cc:3055] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:02.736407  8383 raft_consensus.cc:740] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:02.642644 11050 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:02.736334 11117 log.cc:927] Time spent T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.371s	user 0.001s	sys 0.000s
I20260709 13:02:02.656704 11088 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:02.736022 11120 log.cc:927] Time spent T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:02:02.698179 11055 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.756672  8424 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:02.758399 10955 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:02.759317 10996 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:02.631589 10971 consensus_queue.cc:260] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:02.781364  8383 consensus_queue.cc:260] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:02.782039 10408 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:02.782050  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2273) took 1073 ms. Trace:
I20260709 13:02:02.743357 10994 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:02.749047 11131 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:02.656919 10993 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:02.788676  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2269) took 1107 ms. Trace:
I20260709 13:02:02.765368 11139 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:02.647387 11059 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:02.775671  8381 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:02.814658  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2240) took 3414 ms. Trace:
I20260709 13:02:02.779496 11051 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:02.774912 11055 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:02:02.782351  8383 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:02.759703 10770 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:02.782905  8382 rpcz_store.cc:276] 0709 13:02:01.708441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.060327 (+351886us) service_pool.cc:224] Handling call
0709 13:02:02.076801 (+ 16474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.077060 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.077137 (+    77us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.082651 (+  5514us) log.cc:844] Serialized 26 byte log entry
0709 13:02:02.366193 (+283542us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:02.366235 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.366312 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:02.781814 (+415502us) raft_consensus.cc:1685] finished
0709 13:02:02.781837 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.781979 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":2287,"thread_start_us":232905,"threads_started":1,"wal-append.queue_time_us":402344}
W20260709 13:02:02.783295 11116 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.393s	user 0.000s	sys 0.001s
I20260709 13:02:02.752686 11088 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:02.794409 10877 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:02.802009 11126 log.cc:927] Time spent T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:02:02.805168  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1952) took 1753 ms. Trace:
I20260709 13:02:02.828526  8526 rpcz_store.cc:276] 0709 13:02:01.051990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.412808 (+1360818us) service_pool.cc:224] Handling call
0709 13:02:02.413169 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.413566 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.413594 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.414076 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:02:02.502441 (+ 88365us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:02.502483 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.502558 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:02.804878 (+302320us) raft_consensus.cc:1685] finished
0709 13:02:02.804903 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.805099 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3219,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":87999,"threads_started":1,"wal-append.queue_time_us":338324}
W20260709 13:02:02.807545 10610 consensus_meta.cc:287] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.509s	user 0.018s	sys 0.010s
W20260709 13:02:02.809468  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 88486.2us
W20260709 13:02:02.811141  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.836930  8383 raft_consensus.cc:1275] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:02.815135  8381 rpcz_store.cc:276] 0709 13:01:59.400740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.421868 (+ 21128us) service_pool.cc:224] Handling call
0709 13:01:59.440837 (+ 18969us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.875785 (+1434948us) spinlock_profiling.cc:243] Waited 9.24 ms on lock 0x7b5400035d20. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c840306f 00007f36c847bf60 00007f36c847d7de 00007f36c8487b49 00007f36c8488416 00007f36c8484d8f 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62
0709 13:02:02.114395 (+1238610us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b5400035d20. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8402520 00007f36c847bf70 00007f36c847d7de 00007f36c8487b49 00007f36c8488416 00007f36c8484d8f 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62
0709 13:02:02.814276 (+699881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.814576 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147153024}
I20260709 13:02:02.759325 10997 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:02.818308 11051 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:02.789283  8385 rpcz_store.cc:276] 0709 13:02:01.680755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.008148 (+327393us) service_pool.cc:224] Handling call
0709 13:02:02.026348 (+ 18200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.075771 (+ 49423us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:02.363060 (+287289us) log.cc:844] Serialized 14 byte log entry
0709 13:02:02.517140 (+154080us) spinlock_profiling.cc:243] Waited 971 us on lock 0x7b1800045940. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c802d4bc 00007f36c537b48b 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c802523a
0709 13:02:02.703159 (+186019us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.703214 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:02.703270 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.788387 (+ 85117us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b5400351954. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:02.788451 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.788606 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20595,"prepare.queue_time_us":318797,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":142304,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":39322,"spinlock_wait_cycles":102522880,"thread_start_us":477151,"threads_started":3,"wal-append.queue_time_us":133527}
I20260709 13:02:02.817574 10996 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:02.824746 10408 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:02.747004 11050 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:02.838512  8378 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:02.817432  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.741050 11135 consensus_queue.cc:1059] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:02:02.853288  9260 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:02.855396  9260 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:02.856926  9260 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:02.858148  9260 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:02.862695  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 203760us
I20260709 13:02:02.864499  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:02.864804  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:02.865315  9290 raft_consensus.cc:2368] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7.
I20260709 13:02:02.865855  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:02.866376  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:02.867018  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:02.867990  9295 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 5: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:02.869392  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:02.870347  9292 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:02:02.865257  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:02.872102  9293 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
W20260709 13:02:02.875308  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 155153us
I20260709 13:02:02.876418  8351 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:02.827929 11131 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:02.826066 11139 raft_consensus.cc:697] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:02.769752 11085 consensus_queue.cc:237] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:02.896332  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:02.824378 11045 consensus_queue.cc:1059] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:02:02.898470  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2272) took 1208 ms. Trace:
I20260709 13:02:02.850188 11051 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:02.850907 10996 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:02.827734 10770 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:02:02.907331  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 490) took 1934 ms. Trace:
W20260709 13:02:02.889322 11087 consensus_meta.cc:287] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.822s	user 0.018s	sys 0.019s
W20260709 13:02:02.911572  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 330272us
I20260709 13:02:02.903942  8377 rpcz_store.cc:276] 0709 13:02:01.690558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.038636 (+348078us) service_pool.cc:224] Handling call
0709 13:02:02.049456 (+ 10820us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.049926 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.049968 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.054542 (+  4574us) log.cc:844] Serialized 26 byte log entry
0709 13:02:02.164562 (+110020us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:02.164621 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.164724 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:02.898217 (+733493us) raft_consensus.cc:1685] finished
0709 13:02:02.898240 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.898393 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":112,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":2044,"thread_start_us":83958,"threads_started":1,"wal-append.queue_time_us":245324}
I20260709 13:02:02.913908  8531 rpcz_store.cc:276] 0709 13:02:00.972815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.342580 (+1369765us) service_pool.cc:224] Handling call
0709 13:02:02.360671 (+ 18091us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.361050 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.361103 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.379310 (+ 18207us) log.cc:844] Serialized 26 byte log entry
0709 13:02:02.713415 (+334105us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:02.713456 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.713531 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:02.907145 (+193614us) raft_consensus.cc:1685] finished
0709 13:02:02.907161 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.907276 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":851,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":16102,"thread_start_us":271196,"threads_started":1,"wal-append.queue_time_us":416367}
I20260709 13:02:02.817061  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45d39340781e466abc648aacd7ee5822"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:02.894932 11137 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.922519 11086 raft_consensus.cc:697] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:02.923259  8458 raft_consensus.cc:1240] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:02.923544 11086 consensus_queue.cc:237] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:02.924294  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:02.927053  8453 raft_consensus.cc:1240] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:02.913300 10996 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:02.921366  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.911485 11131 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:02.930506 11143 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:02.935115  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 353052us
W20260709 13:02:02.935662  8532 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.000s	sys 0.009s
I20260709 13:02:02.934340  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:02.936085  8532 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.000s	sys 0.009s
I20260709 13:02:02.920135  8349 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:02.943841  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:02.932422  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 150794us
I20260709 13:02:02.943310  8500 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:02.947968 10408 consensus_queue.cc:1048] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:02.950655  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:02.921897 10997 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:02.951431  8460 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:02.910334 10952 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:02.960561 10408 consensus_queue.cc:1048] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:02.973143  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:02.974081  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 54029.9us
I20260709 13:02:02.947072 10955 raft_consensus.cc:697] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:02.934067 11129 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:02.926043 11145 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:02.982440  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 56379.9us
I20260709 13:02:02.974877  8349 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:02.976871  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:02.942041 11091 consensus_meta.cc:287] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.727s	user 0.010s	sys 0.021s
I20260709 13:02:02.920333 11087 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:02.987052  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:02.937273  8271 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 56cc480ba6f642e08bb2e547a0ef50a1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d653e71832b7402b9a03b46249d3b885 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:02.995924  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:02.997136  8454 raft_consensus.cc:1240] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:02:02.997903  8349 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:03.003684  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:03.005137  8456 raft_consensus.cc:2410] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:02:02.991144 10845 consensus_meta.cc:287] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.906s	user 0.037s	sys 0.000s
I20260709 13:02:03.018210  8349 leader_election.cc:400] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5.
I20260709 13:02:02.984615 11145 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.023121  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:03.032749  8386 raft_consensus.cc:1275] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:02.929682 11137 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:03.046451  8458 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:03.048914  8460 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:03.046731  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:03.050186  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 90918.4us
I20260709 13:02:03.046449 11059 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:03.008050 11099 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:02.974640 11144 consensus_queue.cc:1059] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:02:03.068879  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:03.071592  8460 raft_consensus.cc:2393] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 6: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:03.012451 10993 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:02.999579 11153 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:02.990013 11091 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:03.012985  8271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 78899us
I20260709 13:02:03.052572 10845 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.033831 11145 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:03.075219  9260 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:03.048058 11121 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:03.086665  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:03.046705 10955 consensus_queue.cc:237] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:03.066874 11131 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:02.983566 11139 consensus_queue.cc:237] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:03.067153 11055 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:03.090958  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:03.091904  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2257) took 3352 ms. Trace:
I20260709 13:02:03.103821  8386 rpcz_store.cc:276] 0709 13:01:59.739886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.475249 (+1735363us) service_pool.cc:224] Handling call
0709 13:02:01.478708 (+  3459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.033255 (+1554547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.091685 (+ 58430us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400352354. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:03.091847 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3573193088}
I20260709 13:02:03.093992  8381 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:03.101670  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1950) took 2068 ms. Trace:
I20260709 13:02:03.072918 11099 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:03.075358 11153 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:03.111261  8386 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:03.106377  8532 rpcz_store.cc:276] 0709 13:02:01.033582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.362153 (+1328571us) service_pool.cc:224] Handling call
0709 13:02:02.362534 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.362799 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:02.936570 (+573771us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.101299 (+164729us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.101353 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:03.101408 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.101475 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.101604 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":710582,"threads_started":3,"wal-append.queue_time_us":149033}
I20260709 13:02:03.075690 10877 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:03.093111 10826 consensus_meta.cc:287] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.023s	user 0.017s	sys 0.017s
I20260709 13:02:03.136138  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:03.140763  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 68393.3us
W20260709 13:02:03.143682  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.152086  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:03.153936  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:03.156739  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:03.087073 11059 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:02:03.106925 11050 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:03.129012 11055 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:03.168841  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:03.170908  8456 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:02:03.086567 10993 consensus_queue.cc:1059] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:02:03.128619 11099 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:03.128746 11153 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:03.089425 10845 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:03.161947 11065 consensus_meta.cc:287] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.109s	user 0.021s	sys 0.008s
I20260709 13:02:03.186625  8460 raft_consensus.cc:1240] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:03.188876 11137 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:03.193606 11150 log.cc:927] Time spent T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
W20260709 13:02:03.195251 11162 log.cc:927] Time spent T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:02:03.197321 11141 log.cc:927] Time spent T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:02:03.199769 10877 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:03.199535 10639 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:03.105822 11131 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:03.207058 11131 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:03.207945 10865 consensus_meta.cc:287] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 1.077s	user 0.004s	sys 0.015s
I20260709 13:02:03.211622  8527 raft_consensus.cc:2410] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:03.212236 11091 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:03.213384  8459 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 3. Current term is 5. Ops: [3.2-3.2]
I20260709 13:02:03.213759  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:03.215008  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:03.216157  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:03.217284 11091 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.140368 11129 raft_consensus.cc:697] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:02:03.208464 10995 consensus_meta.cc:287] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.883s	user 0.013s	sys 0.008s
I20260709 13:02:03.208847 10952 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:03.209359  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:03.149070 10826 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:03.231274  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:03.232156  8456 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:03.226800  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:03.235833  8380 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 13:02:03.236573  8380 pending_rounds.cc:85] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 3
I20260709 13:02:03.236970  8380 pending_rounds.cc:107] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 13:02:03.237329  8380 raft_consensus.cc:2917] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 13:02:03.241477  8380 raft_consensus.cc:2889] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:03.243297  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:03.244069  8453 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
W20260709 13:02:03.238683  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 291852us
I20260709 13:02:03.257748  8460 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:03.217566 10994 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:03.280088  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 336840us
W20260709 13:02:03.280681  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 230688us
W20260709 13:02:03.281757  8501 leader_election.cc:336] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.584s (SENT)
I20260709 13:02:03.282174  8501 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:03.294394  8532 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:03.296051  8532 raft_consensus.cc:1240] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:03.248226 10995 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.243948 11059 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:03.334605  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 53644.8us
W20260709 13:02:03.334906  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 53186us
I20260709 13:02:03.336850  8526 raft_consensus.cc:1275] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:03.337190  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:03.338210  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:03.338789  8531 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:03.222688 11065 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:03.238138 11091 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:03.340296  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:03.354350  8460 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
W20260709 13:02:03.332717 11012 consensus_meta.cc:287] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.806s	user 0.011s	sys 0.000s
I20260709 13:02:03.500501 11012 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:03.504143  9294 raft_consensus.cc:2368] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8.
I20260709 13:02:03.505630  9294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 430) took 1148 ms. Trace:
I20260709 13:02:03.506086  9294 rpcz_store.cc:276] 0709 13:02:02.357017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.379525 (+ 22508us) service_pool.cc:224] Handling call
0709 13:02:03.505327 (+1125802us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54004ea7d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:03.505541 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2476964736}
W20260709 13:02:03.507373  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:03.513622  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.363749  8456 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:02:03.369020 11158 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.343729 10865 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:03.333992 10995 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:03.345863 10993 consensus_queue.cc:1059] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:02:03.373826  8529 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:03.375360  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:03.572194  8526 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:02:03.313714 11159 raft_consensus.cc:3055] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:03.417943  8534 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:03.369197 11129 consensus_queue.cc:237] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:03.418648  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 73876.4us
I20260709 13:02:03.284909 10994 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:03.419713 11165 consensus_queue.cc:1059] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:02:03.419925  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 44030.1us
I20260709 13:02:03.420482 11155 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.420945 10770 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:03.298951 11087 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:03.421768 11132 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:03.424330  8426 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:03.431624 11135 raft_consensus.cc:3055] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:03.439221  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2275) took 1701 ms. Trace:
I20260709 13:02:03.617334  8378 rpcz_store.cc:276] 0709 13:02:01.737433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.141044 (+403611us) service_pool.cc:224] Handling call
0709 13:02:02.141446 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.851399 (+709953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.438859 (+587460us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b54003b7c54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:03.439129 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1602614016}
I20260709 13:02:03.445318 10997 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:02:03.418733  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.451471 11037 raft_consensus.cc:3055] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:03.462361  8458 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:03.463706  8453 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:03.464706  8459 raft_consensus.cc:1240] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:03.470162  8527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 1943) took 1955 ms (client timeout 2056 ms). Trace:
W20260709 13:02:03.631096  8527 rpcz_store.cc:269] 0709 13:02:01.515045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.644638 (+129593us) service_pool.cc:224] Handling call
0709 13:02:03.469922 (+1825284us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b5400097254. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:03.470097 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3599975168}
I20260709 13:02:03.471185  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2281) took 1041 ms. Trace:
I20260709 13:02:03.474218  8281 catalog_manager.cc:5697] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:03.495255  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1942) took 2821 ms. Trace:
I20260709 13:02:03.634137  8281 catalog_manager.cc:5697] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 4 to 6, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 6 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:03.633471  8533 rpcz_store.cc:276] 0709 13:02:00.673864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.186277 (+1512413us) service_pool.cc:224] Handling call
0709 13:02:02.461142 (+274865us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.490726 (+ 29584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.490757 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.499574 (+  8817us) log.cc:844] Serialized 26 byte log entry
0709 13:02:02.832103 (+332529us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:02.832659 (+   556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.832755 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:03.201170 (+368415us) raft_consensus.cc:1685] finished
0709 13:02:03.201199 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.494886 (+293687us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54002ad5d0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:03.495170 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12045,"raft.queue_time_us":12351,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":11683,"spinlock_wait_cycles":631076608,"thread_start_us":200144,"threads_started":1,"wal-append.queue_time_us":311333}
I20260709 13:02:03.636878  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:03.339715 11005 consensus_meta.cc:287] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.195s	user 0.019s	sys 0.018s
I20260709 13:02:03.369297 10639 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:03.536450 11029 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:02:03.520993 10408 consensus_queue.cc:1048] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:03.524706  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:03.379346 11038 consensus_meta.cc:287] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.737s	user 0.010s	sys 0.001s
I20260709 13:02:03.644958 11038 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:03.646538 10995 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:03.647140 11038 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:03.415690 11088 consensus_meta.cc:287] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.000s
I20260709 13:02:03.648209 11088 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:03.649132 11171 log.cc:927] Time spent T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:02:03.649264  8457 raft_consensus.cc:606] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:03.649770  8457 raft_consensus.cc:614] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:03.650286  8452 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:03.650645 11088 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:03.651482 10826 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:03.351740 11173 consensus_queue.cc:1059] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.176s
I20260709 13:02:03.652477 11173 raft_consensus.cc:3055] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:03.652855 11173 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:03.653858 11173 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:03.655174 11173 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:03.569736  8351 connection.cc:256] RPC call timeout handler was delayed by -1.1058919530000253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
I20260709 13:02:03.571085  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:03.658380  8535 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:03.659926 11091 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:03.660732  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:03.661393  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:03.662737  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:03.239617 11154 consensus_queue.cc:1059] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.285s
I20260709 13:02:03.663736  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:03.663990 11154 raft_consensus.cc:3055] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:03.664206 11065 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:03.664472 11154 raft_consensus.cc:740] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:03.664604  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:03.535984 11158 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:03.665370 11154 consensus_queue.cc:260] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:03.665781 10639 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:03.376641 11055 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.195s
I20260709 13:02:03.634287 10997 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:03.568312  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:03.376401 11166 consensus_queue.cc:1059] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.211s
I20260709 13:02:03.625176  8531 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:03.632608  8380 rpcz_store.cc:276] 0709 13:02:02.429727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.431235 (+  1508us) service_pool.cc:224] Handling call
0709 13:02:02.431491 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.242535 (+811044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.470938 (+228403us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54002cc254. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:03.471125 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1848647936}
I20260709 13:02:03.638372  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:03.696746  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:03.580888 10610 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.574102 11159 raft_consensus.cc:740] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:03.611042 11135 raft_consensus.cc:740] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:02:03.640864 11145 consensus_meta.cc:287] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.000s
W20260709 13:02:03.643500 11051 consensus_meta.cc:287] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.725s	user 0.011s	sys 0.000s
I20260709 13:02:03.644371  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:03.661448  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:03.664978  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:03.367594 11175 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.153s
I20260709 13:02:03.667343  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:03.571403  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:03.668428 10408 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:03.669009  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:03.669365  8535 raft_consensus.cc:2410] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:03.671505  8351 leader_election.cc:400] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7.
I20260709 13:02:03.675019  8377 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:02:03.336710 11059 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:02:03.638372  8281 catalog_manager.cc:5697] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 5 to 7, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 7 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:03.685635  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:03.633037 10865 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.586803 11148 consensus_queue.cc:1059] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:02:03.633236 11037 raft_consensus.cc:740] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:03.685007 10996 consensus_meta.cc:287] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.735s	user 0.010s	sys 0.000s
W20260709 13:02:03.686270 11127 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.964s	user 0.002s	sys 0.011s
I20260709 13:02:03.709362  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:03.815320  8380 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:03.667117 11029 consensus_queue.cc:1243] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer d653e71832b7402b9a03b46249d3b885 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:03.667081 11154 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:03.651816 11088 consensus_queue.cc:1048] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:02:03.648821 11099 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:03.711392  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 353511us
I20260709 13:02:03.591074 11155 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:03.679349 11147 consensus_queue.cc:1175] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b8eb0ad4490645598004d862412f4e31" responder_term: 6 status { last_received { term: 6 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 6 index: 7 } }
I20260709 13:02:03.840149  8380 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:03.802215  8533 raft_consensus.cc:1240] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:03.802613  9295 raft_consensus.cc:2410] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:03.803048  8385 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:03.803144  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:03.778610  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:03.804936  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 133580us
I20260709 13:02:03.805413  8378 raft_consensus.cc:2393] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 8: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:03.843005  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:03.843266  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:03.843892  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.843914  8378 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:02:03.844209  8377 raft_consensus.cc:2410] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:03.805500  8386 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:02:03.692467 11158 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:03.804275  8281 catalog_manager.cc:5697] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:03.808377  8500 leader_election.cc:336] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.564s (SENT)
I20260709 13:02:03.856392  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:03.777351 11153 consensus_meta.cc:287] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.000s
I20260709 13:02:03.860968  8351 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:03.864377  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 272797us
I20260709 13:02:03.864326  8281 catalog_manager.cc:5697] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 5 to 6, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 6 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:03.839534 11121 consensus_meta.cc:287] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.737s	user 0.011s	sys 0.000s
I20260709 13:02:03.829566  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:03.832044 10971 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:03.757939  8381 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:02:03.776696  8531 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:03.856400  8500 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:03.820026 11127 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.098s	user 0.002s	sys 0.012s
I20260709 13:02:03.692075 11131 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:03.858359  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.885874 10408 consensus_queue.cc:1059] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:03.887277 10408 consensus_queue.cc:1048] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:03.867702  8351 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
W20260709 13:02:03.829339  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 405080us
I20260709 13:02:03.708937 10610 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:03.875586  8385 raft_consensus.cc:1240] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:03.868932  8281 catalog_manager.cc:5697] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 4 to 5, term changed from 3 to 4, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to <none>, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:03.891809  8281 catalog_manager.cc:5697] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:03.882323  8424 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:03.891798  8426 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:03.894378  8281 catalog_manager.cc:5697] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:02:03.898578  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 90255.2us
W20260709 13:02:03.902796  8500 leader_election.cc:336] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.608s (SENT)
I20260709 13:02:03.889004 10408 raft_consensus.cc:3055] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:03.811868 10865 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:03.898662  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:03.889591  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:03.903512 10408 raft_consensus.cc:740] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:03.903345  8500 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:03.859704 11055 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.859813 11012 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:03.866851 11182 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:03.811519 11051 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:03.801715 11145 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:03.866683 11005 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:03.906215  8457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43296 (request call id 27) took 1086 ms. Trace:
I20260709 13:02:03.914150  8533 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:03.915391  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:03.871047  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:03.878736 11121 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:03.945618  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:03.874302 11139 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:03.823964 10996 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:03.909422  8281 catalog_manager.cc:5697] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 1 to 3, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 3 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:03.920065  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 52915.1us
I20260709 13:02:03.920076  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:03.879114 11127 raft_consensus.cc:697] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:03.941218  8457 rpcz_store.cc:276] 0709 13:02:02.792813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.792988 (+   175us) service_pool.cc:224] Handling call
0709 13:02:03.878788 (+1085800us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b540015b8d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c847f853 00007f36cd44d60a 00007f36c69d37d4 00007f36c69d3762 00007f36c69d3691 00007f36c69d360c 00007f36c69d28c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:03.878915 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1677875072}
I20260709 13:02:03.933889  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:03.942241  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 50515.2us
I20260709 13:02:03.951800  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:03.952656  8380 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:02:03.936924  8383 raft_consensus.cc:2410] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:03.970842  8426 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:03.921190 10408 consensus_queue.cc:260] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:03.911075 11065 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:03.963083  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:03.964854  8281 catalog_manager.cc:5697] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:03.979028  8385 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:02:03.979128  8426 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:03.979833  8281 catalog_manager.cc:5697] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:03.911298 10993 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:03.982481  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:03.984396  9294 raft_consensus.cc:2393] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 8: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:03.915989 11086 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:03.987756  8281 catalog_manager.cc:5697] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:04.005975  8281 catalog_manager.cc:5697] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:03.991990  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.867702 11153 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:04.002215  8386 raft_consensus.cc:1240] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:04.007854  9291 raft_consensus.cc:2393] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 4: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:03.954756 10968 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:03.920626 11055 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:03.860242 11135 consensus_queue.cc:260] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:03.905889 11131 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:03.877413 11037 consensus_queue.cc:260] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:03.900094 11159 consensus_queue.cc:260] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:04.307520  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:04.116086  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:04.503276  8380 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
W20260709 13:02:04.309566  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.117914  8281 catalog_manager.cc:5697] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:02:04.504257  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:04.099390  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:04.504987  9294 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:02:04.470734  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:04.505582  9294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 434) took 1133 ms. Trace:
I20260709 13:02:04.506058  9294 rpcz_store.cc:276] 0709 13:02:03.372595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.985052 (+612457us) service_pool.cc:224] Handling call
0709 13:02:04.505516 (+520464us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:03.982470 11134 log.cc:927] Time spent T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:02:04.404989  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:04.522362  8526 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
W20260709 13:02:04.424235  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 521387us
I20260709 13:02:04.520828  8281 catalog_manager.cc:5697] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:02:04.523487  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.332379  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:04.395543 11146 consensus_queue.cc:1059] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.138s
I20260709 13:02:04.430799 11127 consensus_queue.cc:237] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:04.534554 11193 raft_consensus.cc:3055] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:04.534957 11193 raft_consensus.cc:740] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:04.535763 11193 consensus_queue.cc:260] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:04.538321  8281 catalog_manager.cc:5697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:03.977428 11065 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:04.010453 11191 log.cc:927] Time spent T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:02:04.540566  8281 catalog_manager.cc:5697] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:04.544662  8500 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:04.001346 11175 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:02:04.406252 11199 log.cc:927] Time spent T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.430s	user 0.000s	sys 0.000s
W20260709 13:02:04.436308 11184 log.cc:927] Time spent T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:02:04.549182  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:04.435546 11187 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:04.573279  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.551822  8527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.000s	sys 0.010s
W20260709 13:02:04.575681  8527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.000s	sys 0.011s
W20260709 13:02:04.551766  8425 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.000s	sys 0.010s
I20260709 13:02:04.556159  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:04.576972  8425 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.000s	sys 0.011s
I20260709 13:02:04.577275  8384 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:02:04.557451  8500 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:04.005147 11086 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:04.557790  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:04.433877 10610 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:04.405308 10865 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:04.552919 11065 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:04.329073 11192 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:04.457170  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:04.561549  8533 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:04.562258  8460 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.013s	sys 0.006s
W20260709 13:02:04.632212  8460 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.013s	sys 0.006s
I20260709 13:02:04.437999 11051 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:04.520598 10968 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:04.567878  8532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.072s	sys 0.125s
W20260709 13:02:04.632881  8532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.072s	sys 0.125s
I20260709 13:02:04.482299 11145 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:04.606787  9294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 432) took 1234 ms. Trace:
I20260709 13:02:04.438648 11155 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:04.405416 10996 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:04.612424  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.435372 11009 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:04.549928 11135 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:04.431946 11177 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:04.628434  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:03.966671 11182 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:05.275470  8535 raft_consensus.cc:1275] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:05.276548  9294 rpcz_store.cc:276] 0709 13:02:03.372063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.507161 (+1135098us) service_pool.cc:224] Handling call
0709 13:02:04.606702 (+ 99541us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.277997  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:05.278151  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:05.278635  8535 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:05.279232  9294 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 5: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
W20260709 13:02:05.279775  9294 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55734 (request call id 720) took 1908 ms (client timeout 2253 ms). Trace:
W20260709 13:02:05.280297  9294 rpcz_store.cc:269] 0709 13:02:03.371173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.277816 (+1906643us) service_pool.cc:224] Handling call
0709 13:02:05.279697 (+  1881us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.639241  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:04.881999  8528 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.010s	sys 0.016s
W20260709 13:02:05.282060  8528 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.166s	user 0.010s	sys 0.025s
W20260709 13:02:05.185802 11212 log.cc:927] Time spent T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.443s	user 0.001s	sys 0.000s
W20260709 13:02:04.754531  8377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.021s	sys 0.034s
W20260709 13:02:05.283679  8377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.298s	user 0.030s	sys 0.051s
I20260709 13:02:05.283903  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1972) took 1450 ms. Trace:
I20260709 13:02:05.284813  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 431) took 1614 ms. Trace:
I20260709 13:02:05.284346  8527 rpcz_store.cc:276] 0709 13:02:03.833938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.834338 (+   400us) service_pool.cc:224] Handling call
0709 13:02:03.866654 (+ 32316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:03.876154 (+  9500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.876186 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:03.876658 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:02:04.576353 (+699695us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:04.576423 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.576538 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.283709 (+707171us) raft_consensus.cc:1685] finished
0709 13:02:05.283728 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.283849 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8286,"raft.queue_time_us":33862,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":6316,"spinlock_wait_cycles":1873664,"thread_start_us":613302,"threads_started":1,"wal-append.queue_time_us":830647}
I20260709 13:02:04.689667 11192 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:04.741521  8380 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:02:04.744549  9288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55734 (request call id 721) took 1344 ms. Trace:
W20260709 13:02:04.665136  8379 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 2283) took 2199 ms (client timeout 1502 ms). Trace:
I20260709 13:02:05.287636  9288 rpcz_store.cc:276] 0709 13:02:03.371508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.374009 (+1002501us) service_pool.cc:224] Handling call
0709 13:02:04.716147 (+342138us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:04.762646 11173 consensus_meta.cc:287] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 1.107s	user 0.007s	sys 0.007s
W20260709 13:02:05.288314  8379 rpcz_store.cc:269] 0709 13:02:02.430323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.430425 (+   102us) service_pool.cc:224] Handling call
0709 13:02:04.629683 (+2199258us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400188b54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:04.629853 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2791595264}
W20260709 13:02:04.703644  8427 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.004s	sys 0.016s
W20260709 13:02:05.289984  8427 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.336s	user 0.011s	sys 0.023s
I20260709 13:02:05.290427  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:04.664831 10971 consensus_meta.cc:287] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.780s	user 0.003s	sys 0.008s
I20260709 13:02:04.609140 10993 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:04.635532 10968 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:04.635854  8460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 458) took 1215 ms. Trace:
W20260709 13:02:05.058885  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.008440 10997 consensus_meta.cc:287] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 1.304s	user 0.012s	sys 0.000s
I20260709 13:02:05.295871 11182 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:04.613330 11086 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:05.132344  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.761927 11154 consensus_meta.cc:287] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.927s	user 0.010s	sys 0.000s
I20260709 13:02:04.792081  8533 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
W20260709 13:02:05.299329  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 741919us
I20260709 13:02:05.318778  8500 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:05.299201  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 1.34552e+06us
I20260709 13:02:05.276207  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1962) took 1979 ms. Trace:
W20260709 13:02:04.695432  8426 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.002s	sys 0.020s
W20260709 13:02:05.321187  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.321496  8426 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.335s	user 0.011s	sys 0.024s
W20260709 13:02:05.147503  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.256899  8531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.003s	sys 0.017s
I20260709 13:02:05.300993  8379 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
W20260709 13:02:04.703976 11045 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.004s	sys 0.016s
I20260709 13:02:05.325814  9295 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:05.302397  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:04.665294 11099 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:04.864728 11055 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:04.759793 11209 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:05.304804  8460 rpcz_store.cc:276] 0709 13:02:03.420859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.422438 (+  1579us) service_pool.cc:224] Handling call
0709 13:02:03.422776 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.423028 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:03.830178 (+407150us) log.cc:844] Serialized 14 byte log entry
0709 13:02:04.635476 (+805298us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.635529 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:04.635581 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.635655 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.635794 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2804,"prepare.queue_time_us":231291,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":112941,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":130,"spinlock_wait_cycles":80130432,"thread_start_us":1202116,"threads_started":2,"wal-append.queue_time_us":1027409}
I20260709 13:02:05.303683  8535 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:05.345259  8454 raft_consensus.cc:1240] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:05.126262  9261 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.281s	user 0.015s	sys 0.011s
W20260709 13:02:05.346307  9261 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.501s	user 0.015s	sys 0.011s
W20260709 13:02:05.346622  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 1.5013e+06us
W20260709 13:02:05.341459 11045 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.357s	user 0.010s	sys 0.021s
I20260709 13:02:05.350612  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:05.324744  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:05.319854  8532 rpcz_store.cc:276] 0709 13:02:03.296918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.297039 (+   121us) service_pool.cc:224] Handling call
0709 13:02:03.309964 (+ 12925us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:03.335739 (+ 25775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.335784 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:03.345571 (+  9787us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.498469 (+152898us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b18004180c0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c80250d1 00007f36c8440a0f
0709 13:02:03.731619 (+233150us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:03.905820 (+174201us) log.cc:844] Serialized 14 byte log entry
0709 13:02:05.275670 (+1369850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.275772 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.275829 (+    57us) raft_consensus.cc:1685] finished
0709 13:02:05.275959 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.276133 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25346,"prepare.queue_time_us":702627,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":73111,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":16131,"spinlock_wait_cycles":144563840,"thread_start_us":1051828,"threads_started":3,"wal-append.queue_time_us":432367}
W20260709 13:02:05.326717  9294 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55720 (request call id 418) took 1731 ms (client timeout 2096 ms). Trace:
I20260709 13:02:05.288466 11192 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:05.352665  9294 rpcz_store.cc:269] 0709 13:02:03.595543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.302026 (+1706483us) service_pool.cc:224] Handling call
0709 13:02:05.326659 (+ 24633us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.285557  8377 rpcz_store.cc:276] 0709 13:02:03.670504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.845007 (+174503us) service_pool.cc:224] Handling call
0709 13:02:03.845452 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.845702 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:03.985757 (+140055us) log.cc:844] Serialized 14 byte log entry
0709 13:02:05.284270 (+1298513us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:05.284412 (+   142us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:05.284510 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.284610 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.284753 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":704487,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":42086,"spinlock_wait_cycles":123136,"thread_start_us":1416319,"threads_started":2}
I20260709 13:02:05.314455 11177 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:05.333603 10845 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:05.316067 10997 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:05.338327 11155 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.338801 11051 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:05.339234 11218 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.760052 11186 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:05.343667  8457 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:05.237987 11200 log.cc:927] Time spent T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.494s	user 0.000s	sys 0.000s
W20260709 13:02:05.324113  8531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.004s	sys 0.018s
W20260709 13:02:05.349658  9261 connection.cc:256] RPC call timeout handler was delayed by -1.4952800249999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
I20260709 13:02:05.326898 11182 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:05.346069 11194 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.008s	sys 0.013s
I20260709 13:02:05.359746 11192 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:02:05.381929  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.382344  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.366820 10865 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:05.379601 11194 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.009s	sys 0.014s
I20260709 13:02:05.360185 11211 consensus_queue.cc:1059] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:02:05.385597 10947 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.378752 11135 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:05.367234 11051 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:05.385896 11145 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.396332 11145 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:05.398245 11177 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:05.398399 11166 raft_consensus.cc:3055] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:05.398521 11145 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:05.398976 11166 raft_consensus.cc:740] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:05.399716 11166 consensus_queue.cc:260] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:05.400638 11166 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.400695 11137 raft_consensus.cc:3055] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:05.401255 11137 raft_consensus.cc:740] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:05.402101 11137 consensus_queue.cc:260] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:05.403299 11137 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:05.403342 11086 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:05.394761 11135 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:05.405644 11086 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:05.406430 11135 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:05.382915 11182 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:05.389396 11219 raft_consensus.cc:3055] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:05.366039 11155 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:05.367018 11218 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:05.410426 11182 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:05.410909 11218 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:05.412657 11155 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:05.408463 11219 raft_consensus.cc:740] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:05.414009 11219 consensus_queue.cc:260] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:05.415259 11219 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.418009 11157 raft_consensus.cc:3055] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:05.418581 11157 raft_consensus.cc:740] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:05.419873 11157 consensus_queue.cc:260] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:05.422578 11172 log.cc:927] Time spent T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 1.841s	user 0.043s	sys 0.089s
W20260709 13:02:05.452255  8281 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.000s	sys 0.004s
W20260709 13:02:05.453518  8281 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.001s	sys 0.004s
I20260709 13:02:05.354076  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:05.462778  8377 raft_consensus.cc:2368] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8.
W20260709 13:02:05.464285  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.465137  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:05.466878  8377 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:02:05.468142  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:05.468895  8377 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.473670  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 430) took 1803 ms. Trace:
I20260709 13:02:05.474249  8378 rpcz_store.cc:276] 0709 13:02:03.670288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.844686 (+174398us) service_pool.cc:224] Handling call
0709 13:02:03.845331 (+   645us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:03.860844 (+ 15513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.860871 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:03.861357 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:02:04.329744 (+468387us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:05.272901 (+943157us) log.cc:844] Serialized 14 byte log entry
0709 13:02:05.273164 (+   263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.273247 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.423961 (+150714us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b18002bf0c0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:02:05.472880 (+ 48919us) raft_consensus.cc:1685] finished
0709 13:02:05.473071 (+   191us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.473388 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15116,"prepare.queue_time_us":236961,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":21368,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":29267,"spinlock_wait_cycles":21781888,"thread_start_us":790270,"threads_started":2,"wal-append.queue_time_us":792633}
I20260709 13:02:05.477742  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:05.479650  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:05.480662  8378 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:02:05.481841  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:05.482686  8378 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:02:05.484583  8378 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:05.355041  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:05.486181  8379 raft_consensus.cc:2393] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 7: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:05.486730  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 1887) took 1005 ms. Trace:
I20260709 13:02:05.487107  8379 rpcz_store.cc:276] 0709 13:02:04.481548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.354654 (+873106us) service_pool.cc:224] Handling call
0709 13:02:05.486623 (+131969us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.492216  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2293) took 2762 ms. Trace:
I20260709 13:02:05.492731  8382 rpcz_store.cc:276] 0709 13:02:02.730174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.933641 (+203467us) service_pool.cc:224] Handling call
0709 13:02:02.955216 (+ 21575us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.996536 (+ 41320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.996566 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:03.013716 (+ 17150us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.240819 (+227103us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:03.240876 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.240978 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.421977 (+2180999us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:05.491569 (+ 69592us) raft_consensus.cc:1685] finished
0709 13:02:05.491618 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.492023 (+   405us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40897,"raft.queue_time_us":41499,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":47844,"spinlock_wait_cycles":4241152,"thread_start_us":168934,"threads_started":1,"wal-append.queue_time_us":300190}
I20260709 13:02:05.498905  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 1879) took 1555 ms. Trace:
W20260709 13:02:05.359570  8426 connection.cc:256] RPC call timeout handler was delayed by -1.3479617079999571s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
I20260709 13:02:05.509757  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:05.501960  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48484 (request call id 424) took 1840 ms. Trace:
I20260709 13:02:05.510599  8383 rpcz_store.cc:276] 0709 13:02:03.661036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.663546 (+  2510us) service_pool.cc:224] Handling call
0709 13:02:05.501285 (+1837739us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54003b7754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:05.501654 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625942784}
I20260709 13:02:05.511606  8452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 1803) took 2588 ms. Trace:
I20260709 13:02:05.512085  8452 rpcz_store.cc:276] 0709 13:02:02.923229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.925291 (+  2062us) service_pool.cc:224] Handling call
0709 13:02:02.925592 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.650660 (+725068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.511073 (+1860413us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b540015b8d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:05.511390 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1666189568}
I20260709 13:02:05.514601  8380 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:05.516433  8382 raft_consensus.cc:1240] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:05.528259  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:05.531730  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:05.349436  9287 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:02:05.390266 10865 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:05.533952  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:05.543128 10997 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:05.528301  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:05.544310  8458 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:05.369881 11045 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:02:05.544399 10997 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.550203 11132 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.548362  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 1885) took 1065 ms. Trace:
I20260709 13:02:05.502701  8386 rpcz_store.cc:276] 0709 13:02:03.943699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.969156 (+ 25457us) service_pool.cc:224] Handling call
0709 13:02:03.998260 (+ 29104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.504984 (+506724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.498116 (+993132us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b5400189054. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:05.498642 (+   526us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8628096}
I20260709 13:02:05.557220  8378 rpcz_store.cc:276] 0709 13:02:04.480998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.483390 (+1002392us) service_pool.cc:224] Handling call
0709 13:02:05.484000 (+   610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.484963 (+   963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.546105 (+ 61142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.559029 10997 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:05.565356 11086 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:05.566241 11086 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:05.565224 10997 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:05.586728  8459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 1812) took 2127 ms. Trace:
I20260709 13:02:05.588181  8459 rpcz_store.cc:276] 0709 13:02:03.459533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.464167 (+  4634us) service_pool.cc:224] Handling call
0709 13:02:03.464495 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.630952 (+166457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.585972 (+1955020us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b540008a5a0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c83fcdc0 00007f36c8488a02 00007f36c8484dd6 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2
0709 13:02:05.586480 (+   508us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24863104}
W20260709 13:02:05.589416  8501 leader_election.cc:336] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.059s (SENT)
I20260709 13:02:05.590268  8501 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:05.593462 11132 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:05.594084  8426 leader_election.cc:336] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Timed out: RequestConsensusVote RPC to 127.7.25.196:40669 timed out after 2.013s (SENT)
I20260709 13:02:05.599897 11051 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:05.596927 11099 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:05.601830 11099 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:05.603546  8533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38894 (request call id 1976) took 1604 ms (client timeout 1632 ms). Trace:
I20260709 13:02:05.606508 11182 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:05.613703  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:05.614128  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:05.615283  9289 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55734 (request call id 709) took 2457 ms (client timeout 1805 ms). Trace:
W20260709 13:02:05.615751  9289 rpcz_store.cc:269] 0709 13:02:03.157361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.185034 (+ 27673us) service_pool.cc:224] Handling call
0709 13:02:03.497643 (+312609us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b5800220e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd44b0a0 00007f36cd44a984 00007f36c69c56d4 00007f36c69c5662
0709 13:02:05.613730 (+2116087us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b5800220e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360e9c 00007f36c5360a5b 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd44b0a0 00007f36cd44a984 00007f36c69c56d4 00007f36c69c5662
0709 13:02:05.615148 (+  1418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88339200}
I20260709 13:02:05.618275  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:05.618505  8381 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
W20260709 13:02:05.618871  9261 leader_election.cc:336] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.867s (SENT)
W20260709 13:02:05.619484  9290 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55734 (request call id 708) took 2462 ms (client timeout 1515 ms). Trace:
W20260709 13:02:05.620069  8381 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 1876) took 1705 ms (client timeout 1565 ms). Trace:
I20260709 13:02:05.621261 11140 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.621904 11140 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:05.620548  8381 rpcz_store.cc:269] 0709 13:02:03.915024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.915128 (+   104us) service_pool.cc:224] Handling call
0709 13:02:05.619776 (+1704648us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b5400350054. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:05.619947 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3856760576}
I20260709 13:02:05.625579  9294 raft_consensus.cc:1240] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:05.625509  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:05.627238  8460 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:05.627665  9293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 711) took 2461 ms. Trace:
W20260709 13:02:05.621042  9291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55720 (request call id 411) took 2755 ms (client timeout 1949 ms). Trace:
I20260709 13:02:05.628854 10968 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:05.629315  9291 rpcz_store.cc:269] 0709 13:02:02.865240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.865553 (+   313us) service_pool.cc:224] Handling call
0709 13:02:05.620574 (+2755021us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400720e54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:05.620836 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2624249088}
I20260709 13:02:05.630836  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:05.631865  9291 raft_consensus.cc:2393] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 5: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:05.632005  8458 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:05.633622  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:05.628192  9293 rpcz_store.cc:276] 0709 13:02:03.166403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.461516 (+295113us) service_pool.cc:224] Handling call
0709 13:02:05.622914 (+2161398us) spinlock_profiling.cc:243] Waited 8.58 ms on lock 0x7b5800220e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd45efc0 00007f36cd449929 00007f36cd4493d2 00007f36c69c0bd4
0709 13:02:05.626722 (+  3808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.627130 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.627156 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:05.627201 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:05.627258 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.627312 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.627461 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19729280}
I20260709 13:02:05.634678  8460 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:05.604095  8533 rpcz_store.cc:269] 0709 13:02:03.998625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.003573 (+  4948us) service_pool.cc:224] Handling call
0709 13:02:05.603038 (+1599465us) spinlock_profiling.cc:243] Waited 36.4 ms on lock 0x7b54002af8d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:05.603266 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83803392}
I20260709 13:02:05.638932  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:05.639067  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:05.639961  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:05.645900  8382 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:02:05.620072  9290 rpcz_store.cc:269] 0709 13:02:03.157041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.162201 (+  5160us) service_pool.cc:224] Handling call
0709 13:02:03.450317 (+288116us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b5800220e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd44b0a0 00007f36cd44a984 00007f36c69c56d4 00007f36c69c5662
0709 13:02:05.617866 (+2167549us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5800220e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360e9c 00007f36c5360a5b 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd44b0a0 00007f36cd44a984 00007f36c69c56d4 00007f36c69c5662
0709 13:02:05.619397 (+  1531us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83130368}
I20260709 13:02:05.604794 11099 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:05.659160  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:05.656157  9261 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:05.665297  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:05.673733  8458 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:05.678740  9261 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:05.679188 11065 consensus_meta.cc:287] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.041s	user 0.015s	sys 0.005s
I20260709 13:02:05.679836 11065 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:05.693921  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 73081us
I20260709 13:02:05.700584  9291 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 LEARNER]: Advancing to term 4
I20260709 13:02:05.702811  8379 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:05.668368 10947 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.704202  8459 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:02:05.719766  8456 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:05.698748 11086 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:05.729200  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 384736us
I20260709 13:02:05.729900 10968 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:05.730525  8424 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.632s (SENT) [suppressed 40 similar messages]
I20260709 13:02:05.733157  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1981) took 1036 ms. Trace:
I20260709 13:02:05.736145  8460 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:02:05.718415 10947 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:05.733647  8526 rpcz_store.cc:276] 0709 13:02:04.621598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.274342 (+652744us) service_pool.cc:224] Handling call
0709 13:02:05.274721 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:05.365692 (+ 90971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.365767 (+    75us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:05.367195 (+  1428us) log.cc:844] Serialized 26 byte log entry
0709 13:02:05.576650 (+209455us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:05.576765 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.576918 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.649489 (+ 72571us) raft_consensus.cc:1685] finished
0709 13:02:05.649508 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.657888 (+  8380us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":71323,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3515,"thread_start_us":299087,"threads_started":2,"wal-append.queue_time_us":209277}
W20260709 13:02:05.743911  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 49371us
I20260709 13:02:05.744979 10947 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:05.746235 11135 consensus_queue.cc:1059] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:02:05.747236  8424 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:05.746285 10968 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:02:05.749114 11065 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:05.749450 11155 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:02:05.741523  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.749215 11173 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
W20260709 13:02:05.750771  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.751546  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 432664us
I20260709 13:02:05.753268 11086 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:05.754223 11086 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:05.755012  8382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:02:05.755975  8382 raft_consensus.cc:606] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:05.756395  8382 raft_consensus.cc:614] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:05.733174 10952 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:02:05.759054 11176 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:05.759142 11154 consensus_queue.cc:1059] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:02:05.762790 11145 raft_consensus.cc:3055] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:05.763183 11145 raft_consensus.cc:740] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:05.764508 10947 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:05.764526  8424 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:05.766283 10968 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:05.767340 11195 log.cc:927] Time spent T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 1.068s	user 0.004s	sys 0.008s
W20260709 13:02:05.767740  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.768438 10968 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.764292 11193 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:05.774603  8377 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:02:05.752782  8500 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:05.786221  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1967) took 2398 ms. Trace:
I20260709 13:02:05.786507 10952 consensus_queue.cc:1048] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:05.786743  8530 rpcz_store.cc:276] 0709 13:02:03.371125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.416757 (+ 45632us) service_pool.cc:224] Handling call
0709 13:02:03.417139 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:03.588465 (+171326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.588509 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:03.598147 (+  9638us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.809852 (+211705us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:03.809920 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.629854 (+1819934us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b1800418060. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53662a6 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419
0709 13:02:05.630404 (+   550us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54001699d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:05.630459 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.766172 (+135713us) spinlock_profiling.cc:243] Waited 55.7 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:05.768930 (+  2758us) raft_consensus.cc:1685] finished
0709 13:02:05.768959 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.769261 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2948,"raft.queue_time_us":226842,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":23711,"spinlock_wait_cycles":519505408,"thread_start_us":162249,"threads_started":1,"wal-append.queue_time_us":935007}
I20260709 13:02:05.782234 11065 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:05.789388 11153 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:05.789629 11065 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:05.767390 11145 consensus_queue.cc:260] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:05.791827 11145 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.792529 11065 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:05.794193  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 205016us
W20260709 13:02:05.794694 11214 log.cc:927] Time spent T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.930s	user 0.003s	sys 0.001s
I20260709 13:02:05.779960 10968 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:05.747751 11135 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:05.765532 10947 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:05.806349 11220 log.cc:927] Time spent T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.427s	user 0.001s	sys 0.001s
I20260709 13:02:05.785123  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 1888) took 1299 ms. Trace:
I20260709 13:02:05.811148  8377 rpcz_store.cc:276] 0709 13:02:04.481786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.467668 (+985882us) service_pool.cc:224] Handling call
0709 13:02:05.781122 (+313454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.814219  8457 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:05.822098 11166 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:05.835412 11132 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:05.840116 10947 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:05.840767  9295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55734 (request call id 719) took 2508 ms (client timeout 2013 ms). Trace:
W20260709 13:02:05.841210  9295 rpcz_store.cc:269] 0709 13:02:03.332427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.843086 (+510659us) service_pool.cc:224] Handling call
0709 13:02:05.840365 (+1997279us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400735854. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:05.840583 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3377057024}
W20260709 13:02:05.845608  9287 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55720 (request call id 408) took 2981 ms (client timeout 1628 ms). Trace:
W20260709 13:02:05.846165  9287 rpcz_store.cc:269] 0709 13:02:02.864294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.864445 (+   151us) service_pool.cc:224] Handling call
0709 13:02:05.845186 (+2980741us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b54005348d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:05.845374 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5583442816}
I20260709 13:02:05.848992  9294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 713) took 2677 ms. Trace:
I20260709 13:02:05.849443  9294 rpcz_store.cc:276] 0709 13:02:03.171772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.361660 (+2189888us) service_pool.cc:224] Handling call
0709 13:02:05.624582 (+262922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.626109 (+  1527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.848725 (+222616us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b5400720e50. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:05.848906 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":586079616}
I20260709 13:02:05.854825  9295 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:02:05.855760  9295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 431) took 2484 ms. Trace:
W20260709 13:02:05.856523  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 70249.1us
I20260709 13:02:05.859372 11158 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.859700 11059 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:05.860463 11158 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:05.860498  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 107861us
I20260709 13:02:05.856191  9295 rpcz_store.cc:276] 0709 13:02:03.371795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.842040 (+2470245us) service_pool.cc:224] Handling call
0709 13:02:05.854299 (+ 12259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.855477 (+  1178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.855680 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.871006  8456 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:05.876715  8454 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
W20260709 13:02:05.878917  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 133278us
W20260709 13:02:05.879685  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 183162us
I20260709 13:02:05.877583  9293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 715) took 2687 ms. Trace:
I20260709 13:02:05.885571  9291 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEARNER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:02:05.887125  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.886885  9291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 714) took 2713 ms. Trace:
I20260709 13:02:05.889204  9291 rpcz_store.cc:276] 0709 13:02:03.173751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.632834 (+2459083us) service_pool.cc:224] Handling call
0709 13:02:05.656841 (+ 24007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.886543 (+229702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.886812 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.900974  9258 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:05.901813 11158 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:05.884445  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 89111.4us
I20260709 13:02:05.905516  9260 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:05.905874 11146 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.892863  8500 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:05.910022 11241 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:05.910620 11241 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:05.910519  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 44773.5us
I20260709 13:02:05.911264 11241 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.915292 11045 consensus_queue.cc:1059] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:05.916548 11045 consensus_queue.cc:1059] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:05.917454 11215 raft_consensus.cc:3055] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:05.918728 11166 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:05.920305  8529 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:05.909478  9260 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:05.920499  9290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 718) took 2636 ms. Trace:
W20260709 13:02:05.921840  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.885123  9293 rpcz_store.cc:276] 0709 13:02:03.182377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.635425 (+2453048us) service_pool.cc:224] Handling call
0709 13:02:05.635965 (+   540us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:05.668787 (+ 32822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.668830 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:05.669654 (+   824us) log.cc:844] Serialized 26 byte log entry
0709 13:02:05.723504 (+ 53850us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:05.869547 (+146043us) log.cc:844] Serialized 14 byte log entry
0709 13:02:05.869858 (+   311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.869962 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.870014 (+    52us) raft_consensus.cc:1685] finished
0709 13:02:05.870032 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.870191 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32302,"raft.queue_time_us":33324,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":10189,"thread_start_us":185193,"threads_started":2,"wal-append.queue_time_us":116430}
W20260709 13:02:05.921620  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 55541.9us
I20260709 13:02:05.925395 11143 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:05.887145 10639 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:05.925431  8501 connection.cc:256] RPC call timeout handler was delayed by -1.1341473900000096s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
I20260709 13:02:05.932320  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:05.922628 11215 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:05.937847  9260 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
W20260709 13:02:05.934254  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 255783us
I20260709 13:02:05.945950  9295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 722) took 2312 ms. Trace:
I20260709 13:02:05.947536  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:05.949908 11037 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.950212  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:05.950846  8381 raft_consensus.cc:1240] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:05.952176  8385 pending_rounds.cc:85] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 6
I20260709 13:02:05.952572  8385 pending_rounds.cc:107] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:02:05.952869  8385 raft_consensus.cc:2889] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:05.955500  9287 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:02:05.956525  9287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 416) took 2361 ms. Trace:
I20260709 13:02:05.957480  8378 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:05.958069  9296 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:05.958788  9296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 710) took 2801 ms. Trace:
I20260709 13:02:05.956951  9287 rpcz_store.cc:276] 0709 13:02:03.594943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.847156 (+2252213us) service_pool.cc:224] Handling call
0709 13:02:05.954858 (+107702us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b5800220e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd45efc0 00007f36cd449929 00007f36cd4493d2 00007f36c69c0bd4
0709 13:02:05.955147 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:05.956201 (+  1054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.956452 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38535040}
I20260709 13:02:05.959236  9296 rpcz_store.cc:276] 0709 13:02:03.157631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.435954 (+278323us) service_pool.cc:224] Handling call
0709 13:02:05.957408 (+2521454us) spinlock_profiling.cc:243] Waited 8.3 ms on lock 0x7b5800220e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd45efc0 00007f36cd449929 00007f36cd4493d2 00007f36c69c0bd4
0709 13:02:05.957713 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.958524 (+   811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.958735 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19084032}
I20260709 13:02:05.962283  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:05.962870  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:05.963183  8533 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:02:05.963515 10994 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:05.963645  8454 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:02:05.964146 11135 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:05.964732 11135 raft_consensus.cc:697] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:05.965889 11135 consensus_queue.cc:237] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:05.967711  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 1886) took 1486 ms. Trace:
I20260709 13:02:05.968151  8379 rpcz_store.cc:276] 0709 13:02:04.481282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.487887 (+1006605us) service_pool.cc:224] Handling call
0709 13:02:05.488382 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.703443 (+215061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.967440 (+263997us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b540013ddd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:05.967630 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":485569920}
I20260709 13:02:05.969125  9260 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:05.947994  9295 rpcz_store.cc:276] 0709 13:02:03.626427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.866991 (+2240564us) service_pool.cc:224] Handling call
0709 13:02:05.924695 (+ 57704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.931219 (+  6524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.931249 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:05.934705 (+  3456us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:05.938481 (+  3776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.938565 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.938696 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.971057  8382 raft_consensus.cc:1240] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:05.970420 11166 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:05.971706 11147 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:05.971845 11166 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:05.972093  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:05.972158 11147 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.972333 10865 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:05.972910 11147 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.927843 11086 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:05.922675 10968 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:05.972949  8526 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.928611 11143 raft_consensus.cc:697] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:05.935580 11213 raft_consensus.cc:3055] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:05.980283  8530 raft_consensus.cc:1275] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:05.980319 11140 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:05.965912 11165 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:05.931974 10639 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:05.935468 11243 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:02:05.980794  9292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 705) took 2780 ms. Trace:
I20260709 13:02:05.980839 11166 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:05.981052 11157 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:06.015118  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.015791  9261 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:06.016379  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:06.016736  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:06.017143  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:06.018057 11206 log.cc:927] Time spent T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 1.243s	user 0.002s	sys 0.003s
I20260709 13:02:06.012701  9292 rpcz_store.cc:276] 0709 13:02:03.153838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.160694 (+  6856us) service_pool.cc:224] Handling call
0709 13:02:03.452860 (+292166us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b5800220e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd45efc0 00007f36cd449929 00007f36cd4493d2 00007f36c69c0bd4
0709 13:02:05.631980 (+2179120us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b5800220e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360e9c 00007f36c5360a5b 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd45efc0 00007f36cd449929 00007f36cd4493d2 00007f36c69c0bd4
0709 13:02:05.632313 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:05.670664 (+ 38351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.670710 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:05.671483 (+   773us) log.cc:844] Serialized 26 byte log entry
0709 13:02:05.720708 (+ 49225us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:05.881714 (+161006us) log.cc:844] Serialized 14 byte log entry
0709 13:02:05.904300 (+ 22586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.921997 (+ 17697us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.922736 (+   739us) raft_consensus.cc:1685] finished
0709 13:02:05.924408 (+  1672us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.932874 (+  8466us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50384,"prepare.queue_time_us":179424,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":41167,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":212,"spinlock_wait_cycles":164397184,"thread_start_us":154606,"threads_started":2,"wal-append.queue_time_us":37950}
I20260709 13:02:06.018956 10968 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:06.034577  8530 raft_consensus.cc:2376] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8. Re-sending same reply.
I20260709 13:02:06.035625  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:06.036504  8527 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:05.983573 11213 raft_consensus.cc:740] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:06.040186 11213 consensus_queue.cc:260] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:06.042099 11213 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:06.042219 11201 log.cc:927] Time spent T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 1.296s	user 0.008s	sys 0.007s
I20260709 13:02:06.043386  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:06.043912  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 1968) took 2672 ms. Trace:
I20260709 13:02:06.044137  8535 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:05.945901 11146 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:05.999032 11165 raft_consensus.cc:697] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:06.044312  8528 rpcz_store.cc:276] 0709 13:02:03.371426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.374228 (+  2802us) service_pool.cc:224] Handling call
0709 13:02:03.374570 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:03.639692 (+265122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.639738 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:03.692772 (+ 53034us) log.cc:844] Serialized 26 byte log entry
0709 13:02:04.010776 (+318004us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:05.282430 (+1271654us) log.cc:844] Serialized 14 byte log entry
0709 13:02:05.366704 (+ 84274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.366982 (+   278us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.986848 (+619866us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:06.043440 (+ 56592us) raft_consensus.cc:1685] finished
0709 13:02:06.043569 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.043755 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1623,"prepare.queue_time_us":319349,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":285758,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":5863,"spinlock_wait_cycles":88464768,"thread_start_us":1713455,"threads_started":4,"wal-append.queue_time_us":1015064}
I20260709 13:02:06.046754  8531 raft_consensus.cc:2410] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:06.046916  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:06.047802  8528 raft_consensus.cc:2410] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:06.048893 11215 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:06.050271  8532 raft_consensus.cc:2376] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7. Re-sending same reply.
I20260709 13:02:06.045607 11165 consensus_queue.cc:237] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:06.029763  8500 leader_election.cc:400] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5.
I20260709 13:02:06.030328  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:05.924306  9290 rpcz_store.cc:276] 0709 13:02:03.283847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.664956 (+2381109us) service_pool.cc:224] Handling call
0709 13:02:05.671507 (+  6551us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:05.672205 (+   698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.672235 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:05.673044 (+   809us) log.cc:844] Serialized 52 byte log entry
0709 13:02:05.739637 (+ 66593us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:05.745983 (+  6346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.746087 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.920238 (+174151us) raft_consensus.cc:1685] finished
0709 13:02:05.920268 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.920426 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":453,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":25216,"thread_start_us":54850,"threads_started":1,"wal-append.queue_time_us":213036}
I20260709 13:02:06.033752  8501 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:06.051273  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:06.027434  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:06.042270  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:06.066814  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.059517  8383 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:06.069278  8534 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:06.069566 11143 consensus_queue.cc:237] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:06.072371 11140 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:06.073105  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 46425.1us
I20260709 13:02:06.107291  8535 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:06.140110 10997 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:06.169800 11158 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:06.109609 11140 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:06.190251  8501 leader_election.cc:336] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.565s (SENT)
W20260709 13:02:06.219087  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.220358 11244 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:06.221240 11244 raft_consensus.cc:697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:02:06.221925 11250 log.cc:927] Time spent T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:06.222419 11244 consensus_queue.cc:237] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:06.224282 11215 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.235888 10770 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:02:06.234161 11158 consensus_queue.cc:1059] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:02:06.256930 11158 raft_consensus.cc:3055] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:06.258121  8501 leader_election.cc:336] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.778s (SENT)
W20260709 13:02:06.265770  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 271195us
I20260709 13:02:06.266819  8534 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:02:06.268518  9261 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:06.261125  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:06.271464  8527 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:06.272948  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:06.273602  8377 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.274773  8424 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:06.192875 11193 consensus_queue.cc:1059] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:02:06.282366  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:06.289188  8535 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.290932  9294 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:06.291781  9294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 420) took 2695 ms. Trace:
I20260709 13:02:06.292101  9294 rpcz_store.cc:276] 0709 13:02:03.596150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.850361 (+2254211us) service_pool.cc:224] Handling call
0709 13:02:05.953344 (+102983us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b5800220e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd45efc0 00007f36cd449929 00007f36cd4493d2 00007f36c69c0bd4
0709 13:02:05.953598 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.290769 (+337171us) spinlock_profiling.cc:243] Waited 56.6 ms on lock 0x7b54001908a0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c83fcdc0 00007f36c84871c0 00007f36c8488231 00007f36c8484d8f 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c
0709 13:02:06.291451 (+   682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.291710 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161034496}
I20260709 13:02:06.283222 11050 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:06.294772 11050 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:06.295343 11050 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:06.277325  8501 leader_election.cc:336] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.811s (SENT)
I20260709 13:02:06.303380  8526 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:06.303556  8535 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:06.257476 11158 raft_consensus.cc:740] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:06.307925  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 369220us
W20260709 13:02:06.308717  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 213227us
W20260709 13:02:06.313612  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:06.314353  8501 leader_election.cc:336] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.988s (SENT)
W20260709 13:02:06.321367  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 54711.5us
W20260709 13:02:06.324580  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 56150.3us
I20260709 13:02:06.332180  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:06.336697 11153 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:06.339002  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:06.342280 10770 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:06.342763 10770 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.343111  9261 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:06.343768  8424 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:06.344180 11176 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:06.344661 11176 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.344797  9261 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:06.345124 11176 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.345443 11009 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:06.346638  9261 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:06.347636 11245 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:06.348344 11037 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:06.348443 11245 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:06.348642 10996 consensus_queue.cc:1059] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:06.349033 11037 raft_consensus.cc:697] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:06.349249 11245 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.349686 11245 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:06.349941 10996 raft_consensus.cc:3055] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:06.350229 11088 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.350368 10996 raft_consensus.cc:740] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:02:06.338088  8501 leader_election.cc:336] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.105s (SENT)
I20260709 13:02:06.343190  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:06.357566  8385 raft_consensus.cc:2410] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:06.359629  8377 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:06.363267  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:06.335327 11143 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:06.397143 11143 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.397970 11143 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.363636  8500 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:06.388231 11158 consensus_queue.cc:260] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:06.343130 10770 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.391361  8424 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:06.419389  8527 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:06.350176 11037 consensus_queue.cc:237] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:06.393764 11140 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:06.425607  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:06.396409  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:06.396586  8457 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:02:06.423112  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.422050  8535 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:02:06.439193 11152 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:06.350811 11088 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:06.429207 11158 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:06.431273  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 108541us
W20260709 13:02:06.437387  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 50277.3us
W20260709 13:02:06.439203  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 47933.3us
W20260709 13:02:06.454010  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:06.437904  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 101993us
I20260709 13:02:06.440492  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:06.450932  8501 leader_election.cc:336] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.119s (SENT)
W20260709 13:02:06.452911  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.458418  8424 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:06.460738  8427 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:06.470945  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:06.478152  9294 raft_consensus.cc:2410] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:02:06.475620  8501 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:06.485157  8385 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:06.495002  8424 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:06.504009 10993 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:06.505481 11260 log.cc:927] Time spent T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:02:06.507701  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 51703us
I20260709 13:02:06.523465 11245 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:06.457962 11152 raft_consensus.cc:697] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:06.533480  8500 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:06.535678  8424 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:06.533068  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:06.537811  8385 raft_consensus.cc:1275] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:06.493562 11193 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:06.539681  8377 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:06.517026 11215 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:06.457196 10996 consensus_queue.cc:260] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:06.558615 11213 consensus_meta.cc:287] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.509s	user 0.002s	sys 0.013s
W20260709 13:02:06.574163  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 65463.7us
I20260709 13:02:06.555629 10994 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.576000  8351 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:06.560948 11009 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:06.564081 11193 raft_consensus.cc:697] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:06.587536  8384 raft_consensus.cc:1240] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:06.592669  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 57057.5us
W20260709 13:02:06.594599  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 67912.4us
I20260709 13:02:06.571609 11166 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:06.557313 11153 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:02:06.601971  8385 raft_consensus.cc:1240] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:06.603099 11194 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:02:06.603890 11253 log.cc:927] Time spent T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:02:06.604818  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:06.590248 10947 raft_consensus.cc:2764] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:02:06.605625 11266 log.cc:927] Time spent T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:02:06.607932  9289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 717) took 3381 ms. Trace:
I20260709 13:02:06.566668 11065 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:02:06.625386  8500 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:06.627496  8500 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:06.609360 11152 consensus_queue.cc:237] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:06.545482 11140 consensus_queue.cc:1059] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:02:06.627059  9289 rpcz_store.cc:276] 0709 13:02:03.226708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.640570 (+2413862us) service_pool.cc:224] Handling call
0709 13:02:05.641059 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:05.928303 (+287244us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:05.928344 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:05.997028 (+ 68684us) log.cc:844] Serialized 26 byte log entry
0709 13:02:06.132341 (+135313us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:06.132442 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.132888 (+   446us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:06.607618 (+474730us) raft_consensus.cc:1685] finished
0709 13:02:06.607649 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.607844 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28275,"raft.queue_time_us":79939,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"thread_start_us":298991,"threads_started":2,"wal-append.queue_time_us":457789}
I20260709 13:02:06.632417 11194 raft_consensus.cc:697] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:06.632659 10639 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:06.633512 11194 consensus_queue.cc:237] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:06.635429 11193 consensus_queue.cc:237] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:06.643404  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:06.610108 10770 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:06.645066  8528 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:06.659673  9258 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:06.611786  8351 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:06.593856  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:06.624476  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 173579us
W20260709 13:02:06.609844 11259 log.cc:927] Time spent T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:02:06.670818 10770 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:06.671717 11166 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:06.610925 11245 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:06.670178  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:06.679314 10996 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.679641 11050 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:02:06.614729 11009 raft_consensus.cc:697] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:06.685132  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:06.686249  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 73246.8us
W20260709 13:02:06.690500  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 78767.4us
I20260709 13:02:06.628569 10994 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.692916  8424 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:06.684872  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:02:06.698056  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 70708.9us
I20260709 13:02:06.694159 11132 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:06.699080 11132 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.699457 11132 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:06.700090  8500 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:06.701325 10994 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:06.702773 10994 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.701498  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:06.704147  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.718822 11131 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:06.719729 11159 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.723186 11143 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:06.725024  9290 raft_consensus.cc:2393] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 8: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
W20260709 13:02:06.726799 11263 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.457s	user 0.000s	sys 0.002s
I20260709 13:02:06.732388 11088 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:06.733973 11241 consensus_meta.cc:287] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.822s	user 0.005s	sys 0.011s
I20260709 13:02:06.734546 11241 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:06.738289 11127 raft_consensus.cc:3055] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:06.738759 11127 raft_consensus.cc:740] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:02:06.739280 11147 consensus_meta.cc:287] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.766s	user 0.010s	sys 0.000s
I20260709 13:02:06.739656 11127 consensus_queue.cc:260] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:06.740839  9288 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:06.741637 11143 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:06.742594  9288 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55734 (request call id 723) took 3109 ms (client timeout 2134 ms). Trace:
I20260709 13:02:06.742261 11009 consensus_queue.cc:237] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:06.743048  9288 rpcz_store.cc:269] 0709 13:02:03.633596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.639439 (+2005843us) service_pool.cc:224] Handling call
0709 13:02:06.742413 (+1102974us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b54004b9954. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:06.742523 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1509163904}
I20260709 13:02:06.744418 11153 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:06.745016 11153 raft_consensus.cc:697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:06.745944 11153 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:06.747650  8351 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:06.748536  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 55012.1us
I20260709 13:02:06.704489 11137 raft_consensus.cc:3055] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:06.710074 11270 log.cc:927] Time spent T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:02:06.697228  8424 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:06.714548 11155 raft_consensus.cc:3055] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:06.716861 11261 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.449s	user 0.002s	sys 0.000s
I20260709 13:02:06.717542 11186 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:06.717054 11132 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:06.718035 11146 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:06.718552 11050 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:06.750525  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:06.750242  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:06.766548  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:06.736945 11241 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:06.760062 11127 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.792876  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:06.769274  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 72136.8us
I20260709 13:02:06.774737  8500 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:06.759653 11137 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:06.763304 11131 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:06.796243  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:06.795455  8379 raft_consensus.cc:2393] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 8: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:06.800209  8531 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.763165 11155 raft_consensus.cc:740] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:06.804711  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.739684 11147 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:06.841977  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:06.846171  8386 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:06.767951 11166 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:06.855508  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:06.858273  8379 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.856230  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:06.860193  8427 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:06.796797 11186 raft_consensus.cc:697] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:06.869397 10993 raft_consensus.cc:2764] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:02:06.873716 11037 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.877418  8427 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:06.878865 10770 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:06.879504 10770 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.879994 10770 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:06.888171 10408 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.891403 11037 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:06.893895  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:06.894244 11037 consensus_queue.cc:1059] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:06.894673  8384 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:02:06.895306 10639 raft_consensus.cc:3055] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:06.902320  9289 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:06.902242 10639 raft_consensus.cc:740] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:06.903461 10639 consensus_queue.cc:260] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:06.904981 11218 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.905529 11218 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:06.843243 11146 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:06.906764 11146 raft_consensus.cc:697] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:06.907717 11146 consensus_queue.cc:237] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:06.896313  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:06.920113  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 158746us
I20260709 13:02:06.920440  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:06.856853 11131 raft_consensus.cc:697] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:06.923542  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:06.917733  8386 raft_consensus.cc:2376] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9. Re-sending same reply.
I20260709 13:02:06.926316  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:06.930047  8528 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.934506  8385 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
W20260709 13:02:06.935175  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.912922 10639 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.941885  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:06.946893  8527 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:02:06.952418  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:06.868448 11166 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:06.957219  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:06.958127  8535 raft_consensus.cc:1240] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:06.954631  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:06.963155  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:06.961056  9296 raft_consensus.cc:2376] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7. Re-sending same reply.
W20260709 13:02:06.952725 11165 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.006s	sys 0.014s
W20260709 13:02:06.968549 11165 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.006s	sys 0.015s
I20260709 13:02:06.969553  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:06.970312  9287 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:02:06.944115 10865 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.971623 10865 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:06.974362 10865 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:06.975284 11132 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:06.934156 11137 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:06.980919 11137 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.980818 11155 consensus_queue.cc:260] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:06.983152 11155 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.985373 11186 consensus_queue.cc:237] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:06.987782  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:06.973922 11131 consensus_queue.cc:237] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:06.940948  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:07.002199  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:07.017405  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 57614.1us
I20260709 13:02:07.023018  8531 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
W20260709 13:02:07.022874 11176 consensus_meta.cc:287] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.675s	user 0.003s	sys 0.009s
I20260709 13:02:07.034799  8424 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:07.039847  9258 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:07.047391  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.048925  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:07.056844  8527 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:07.059082 11147 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:07.059892  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 97885.7us
I20260709 13:02:07.060266  8532 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:07.060863  8500 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:07.096549  8531 raft_consensus.cc:3055] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:07.097117  8531 raft_consensus.cc:740] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:07.024397 11145 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:02:07.075685 11285 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:07.103360  8533 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:07.068782 11245 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:07.093570 11140 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.134910  8535 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:02:07.135378  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 74642.8us
I20260709 13:02:07.066584 11152 consensus_queue.cc:1059] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:02:07.104336 11159 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:07.146360  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:07.063136 11176 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:07.122761 11285 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:07.161984  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 204950us
I20260709 13:02:07.160696  8531 consensus_queue.cc:260] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:07.145257 11245 raft_consensus.cc:697] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:07.131287 11241 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:02:07.173863 10971 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:07.174532  9294 raft_consensus.cc:2368] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7.
I20260709 13:02:07.174831  8380 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:02:07.173862  8531 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.152858 11132 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.168510  8500 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:07.159677 11285 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.177752  8380 pending_rounds.cc:85] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 7
I20260709 13:02:07.184636  8380 pending_rounds.cc:107] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:02:07.184947  8380 raft_consensus.cc:2889] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:07.149804 11140 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:07.174366 11165 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:07.200080 11159 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:07.212354  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 170598us
W20260709 13:02:07.214089  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.215266  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.200915 11289 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
W20260709 13:02:07.216965  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.219324  8500 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:07.213600 11282 log.cc:927] Time spent T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:02:07.223893 11159 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:07.215832 11166 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:07.234741 10770 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:07.193367 11132 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:07.240370  8454 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
W20260709 13:02:07.216799 10996 consensus_meta.cc:287] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.003s
I20260709 13:02:07.242198  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:07.249872  8378 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:07.185796 10971 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:07.264923  8527 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
W20260709 13:02:07.248857  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.266839  8528 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:07.203095 11165 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:07.246240 11140 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:07.292052  8426 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:07.273756  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 61201us
I20260709 13:02:07.272423 11218 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:07.317456  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:07.319787  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:07.321806  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.317539 11186 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:07.324499 11166 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:07.325778  8500 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:02:07.325924  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.330754  8457 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:07.337539  8381 raft_consensus.cc:3055] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:07.337951  8381 raft_consensus.cc:740] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:02:07.333068 11292 log.cc:927] Time spent T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.167s	user 0.001s	sys 0.001s
I20260709 13:02:07.325959 10971 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:07.355871  8379 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
W20260709 13:02:07.357268  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 336791us
W20260709 13:02:07.344058  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 179332us
I20260709 13:02:07.290009 11245 consensus_queue.cc:237] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:07.338167 11286 log.cc:927] Time spent T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:02:07.355270  8381 consensus_queue.cc:260] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:07.340168 10865 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:07.369648  8381 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:07.370546  8349 leader_election.cc:336] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.551s (SENT)
W20260709 13:02:07.371188  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 45470.4us
I20260709 13:02:07.325062 11166 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:07.364245  9261 leader_election.cc:336] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.512s (SENT)
I20260709 13:02:07.378295  9261 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:07.364795 11293 log.cc:927] Time spent T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.102s	user 0.001s	sys 0.001s
W20260709 13:02:07.383177  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.372011 11290 log.cc:927] Time spent T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:02:07.370015 10865 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:07.377028 11194 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.411612  8457 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:07.418331  8456 raft_consensus.cc:1240] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:07.380131 11159 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.405402 11243 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:07.384598 11050 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.414007  8500 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:07.423574  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:07.382532 11152 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:02:07.438103  8383 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:02:07.438542  8383 pending_rounds.cc:85] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 4
I20260709 13:02:07.438788  8383 pending_rounds.cc:107] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:02:07.439013  8383 raft_consensus.cc:2889] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:07.439482 11287 log.cc:927] Time spent T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:02:07.440681 10971 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:07.441430 10996 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.441298 10971 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:07.441937 10996 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:07.443540 10971 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:07.443913 10996 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:07.420225 11194 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:07.445824 11295 log.cc:927] Time spent T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:02:07.447183 11194 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:07.447384  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 83327.8us
I20260709 13:02:07.447417  9292 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:07.449515  9261 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:07.452054  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:07.453392  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2337) took 1186 ms. Trace:
I20260709 13:02:07.453538  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:07.454064  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:07.455049  9296 raft_consensus.cc:2368] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5.
I20260709 13:02:07.453825  8377 rpcz_store.cc:276] 0709 13:02:06.266792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.547485 (+280693us) service_pool.cc:224] Handling call
0709 13:02:06.561994 (+ 14509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.572535 (+ 10541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.572582 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:06.585424 (+ 12842us) log.cc:844] Serialized 26 byte log entry
0709 13:02:06.859635 (+274211us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:06.859672 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.859728 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:07.453167 (+593439us) raft_consensus.cc:1685] finished
0709 13:02:07.453188 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.453328 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2842,"raft.queue_time_us":10198,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":13294,"thread_start_us":237690,"threads_started":1,"wal-append.queue_time_us":510161}
I20260709 13:02:07.433743 11050 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:07.437430  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:07.449627 11165 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:07.412402 10865 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.453610  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:07.444967  8381 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:02:07.456852 11165 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:07.466042  9293 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:07.483136  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:07.459208  8349 leader_election.cc:336] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.734s (SENT)
W20260709 13:02:07.481518  8351 connection.cc:256] RPC call timeout handler was delayed by -2.1334016380000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
W20260709 13:02:07.426595 11298 log.cc:927] Time spent T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:02:07.466022  8381 pending_rounds.cc:85] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 5
I20260709 13:02:07.372572 11300 consensus_queue.cc:1059] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:02:07.495640  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:07.496279  8527 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:07.496546  8528 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:07.485925  8381 pending_rounds.cc:107] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:02:07.498364  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:02:07.498262  8271 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 56cc480ba6f642e08bb2e547a0ef50a1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d653e71832b7402b9a03b46249d3b885 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:07.498742  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:07.499387  9288 raft_consensus.cc:2393] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 5: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:07.497336  8381 raft_consensus.cc:2889] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:07.501653  8458 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:07.501889  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:07.492717  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:07.502765 11166 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:07.503032  9296 raft_consensus.cc:2393] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 4: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:07.503160  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:07.503575 11166 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:07.504886 11050 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:07.505158  8452 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:02:07.506960  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:07.507907  8459 raft_consensus.cc:2393] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 7: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:07.503867  8453 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
W20260709 13:02:07.497310  8351 leader_election.cc:336] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Timed out: RequestConsensusVote RPC to 127.7.25.196:40669 timed out after 1.695s (SENT)
I20260709 13:02:07.509269  8351 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:07.513545  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:07.515496  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:07.516923 10971 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:07.517462  9261 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:07.517839  8455 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:02:07.518447 10971 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:07.519196  9261 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:07.519101 10971 consensus_queue.cc:1059] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:07.520386 10971 raft_consensus.cc:3055] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:07.520798 10971 raft_consensus.cc:740] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:07.521701 10971 consensus_queue.cc:260] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:07.522866 10971 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:07.532905 10865 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:07.482676 10993 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:07.533990  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 519) took 1207 ms. Trace:
I20260709 13:02:07.534448 10993 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:07.535462 10993 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.534449  8530 rpcz_store.cc:276] 0709 13:02:06.326822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.651022 (+324200us) service_pool.cc:224] Handling call
0709 13:02:06.651440 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.681199 (+ 29759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.681249 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:06.681946 (+   697us) log.cc:844] Serialized 26 byte log entry
0709 13:02:06.944033 (+262087us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:06.944089 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.944182 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:07.533776 (+589594us) raft_consensus.cc:1685] finished
0709 13:02:07.533797 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.533931 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9411,"raft.queue_time_us":30696,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":24987,"thread_start_us":261482,"threads_started":1,"wal-append.queue_time_us":471170}
W20260709 13:02:07.538213 10639 consensus_meta.cc:287] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.579s	user 0.007s	sys 0.003s
I20260709 13:02:07.552733  8500 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:07.554141 11050 raft_consensus.cc:2764] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
W20260709 13:02:07.554450  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 60363.9us
I20260709 13:02:07.558785 11285 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:07.562850  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 53566.6us
I20260709 13:02:07.574393  8426 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:07.574915 11176 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:07.576162  8426 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:07.578382  9294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55720 (request call id 423) took 1080 ms. Trace:
I20260709 13:02:07.578804  9294 rpcz_store.cc:276] 0709 13:02:06.498872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.528627 (+ 29755us) service_pool.cc:224] Handling call
0709 13:02:07.578166 (+1049539us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b54005d25d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:07.578312 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1457741696}
I20260709 13:02:07.580051 11088 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:07.580744 11218 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:07.583117  8427 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:07.601401  8454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:07.611464  9293 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
W20260709 13:02:07.598390  8349 leader_election.cc:336] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.847s (SENT)
W20260709 13:02:07.615769  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 59016.8us
W20260709 13:02:07.623373  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 126085us
I20260709 13:02:07.623811 10993 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:07.624888  8351 leader_election.cc:336] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Timed out: RequestConsensusVote RPC to 127.7.25.196:40669 timed out after 1.759s (SENT)
I20260709 13:02:07.626412 10993 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:07.628036  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:07.628643  8380 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:07.628597  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:07.630537  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:07.632059  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:07.632649  8534 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:02:07.638410  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:07.640560  8454 raft_consensus.cc:606] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:07.427757 11159 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:07.641045  8454 raft_consensus.cc:614] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:07.642092  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:07.642495  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 44134.3us
I20260709 13:02:07.643898  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:07.644486  8532 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:07.644717  8377 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
W20260709 13:02:07.646526  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 70490.9us
I20260709 13:02:07.648797  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:07.648993  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:07.649816  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:07.633972 11140 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:07.627416 11153 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:07.651827  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.651648  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:07.651912  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:07.658245  8379 raft_consensus.cc:2376] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4. Re-sending same reply.
I20260709 13:02:07.658767  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:07.655344  8381 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:02:07.659350  8426 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:07.633747 11176 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:07.657692  8378 raft_consensus.cc:2368] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8.
I20260709 13:02:07.653237  8427 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:07.660303  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 141192us
I20260709 13:02:07.634438 11037 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:07.662463  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:07.663100  9293 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:07.667039  8385 raft_consensus.cc:2393] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 8: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:07.668340  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:07.669337  8377 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:02:07.670893  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:07.671550  9294 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:02:07.672444  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:07.685616 11088 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:07.685876 11283 raft_consensus.cc:3055] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:02:07.686554 11307 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.242s	user 0.003s	sys 0.000s
I20260709 13:02:07.688014 11152 raft_consensus.cc:3055] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:07.688418 11152 raft_consensus.cc:740] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:07.690639 11284 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:07.694443 10865 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:07.696527  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:07.697221  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:07.697808  8531 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:07.700107 11281 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:07.701203 11176 raft_consensus.cc:697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:07.701695  8534 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:07.702179 11176 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:07.702682  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:07.703749  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:07.705498  8530 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:07.706436  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:07.707088 11285 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:07.707458  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:07.668789 11153 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:07.708477  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:07.686473 11283 raft_consensus.cc:740] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:07.709239  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:07.709937  8528 raft_consensus.cc:2368] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12.
I20260709 13:02:07.710325 11153 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:07.710041 11283 consensus_queue.cc:260] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:02:07.664470 11037 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.711052  8535 raft_consensus.cc:1240] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 7. Ops: []
I20260709 13:02:07.711349  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:07.711515 11283 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.712024  8527 raft_consensus.cc:2368] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8.
I20260709 13:02:07.712864  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:07.710659  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:07.714669  8535 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:07.715204  8532 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:02:07.726585  8534 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:02:07.726846  8527 raft_consensus.cc:1240] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:07.715448  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 49357.8us
I20260709 13:02:07.728433  8426 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:07.729842  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:07.711159 11037 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:07.730904  8527 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.686362 11088 raft_consensus.cc:697] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:07.735277  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:07.736340  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:07.737010  8535 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:07.738785  8533 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:07.738994  8460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:07.743081  8460 raft_consensus.cc:606] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:07.739799  9258 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:07.762080  8528 raft_consensus.cc:3055] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:07.762516  8528 raft_consensus.cc:740] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:07.763890  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:07.764782  8526 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:07.744583  8532 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:07.716048 11300 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:07.771859  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:07.774130  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:07.775092  8534 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
W20260709 13:02:07.778046  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 85997us
I20260709 13:02:07.778684  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:07.779222  8459 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:07.761291 10997 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.004s	sys 0.004s
W20260709 13:02:07.805982 10997 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.005s	sys 0.005s
I20260709 13:02:07.808166  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:07.796713 11281 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:02:07.808790  8379 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.810498 11159 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:07.811383  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:07.811964  8533 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:07.783629 11132 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:07.816139  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:07.789525  9292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55720 (request call id 425) took 1221 ms. Trace:
I20260709 13:02:07.817364  9292 rpcz_store.cc:276] 0709 13:02:06.569225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.577516 (+  8291us) service_pool.cc:224] Handling call
0709 13:02:06.672926 (+ 95410us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b5800220e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd44b0a0 00007f36cd44a984 00007f36c69c56d4 00007f36c69c5662
0709 13:02:07.789351 (+1116425us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b5400533c54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:07.789464 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1309775488}
I20260709 13:02:07.790971  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:07.818734  8457 raft_consensus.cc:606] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Received request to transfer leadership to TS 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:07.819077  8457 raft_consensus.cc:614] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:07.792754 10770 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:07.821142  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.801659  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:07.822678  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:07.823417 11088 consensus_queue.cc:237] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:07.824427  8457 raft_consensus.cc:606] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
W20260709 13:02:07.830632  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 408310us
I20260709 13:02:07.836374  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:07.839160 11166 consensus_queue.cc:1059] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:07.840618 10865 raft_consensus.cc:3055] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:07.841005 10865 raft_consensus.cc:740] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:07.841822 10865 consensus_queue.cc:260] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:07.843109 10865 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:07.843472  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.845005  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.846210  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:07.847771  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:07.849050  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:07.850004  8535 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.771178 11152 consensus_queue.cc:260] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:07.805218 11301 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.336s	user 0.006s	sys 0.000s
W20260709 13:02:07.851351  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.851759  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.852120  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.771808  8528 consensus_queue.cc:260] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:07.862316  8379 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:02:07.862628  8527 raft_consensus.cc:2410] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:07.863941  8380 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:02:07.865835  8531 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:07.867072  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:07.871804  8533 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
W20260709 13:02:07.874166  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 95817.6us
I20260709 13:02:07.770298 11284 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:07.769837 11245 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:07.887714  8528 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.884742  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:07.889621  8457 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.890596  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:07.885290  8530 raft_consensus.cc:1240] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:07.877748  8427 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:07.765780 11312 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:07.893721  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:07.895377  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:07.896103  8533 raft_consensus.cc:2368] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8.
I20260709 13:02:07.902518  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:07.903316  8453 raft_consensus.cc:2393] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 6: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:07.901662  8526 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:07.908859  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:07.928251  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 51687.2us
I20260709 13:02:07.928987  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:07.929744  8534 raft_consensus.cc:2393] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 7: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:07.929272  9258 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:07.936645  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:07.937911  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 199435us
I20260709 13:02:07.939291  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:07.876513 11146 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.939875  8526 raft_consensus.cc:2376] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9. Re-sending same reply.
I20260709 13:02:07.955224  8457 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:02:07.959969  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:07.959414  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:07.940770  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:07.966375  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:07.967093  8533 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.968703  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:07.975131  8535 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:07.977697  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:07.997490  8459 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:02:08.000238  8528 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:02:08.000855  8528 pending_rounds.cc:85] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 5
W20260709 13:02:07.979142  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.001320  8528 pending_rounds.cc:107] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:02:08.001701  8528 raft_consensus.cc:2889] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:08.002274  8349 leader_election.cc:336] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 2.074s (SENT)
I20260709 13:02:07.981535  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:08.002766  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:08.003460  8526 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 5: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:07.941715 10770 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:07.984314  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:07.985713 11037 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:07.937290 11245 raft_consensus.cc:697] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:08.004448  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:08.005903  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:07.903987 11145 consensus_queue.cc:1059] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:02:08.002710  8349 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:08.006515  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:08.018982  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:08.021203  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:08.021912  9296 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:08.022352  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:08.022919  8531 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:02:08.023664  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:08.024585  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:08.027344  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:07.976394 11241 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:08.031539  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:08.019876  8528 raft_consensus.cc:2376] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8. Re-sending same reply.
I20260709 13:02:08.033144  8531 raft_consensus.cc:2368] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12.
I20260709 13:02:07.957442 11244 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:02:08.040441  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2012) took 1108 ms. Trace:
I20260709 13:02:07.928937 11312 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:08.035249  8526 raft_consensus.cc:2376] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7. Re-sending same reply.
I20260709 13:02:08.035895  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:08.037009  8535 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:08.037706  8533 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:08.041882  8532 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
W20260709 13:02:08.051640  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 49383.3us
W20260709 13:02:08.043568  8501 leader_election.cc:336] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.110s (SENT)
I20260709 13:02:08.054764  8501 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:08.057880  8351 leader_election.cc:400] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5.
I20260709 13:02:08.014906 11137 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:07.961910 11146 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:08.041563  9292 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:08.029970 10770 raft_consensus.cc:697] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:08.065287  8530 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:02:08.040868  8529 rpcz_store.cc:276] 0709 13:02:06.920925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.925567 (+  4642us) service_pool.cc:224] Handling call
0709 13:02:06.925923 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.943577 (+ 17654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.943604 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:06.995823 (+ 52219us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.354218 (+358395us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:07.354260 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.354343 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:07.684724 (+330381us) spinlock_profiling.cc:243] Waited 44.8 ms on lock 0x7b24001fd078. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c521e9c4 00007f36c521cacb 00007f36c53d7dc9 00007f36c53d7a55 00007f36c53d709d 00007f36c800910e 00007f36c802088c 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221
0709 13:02:08.025754 (+341030us) raft_consensus.cc:1685] finished
0709 13:02:08.025777 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.029480 (+  3703us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2771,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":46421,"spinlock_wait_cycles":103022848,"thread_start_us":284155,"threads_started":1,"wal-append.queue_time_us":348756}
I20260709 13:02:08.035036 11241 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.075366  8382 raft_consensus.cc:3055] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:08.075814  8382 raft_consensus.cc:740] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:08.056229 11153 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.078694  8351 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:08.058230 11127 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:08.030100 11131 consensus_queue.cc:1059] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:02:08.084353  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 210790us
W20260709 13:02:08.084642  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 53498.8us
I20260709 13:02:08.082702  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:08.089143  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 45611.9us
I20260709 13:02:08.082741  8382 consensus_queue.cc:260] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:08.089495  8530 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:02:08.094918  8382 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:08.079401 11241 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:08.081885 11159 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:08.104995  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:08.108695  8351 leader_election.cc:400] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7.
I20260709 13:02:08.109201  8351 leader_election.cc:403] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:02:08.111829  8424 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:08.101928  9260 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
W20260709 13:02:08.126891  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.096380 11284 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:02:08.113788 11137 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:08.090162 11153 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:08.157109 11324 log.cc:927] Time spent T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:02:08.160557  9258 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:08.170120  8529 raft_consensus.cc:1240] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:08.171743  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 63231.9us
I20260709 13:02:08.132323 10639 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:08.129160 11329 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:02:08.180024  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 55928.3us
I20260709 13:02:08.182446  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:08.189441  8501 leader_election.cc:336] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.057s (SENT)
I20260709 13:02:08.174261 11332 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:08.113509 11245 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:08.217152  8531 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:08.218535 11166 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.181353 10639 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:08.221959 11319 log.cc:927] Time spent T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:02:08.223796 11321 log.cc:927] Time spent T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:02:08.238597  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.221365 11037 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:08.176923 11088 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
W20260709 13:02:08.263705  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:08.264408  8349 leader_election.cc:336] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 2.108s (SENT)
I20260709 13:02:08.268177  8382 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:02:08.275449  8382 pending_rounds.cc:85] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 1
I20260709 13:02:08.275808  8382 pending_rounds.cc:107] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:02:08.276124  8382 raft_consensus.cc:2889] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:08.263675 11131 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:08.138849 10770 consensus_queue.cc:237] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:08.228989 11332 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.283017 11132 consensus_queue.cc:1059] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:02:08.289539  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.291781 11009 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:08.295518  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:08.315204  8529 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:08.296844 11325 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.341s	user 0.001s	sys 0.000s
I20260709 13:02:08.299227  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:08.269989 11322 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:02:08.307461  9296 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:02:08.281740  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:08.316596  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 144047us
I20260709 13:02:08.269745 10639 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:08.210430 11243 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:02:08.265714 11329 raft_consensus.cc:697] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:02:08.324415  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.349320  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:08.349557  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:08.350136  8526 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:08.326834  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:08.323504 11155 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:08.357337  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.321949 10971 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:02:08.317093 11332 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:08.269187 11166 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:08.324081 11336 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:02:08.370744  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.373337  8526 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:08.375248  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:08.377818  8526 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:02:08.389482 11330 log.cc:927] Time spent T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 13:02:08.392474 10865 consensus_meta.cc:287] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.000s
I20260709 13:02:08.394398  8534 raft_consensus.cc:2410] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:08.394763 11338 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.395470 11338 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:08.404738  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 77998.9us
I20260709 13:02:08.407145  8351 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:08.419929  8535 raft_consensus.cc:1240] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:08.424240 11131 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7.
I20260709 13:02:08.428504 11244 raft_consensus.cc:3055] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:08.429014 11244 raft_consensus.cc:740] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:08.429342 11153 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:08.429862 11244 consensus_queue.cc:260] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:08.430619 11153 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:08.430907 11244 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:08.431059 11153 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:08.431550 11153 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:08.364773 11155 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:08.405927 11283 consensus_meta.cc:287] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.673s	user 0.006s	sys 0.005s
I20260709 13:02:08.458535  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:08.459424  8382 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:08.407509 11146 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:08.468420  8500 connection.cc:256] RPC call timeout handler was delayed by -4.1681064720000336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
W20260709 13:02:08.468637  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 61593us
W20260709 13:02:08.469059  8500 connection.cc:256] RPC call timeout handler was delayed by -3.176443087999985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2223s for a response
W20260709 13:02:08.469630  8500 connection.cc:256] RPC call timeout handler was delayed by -3.1156952780000324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1826s for a response
W20260709 13:02:08.470011  8500 connection.cc:256] RPC call timeout handler was delayed by -2.7691952780000406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
W20260709 13:02:08.477501  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 166953us
I20260709 13:02:08.498159  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:08.501008  8453 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:08.505520  8500 leader_election.cc:400] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8.
I20260709 13:02:08.506094  8500 leader_election.cc:403] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:08.511045 11137 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:08.513752  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:08.514434  8459 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
W20260709 13:02:08.474076 11176 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.003s	sys 0.008s
I20260709 13:02:08.471549 11336 raft_consensus.cc:697] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:08.515398  8382 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:08.521487  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:08.525952  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:08.518522 11176 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.003s	sys 0.009s
I20260709 13:02:08.529018  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:08.532760  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:08.535362  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.535826  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:08.433761 11329 consensus_queue.cc:237] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:08.538579  8460 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:08.518360 10865 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8.
I20260709 13:02:08.515398 11347 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:08.543064  8529 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:08.544378  8351 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:08.547835  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.549360 11357 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:08.549831 11357 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.550163 11357 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:08.533102 11349 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:02:08.557405 11349 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:08.557909 11314 raft_consensus.cc:3055] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:08.558372 11314 raft_consensus.cc:740] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:08.559263 11314 consensus_queue.cc:260] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:08.561216 11312 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:08.566147  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:08.567092  8527 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:08.571115  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:08.528257 11137 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:02:08.589974  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:08.586977 10865 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:08.590183 10770 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:08.591936 11155 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:08.596330 11343 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:02:08.599642  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:08.600478  8457 raft_consensus.cc:2393] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:08.625494  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:08.626446  8455 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:02:08.627844 11153 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:08.629824 11348 log.cc:927] Time spent T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:02:08.631242 11153 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:08.641415 11336 consensus_queue.cc:237] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:08.572511 11347 raft_consensus.cc:697] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:08.649439 11166 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:08.557981 11349 raft_consensus.cc:697] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:02:08.678874  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.640955 11332 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:08.729411 11153 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:08.730593 11362 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.730422 11153 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:02:08.731168 11362 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:08.733891  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:08.734586  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:08.735370  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:08.735612  8457 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:02:08.735546 10639 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:08.736642  8452 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:08.736996  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:08.737255  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:08.737727  8457 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
W20260709 13:02:08.738333  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.739157  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:08.739732  8461 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:02:08.738870  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:08.741436  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:08.741677  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.741454  8427 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:08.742700  8460 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
W20260709 13:02:08.742888  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 88897.9us
I20260709 13:02:08.747535 10408 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:08.745589 11186 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:08.752979 11186 raft_consensus.cc:697] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:08.753908 11283 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:08.756879  8458 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:02:08.764238  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 231334us
I20260709 13:02:08.781345  8500 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:08.783632  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 239313us
I20260709 13:02:08.763921 11153 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:08.789450  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:08.790290  8382 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:08.793360  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:08.795552  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:08.783073 11241 consensus_meta.cc:287] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.667s	user 0.008s	sys 0.004s
I20260709 13:02:08.800868  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:08.801501  8381 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
W20260709 13:02:08.801957  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.802938  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:08.803627  8381 raft_consensus.cc:2393] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 8: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:08.810708  8382 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:08.811828  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:08.812873  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:08.814883  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:08.815487  8381 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:02:08.817492  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:08.819412  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:08.819826  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:08.820204  8386 raft_consensus.cc:2393] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 5: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:02:08.821357  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.821234  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:08.822384  8500 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:08.823936 11366 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:08.824858  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 84384.1us
I20260709 13:02:08.828651  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:08.836594  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:08.839983  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:08.840793  8526 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:08.842720  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.854017  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:08.829578  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:08.930886  8385 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:08.933038  8384 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:02:08.934445  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 107807us
I20260709 13:02:08.936684  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:08.787122 11367 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:08.957332  8424 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:08.753917 11186 consensus_queue.cc:237] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:08.996059  8424 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:09.003407  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.017424  8526 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
W20260709 13:02:09.062058  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:09.097028  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:09.125440  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.147364  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:09.148259  8384 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:02:08.741115 11349 consensus_queue.cc:237] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:08.798728 11137 consensus_queue.cc:1059] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.156s
W20260709 13:02:09.153194  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 157227us
I20260709 13:02:09.153836 10408 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:09.178586 10408 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.179124 10408 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.159309  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:09.180696  8534 raft_consensus.cc:2393] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 7: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:09.172070  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:08.932322 11362 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:09.186619  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:09.187549  8533 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:08.945447 11366 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:08.819355 11241 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.184957  8530 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:08.957834 11367 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:09.192922  8377 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:02:09.202700  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:09.203250  8458 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:02:09.203552  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 420605us
I20260709 13:02:09.205035  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:09.205950  8460 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 5: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:09.145933 10639 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:08.946205 11009 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.245s
W20260709 13:02:09.187701 11334 log.cc:927] Time spent T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:02:09.164680 11299 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:09.149431 11359 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:09.163419 11355 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:09.235127  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:09.235946  8382 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:09.213929  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:09.235967  8385 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:02:09.242058  8381 raft_consensus.cc:1240] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:09.212499  8533 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
W20260709 13:02:09.218293 11323 log.cc:927] Time spent T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 1.264s	user 0.005s	sys 0.013s
I20260709 13:02:09.218643 11241 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:09.247491 11368 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:09.248116 11368 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:09.249963 11244 consensus_meta.cc:287] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.819s	user 0.007s	sys 0.006s
I20260709 13:02:09.250444 11368 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:09.219067 11320 log.cc:927] Time spent T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 1.104s	user 0.006s	sys 0.007s
W20260709 13:02:09.219471 11360 log.cc:927] Time spent T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.262s	user 0.000s	sys 0.000s
I20260709 13:02:09.203853 11366 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:09.219720 11369 log.cc:927] Time spent T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 13:02:09.220470 11353 log.cc:927] Time spent T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.620s	user 0.008s	sys 0.076s
I20260709 13:02:09.256002 11366 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:09.220748 11363 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:02:09.221768 11345 log.cc:927] Time spent T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:02:09.229149 11152 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:09.213320  8271 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 56cc480ba6f642e08bb2e547a0ef50a1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d653e71832b7402b9a03b46249d3b885 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:02:09.259657  8271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 53230.7us
W20260709 13:02:09.262760 11342 log.cc:927] Time spent T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.888s	user 0.017s	sys 0.006s
I20260709 13:02:09.205106 11367 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:09.269179 11355 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.270407  8284 catalog_manager.cc:5697] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 5 to 6, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 6 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:09.272286 11355 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:09.244962  8385 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:09.165616 11166 consensus_queue.cc:1059] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:02:09.281571 11166 raft_consensus.cc:3055] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:09.281972 11166 raft_consensus.cc:740] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:09.280279  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:09.280279 11243 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:09.162338 11347 consensus_queue.cc:237] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.285279  8378 raft_consensus.cc:1275] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:02:09.300838  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.300262 10408 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:09.283360 11357 consensus_meta.cc:287] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.733s	user 0.013s	sys 0.000s
I20260709 13:02:09.305794  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:09.243044 11176 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.308840 10408 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:09.313467  8379 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:09.273737 11299 raft_consensus.cc:697] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:09.314618  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:09.316071  8461 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.017s	sys 0.021s
I20260709 13:02:09.243845 11359 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:09.315073 11357 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:09.375119  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:09.322356  8461 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.017s	sys 0.021s
W20260709 13:02:09.380777  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 202206us
I20260709 13:02:09.388530  8379 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:09.316171 11176 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.388824  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:09.415560 11359 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:09.376762 11299 consensus_queue.cc:237] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:09.425765 11354 log.cc:927] Time spent T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.792s	user 0.025s	sys 0.066s
I20260709 13:02:09.426456 11357 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:09.425302  8501 connection.cc:256] RPC call timeout handler was delayed by -1.1124580970000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
I20260709 13:02:09.382853  9287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 736) took 1372 ms. Trace:
I20260709 13:02:09.442912  8385 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:09.444337  9258 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:09.451682  8533 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:09.331162 11166 consensus_queue.cc:260] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.455518 11243 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:09.458434  8533 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:02:09.458882  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:09.460227  8531 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
W20260709 13:02:09.453518 11352 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.011s	sys 0.029s
I20260709 13:02:09.458320 11186 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.477600 11176 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:09.478199 11166 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.479875 11332 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:09.469950 11352 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.011s	sys 0.029s
I20260709 13:02:09.459401 11243 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:09.489060  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.512271  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:09.516446  8529 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.510788  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:09.510788  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:09.521102  8380 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.510857  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:09.513741  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:09.523900  8535 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:09.526544  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 95951.7us
W20260709 13:02:09.527240  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 97364.8us
W20260709 13:02:09.528685  8501 connection.cc:256] RPC call timeout handler was delayed by -1.0532746260000181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
I20260709 13:02:09.512207 11384 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:09.531627  8501 connection.cc:256] RPC call timeout handler was delayed by -1.0161580970000159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
I20260709 13:02:09.494338 11383 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.512454  8284 catalog_manager.cc:5697] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 2 to 4, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 4 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:09.516274 11243 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.531203  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:09.537549  8501 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:09.545341  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:09.546731  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:09.503883 11367 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.553220 11213 consensus_queue.cc:1048] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:09.554281  8527 raft_consensus.cc:1240] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:09.554935 11338 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:09.553838 11367 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:09.561290 11366 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:09.562451  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2037) took 1268 ms. Trace:
I20260709 13:02:09.562117 11366 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.562918  8528 rpcz_store.cc:276] 0709 13:02:08.294140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.295476 (+  1336us) service_pool.cc:224] Handling call
0709 13:02:08.295852 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.397700 (+101848us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:08.398112 (+   412us) log.cc:844] Serialized 14 byte log entry
0709 13:02:08.495975 (+ 97863us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.523419 (+ 27444us) log.cc:844] Serialized 26 byte log entry
0709 13:02:08.524108 (+   689us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:08.524155 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.561997 (+1037842us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400169c54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:09.562055 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.562113 (+    58us) raft_consensus.cc:1685] finished
0709 13:02:09.562219 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.562381 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3394,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":623,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":3208,"spinlock_wait_cycles":232937856,"thread_start_us":97209,"threads_started":1,"wal-append.queue_time_us":154336,"wal-append.run_cpu_time_us":2049,"wal-append.run_wall_time_us":1002082}
I20260709 13:02:09.523859 11146 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.567188  9296 raft_consensus.cc:1240] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:09.582422  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:09.586970  9294 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:02:09.609426  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.509323 11186 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:09.540453 11389 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.548065 11359 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:09.608278  8500 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:09.617404  8380 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:09.545611 11355 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:09.615881  8535 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:09.619428  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:09.565699 11368 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.621598  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:09.625154  8529 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:09.586663 11166 raft_consensus.cc:2764] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:02:09.623512  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:09.586563 11194 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.625873  8500 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:09.622452  8526 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:09.626077  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:09.635082  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 97582.7us
I20260709 13:02:09.640308  8500 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:09.631374 11245 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:09.642342 11245 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.643011 11166 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:09.643530 11166 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.643911 11166 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.644414  8383 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:09.645409 11194 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.628428 11355 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:09.648211 11194 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:09.648289 11355 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:09.565927 11300 consensus_queue.cc:1059] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:02:09.640210 11367 raft_consensus.cc:2764] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:09.653805 11300 raft_consensus.cc:3055] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:09.634212  9296 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:02:09.660435  8501 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:09.661990  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:09.661957  8501 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:09.665181  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.621596 11389 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.670385 11389 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:09.623769 11359 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.671455 11367 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:09.672506 11367 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:09.673368 11359 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:09.606261 11146 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.674053  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:09.674656  9261 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:09.675697 11146 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:09.674667  9296 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:09.676457  9261 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:09.677701 11127 raft_consensus.cc:3055] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:09.679121 11186 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:09.434917  9287 rpcz_store.cc:276] 0709 13:02:08.010711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.029542 (+ 18831us) service_pool.cc:224] Handling call
0709 13:02:08.083805 (+ 54263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.096885 (+ 13080us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:08.143656 (+ 46771us) log.cc:844] Serialized 14 byte log entry
0709 13:02:08.755962 (+612306us) spinlock_profiling.cc:243] Waited 6.92 ms on lock 0x7b18002da240. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5395455 00007f36cbe7d3c7 00007f36c848f9a7 00007f36c849f0bf 00007f36c849f038
0709 13:02:08.939305 (+183343us) log.cc:844] Serialized 14 byte log entry
0709 13:02:09.381950 (+442645us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.382092 (+   142us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:09.382231 (+   139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.382404 (+   173us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.382681 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43737,"prepare.queue_time_us":71675,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":79,"raft.queue_time_us":259441,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":24689,"spinlock_wait_cycles":15925120,"thread_start_us":524928,"threads_started":3,"wal-append.queue_time_us":240639}
I20260709 13:02:09.682291  8284 catalog_manager.cc:5697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 6 to 8, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 8 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:09.688853  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.689813  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 552) took 1207 ms. Trace:
I20260709 13:02:09.565068 11366 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:09.548264 11384 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.695497  9261 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:09.697059  9258 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:09.655880 11300 raft_consensus.cc:740] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:09.658900 11355 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:09.644425 11245 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:09.550767 11383 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:09.708866  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:09.716950 11389 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:09.717396  8535 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:02:09.699800  8532 rpcz_store.cc:276] 0709 13:02:08.482491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.505192 (+ 22701us) service_pool.cc:224] Handling call
0709 13:02:08.505583 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.515895 (+ 10312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.515970 (+    75us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.522853 (+  6883us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.495413 (+972560us) spinlock_profiling.cc:243] Waited 8.89 ms on lock 0x7b1800056740. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c80250d1 00007f36c8440a0f
0709 13:02:09.608880 (+113467us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:09.608924 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.608989 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.655405 (+ 46416us) raft_consensus.cc:1685] finished
0709 13:02:09.655424 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.689743 (+ 34319us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28366,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":12173,"spinlock_wait_cycles":20455168,"thread_start_us":113271,"threads_started":1,"wal-append.queue_time_us":1108375}
I20260709 13:02:09.717980  9292 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:02:09.714443  8454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 476) took 1973 ms. Trace:
I20260709 13:02:09.718256  9258 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:09.718806  9292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 435) took 1480 ms. Trace:
I20260709 13:02:09.719144 10996 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:09.719419  9292 rpcz_store.cc:276] 0709 13:02:08.238343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.262710 (+ 24367us) service_pool.cc:224] Handling call
0709 13:02:08.287381 (+ 24671us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.717706 (+1430325us) spinlock_profiling.cc:243] Waited 79.5 ms on lock 0x7b540072fea0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c83fcdc0 00007f36c84871c0 00007f36c8488231 00007f36c8484d8f 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c
0709 13:02:09.718493 (+   787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.718747 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182835584}
I20260709 13:02:09.720105 10996 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:09.721220 11383 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:09.693367 11367 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.722308 11367 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.722968  9258 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:09.724074 11381 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:09.724539 11381 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.691439 11359 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:09.724936 11381 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.725359 11359 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.727677 11359 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:09.689486 11127 raft_consensus.cc:740] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:09.728747 11127 consensus_queue.cc:260] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.703922 11132 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:09.729945 11127 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:09.730201 11132 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:09.730705 11132 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:09.692628 11145 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:02:09.632687 11368 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:09.734181 11355 raft_consensus.cc:697] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:09.735069 11368 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:09.734355 10408 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.736340 10408 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.716089  8529 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:09.721020 11389 raft_consensus.cc:697] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:09.718679  8454 rpcz_store.cc:276] 0709 13:02:07.739912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.740113 (+   201us) service_pool.cc:224] Handling call
0709 13:02:07.740424 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.850574 (+110150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.850608 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:07.851067 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.954608 (+103541us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:07.954643 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.191385 (+1236742us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:09.712631 (+521246us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54001e69d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:09.712693 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.712754 (+    61us) raft_consensus.cc:1685] finished
0709 13:02:09.712770 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.712918 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1158,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":8716,"spinlock_wait_cycles":288324224,"thread_start_us":103184,"threads_started":1,"wal-append.queue_time_us":102829}
I20260709 13:02:09.724720 11367 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:09.697832  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 160122us
I20260709 13:02:09.740406  9261 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:09.742177  9258 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:09.735246 11355 consensus_queue.cc:237] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:02:09.728467 11243 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.745489  9296 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:09.747028 10408 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:09.746577 11389 consensus_queue.cc:237] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.754338  9261 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:09.761114  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 99203.6us
I20260709 13:02:09.765686  8427 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:09.755405 11329 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:09.757292 11245 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:09.758476 11176 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:09.761858  8501 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:09.776094 11176 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.767549 11380 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:09.775655 11326 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:09.785017  8501 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:09.777632  9288 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:02:09.763419 10996 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:02:09.790701 11152 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:02:09.782029 11193 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 13:02:09.803589  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.807077 11338 consensus_queue.cc:1059] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:09.808044 11338 raft_consensus.cc:3055] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:09.808379 11338 raft_consensus.cc:740] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:09.810117 10996 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:09.810782 10996 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.791646  8427 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:09.783344 11176 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.817551  8501 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:09.820663  8456 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:02:09.820538  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:09.786938 11326 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.789551 11367 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:09.841706  8386 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:09.842482 11166 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:09.843443 11137 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:09.825608 11347 consensus_queue.cc:1059] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:02:09.791139 11245 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:02:09.836092 10865 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:09.850198 11384 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:09.851043 11381 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.858297 11132 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.859876 11243 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:09.867664 11367 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:09.868369  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 50943.7us
I20260709 13:02:09.910753  8501 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:09.911888  8501 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:09.891301  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:09.889354 11408 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:09.894737  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 132236us
I20260709 13:02:09.895592  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:09.867602 11326 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:09.833200 11186 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:09.862438  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.872934 11159 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:09.923657  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:09.943259  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:09.945058  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:09.945536  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.945868  9296 raft_consensus.cc:2393] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 7: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:09.951900  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:09.913416 11367 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.896739 11137 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:09.960165  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:09.833468 11338 consensus_queue.cc:260] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:09.794094 11300 consensus_queue.cc:260] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:09.961444  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:09.969272  8382 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:02:09.924621 11405 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:09.962932  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:09.974995  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:09.964829  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:09.971619  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:09.976873  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:09.972455  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:09.978596  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:09.967836  9260 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:09.984886  8381 raft_consensus.cc:2393] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 8: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:09.985316  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:09.950256 11186 raft_consensus.cc:697] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:09.987648  8459 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:09.988555  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:09.960414 10865 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:09.989959  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:09.990758  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:09.991258  8531 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:02:09.992081  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:09.992154  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:09.992731  8380 raft_consensus.cc:2393] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 6: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:02:09.995730 11350 log.cc:927] Time spent T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 1.405s	user 0.018s	sys 0.007s
I20260709 13:02:09.998426  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:09.999082  8386 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:02:10.001736  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:09.973469 11405 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.977522 10996 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:10.008066  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:10.009621 11132 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:10.012929 11416 log.cc:927] Time spent T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:02:09.998042 11338 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:10.019261 11137 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:10.020084 11336 raft_consensus.cc:3055] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:10.020498 11421 consensus_queue.cc:1059] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:10.018947 11381 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:10.020531 11336 raft_consensus.cc:740] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:10.017987  8501 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:10.026341  8501 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:10.023319 11328 raft_consensus.cc:993] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:02:10.029829 11328 raft_consensus.cc:1081] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:02:10.005062 11243 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:10.030876 10865 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:10.031358 10865 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:10.031746 10865 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:10.032073  8453 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:09.926054 11408 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:10.022571 11336 consensus_queue.cc:260] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:10.033773 11336 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:10.034977 11408 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:10.037631  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:10.038976  9296 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:02:10.040251  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:10.045348  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:10.046236  8526 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.048095  8501 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:10.003551 11405 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:10.053820 11137 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:10.054272 11362 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:10.054868 11186 consensus_queue.cc:237] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:10.024895 11159 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:10.055841 11368 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:10.060371 11367 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:10.062001 11326 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:10.064278 10971 consensus_queue.cc:1059] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:10.106096  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:10.065421  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:10.069420  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.079156 11314 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:10.084829  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:10.086867  8501 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:10.088714  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:10.090932  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:10.090647 11159 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:10.091293 11408 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:10.094851  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48484 (request call id 447) took 1302 ms. Trace:
I20260709 13:02:10.160163  8383 rpcz_store.cc:276] 0709 13:02:08.792903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.793027 (+   124us) service_pool.cc:224] Handling call
0709 13:02:10.094683 (+1301656us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b54002fa3d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:10.094792 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1629221632}
I20260709 13:02:10.094728  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:10.096127  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:10.097235  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:10.097433 11166 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:10.097930 11176 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:10.098326 11355 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:10.109640  8534 raft_consensus.cc:1240] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:10.112730  9296 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
W20260709 13:02:10.131256  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 44471.2us
W20260709 13:02:10.143302  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.188481  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:10.173207  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 65728.5us
I20260709 13:02:10.120580 11332 raft_consensus.cc:3055] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:10.197314  8526 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:10.153558 11408 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.199848  8349 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:10.110743 11137 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:02:10.206771  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:10.172873 11385 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:10.204661  8349 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:10.211395  8349 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:10.154274 11359 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:10.202486  9258 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:10.207707  9294 raft_consensus.cc:2368] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 6. Current term is 7.
I20260709 13:02:10.190068 11366 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.199172 11332 raft_consensus.cc:740] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:10.186487  9288 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:02:10.216814  8349 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:10.206043 11408 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:10.217270  8351 leader_election.cc:336] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Timed out: RequestConsensusVote RPC to 127.7.25.196:40669 timed out after 1.734s (SENT)
I20260709 13:02:10.219595  8351 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:10.204780  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:10.217983  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:10.224602 11137 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:10.234438  8349 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:10.207479 11423 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:10.214196 11338 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:10.218791 11362 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:10.192251 11355 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:10.214717 11385 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:10.216665 11347 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:10.219125 11366 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:10.250432 11385 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:10.251871 11366 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:10.238412  9289 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:02:10.253842  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:10.254735  8349 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:10.255991 11362 raft_consensus.cc:697] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:10.256536 11159 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:10.257054 11362 consensus_queue.cc:237] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:10.257514  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:10.261940  9287 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:02:10.218699 11349 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:10.231395 11137 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:10.243671 11332 consensus_queue.cc:260] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:10.282243  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.282791  8349 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:10.245298 11326 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:10.266268  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.248780 11355 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:10.269495 11421 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:10.292588  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:10.289000  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:10.289399  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:10.316867  8385 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 10: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:10.317682  8382 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:10.318537  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:10.318595  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 101350us
I20260709 13:02:10.317605  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:10.319747  8378 raft_consensus.cc:2410] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:10.320343  8500 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:10.322302  8384 raft_consensus.cc:2410] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:10.275041 11159 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.334299  8386 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:02:10.334722  8386 pending_rounds.cc:85] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 5
I20260709 13:02:10.335011  8386 pending_rounds.cc:107] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:02:10.335249  8386 raft_consensus.cc:2889] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:10.325868  8500 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:10.320428 11349 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:10.324136 11332 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:10.327348  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:10.341671  9288 raft_consensus.cc:2393] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 7: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:10.346376  9295 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:02:10.338407 11359 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:10.350773  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:10.351056  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:10.327610 11385 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:10.328675  8459 raft_consensus.cc:1275] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:10.338181  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:10.339691 10408 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:10.334098  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:10.324223 11347 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:10.369626  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.306283 11366 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:10.373605  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:10.373981  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:10.374682  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:10.339237 11349 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:10.375200  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:10.375645  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:10.387027 11244 consensus_queue.cc:1059] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:02:10.395262 11366 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:10.395741  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:10.395920 11244 raft_consensus.cc:3055] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:10.396327 11244 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:10.397272 11213 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:10.398348 11366 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:10.401669  8526 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:02:10.402094  8526 pending_rounds.cc:85] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 7
I20260709 13:02:10.402371  8526 pending_rounds.cc:107] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:02:10.402608  8526 raft_consensus.cc:2889] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:10.379618  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:10.375622  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:10.376274  9291 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:10.374778  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:10.382246  9261 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:10.339389 11159 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:10.386273  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:10.392194  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:10.392439  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 54331.9us
I20260709 13:02:10.375327  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:10.406620  8351 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:10.411314  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:10.373113 10865 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:10.412580  8500 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:10.413162  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:10.380646 11405 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:10.400565 11349 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:10.398483 11429 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:10.417897  8386 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:10.419149  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:10.416220  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:10.426571  8385 raft_consensus.cc:2410] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:10.427300  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:10.427489  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:10.428411  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:10.425869  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:10.421850 11421 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:10.415334 11432 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:10.430639  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:10.422840  8526 raft_consensus.cc:1275] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:10.431280 11333 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.431331  8386 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:10.422984 11338 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:10.423763  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:10.431829 11333 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:10.434244  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:10.434803 11432 raft_consensus.cc:697] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:10.435935 11432 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:10.425865 11159 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:10.438786  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:10.439353  8500 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:10.415892  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:10.422554 11366 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:10.412015 10971 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:02:10.441339 11366 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:10.433298 11244 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:10.434897  8384 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:02:10.442647 11244 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:10.413829 11347 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:10.443966  8527 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:02:10.428691  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:10.416791  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 134074us
I20260709 13:02:10.444954  8535 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:10.445349  8349 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:10.446060 11347 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.446514 11347 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:10.447693  8385 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:02:10.448411  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.414297 11370 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:10.451784  8385 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:02:10.469869  8385 pending_rounds.cc:85] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 5
I20260709 13:02:10.470815 11421 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:10.472455 10971 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:10.474603 11357 raft_consensus.cc:3055] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:10.474995 11357 raft_consensus.cc:740] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:10.475839 11405 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:10.476393  9292 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:02:10.476657 11370 raft_consensus.cc:697] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:10.477771 11370 consensus_queue.cc:237] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:10.479689  8456 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:02:10.461879  9261 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:10.411955  9288 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:10.472824  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:10.442669 10865 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:10.481506  8528 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:10.482108  9261 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:10.414045 11176 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:10.479753 11415 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.466799  8501 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:10.484998  8349 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:10.486030  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:10.470353  8385 pending_rounds.cc:107] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:02:10.484099  9261 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:10.486949  8532 raft_consensus.cc:2410] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:10.487195  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:10.487741  9261 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:10.484328  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:10.488410  8385 raft_consensus.cc:2889] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:10.488651  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:10.493584  8381 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:02:10.494472  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:10.502635  8500 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:10.506206  8532 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:10.508329  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:10.509045  8528 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:10.513818  8532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38894
I20260709 13:02:10.514688  8532 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:10.515139  8532 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:10.526919  8528 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:10.503595 11159 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:10.533663  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 48737.7us
I20260709 13:02:10.457561  8386 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:10.549906  8527 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:10.534649  8349 leader_election.cc:400] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12.
I20260709 13:02:10.557919  8349 leader_election.cc:403] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:10.559183  9258 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:10.566774  8532 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:10.580644  8532 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:10.486294 11314 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:10.534981 11421 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:10.500444 11331 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:10.498126 10971 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:10.528987 10865 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:10.616302  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 86419.5us
I20260709 13:02:10.500090 11405 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:10.536753 11338 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:10.536288 11176 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:02:10.639504  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 80435.7us
I20260709 13:02:10.500134 11415 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:10.626608 11333 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:10.475876 11357 consensus_queue.cc:260] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:10.631136 10865 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:10.665321 11425 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.425s	user 0.000s	sys 0.005s
I20260709 13:02:10.671723 11373 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:10.714064 11408 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:10.716532 11408 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:10.689247 10865 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:10.666785 11405 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:10.726524  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 192009us
I20260709 13:02:10.734591  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:10.735332  8457 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:02:10.684651 11137 consensus_queue.cc:1059] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:02:10.740221  8349 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:10.720533 11373 raft_consensus.cc:697] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:10.732987 11088 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.784446  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:10.785190  8377 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:10.756593 11430 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12.
W20260709 13:02:10.809754  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 178250us
I20260709 13:02:10.817409  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:10.830976  8377 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:02:10.771112 11283 consensus_queue.cc:1059] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:02:10.841372  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 567) took 1028 ms. Trace:
I20260709 13:02:10.841903  8529 rpcz_store.cc:276] 0709 13:02:09.812967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.813094 (+   127us) service_pool.cc:224] Handling call
0709 13:02:09.833266 (+ 20172us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.833818 (+   552us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:09.890642 (+ 56824us) log.cc:844] Serialized 14 byte log entry
0709 13:02:10.082222 (+191580us) spinlock_profiling.cc:243] Waited 997 us on lock 0x7b1800311fe0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c802523a 00007f36c848fa2a
0709 13:02:10.181105 (+ 98883us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:10.203315 (+ 22210us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.203511 (+   196us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:10.203543 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.203615 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.664442 (+460827us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:10.841146 (+176704us) raft_consensus.cc:1685] finished
0709 13:02:10.841168 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.841311 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":58808,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":3610,"raft.queue_time_us":9727,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":2836,"spinlock_wait_cycles":4886784,"thread_start_us":98155,"threads_started":1,"wal-append.queue_time_us":301994}
I20260709 13:02:10.785230 11405 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:10.851814  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:10.841348 11333 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:10.825246 11332 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:02:10.826498 11386 consensus_queue.cc:1059] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:02:10.908670  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:10.909284  8377 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:10.867116 11430 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:10.797293 11088 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:02:10.841195 11314 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:02:10.901031 11333 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.895920 11444 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:10.925755  8529 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:02:10.920948 11437 log.cc:927] Time spent T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:02:10.856031 11373 consensus_queue.cc:237] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:10.940351 11331 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:10.942678  8384 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:10.943045 11336 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:10.929067 11444 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:10.947880 11088 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:10.922920 11333 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:10.953127  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 213014us
I20260709 13:02:10.907173 11347 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:10.965341 11405 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.948662 11213 raft_consensus.cc:3055] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:10.966143 11428 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:10.968255 11444 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:10.968796 11336 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:10.970036  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.976305 11421 raft_consensus.cc:697] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:10.976104 11213 raft_consensus.cc:740] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:10.963759 11440 log.cc:927] Time spent T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 13:02:10.980877  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 235074us
I20260709 13:02:10.981663  8377 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
W20260709 13:02:10.989917  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 205252us
I20260709 13:02:10.990746  8381 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 6: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:10.988323  8349 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:11.001672  8349 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:10.982630 11432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.018s	sys 0.028s
W20260709 13:02:11.071512  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 69959.4us
I20260709 13:02:11.072388  8349 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:11.074080  8349 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:11.076162  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:11.076867  8534 raft_consensus.cc:2368] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6.
I20260709 13:02:11.077139 11430 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:10.986024 11213 consensus_queue.cc:260] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:11.077826 11430 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:11.077992 11213 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:11.070619 11408 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.079264 11408 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:10.980897 11405 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:11.081804 11433 log.cc:927] Time spent T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:02:11.082116 11408 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:11.010068 11432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.018s	sys 0.029s
I20260709 13:02:11.082901 11405 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:10.980433 11428 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:11.085888 11336 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:10.980362 11421 consensus_queue.cc:237] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:11.086607 11428 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:11.093791 11442 log.cc:927] Time spent T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:02:11.101686 11446 log.cc:927] Time spent T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:02:11.106401  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:11.106401  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:11.108834  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:11.004686 11444 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:11.108892  8534 raft_consensus.cc:2410] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:11.005221 11429 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:11.114200  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:11.119189  8284 catalog_manager.cc:5697] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:02:11.124805  8530 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:11.125878 11336 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:11.126433 11336 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:11.116997 11415 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:11.128912 11336 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:10.377568  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:11.138412  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:11.139086  8384 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:11.139289  8530 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 6: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:11.113369  8528 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:02:11.112495  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:11.177170  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:11.178366  8527 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
W20260709 13:02:11.192745  8500 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.704s (SENT) [suppressed 40 similar messages]
I20260709 13:02:11.198382  8501 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:11.203696  8501 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:11.122954 11347 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:11.129503 11244 consensus_meta.cc:287] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.686s	user 0.002s	sys 0.009s
W20260709 13:02:11.112051 11349 consensus_meta.cc:287] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.669s	user 0.009s	sys 0.000s
I20260709 13:02:11.211826  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:11.113602 11357 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:11.217962  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:11.219040 11429 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:11.219638 11429 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:11.220368 11333 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:11.211236  8271 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 56cc480ba6f642e08bb2e547a0ef50a1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d653e71832b7402b9a03b46249d3b885 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:11.212574  9288 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:02:11.221709 11429 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:11.206280 11428 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:02:11.244387 11455 log.cc:927] Time spent T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:02:11.207484 10865 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:11.246639 11333 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:11.225385  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:11.226042  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:11.232249  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:11.249439  8458 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:11.233160  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:11.233228 11408 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:11.215936 11405 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:11.234298  9289 raft_consensus.cc:2410] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:02:11.111413 11186 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:11.253603  9287 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:11.253801 11357 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:11.254557 11357 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:11.254918 10865 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:11.256829 11357 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:11.258404  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:11.266757  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 326937us
I20260709 13:02:11.270582  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:11.271816  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:11.272280  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:11.272385  8386 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:11.276712  8377 raft_consensus.cc:3055] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:11.277112  8377 raft_consensus.cc:740] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:11.280217  8386 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:02:11.281322  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:11.281858  8501 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:11.271265  8382 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:02:11.272941  8384 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:02:11.277890  8377 consensus_queue.cc:260] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:11.284960  8377 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:11.281464 10997 consensus_queue.cc:1059] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:11.286258  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:11.287339  9288 raft_consensus.cc:2393] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 6: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:11.288688  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:11.290632  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 342754us
I20260709 13:02:11.281895  8386 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:11.257407 11429 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:11.265938 11336 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:11.295688  8380 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:11.214435 11349 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:11.282640 11405 raft_consensus.cc:697] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:11.303216  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:11.292145 10865 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.269443 11186 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:11.303567  8534 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:02:11.315047  8534 pending_rounds.cc:85] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 6
I20260709 13:02:11.315305  8534 pending_rounds.cc:107] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:02:11.315522  8534 raft_consensus.cc:2889] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:11.303756 11336 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:11.316274 11186 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:11.299664 11326 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:02:11.317910 11336 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:11.303318 10968 raft_consensus.cc:3055] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:11.312704  8379 raft_consensus.cc:1240] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:02:11.287287 11451 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:11.303843 11429 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:11.314206 10865 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:11.311744 11349 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:11.303879  8526 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:11.324393 11326 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:11.326051  8501 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:11.320640  8458 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:11.335837  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:11.343045  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:11.344169  9291 raft_consensus.cc:2410] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:11.343052 11314 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:02:11.346375 11373 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:11.348275  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 360944us
I20260709 13:02:11.350989 11408 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:11.351564 11408 raft_consensus.cc:697] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:11.353466  9292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 441) took 1354 ms. Trace:
I20260709 13:02:11.322494 10968 raft_consensus.cc:740] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:11.353876  9292 rpcz_store.cc:276] 0709 13:02:10.000313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.003445 (+  3132us) service_pool.cc:224] Handling call
0709 13:02:11.353258 (+1349813us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b54007a0154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:11.353387 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":980562176}
I20260709 13:02:11.354398 11367 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:11.354578 10968 consensus_queue.cc:260] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:11.355643 11367 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:11.355927 10968 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:11.359948  8377 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:02:11.360437  8377 pending_rounds.cc:85] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 7
I20260709 13:02:11.360808  8377 pending_rounds.cc:107] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 7.8
W20260709 13:02:11.350525  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.370390  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 177677us
I20260709 13:02:11.373790  8377 raft_consensus.cc:2889] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:11.360809  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.377651  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:11.378546  9293 raft_consensus.cc:2368] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8.
I20260709 13:02:11.378885  8384 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:02:11.381336  8384 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:11.384341  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:11.385251  8382 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:02:11.384606  8349 leader_election.cc:400] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6.
I20260709 13:02:11.387957  8349 leader_election.cc:403] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:02:11.321405 11451 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:11.397202 11451 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:11.398566 11332 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:11.401808  8377 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:11.402827 11429 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:11.407176  8349 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:11.409042  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 77158.4us
I20260709 13:02:11.410553  8424 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:11.416061  9258 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:11.420056  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 69475.6us
I20260709 13:02:11.425632  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:11.427019  9296 raft_consensus.cc:2393] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 8: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:11.427711  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:11.428332  9291 raft_consensus.cc:2376] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7. Re-sending same reply.
I20260709 13:02:11.352521 11408 consensus_queue.cc:237] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:11.431186  8349 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:11.431742  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:11.349468 11146 consensus_queue.cc:1059] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:02:11.445453  8386 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
W20260709 13:02:11.503818  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.489825 11331 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:11.451167  8349 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:11.369104 11367 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:11.434602  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:11.427234 11349 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6.
I20260709 13:02:11.491216  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:11.528064  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:11.528877  8527 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:11.495829 10865 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:11.450073 11457 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:11.476227 11147 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.450685  8534 raft_consensus.cc:1240] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:11.501436 11383 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:11.509680  8535 raft_consensus.cc:2393] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 6: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:02:11.507342  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 56293.8us
I20260709 13:02:11.567203  8349 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:11.541134  8529 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:02:11.498833  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:02:11.506392  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 180390us
I20260709 13:02:11.566313  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:11.510710 11429 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:11.574645 11462 log.cc:927] Time spent T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:02:11.575083 11131 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:11.575506 11131 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:11.575949 11131 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:11.576355 11466 log.cc:927] Time spent T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:02:11.577222 11146 consensus_queue.cc:1059] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:11.496407 11405 consensus_queue.cc:237] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:11.574529  8349 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:11.506848 11331 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.516088 11428 raft_consensus.cc:697] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 6 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:11.532133 11367 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:11.586349  8501 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:11.593844  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 157581us
W20260709 13:02:11.596652  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 175780us
I20260709 13:02:11.599071  8426 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:11.603360  8349 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:11.612982  8426 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:11.617192  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:11.581524 11421 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:11.609970  8349 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:11.585739 11331 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:11.582746 11383 raft_consensus.cc:697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:11.604751 11461 raft_consensus.cc:3055] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:11.612080 11329 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.584496 11430 consensus_queue.cc:1059] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:02:11.618037 11464 raft_consensus.cc:3055] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:11.572918 11147 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:11.615746 11457 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:11.613006 10865 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:11.646878  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:11.636763 11152 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:11.628014 11450 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:11.620021 11454 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:11.659693  8457 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:02:11.667760  8349 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:11.681584  8349 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:11.654945 10865 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:11.667735  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 189463us
I20260709 13:02:11.637343 11461 raft_consensus.cc:740] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:11.634467 11465 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:11.671701  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:11.696836  8453 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:11.697597 11457 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:11.681730  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 66757.1us
I20260709 13:02:11.653350 11464 raft_consensus.cc:740] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:11.658305 11475 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.730379  8424 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:11.698025 11457 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:11.732227 11457 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:11.732447 11464 consensus_queue.cc:260] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:11.733767 11464 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:11.696712 10865 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:11.739372  8530 raft_consensus.cc:1275] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:11.676510 11152 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:11.678508 11450 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:11.652520 11329 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:11.679852 11451 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:11.680900 11454 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:11.703253 11357 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:11.750597  8427 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:11.773924 11477 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 13:02:11.775111 11480 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:02:11.752686 11450 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:11.799466  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.749272 11152 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:11.780637  8284 catalog_manager.cc:5697] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.822594 11444 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:11.823442 11467 log.cc:927] Time spent T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:02:11.823267 11444 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:11.823756  8284 catalog_manager.cc:5697] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:02:11.659066 11428 consensus_queue.cc:237] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:11.825163  8284 catalog_manager.cc:5697] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.824930 11496 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:11.826907  8284 catalog_manager.cc:5697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 4 to 5, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 5 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:11.754055 11469 log.cc:927] Time spent T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.155s	user 0.001s	sys 0.001s
I20260709 13:02:11.840253  8377 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
W20260709 13:02:11.838799  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 108081us
I20260709 13:02:11.825556 11444 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:11.740623 11283 consensus_queue.cc:1048] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:02:11.761766 11454 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:11.762151 11479 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:11.865257 11483 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:11.865808 11483 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:11.866039  9294 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 446) took 1768 ms (client timeout 2235 ms). Trace:
W20260709 13:02:11.866722  9294 rpcz_store.cc:269] 0709 13:02:10.101492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.105813 (+  4321us) service_pool.cc:224] Handling call
0709 13:02:11.865760 (+1759947us) spinlock_profiling.cc:243] Waited 98.8 ms on lock 0x7b54007701d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:11.865962 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227271936}
W20260709 13:02:11.867321 11484 log.cc:927] Time spent T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:02:11.867573  9287 consensus_meta.cc:287] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.000s
I20260709 13:02:11.828168 11461 consensus_queue.cc:260] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:11.869431 11461 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:11.868139  9287 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:11.866155 11483 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:11.735925 11475 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:11.785492 11430 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:02:11.886307 11186 consensus_queue.cc:1059] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:02:11.887374 10968 consensus_meta.cc:287] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.515s	user 0.007s	sys 0.003s
I20260709 13:02:11.891290 11451 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:11.852864 11314 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:11.897171  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.853673 11357 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:11.902036  8453 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:02:11.738328 11383 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:11.911504  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:11.910665  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 125197us
I20260709 13:02:11.854527 11244 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.906615 11147 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:11.924093 11450 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:11.924301 11367 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:11.875773 11479 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:12.019265  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:12.020155  9291 raft_consensus.cc:2393] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 7: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:12.022022  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:11.915764 11357 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:12.027482 11470 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:12.028077 11470 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:12.029229 11357 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:12.030526 11470 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:12.030802 11450 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:11.934675 11152 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:12.033913  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 463) took 1614 ms. Trace:
I20260709 13:02:12.033789 11331 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:12.034389  8379 rpcz_store.cc:276] 0709 13:02:10.419411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.439859 (+ 20448us) service_pool.cc:224] Handling call
0709 13:02:10.440204 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.319132 (+878928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.033650 (+714518us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b540013e2d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:12.033844 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2005984000}
I20260709 13:02:12.035570 11152 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:12.031067 11470 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.044581 11482 raft_consensus.cc:3055] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:11.900715 11457 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:11.918030 11465 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:12.044127 11470 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:12.018201 11408 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.052955 11482 raft_consensus.cc:740] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:12.070290  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 473) took 1551 ms. Trace:
I20260709 13:02:12.005234 11244 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:12.026753 11347 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:11.912926 11314 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:11.911499 11131 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:12.075366 11331 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:12.072197 11454 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:12.102686  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:12.103258 11347 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:12.094722  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:12.086680 11352 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.070984 11489 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:12.105392 11352 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:12.106144 11347 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:12.085433  8284 catalog_manager.cc:5697] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:02:12.107630 11352 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:12.084633 11367 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:12.073961  8385 rpcz_store.cc:276] 0709 13:02:10.519995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.680932 (+160937us) service_pool.cc:224] Handling call
0709 13:02:10.685508 (+  4576us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:10.857487 (+171979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:10.857520 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:10.869908 (+ 12388us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.205730 (+335822us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:11.205774 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.069863 (+864089us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54002c7754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:12.069916 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.069982 (+    66us) raft_consensus.cc:1685] finished
0709 13:02:12.069996 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.070227 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12608,"raft.queue_time_us":93964,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":6243,"spinlock_wait_cycles":365496704,"thread_start_us":296671,"threads_started":1,"wal-append.queue_time_us":409980}
I20260709 13:02:12.104107 11454 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:12.108419  8284 catalog_manager.cc:5697] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 9 to 10, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 10 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:12.101824 11244 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:12.074467  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:12.110675  8284 catalog_manager.cc:5697] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 4 to 6, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 6 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:12.113205 11244 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.113612  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:12.113893 11329 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:12.113727 11244 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:12.117245  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:12.117571  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:12.118299  8453 raft_consensus.cc:1240] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:12.120008  9287 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:12.120477  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:12.121635  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:12.122076  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:12.122376  9287 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:12.122972 11244 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:12.123481  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:12.105849 11489 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:12.083705  8281 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59480 (request call id 201) took 17319 ms (client timeout 15000 ms). Trace:
I20260709 13:02:12.107188  8500 leader_election.cc:400] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8.
I20260709 13:02:12.135017  8500 leader_election.cc:403] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:12.102312 11314 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:12.131142  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:12.136556  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:12.068900 11300 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:12.147495 11329 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:12.076781 11479 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:12.147744  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:12.398494  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:12.193674 11405 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:12.402204  9291 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:12.171768  8529 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:12.369635 11244 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.403282 11244 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:12.282974 11332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.017s	sys 0.007s
I20260709 13:02:12.147815  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:12.283298  8424 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.032s	sys 0.033s
W20260709 13:02:12.404649  8424 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.035s	sys 0.040s
I20260709 13:02:12.199010 11429 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:12.180667  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 284470us
I20260709 13:02:12.406154 11429 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:12.408804 11429 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:12.269003 10865 consensus_meta.cc:287] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.002s
I20260709 13:02:12.413405 10865 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:12.415333 11244 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:12.074167 11483 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
W20260709 13:02:12.404935  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 668774us
W20260709 13:02:12.213519  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:12.219612  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 71058.7us
W20260709 13:02:12.134935  8281 rpcz_store.cc:269] 0709 13:01:54.764791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.773321 (+  8530us) service_pool.cc:224] Handling call
0709 13:01:55.332518 (+559197us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b540014ebd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ef090 00007f36c848df3a 00007f36ce2441cc 00007f36ce34237e 00007f36cc8032a4 00007f36cc803232 00007f36cc803161 00007f36cc8030dc 00007f36cc802392 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:12.083548 (+16751030us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:05.483774 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:05.484788 (+  1014us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:05.484842 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:02:05.484885 (+    43us) tablet.cc:662] Decoding operations
0709 13:02:05.514026 (+ 29141us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:05.514155 (+   129us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:05.514221 (+    66us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:02:05.516335 (+  2114us) tablet.cc:701] Row locks acquired
0709 13:02:05.516478 (+   143us) write_op.cc:260] PREPARE: finished
0709 13:02:05.516788 (+   310us) write_op.cc:270] Start()
0709 13:02:05.517034 (+   246us) write_op.cc:276] Timestamp: P: 1783602125516678 usec, L: 0
0709 13:02:05.517107 (+    73us) op_driver.cc:348] REPLICATION: starting
0709 13:02:05.518711 (+  1604us) log.cc:844] Serialized 6700 byte log entry
0709 13:02:05.768746 (+250035us) op_driver.cc:464] REPLICATION: finished
0709 13:02:05.924934 (+156188us) write_op.cc:301] APPLY: starting
0709 13:02:05.930544 (+  5610us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:06.024476 (+ 93932us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:06.050400 (+ 25924us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:06.450903 (+400503us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:06.511476 (+ 60573us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:02:06.511548 (+    72us) write_op.cc:312] APPLY: finished
0709 13:02:06.512194 (+   646us) log.cc:844] Serialized 119 byte log entry
0709 13:02:06.512465 (+   271us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:06.512700 (+   235us) write_op.cc:454] Released schema lock
0709 13:02:06.512802 (+   102us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:06.513432 (+   630us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:06.513474 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7159,"reported_tablets":23,"spinlock_wait_cycles":1145154944,"child_traces":[["op",{"apply.queue_time_us":111787,"apply.run_cpu_time_us":9124,"apply.run_wall_time_us":618972,"num_ops":17,"prepare.queue_time_us":538640,"prepare.run_cpu_time_us":15500,"prepare.run_wall_time_us":43229,"raft.queue_time_us":121451,"raft.run_cpu_time_us":5793,"raft.run_wall_time_us":163405,"replication_time_us":208841,"spinlock_wait_cycles":28032,"thread_start_us":706329,"threads_started":4,"wal-append.queue_time_us":7718,"wal-append.run_cpu_time_us":17904,"wal-append.run_wall_time_us":2006277}]]}
W20260709 13:02:12.401537  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 264738us
I20260709 13:02:12.417827  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:02:12.401412  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 294317us
I20260709 13:02:12.418815  8500 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:12.075811 11457 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:12.081938 11408 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:12.324928 11482 consensus_queue.cc:260] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:12.420799  8500 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:12.423156  8424 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:12.074935 11488 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:12.426321  8351 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:12.433463  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:12.434664  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:12.436030  8351 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:12.415674 10865 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:12.439108  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:12.443411  8424 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:12.446280  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:12.446106  8351 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:12.427080 11454 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:12.427589 11329 raft_consensus.cc:697] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:12.425181 11429 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:12.428725 11347 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:12.439755 10865 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:12.464704 11431 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 2.122s	user 0.000s	sys 0.007s
I20260709 13:02:12.438863 11482 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:12.437233 11127 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:12.473663  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:12.445183 11451 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:12.468370  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:12.543568  9295 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 LEARNER]: Advancing to term 5
I20260709 13:02:12.472561  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:12.471192  8383 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:12.470625  8386 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:12.473455  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:12.473117  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:12.545773  8454 raft_consensus.cc:2410] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:02:12.440832 11430 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:12.494254  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 50920.2us
I20260709 13:02:12.466799 11383 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:12.467669 11326 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:12.518926 11502 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:12.503276  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 57323.3us
I20260709 13:02:12.465153 11496 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
W20260709 13:02:12.469650 11504 log.cc:927] Time spent T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
I20260709 13:02:12.546232  8458 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:12.545074  8457 raft_consensus.cc:2410] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:02:12.521889  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.156390  8461 raft_consensus.cc:2410] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:02:12.525194  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:12.543757 11508 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:12.582118 11483 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:12.471951 11489 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:12.472939 11131 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:12.583377 11514 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:12.557749 11430 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:12.471334 11386 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:13.281625 11386 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.282950 11430 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:13.284053 11386 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:12.438423 11488 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:12.526979 11432 raft_consensus.cc:3055] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:13.290068 11432 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:13.290930  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:12.510861 11456 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.446662 11457 consensus_queue.cc:1059] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 13:02:13.291111 11432 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:13.294430 11457 raft_consensus.cc:3055] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:13.294927 11457 raft_consensus.cc:740] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:13.295866 11457 consensus_queue.cc:260] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:12.437510 11464 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:12.609920 11502 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.300382 11502 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:12.695196 11521 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:12.704181 11506 log.cc:927] Time spent T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:02:13.301481  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:12.704900 11517 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:13.302382 11517 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:12.760499 11510 log.cc:927] Time spent T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.146s	user 0.004s	sys 0.000s
I20260709 13:02:12.556074 10865 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:13.304554 11517 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:12.990967 11441 log.cc:927] Time spent T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 2.234s	user 0.000s	sys 0.010s
I20260709 13:02:13.305295  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2448) took 1390 ms. Trace:
I20260709 13:02:13.305723  8382 rpcz_store.cc:276] 0709 13:02:11.914476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.915287 (+   811us) service_pool.cc:224] Handling call
0709 13:02:11.915560 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.920586 (+  5026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.920619 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.921127 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.296456 (+375329us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:12.296511 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.296606 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.305110 (+1008504us) raft_consensus.cc:1685] finished
0709 13:02:13.305131 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.305240 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2236,"raft.queue_time_us":5799,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":374888,"threads_started":1,"wal-append.queue_time_us":694466}
W20260709 13:02:13.008988 11405 consensus_meta.cc:287] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.606s	user 0.008s	sys 0.003s
I20260709 13:02:13.307624 11405 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8.
W20260709 13:02:13.017019  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 468817us
I20260709 13:02:13.018959  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:13.019028 11507 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:13.310184 11507 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:13.310575 11507 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:13.310984 11507 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:12.545449 11429 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.032716 11451 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.305351 10865 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:13.313577 11451 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.032749 11127 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:13.035333 11527 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.314993 11127 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.317041 11127 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:13.038293 11347 consensus_meta.cc:287] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.011s
W20260709 13:02:13.317503  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 298567us
I20260709 13:02:13.317776 11347 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:13.049685 11329 consensus_queue.cc:237] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.320163  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:13.320358  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:13.055855  8456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 1856) took 2562 ms. Trace:
W20260709 13:02:13.070222  8499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.013s	sys 0.004s
I20260709 13:02:13.321281  8378 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:13.321597  8499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.014s	sys 0.005s
W20260709 13:02:13.072573  9287 consensus_meta.cc:287] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.950s	user 0.009s	sys 0.007s
I20260709 13:02:13.322546  9287 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:02:13.323020 11451 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:13.323092  9287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55720 (request call id 453) took 1201 ms. Trace:
I20260709 13:02:12.586377 11326 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.323212  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:13.323637  9287 rpcz_store.cc:276] 0709 13:02:12.121236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.121352 (+   116us) service_pool.cc:224] Handling call
0709 13:02:13.323027 (+1201675us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:13.076036 11470 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:13.080174  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.324802  9290 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:13.326617  9290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 751) took 1195 ms. Trace:
I20260709 13:02:13.326684 11429 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:13.082132 11479 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.083307 11519 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:13.327425 11194 consensus_queue.cc:1059] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:13.327682 11519 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.330008 11519 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:13.330404 11194 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.331095  8529 raft_consensus.cc:1240] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:13.080572 11152 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.101186 11421 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:13.331684 11152 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.331771 11421 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.092561 11447 raft_consensus.cc:3055] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:13.320957  8456 rpcz_store.cc:276] 0709 13:02:10.493614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.493759 (+   145us) service_pool.cc:224] Handling call
0709 13:02:10.494081 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:10.494522 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:10.494559 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:10.495110 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.869922 (+1374812us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b180040d560. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c80250d1 00007f36c8440a0f
0709 13:02:11.911893 (+ 41971us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:11.911945 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.912317 (+   372us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.055539 (+1143222us) raft_consensus.cc:1685] finished
0709 13:02:13.055554 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.055785 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3160,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":112798,"spinlock_wait_cycles":7884160,"thread_start_us":40817,"threads_started":1,"wal-append.queue_time_us":1566558}
I20260709 13:02:13.333444 11447 raft_consensus.cc:740] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:13.334124 11152 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:13.334322 11447 consensus_queue.cc:260] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.115028 11336 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.335597 11447 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:13.335441 11336 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:13.101469  8501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.003s	sys 0.009s
I20260709 13:02:13.332188  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:13.337247  8501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.004s	sys 0.010s
I20260709 13:02:13.338094 11336 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:13.104849 11450 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:13.127821 11530 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.340248 11450 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.340399 11530 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:12.545885 11454 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.128846  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:13.125952 11526 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:13.342581  9293 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:13.132050 11532 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:13.140569 11428 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.021s	sys 0.025s
I20260709 13:02:13.343005 11526 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:13.343979 11428 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.022s	sys 0.025s
W20260709 13:02:13.344369  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.088061  8500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.024s	sys 0.030s
W20260709 13:02:13.165885  9289 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55734 (request call id 748) took 2795 ms (client timeout 1810 ms). Trace:
W20260709 13:02:13.347638  8500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.024s	sys 0.030s
W20260709 13:02:13.347746  9289 rpcz_store.cc:269] 0709 13:02:10.370403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.375040 (+  4637us) service_pool.cc:224] Handling call
0709 13:02:13.165602 (+2790562us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b54007378d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:13.165798 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1843836160}
I20260709 13:02:13.170766 11465 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:13.349170 11465 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:13.186126  8458 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:13.190451 11213 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:13.192902  9295 consensus_meta.cc:287] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.645s	user 0.019s	sys 0.015s
I20260709 13:02:13.202028  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2445) took 1817 ms. Trace:
I20260709 13:02:13.206935 11508 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:13.352321  9295 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEARNER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:13.352066  8377 rpcz_store.cc:276] 0709 13:02:11.384067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.402729 (+ 18662us) service_pool.cc:224] Handling call
0709 13:02:11.403022 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.840818 (+437796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.201648 (+1360830us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b54003dd1d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:13.201937 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1004987136}
I20260709 13:02:13.226949 11483 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:13.353138  9295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 458) took 1972 ms. Trace:
I20260709 13:02:13.353353 11483 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.353525  9295 rpcz_store.cc:276] 0709 13:02:11.380578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.454593 (+ 74015us) service_pool.cc:224] Handling call
0709 13:02:12.543244 (+1088651us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b5800220e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd45efc0 00007f36cd449929 00007f36cd4493d2 00007f36c69c0bd4
0709 13:02:12.543441 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.352822 (+809381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.353024 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2684160}
I20260709 13:02:13.227542 11512 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:13.326978  9290 rpcz_store.cc:276] 0709 13:02:12.130752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.134163 (+  3411us) service_pool.cc:224] Handling call
0709 13:02:13.324613 (+1190450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.325603 (+   990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.326427 (+   824us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400464e50. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:13.326562 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2495026432}
I20260709 13:02:13.354853  8377 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:13.228646  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:13.231343  8384 raft_consensus.cc:1240] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:13.234004  8386 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:13.235548  8427 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:13.238858 11533 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:13.357106 11533 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:02:13.359411  8385 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:13.347348 11326 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:13.245546  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:13.253795  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:13.255580  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:13.361950  8528 raft_consensus.cc:2410] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:02:13.365890  8534 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:13.258062  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:13.368285  8530 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:13.259080  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:13.369230 11519 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:13.370391  8527 raft_consensus.cc:2410] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:02:13.370059 11519 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.260076  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:13.264514  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 589) took 1848 ms. Trace:
I20260709 13:02:13.270501 11475 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:13.373332  8531 raft_consensus.cc:2410] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:02:13.273742 10971 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.373899 10971 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.376228 10971 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:13.376513  8531 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:13.377488 11508 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:13.377969 11450 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:13.378280  9291 raft_consensus.cc:2410] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:02:13.379412 11454 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:13.376374 11483 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:13.277860  8284 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53486 (request call id 345) took 17194 ms (client timeout 15000 ms). Trace:
I20260709 13:02:13.278892 11514 raft_consensus.cc:697] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 7 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:13.382162  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.382989 11514 consensus_queue.cc:237] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:13.380865  8284 rpcz_store.cc:269] 0709 13:01:56.087415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.143306 (+ 55891us) service_pool.cc:224] Handling call
0709 13:02:13.277779 (+17134473us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:12.699383 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:12.700714 (+  1331us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:12.700757 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:02:12.700783 (+    26us) tablet.cc:662] Decoding operations
0709 13:02:12.702234 (+  1451us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:12.702314 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:12.702361 (+    47us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:02:12.703762 (+  1401us) tablet.cc:701] Row locks acquired
0709 13:02:12.703791 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:02:12.704017 (+   226us) write_op.cc:270] Start()
0709 13:02:12.704168 (+   151us) write_op.cc:276] Timestamp: P: 1783602132703951 usec, L: 0
0709 13:02:12.704196 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:02:12.704986 (+   790us) log.cc:844] Serialized 4441 byte log entry
0709 13:02:12.710496 (+  5510us) op_driver.cc:464] REPLICATION: finished
0709 13:02:12.711610 (+  1114us) write_op.cc:301] APPLY: starting
0709 13:02:12.711704 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:12.711990 (+   286us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:12.712316 (+   326us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:12.714198 (+  1882us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:12.714475 (+   277us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:02:12.714521 (+    46us) write_op.cc:312] APPLY: finished
0709 13:02:12.714864 (+   343us) log.cc:844] Serialized 83 byte log entry
0709 13:02:12.715669 (+   805us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:12.715803 (+   134us) write_op.cc:454] Released schema lock
0709 13:02:12.715855 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:12.718338 (+  2483us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:12.718377 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3925259,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":903,"apply.run_cpu_time_us":3708,"apply.run_wall_time_us":6693,"num_ops":11,"prepare.queue_time_us":429915,"prepare.run_cpu_time_us":7250,"prepare.run_wall_time_us":7251,"raft.queue_time_us":2052,"raft.run_cpu_time_us":1107,"raft.run_wall_time_us":1107,"replication_time_us":6152,"thread_start_us":368906,"threads_started":4,"wal-append.queue_time_us":1502}]]}
I20260709 13:02:12.461979 11357 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:13.287930  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:13.289569 11488 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:13.292374  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:13.293125 11456 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.297348 11432 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:13.298062 11457 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:12.586790 11383 raft_consensus.cc:697] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:13.315093 11527 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:13.035801  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:13.398159  9296 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 6: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:02:13.398559  9296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 460) took 2015 ms (client timeout 2088 ms). Trace:
W20260709 13:02:13.398953  9296 rpcz_store.cc:269] 0709 13:02:11.382947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.476397 (+ 93450us) service_pool.cc:224] Handling call
0709 13:02:13.035624 (+1559227us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b5800220e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd44b0a0 00007f36cd44a984 00007f36c69c56d4 00007f36c69c5662
0709 13:02:13.398505 (+362881us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12742912}
I20260709 13:02:13.054270 11408 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:13.402247 11533 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:13.402500 11530 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:13.320991  8383 raft_consensus.cc:2393] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 6: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:13.402854 11527 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:13.400764  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 165300us
I20260709 13:02:13.330278  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:13.404390  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:13.404637  8459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 1861) took 2175 ms. Trace:
I20260709 13:02:13.405597  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:13.407140  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.407930  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:13.408492  9288 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:13.408728  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.330965 11194 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.343833 11532 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.133541 11370 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:13.138340  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 474) took 1867 ms. Trace:
I20260709 13:02:13.414985  9290 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:13.414821 11370 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.405018  8459 rpcz_store.cc:276] 0709 13:02:11.229484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.231405 (+  1921us) service_pool.cc:224] Handling call
0709 13:02:11.231755 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.401209 (+2169454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:13.401238 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:13.401281 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:13.401320 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.404427 (+  3107us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b540012bbd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:13.404471 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.404584 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4381,"spinlock_wait_cycles":4988377472}
I20260709 13:02:13.415196  8381 rpcz_store.cc:276] 0709 13:02:11.270816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.272588 (+  1772us) service_pool.cc:224] Handling call
0709 13:02:11.272856 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.290244 (+ 17388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.290271 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.290792 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:02:13.118512 (+1827720us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b18003ad980. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c80250d1 00007f36c8440a0f
0709 13:02:13.125759 (+  7247us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:13.125800 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.126436 (+   636us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.138047 (+ 11611us) raft_consensus.cc:1685] finished
0709 13:02:13.138068 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.138280 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30311,"raft.queue_time_us":18891,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":7280,"spinlock_wait_cycles":6135168,"thread_start_us":7018,"threads_started":1,"wal-append.queue_time_us":1831833}
W20260709 13:02:13.159977 11478 log.cc:927] Time spent T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 1.499s	user 0.003s	sys 0.000s
I20260709 13:02:13.417744 11526 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:13.418941 11456 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:13.321128  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:13.420197  8379 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:02:13.331355 11452 raft_consensus.cc:3055] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:13.327633 11479 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.352003 11213 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.224149  8380 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:02:13.222429 11495 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:13.372732  8526 rpcz_store.cc:276] 0709 13:02:11.415651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.416269 (+   618us) service_pool.cc:224] Handling call
0709 13:02:11.451903 (+ 35634us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.452273 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.452304 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:13.236075 (+1783771us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b2c0003cae8. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2
0709 13:02:13.236366 (+   291us) log.cc:844] Serialized 26 byte log entry
0709 13:02:13.262995 (+ 26629us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:13.263038 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.263122 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.264170 (+  1048us) raft_consensus.cc:1685] finished
0709 13:02:13.264192 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.264442 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126008,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"spinlock_wait_cycles":4254080,"thread_start_us":26221,"threads_started":1,"wal-append.queue_time_us":21085}
I20260709 13:02:13.274302 11176 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:13.386804  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 965959us
I20260709 13:02:13.387655  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.324787  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:13.386345 11357 raft_consensus.cc:697] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:13.392758  8452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36438
I20260709 13:02:13.394961  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.395485  8385 raft_consensus.cc:2410] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:02:13.395925 11283 raft_consensus.cc:3055] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:13.399394  9260 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:13.400497  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.409675  8453 raft_consensus.cc:2410] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:13.409991 11300 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:13.410255  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.412456  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:13.397137 11383 consensus_queue.cc:237] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:13.539768  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.421460  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:13.555385  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.556346  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:13.438658  8534 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:13.544337 11532 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:13.558465  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:13.559715  8457 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 6: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:13.560693  8385 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:13.560935  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:13.562201  8385 raft_consensus.cc:1240] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:13.423527  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:13.563012  8379 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:13.563439  8385 raft_consensus.cc:1275] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:13.563611 11452 raft_consensus.cc:740] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:13.564828 11452 consensus_queue.cc:260] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:13.439599  9293 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:02:13.464725  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:13.566110 11452 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:13.566220  9293 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 461) took 2182 ms (client timeout 1713 ms). Trace:
W20260709 13:02:13.566699  9293 rpcz_store.cc:269] 0709 13:02:11.383836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.432272 (+ 48436us) service_pool.cc:224] Handling call
0709 13:02:13.128693 (+1696421us) spinlock_profiling.cc:243] Waited 7.24 ms on lock 0x7b5800220e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd44b0a0 00007f36cd44a984 00007f36c69c56d4 00007f36c69c5662
0709 13:02:13.566148 (+437455us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16643328}
W20260709 13:02:13.522194  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 127671us
W20260709 13:02:13.433562  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 126442us
I20260709 13:02:13.567760  8426 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:13.568043  8454 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
I20260709 13:02:13.569247 11403 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:13.571599  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.572041  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.574671  8500 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:13.575773 11176 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.441579  8530 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:13.399034 11421 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:13.580260  8535 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:02:13.558416  8455 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:02:13.577145  9294 raft_consensus.cc:2393] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 7: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:13.581842  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.584697 11479 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:13.584867  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:13.462258 11370 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:13.585983  8457 raft_consensus.cc:2410] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:13.577310  8461 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:02:13.588115 11213 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:13.578287  8452 raft_consensus.cc:606] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Received request to transfer leadership
I20260709 13:02:13.578519 11331 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:13.579061  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 179788us
I20260709 13:02:13.579401 11403 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:13.448058  8528 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:13.579164 11357 consensus_queue.cc:237] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.438475  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:13.423000  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:13.591041  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:13.558714  8380 pending_rounds.cc:85] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 5
I20260709 13:02:13.576853 11495 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:13.604398  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.602847  8500 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:13.680701  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:13.684322  8379 raft_consensus.cc:2410] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:13.592159  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.593573  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.689097  8380 pending_rounds.cc:107] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:02:13.689672  8380 raft_consensus.cc:2889] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:13.678269  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:13.600418  8426 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:13.554558 11194 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:13.589375 11526 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.705287  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:13.659400 11488 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:13.707048  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 106709us
I20260709 13:02:13.589123 11283 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:13.709059  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:13.717833  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:13.710176  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:13.709175  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.693425 11421 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:13.724211  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.545634 10770 consensus_queue.cc:1059] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.165s
I20260709 13:02:13.739547  8460 raft_consensus.cc:1240] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:13.739452  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.740499  8458 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:13.554528 11465 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:13.705479  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 102805us
I20260709 13:02:13.722007  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:13.748979  8378 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:02:13.726868  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:13.730418  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.750216  8454 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:02:13.750490  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:13.730795  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 139281us
I20260709 13:02:13.732154  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.751715  8461 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 6: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:13.732451  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.727774  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.718708 11403 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:13.733438  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:13.742583  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.743784  8457 raft_consensus.cc:1240] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:13.708786 11479 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:13.757843  8458 raft_consensus.cc:2410] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:13.746161  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:13.734779  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 329527us
I20260709 13:02:13.758975  8455 raft_consensus.cc:2410] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:02:13.747856  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.753307  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:13.761848  9288 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:13.754731  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:13.754956  9261 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:13.762576  9293 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
W20260709 13:02:13.763114  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 102572us
I20260709 13:02:13.767477  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:13.768240  9294 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:13.717972 11526 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:13.779366  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.762665 11403 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.755865 11519 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:13.807916  8351 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:13.809023 11450 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:13.809463 11450 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.809810 11450 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:13.811885 11326 consensus_queue.cc:1059] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:13.738844 11483 consensus_queue.cc:1059] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:02:13.771533 11508 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:13.817612 11450 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:13.797058 11530 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.818624 11530 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.818989 11495 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:13.819844 11450 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:13.797993  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.777794 11502 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:13.822011  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.823107  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:13.824096  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.824631  8460 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:02:13.799045  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:13.793496  8315 debug-util.cc:398] Leaking SignalData structure 0x7b0800314a20 after lost signal to thread 7274
I20260709 13:02:13.800175  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.825783  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:13.826177  8315 debug-util.cc:398] Leaking SignalData structure 0x7b08002c7620 after lost signal to thread 8318
I20260709 13:02:13.826476  8461 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:02:13.826819  8461 pending_rounds.cc:85] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12: Aborting all ops after (but not including) 5
I20260709 13:02:13.827015  8461 pending_rounds.cc:107] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:02:13.827219  8461 raft_consensus.cc:2889] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:13.827489  8315 debug-util.cc:398] Leaking SignalData structure 0x7b08003447c0 after lost signal to thread 8410
W20260709 13:02:13.827775  8315 debug-util.cc:398] Leaking SignalData structure 0x7b08003476c0 after lost signal to thread 8411
W20260709 13:02:13.828836  8315 debug-util.cc:398] Leaking SignalData structure 0x7b0800376e60 after lost signal to thread 8485
I20260709 13:02:13.799243 11555 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:13.829073 11194 consensus_queue.cc:1059] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:13.829380 11547 consensus_queue.cc:1059] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:13.801513  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.830384 11194 raft_consensus.cc:3055] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:13.803284  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:13.830857 11194 raft_consensus.cc:740] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:13.831686 11447 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:13.802372  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.831954 11194 consensus_queue.cc:260] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:13.820690 11530 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:13.738386 11421 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:13.800897  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:13.835381  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.821120 11403 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:13.820690 11526 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:13.881397 11507 consensus_meta.cc:287] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.005s
I20260709 13:02:13.883461 11507 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:13.885685 11507 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:13.885725 11408 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:13.886354 11408 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:13.804641 11540 log.cc:927] Time spent T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:02:13.888106  8385 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:02:13.817875 11176 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:13.888801  8381 raft_consensus.cc:2410] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:02:13.889660  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 95346.7us
I20260709 13:02:13.787633 11532 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:13.760623 11488 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
W20260709 13:02:13.875857  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 152636us
W20260709 13:02:13.889860  8500 connection.cc:256] RPC call timeout handler was delayed by -1.0266700220000189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
W20260709 13:02:13.919992  8500 connection.cc:256] RPC call timeout handler was delayed by -1.0176700220000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
I20260709 13:02:13.920907  8500 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:13.922065 11194 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:13.860345  8315 debug-util.cc:398] Leaking SignalData structure 0x7b08001f7500 after lost signal to thread 8559
I20260709 13:02:13.923399 11519 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:13.928241  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:13.930727  8315 debug-util.cc:398] Leaking SignalData structure 0x7b0800350d60 after lost signal to thread 8560
I20260709 13:02:13.933554  8452 raft_consensus.cc:1275] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:02:13.916823  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 95644.3us
I20260709 13:02:13.936465  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:13.917339  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.924955  8530 raft_consensus.cc:1240] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:13.939100  8315 debug-util.cc:398] Leaking SignalData structure 0x7b080036c300 after lost signal to thread 9320
W20260709 13:02:13.939610  8315 debug-util.cc:398] Leaking SignalData structure 0x7b0800367a40 after lost signal to thread 11147
W20260709 13:02:13.940028  8315 debug-util.cc:398] Leaking SignalData structure 0x7b08003d8e00 after lost signal to thread 11338
W20260709 13:02:13.940249  8315 debug-util.cc:398] Leaking SignalData structure 0x7b08002cd1e0 after lost signal to thread 11349
W20260709 13:02:13.940554  8315 debug-util.cc:398] Leaking SignalData structure 0x7b0800158bc0 after lost signal to thread 11381
W20260709 13:02:13.940784  8315 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8780 after lost signal to thread 11393
I20260709 13:02:13.918152  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.941787  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:13.944075  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:13.945010  8530 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:13.949529  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:13.953392  8384 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:13.955794  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:13.976444  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:14.042374  8530 raft_consensus.cc:2393] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 7: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:14.038223  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:14.047165  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:14.048529  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:14.039188  8378 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:13.968099  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:14.044194  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:13.915212 11508 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:14.050207  8528 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:14.080418  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:14.081197  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:13.888659 11408 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:14.072794  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 136386us
I20260709 13:02:13.965399  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:14.087517  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:14.088333  8534 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
W20260709 13:02:13.916473 11549 log.cc:927] Time spent T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.330s	user 0.007s	sys 0.000s
I20260709 13:02:14.092831  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:14.094810  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:14.119707  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:14.126315  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:14.033288 11465 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:14.131138  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:14.128752  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:14.133129  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 447488us
W20260709 13:02:14.141485  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 418353us
I20260709 13:02:14.151111  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:14.168843  8526 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:02:14.169395  8528 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:14.168807  8534 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:14.133805  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 369841us
I20260709 13:02:13.961301 11530 consensus_queue.cc:1059] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.162s
I20260709 13:02:14.091950 11526 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:14.170624  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:14.082332 11457 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:14.176158  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 409523us
I20260709 13:02:14.201854  9261 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:14.180503  8500 leader_election.cc:336] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.526s (SENT)
I20260709 13:02:14.202885  8500 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:13.933131 11383 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.212s
I20260709 13:02:14.180073  9260 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:14.190989  8349 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:14.197778  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:14.213390  8526 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:13.938664 11532 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:14.092849 11512 consensus_queue.cc:1059] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:02:14.092262 11508 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:14.210945  9261 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:14.211826  9258 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:14.200465  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:14.231092  8383 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:14.175848 11331 raft_consensus.cc:697] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:02:14.114863  8271 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 56cc480ba6f642e08bb2e547a0ef50a1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d653e71832b7402b9a03b46249d3b885 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:14.219588  8534 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:14.195261 11519 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:14.228380  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.241883  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:14.243796  8534 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:02:14.246058  8534 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:14.216267  8349 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:14.250162  8349 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:14.251724  8349 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:14.239713  8530 raft_consensus.cc:2410] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:02:14.168782 11456 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.008s	sys 0.002s
I20260709 13:02:14.171794 11450 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:14.247290  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:14.254160  8349 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:14.240550 11508 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:14.254668  8271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 145792us
I20260709 13:02:14.214985 11526 raft_consensus.cc:697] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:14.258283  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:14.226598 11527 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:14.260231  8349 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:14.267405  8526 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:14.210139 11479 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:02:14.251142 11428 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:14.258647 11456 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.008s	sys 0.002s
I20260709 13:02:14.257980 11507 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:14.232738 11488 consensus_queue.cc:1048] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:02:14.265483 11430 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:14.214680 11475 consensus_queue.cc:1059] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:02:14.215837 11457 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:14.259591 11530 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:14.271075 10997 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:14.257579 11454 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:14.271368 11333 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:14.257845 11519 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:14.263959 11450 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:14.302139  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:14.309623  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:14.302493  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:14.303287  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:14.310254  8455 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 3.
I20260709 13:02:14.313366  8460 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.320493  8424 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:14.324456  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 209195us
I20260709 13:02:14.286052 11430 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:14.294418 10997 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.327356  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:14.344296  8460 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:14.348340  8528 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:14.346156  8424 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:14.346065  8427 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:14.349967  8424 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:14.351648  8424 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:14.300880 11454 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:14.309832 11555 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:14.368156  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:14.382802  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 171050us
I20260709 13:02:14.384696  9258 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:14.327913 11326 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:14.309757 11568 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:14.385749  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 174899us
W20260709 13:02:14.388113  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 207603us
W20260709 13:02:14.390766  8500 leader_election.cc:336] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.580s (SENT)
I20260709 13:02:14.391436  8500 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:14.392485 11479 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:14.393646  8500 leader_election.cc:336] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.704s (SENT)
I20260709 13:02:14.349352 11430 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.402648  9258 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:14.350330 10997 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:14.404634  9258 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:14.367695 11454 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:14.344609 11383 consensus_queue.cc:1059] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:02:14.435298  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:14.445127  8526 raft_consensus.cc:2393] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 8: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:14.447434 11574 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:14.448246 11574 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:14.451668 11386 raft_consensus.cc:3055] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:14.452096 11386 raft_consensus.cc:740] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:14.453775 11556 log.cc:927] Time spent T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:02:14.454779 11565 log.cc:927] Time spent T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
W20260709 13:02:14.455623 11544 log.cc:927] Time spent T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.897s	user 0.003s	sys 0.000s
W20260709 13:02:14.459852 11541 log.cc:927] Time spent T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.655s	user 0.000s	sys 0.006s
I20260709 13:02:14.397279  8500 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:14.428589 11569 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:14.461885  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 68272.3us
W20260709 13:02:14.462381 11537 log.cc:927] Time spent T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.653s	user 0.000s	sys 0.002s
I20260709 13:02:14.428369 11555 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:14.464497 11479 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:14.466207  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:14.464713  8500 leader_election.cc:336] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 2.065s (SENT)
I20260709 13:02:14.467514  8500 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:14.468127  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:14.469097  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:14.469332  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:14.469696  9295 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:14.470615  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:14.471239  8500 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:14.471694 11475 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:14.474436 11495 raft_consensus.cc:993] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:02:14.474978 11495 raft_consensus.cc:1081] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:02:14.475833  9258 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:14.476409 11539 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.679s	user 0.007s	sys 0.000s
I20260709 13:02:14.478511  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2083) took 1160 ms. Trace:
I20260709 13:02:14.482674  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:14.315368 11331 consensus_queue.cc:237] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:14.442176 11502 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:14.491144  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 287826us
I20260709 13:02:14.479080  8527 rpcz_store.cc:276] 0709 13:02:13.318543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.371278 (+ 52735us) service_pool.cc:224] Handling call
0709 13:02:13.371729 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:13.372262 (+   533us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:13.377692 (+  5430us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.716589 (+338897us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:13.734431 (+ 17842us) log.cc:844] Serialized 26 byte log entry
0709 13:02:13.734573 (+   142us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:13.749040 (+ 14467us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.755465 (+  6425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.755548 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.459318 (+703770us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:14.463443 (+  4125us) raft_consensus.cc:1685] finished
0709 13:02:14.463464 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.478436 (+ 14972us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20292,"prepare.queue_time_us":68204,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":12007,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":9426,"spinlock_wait_cycles":74627584,"thread_start_us":329935,"threads_started":1,"wal-append.queue_time_us":386252}
I20260709 13:02:14.496006  8378 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:14.496325  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:14.438836 11326 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.498482  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:14.503002  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 118281us
W20260709 13:02:14.493628 11550 log.cc:927] Time spent T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 13:02:14.504758  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:14.505012  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:14.497467 11452 consensus_meta.cc:287] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.931s	user 0.013s	sys 0.000s
I20260709 13:02:14.509758  8501 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:14.447074 11456 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:14.490927 11527 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:14.511162  8351 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:14.515921  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:14.372293 11526 consensus_queue.cc:237] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:14.490604 11519 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:14.499034 11447 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:14.511597  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:14.510262 11403 consensus_meta.cc:287] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.627s	user 0.011s	sys 0.000s
I20260709 13:02:14.520711 11533 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:14.452870 11386 consensus_queue.cc:260] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:14.518008  8351 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:14.514617 11194 consensus_meta.cc:287] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.006s
I20260709 13:02:14.533859  8459 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
W20260709 13:02:14.543941  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 72746.5us
I20260709 13:02:14.564764  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:14.614915  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 97004.9us
W20260709 13:02:14.565557  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.615156  9293 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:14.566757  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:14.569878  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:14.511220 10770 consensus_queue.cc:1059] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:02:14.530058 11447 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:14.573215  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 63598us
I20260709 13:02:14.620746  8501 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:14.529565 11532 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:14.543483 11383 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.573474  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:14.628888  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:14.575362 11579 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:14.577145 11450 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:14.630693  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:14.631511  8457 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
W20260709 13:02:14.578473 11552 log.cc:927] Time spent T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 1.001s	user 0.002s	sys 0.006s
I20260709 13:02:14.579236 11432 raft_consensus.cc:3055] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:14.579891 11464 raft_consensus.cc:3055] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:14.588168  8426 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:14.591760  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:14.592252 11283 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:14.593879 11527 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:14.595717 11581 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:14.597174 11457 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:14.543056 11533 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.599459  8378 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:14.601643  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2091) took 1210 ms. Trace:
I20260709 13:02:14.687443  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:14.686235  8533 rpcz_store.cc:276] 0709 13:02:13.390815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.406607 (+ 15792us) service_pool.cc:224] Handling call
0709 13:02:13.406943 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:13.407535 (+   592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:13.408520 (+   985us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:13.409153 (+   633us) log.cc:844] Serialized 26 byte log entry
0709 13:02:13.720467 (+311314us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:13.755014 (+ 34547us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.773683 (+ 18669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.773790 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.601447 (+827657us) raft_consensus.cc:1685] finished
0709 13:02:14.601469 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.601590 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49525,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":4601,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":14347,"thread_start_us":199009,"threads_started":1,"wal-append.queue_time_us":466267}
I20260709 13:02:14.566138 11428 consensus_queue.cc:1059] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:02:14.565994 11475 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:14.574461 11176 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:14.545359  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 193772us
I20260709 13:02:14.615254  8500 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:14.562810 11403 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:14.618368  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:14.626524  8377 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
W20260709 13:02:14.713989  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 96882.3us
I20260709 13:02:14.714184  8377 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:14.714622  8377 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:14.629711  8453 raft_consensus.cc:1240] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:14.715240  8351 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
W20260709 13:02:14.630048 11357 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.000s	sys 0.024s
I20260709 13:02:14.621878 11447 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.635919  8386 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:14.623064 11571 log.cc:927] Time spent T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:02:14.637373  8455 raft_consensus.cc:1240] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:14.624704 11582 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:02:14.634210 11547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.014s	sys 0.019s
W20260709 13:02:14.689543  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 101470us
I20260709 13:02:14.728433  8426 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:14.630082 11508 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:14.630301 11579 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:14.712469  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 452254us
I20260709 13:02:14.732669  8349 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:14.733386  8424 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:14.671070 11432 raft_consensus.cc:740] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:02:14.719535  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 104347us
I20260709 13:02:14.739326  8500 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:14.666435 11464 raft_consensus.cc:740] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:14.743475  8426 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:14.745710  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:14.746963  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:14.747069  8500 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:14.724417  8351 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:14.747483  8458 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:14.692456 11533 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:14.717483 11357 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.000s	sys 0.024s
I20260709 13:02:14.747736  8453 raft_consensus.cc:2393] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 7: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:14.755206  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:14.630252  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:14.676699 11489 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
W20260709 13:02:14.727475 11547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.016s	sys 0.026s
I20260709 13:02:14.732594 11457 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:14.751158  8500 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:14.792945  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 68632.4us
I20260709 13:02:14.727036 11450 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:14.666632 11383 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:14.727761 11428 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:14.678129 11527 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:14.800948  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:02:14.810504  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 65177.1us
I20260709 13:02:14.713930 11152 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:14.688540 11581 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:14.731985 11508 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:14.869551  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 54112.5us
I20260709 13:02:14.787976 11479 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:14.742244 11088 consensus_queue.cc:1059] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
W20260709 13:02:14.750382 11542 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:02:14.811215  8377 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:14.736303 11582 raft_consensus.cc:697] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:14.755786 11572 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:02:14.736048 11579 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.809132  9260 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:14.815732  9293 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:14.816031  9289 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:14.945696 11569 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.948151 11581 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:14.948035 11569 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:14.950120 11569 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:14.742750 11532 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:14.951846 11532 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:14.952239 11532 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:14.952381  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 151552us
I20260709 13:02:14.953172  8351 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:14.954473 11581 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:14.955049  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 146019us
I20260709 13:02:14.955410  8351 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:14.751135 11475 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:14.789005 11408 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:14.956689 11336 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:14.754688 11496 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:02:14.959640 11532 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:14.797735 11586 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:14.794111 11583 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:14.960805 11583 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.961252 11583 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:14.963004 11532 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:14.963798 11577 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.803368 11457 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:14.965382 11457 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:14.968581  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 374177us
I20260709 13:02:14.969481  8427 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:14.971024 11574 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:14.973274  8427 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:14.978648 11489 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:14.979116 11489 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:14.979503 11489 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:14.982494 11538 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 1.177s	user 0.000s	sys 0.004s
I20260709 13:02:14.983733  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2077) took 1666 ms. Trace:
I20260709 13:02:14.984103  8532 rpcz_store.cc:276] 0709 13:02:13.316990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.334999 (+ 18009us) service_pool.cc:224] Handling call
0709 13:02:13.335293 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:13.335652 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:13.335679 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:13.336173 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:02:13.617799 (+281626us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:14.137574 (+519775us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.140223 (+  2649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.140350 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.981909 (+841559us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:14.983419 (+  1510us) raft_consensus.cc:1685] finished
0709 13:02:14.983524 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.983673 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":100828,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":3187,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":222,"spinlock_wait_cycles":89924864,"thread_start_us":714269,"threads_started":2,"wal-append.queue_time_us":435648}
I20260709 13:02:14.798887 11454 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:14.991071 11454 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:14.872676  8533 raft_consensus.cc:1275] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:14.873586  8535 raft_consensus.cc:1240] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:02:14.636648 11488 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 13:02:14.816713 11519 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:14.802261 11483 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:14.874571 11508 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.871276 11495 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:14.887367 11450 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:14.887651  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2078) took 1570 ms. Trace:
I20260709 13:02:14.887835 11464 consensus_queue.cc:260] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:14.889345 11383 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:14.893301 11403 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:14.754884 11514 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 13:02:14.870414 11432 consensus_queue.cc:260] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:14.725732 11176 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:14.993165 11336 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.885763 10770 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:15.035503  8532 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:14.896658 11600 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.818661 11576 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:02:14.902890  8377 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:14.903864 11326 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:14.912276 10997 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:14.923134 11588 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:14.925257 11497 raft_consensus.cc:3055] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:14.927268  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:14.929785  8459 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36448 (request call id 1926) took 1465 ms (client timeout 1516 ms). Trace:
I20260709 13:02:15.051688  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:14.930832  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:14.931782 11512 raft_consensus.cc:3055] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:14.827891 11152 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:14.935547 11088 raft_consensus.cc:3055] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:14.935441 11533 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:14.938303 11527 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:14.876106  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2093) took 1484 ms. Trace:
I20260709 13:02:14.935237 11421 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:14.956698  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:02:14.807466  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 56404.8us
I20260709 13:02:15.008910  8529 rpcz_store.cc:276] 0709 13:02:13.317282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.337705 (+ 20423us) service_pool.cc:224] Handling call
0709 13:02:13.338484 (+   779us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:13.339094 (+   610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:13.339120 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:13.339546 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:02:13.525179 (+185633us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:13.556080 (+ 30901us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.556288 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.556382 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.835394 (+279012us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b18002568a0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:02:14.572826 (+737432us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b18002568a0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:02:14.887313 (+314487us) raft_consensus.cc:1685] finished
0709 13:02:14.887347 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.887555 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47202,"prepare.queue_time_us":30584,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":19401,"raft.queue_time_us":168,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":188,"spinlock_wait_cycles":308516352,"thread_start_us":185189,"threads_started":1,"wal-append.queue_time_us":218218}
W20260709 13:02:15.001144 11546 log.cc:927] Time spent T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.376s	user 0.000s	sys 0.007s
I20260709 13:02:14.894918 11479 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:15.025358 11562 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:15.025835  8283 catalog_manager.cc:5697] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:15.026473 11283 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:15.027711 11386 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:15.027801 11176 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:15.003880 11483 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.035274  9288 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:15.035683  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:15.044127  8452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1663cf9302e8495c8762465d306cb479"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:15.049487  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:15.052313  9296 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:15.052033  8459 rpcz_store.cc:269] 0709 13:02:13.464236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.464395 (+   159us) service_pool.cc:224] Handling call
0709 13:02:14.929561 (+1465166us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b54003c7654. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:14.929694 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2180153728}
I20260709 13:02:15.035271 11336 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:15.088234  8454 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:15.015893 11547 consensus_queue.cc:1059] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:02:15.012792 11495 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:15.052174 11430 consensus_meta.cc:287] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.614s	user 0.006s	sys 0.004s
I20260709 13:02:15.268597  8500 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:15.039080 10770 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:15.269569 11408 raft_consensus.cc:2764] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:02:15.270087  8500 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:15.055481 11555 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.220s
I20260709 13:02:15.270855 11408 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:15.271277  8500 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:15.091858  8531 rpcz_store.cc:276] 0709 13:02:13.391301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.420013 (+ 28712us) service_pool.cc:224] Handling call
0709 13:02:13.557658 (+137645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.557881 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:14.595602 (+1037721us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b18003202c0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c802d4bc 00007f36c537b48b 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5395455 00007f36cbe7d3c7 00007f36c848f9a7 00007f36c849f0bf
0709 13:02:14.595764 (+   162us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.874244 (+278480us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:14.874326 (+    82us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:14.874423 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.875860 (+  1437us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.876031 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":148668,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":63787,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":7910,"spinlock_wait_cycles":36218624,"thread_start_us":432835,"threads_started":3,"wal-append.queue_time_us":343080}
I20260709 13:02:15.273053 11519 consensus_queue.cc:1048] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
W20260709 13:02:15.110778  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.179550 11577 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:15.194635  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 93198us
I20260709 13:02:15.197927 11514 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.042644 11600 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:15.279451  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:15.280184 11514 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:15.280928 11600 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:15.082975 11512 raft_consensus.cc:740] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:15.281417 11562 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:15.282999  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:15.282685 11512 consensus_queue.cc:260] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:15.281597  8500 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:15.094553 11213 raft_consensus.cc:3055] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:15.272008 11408 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:15.052446 11497 raft_consensus.cc:740] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:15.115352  9291 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 11: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:15.283624  8452 raft_consensus.cc:606] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:02:15.284579  8500 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:15.326267  8452 raft_consensus.cc:614] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:15.283667  8453 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:02:15.277216 11483 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:15.268983 11430 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:15.297108  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 340433us
I20260709 13:02:15.044634 11464 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:15.328732  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:15.305552  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36438
I20260709 13:02:15.297772  8283 catalog_manager.cc:5697] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 6 to 7, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 7 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:15.268874  8533 raft_consensus.cc:2410] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:15.330762  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:15.313655  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:15.336268  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:15.337648  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 53213.3us
I20260709 13:02:15.332804  8457 raft_consensus.cc:606] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Received request to transfer leadership
W20260709 13:02:15.330586  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 310494us
I20260709 13:02:15.339016  8459 raft_consensus.cc:3055] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:15.339381  8459 raft_consensus.cc:740] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:15.345961  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.346035  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:15.087735 11088 raft_consensus.cc:740] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:15.329334  8380 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:02:15.350450  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:15.350178  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:15.357646  8453 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:15.361603  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:15.362164  8531 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:15.089596 11152 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:15.350594  8378 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:15.347026  8351 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:15.358731  8500 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:15.352514  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:15.365211  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:15.366348  8349 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:15.351490  8283 catalog_manager.cc:5697] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 3 to 4, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 4 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:02:15.370971  8349 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:15.371083  8283 catalog_manager.cc:5697] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 6 to 8, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 8 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:15.366973  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:15.376276  9296 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:15.377390  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:15.139667 11588 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.378878  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:15.284125 11512 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:15.289031 11578 raft_consensus.cc:3055] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:15.296314 11213 raft_consensus.cc:740] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:15.284060 11519 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:15.360919  8459 consensus_queue.cc:260] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:15.383646  8500 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:15.384203  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:15.376781  8283 catalog_manager.cc:5697] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 4 to 7, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 7 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:15.385839  8381 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:15.378007  8386 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:15.304386 11421 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:15.365547 11447 consensus_meta.cc:287] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.000s
W20260709 13:02:15.388180  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 56046.1us
I20260709 13:02:15.434832  8283 catalog_manager.cc:5697] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:02:15.388628  8461 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:02:15.389074  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.393993  8384 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:15.362331 11408 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:15.387656 11532 consensus_queue.cc:1059] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:02:15.398298 10997 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:15.398772  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:15.400740 11495 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:15.350069 11475 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:15.401600 11088 consensus_queue.cc:260] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:15.468055  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:15.468716 11088 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:15.403705 11479 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:15.470831 11583 consensus_meta.cc:287] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.001s
I20260709 13:02:15.404146  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:15.471055  8461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:15.471747  8461 raft_consensus.cc:606] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:15.472141  8461 raft_consensus.cc:614] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:15.456893 11579 consensus_meta.cc:287] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.002s
I20260709 13:02:15.473235 11579 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:15.387945 11530 consensus_queue.cc:1059] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:02:15.405499  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:15.411834 11497 consensus_queue.cc:260] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:15.090799 11582 consensus_queue.cc:237] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:15.421788  8458 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 4.
I20260709 13:02:15.434404  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:15.431775  8378 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:15.441658  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:15.384104 11454 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:15.444047  9260 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
W20260709 13:02:15.509598  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 123557us
W20260709 13:02:15.509658  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 65712.5us
I20260709 13:02:15.448400  8283 catalog_manager.cc:5697] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 6 to 7, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 7 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:15.479106  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:15.394704 11526 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:02:15.514978  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 131409us
I20260709 13:02:15.515829  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:15.516058  8500 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:15.512892  8283 catalog_manager.cc:5697] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 3 to 7, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 7 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:02:15.415179 10770 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:15.396051 11603 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:15.447357 11408 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:15.457765 11589 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:15.481498  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:15.586151 11589 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:15.587463  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:15.588555 11589 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:15.588699  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:15.518124 11514 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:15.476099  8379 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 9: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:15.590070  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:15.424045  8531 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:15.489634  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:15.590682 11602 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:15.471276 11583 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:15.447739 11447 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:15.507392  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.478927  8457 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:15.479348  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:15.511708  8455 raft_consensus.cc:2376] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4. Re-sending same reply.
I20260709 13:02:15.475476 11579 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:15.458256 11428 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:15.603175  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:15.508469 11454 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.425455 11507 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:15.579520 11572 consensus_queue.cc:1048] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:02:15.593240 11475 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:15.594475  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:02:15.597607  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 75819.4us
I20260709 13:02:15.604076  9292 raft_consensus.cc:2393] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 7: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:15.604326  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:15.605278  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:15.605777  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:15.606465  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:15.622648  8500 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:15.623193  8452 raft_consensus.cc:2368] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8.
I20260709 13:02:15.624092  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:15.424815 11588 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:15.630033  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:15.643306  8535 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:15.644497  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:15.647995  9261 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:15.515961  9287 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:15.613229  8424 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:15.614943  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:15.513872 11533 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:15.433215 11578 raft_consensus.cc:740] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:15.626163  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:15.653751  8501 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:15.604116 11497 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:15.518293  8283 catalog_manager.cc:5697] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:02:15.658376  8283 catalog_manager.cc:5697] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 6 to 9, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 9 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:02:15.660306  8283 catalog_manager.cc:5697] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:02:15.631361  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:15.518445 11576 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:15.625392 11428 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:15.635437  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:15.636072 11530 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:15.324455 11561 consensus_queue.cc:1175] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d653e71832b7402b9a03b46249d3b885" responder_term: 6 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:15.637980  8377 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:15.665849  8283 catalog_manager.cc:5697] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 3 to 4, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 4 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:15.638036 11597 log.cc:927] Time spent T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:15.638832  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:15.671260  8533 raft_consensus.cc:2393] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 4: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:15.639626 11614 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:15.612223 11454 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:15.657200  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:15.654301  8453 raft_consensus.cc:2376] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3. Re-sending same reply.
I20260709 13:02:15.627971  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:15.655983  8460 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:02:15.668797  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:15.680061  8386 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:15.581539 11336 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:15.615657 11383 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.638942  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:15.593223 11479 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:02:15.669013  8283 catalog_manager.cc:5697] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
W20260709 13:02:15.676029  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.517632 11213 consensus_queue.cc:260] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:15.695611  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:15.700676  8457 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 6: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:15.695744  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:15.607393 11519 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:02:15.701922  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:15.703223  9291 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:02:15.658497 11300 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.670224 11547 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:15.656924 11333 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:15.657002 11421 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:15.618700 11507 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:15.665953 11576 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.707675  8535 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:15.669956 11579 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:15.701447  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:15.710358  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:15.710435  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:15.664955 11581 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:15.696288 11457 consensus_meta.cc:287] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.730s	user 0.010s	sys 0.000s
W20260709 13:02:15.696620 11489 consensus_meta.cc:287] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.717s	user 0.005s	sys 0.006s
I20260709 13:02:15.679711 10997 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.731186  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:15.667778 11577 consensus_queue.cc:1059] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
W20260709 13:02:15.730094 11452 consensus_queue.cc:1175] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b8eb0ad4490645598004d862412f4e31" responder_term: 4 status { last_received { term: 4 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 4 index: 2 } }
I20260709 13:02:15.672817 11601 consensus_queue.cc:1059] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:02:15.701834 11383 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:15.713770 11300 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:15.694031  8283 catalog_manager.cc:5697] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 2 to 5, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 5 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:02:15.736038  8386 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
W20260709 13:02:15.857769  8270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 382337us
I20260709 13:02:15.866765  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:15.880185  8426 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:15.750687  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:15.887128  8453 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:15.887446  8426 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:15.887645  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:15.888798  8454 raft_consensus.cc:2376] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11. Re-sending same reply.
I20260709 13:02:15.890239  8384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2496) took 1287 ms. Trace:
I20260709 13:02:15.890674  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:15.890728  8384 rpcz_store.cc:276] 0709 13:02:14.602298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.602446 (+   148us) service_pool.cc:224] Handling call
0709 13:02:14.602788 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:15.436239 (+833451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.889664 (+453425us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b54003dd1d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:15.890040 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1818976128}
I20260709 13:02:15.892293  8379 raft_consensus.cc:1275] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:02:15.884521  8427 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:15.892565  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:15.892908  8379 pending_rounds.cc:85] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 4
I20260709 13:02:15.827404 11602 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:15.909164 11602 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:15.751559 10997 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:15.903105  8379 pending_rounds.cc:107] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:02:15.921316  8379 raft_consensus.cc:2889] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:16.020596 11574 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.021026  8384 raft_consensus.cc:1240] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:16.030653 11152 consensus_meta.cc:287] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.641s	user 0.006s	sys 0.006s
W20260709 13:02:16.033294  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.033557 11598 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:15.741549 11576 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:15.790992 11408 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:16.040664  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 156645us
I20260709 13:02:15.747431  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:16.041285 11561 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.063551  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:16.063791 11561 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:15.808364 11508 consensus_meta.cc:287] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.793s	user 0.002s	sys 0.008s
I20260709 13:02:15.749825 11457 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.022015 11533 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:16.042722 11591 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:16.043419  8379 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 6. Current term is 7. Ops: [4.7-6.8]
I20260709 13:02:15.750859  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:16.046314 11612 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:15.808396 11562 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:15.749393 11430 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:15.738147  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:16.051610 10997 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:16.051455  8501 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:16.024991  8381 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:02:16.025156 11488 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:16.105834 11488 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.106344 11495 consensus_queue.cc:1048] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:15.867372  8283 catalog_manager.cc:5697] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 3 to 4, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 4 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:15.752291  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:16.104537  8527 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:02:16.066900  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:16.111977  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:16.111197  8283 catalog_manager.cc:5697] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 5 to 6, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 6 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:15.769968 11600 raft_consensus.cc:3055] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:16.113412 11600 raft_consensus.cc:740] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:15.795763 11300 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:15.778643 11588 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:16.060840 11456 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.034004 11621 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:16.061384 11633 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.749603 11489 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:15.789557 11336 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:16.051753  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 389253us
I20260709 13:02:16.064741  8535 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:15.799643 11432 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:15.788828 11507 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:16.041296 11526 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.128545 11456 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:15.790509 11383 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:16.063534  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:15.774060 11547 raft_consensus.cc:697] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:15.776808 11583 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:16.066916 11527 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:16.099833 11533 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.093461 11152 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.101619 10971 raft_consensus.cc:3055] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:16.104509 11612 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.813496 11532 raft_consensus.cc:3055] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:15.768191  9287 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:02:15.821900 11454 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.117060 11600 consensus_queue.cc:260] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:16.119136  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 68068.1us
I20260709 13:02:16.078877  8385 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:02:15.789330 11447 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:16.108812 11488 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:16.121709  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:16.021668 11574 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.095340 11591 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.123713 11604 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.077922 11457 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:16.150822 11612 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:16.162958  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.123886  8526 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:16.069777 11421 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:16.128635 11598 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:16.095717  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.140105  8458 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:16.140501 11533 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:16.127745 11633 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.129490 11526 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.141101 11632 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.141498 11428 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:16.142011 11588 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:16.143724 10971 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:16.147118 11532 raft_consensus.cc:740] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:16.148231  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:16.181027 11532 consensus_queue.cc:260] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.181911  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:16.149492  8384 raft_consensus.cc:1240] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:16.181067  8283 catalog_manager.cc:5697] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 5 to 6, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 6 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:02:16.184566  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:16.150812  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:16.155141  8454 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:16.067312 11508 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.135720 11456 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:16.157485 11614 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:15.758111 11483 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.162146 11591 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:16.033628 11593 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.122s
I20260709 13:02:16.174960 11598 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:16.176293 11213 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:16.177491 11475 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:16.202419 11475 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.203179 11508 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:16.204103 11589 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.178452 11488 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.178871 10971 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.182009  9260 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:16.182425 11532 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:16.185982  8283 catalog_manager.cc:5697] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:02:16.173642 11574 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:16.148872 11454 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:16.152947  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:16.151115 11602 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.171394 11632 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.137756 11547 consensus_queue.cc:237] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:15.746308 11581 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.168965 11612 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:16.204164  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:16.166993 11604 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.196703 11614 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.218318  8455 raft_consensus.cc:2368] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 8. Current term is 9.
I20260709 13:02:16.218647  8530 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:02:16.218801  8460 raft_consensus.cc:2393] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 8: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:16.218307 11408 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:16.220002 11336 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:16.204849 11475 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:16.205449 11483 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:16.196979 11588 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.226822  8427 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:16.213289 11428 raft_consensus.cc:697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 7 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:16.236811  8381 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 9: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:16.234931 11561 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:16.204799 11589 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:02:16.221963 11430 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:16.236343 10971 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:16.234521 11600 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:16.232111 11489 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:16.255304  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:16.242771 11428 consensus_queue.cc:237] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.256095  8526 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:16.258410 11579 consensus_queue.cc:1059] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:02:16.259583 11489 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:16.260293 11489 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.261448 11588 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:16.232992 11488 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.265843  8454 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:16.269234  8535 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:02:16.265614  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:16.281729 11526 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:16.282634 11593 consensus_queue.cc:1059] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:16.283938 11593 raft_consensus.cc:3055] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:16.284351 11593 raft_consensus.cc:740] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:16.292404  8456 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:02:16.293742 11336 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.296182 11336 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:16.246426 11561 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:16.298055  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:16.298943 11488 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:16.300066  8349 leader_election.cc:336] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.526s (SENT)
I20260709 13:02:16.300352  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:16.301177  8380 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:16.301404 11632 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:16.302331  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:16.300561  8349 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:16.298883  8378 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:16.318188  8377 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:16.320413  8453 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:02:16.321625  8526 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
W20260709 13:02:16.319880  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 48643.9us
I20260709 13:02:16.333328  8454 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:02:16.333479  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 120598us
I20260709 13:02:16.332072  8383 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:16.337875 11447 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:16.338399 11447 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:16.338791 11447 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:16.341959 11632 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:16.341877 11578 consensus_queue.cc:260] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:02:16.345592 11589 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:16.348112  8455 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:16.354501 11488 consensus_queue.cc:1059] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:16.272856 11430 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.379009  8380 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
W20260709 13:02:16.386783  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 158208us
W20260709 13:02:16.392383  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 210639us
I20260709 13:02:16.391441  8427 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:16.398397  8427 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:16.404814  9260 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:16.403043  8427 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:16.411651 11602 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:16.412918 11583 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:16.413632 11583 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.413743  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:16.414279 11583 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:16.415831  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:16.416798 11612 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:16.417160  8386 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:16.417513 11612 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.418123 11612 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:16.395095  8283 catalog_manager.cc:5697] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 4 to 6, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 6 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:16.343340 11408 consensus_queue.cc:1059] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:02:16.430526 11329 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.378368 11428 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:16.413633 11614 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:16.335769 11593 consensus_queue.cc:260] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.456185  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:16.469779 11465 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.470659 11465 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:02:16.448323  8500 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:16.477371  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:16.484778  8383 raft_consensus.cc:2393] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 7: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:02:16.508749  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.509656 11575 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:16.510618 11621 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:16.511369 11621 raft_consensus.cc:697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:16.514568 11430 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:16.479151 11329 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.517534  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:16.517923 11642 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:02:16.519284 11333 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:16.519470  8427 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:16.519536  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:16.519850 11333 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.520377 11283 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:16.520597  8380 raft_consensus.cc:2410] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:16.520818 11283 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.521188 11283 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:16.522055 11333 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:16.525745  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:16.527570  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 134180us
I20260709 13:02:16.531890 11447 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:16.534240  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.536471  8351 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:16.537961 11614 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:16.538527 11614 raft_consensus.cc:697] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:16.509413 11591 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.538815 11450 consensus_queue.cc:1059] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:02:16.563201  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:16.566303  8380 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 8: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:16.568547 11581 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:16.572108  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:16.572826 11578 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:16.578033  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:16.579802  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:16.578706  8378 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:02:16.583897  8460 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:02:16.591588 11576 consensus_meta.cc:287] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.007s
I20260709 13:02:16.591845 11579 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:16.592438 11579 raft_consensus.cc:697] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:16.592219 11576 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.593710 11329 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:16.595336 11576 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:16.595443  8528 raft_consensus.cc:1240] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:16.575485 11593 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:16.596282 11475 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:16.607088  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.579062 11604 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:16.602275  8383 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 3.
I20260709 13:02:16.611169 11475 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.579021 11614 consensus_queue.cc:237] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.621928  8380 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:16.626588  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.619256 11612 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.512789 11621 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.577798 11283 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.648288  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:16.652514  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 165344us
W20260709 13:02:16.659659  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.659933 11612 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:16.661428  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 234661us
I20260709 13:02:16.662472  8500 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:16.643093  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:16.666213  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:16.667335  8383 raft_consensus.cc:2410] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:02:16.669185  8453 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 9: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:16.664139  8500 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:16.700028  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:16.701327  8526 raft_consensus.cc:2393] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 8: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:16.688601  8454 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
W20260709 13:02:16.715065  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.728307  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:16.734084  8528 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:16.689430 11428 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:16.728446 11612 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.722884 11465 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:16.772713 11643 log.cc:927] Time spent T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.125s	user 0.000s	sys 0.002s
I20260709 13:02:16.773241  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:16.773617  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:16.773998  9294 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:16.762902 11582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.917s	user 0.015s	sys 0.032s
W20260709 13:02:16.775229 11582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.015s	sys 0.033s
I20260709 13:02:16.766047  8535 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:02:16.767393 11532 consensus_meta.cc:287] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.002s
I20260709 13:02:16.764484 11575 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:16.783587 11633 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:16.786073 11488 raft_consensus.cc:3055] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:16.786736 11488 raft_consensus.cc:740] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:16.788882  9289 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:16.789655  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:16.790566  9296 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
W20260709 13:02:16.794559  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.796383  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:16.796870 11428 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:16.797456  9291 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 11: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:16.797488 11612 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.798527  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:16.799178  8526 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:16.803499 11283 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:16.801869  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:16.805070  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:16.805831  8454 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:16.806073 11475 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:16.806507  9260 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:16.806653  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2113) took 1474 ms. Trace:
I20260709 13:02:16.807101  8530 rpcz_store.cc:276] 0709 13:02:15.332120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.332242 (+   122us) service_pool.cc:224] Handling call
0709 13:02:15.332517 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:16.236679 (+904162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.806347 (+569668us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b54000abc54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:16.806577 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2006825856}
I20260709 13:02:16.807823 11575 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:16.808547 11575 raft_consensus.cc:697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:16.799073  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:16.810689  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:16.811512 11582 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.813133  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:16.813305 11582 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.814616  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:16.815835  8427 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:16.817206  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:16.802709  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:16.817901  8378 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:16.818184  8459 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:16.818425  8532 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:16.811178  9290 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:16.819461 11572 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.817575  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:16.820226  8452 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:16.820086 11572 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.821502  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:16.822803 11213 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:16.823374 11213 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.823774 11213 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:16.811179  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:16.825800  9296 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:16.752300 11447 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:16.760124 11579 consensus_queue.cc:237] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.828265  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:16.828858  8533 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:16.825137 11432 raft_consensus.cc:3055] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:16.829555 11432 raft_consensus.cc:740] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:16.830644 11432 consensus_queue.cc:260] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.831863 11432 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:16.833483  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:16.834635  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:16.835281  8383 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:16.837689 11575 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.838701  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:16.839129 11489 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:16.839323  8386 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:16.840067  8456 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36448 (request call id 1959) took 1352 ms (client timeout 1622 ms). Trace:
I20260709 13:02:16.838290  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:16.840495  8456 rpcz_store.cc:269] 0709 13:02:15.488065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.489262 (+  1197us) service_pool.cc:224] Handling call
0709 13:02:16.839867 (+1350605us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b540029b8d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:16.840001 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710423424}
I20260709 13:02:16.841863  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:16.842120  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:16.842788  8456 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:16.784772 11583 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.843856  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:16.842142  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:16.846513  8455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 1903) took 1153 ms. Trace:
I20260709 13:02:16.846963  8455 rpcz_store.cc:276] 0709 13:02:15.693335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.348882 (+655547us) service_pool.cc:224] Handling call
0709 13:02:16.368385 (+ 19503us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:16.433179 (+ 64794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.433211 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:16.456816 (+ 23605us) log.cc:844] Serialized 52 byte log entry
0709 13:02:16.644883 (+188067us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:16.644940 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.645034 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:16.846251 (+201217us) raft_consensus.cc:1685] finished
0709 13:02:16.846276 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.846458 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3630,"raft.queue_time_us":9283,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5778,"thread_start_us":117782,"threads_started":1,"wal-append.queue_time_us":358629}
I20260709 13:02:16.846484  8453 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:16.849586  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:16.850206 11479 raft_consensus.cc:3055] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:16.850582 11479 raft_consensus.cc:740] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:16.851337  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:16.851573 11479 consensus_queue.cc:260] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.852218  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:16.853960  8455 raft_consensus.cc:1240] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:16.845851 11640 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:02:16.849647  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 1979) took 1268 ms. Trace:
I20260709 13:02:16.859133  8383 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:16.862632  8457 raft_consensus.cc:2393] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 7: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:16.810329  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:16.861581  8427 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:16.856310  8385 rpcz_store.cc:276] 0709 13:02:15.581573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.589782 (+  8209us) service_pool.cc:224] Handling call
0709 13:02:16.849449 (+1259667us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b54003b5e54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:16.849578 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105914624}
I20260709 13:02:16.873943  8535 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:16.875972  8533 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:16.801635 11612 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:16.852974 11479 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:16.880349 11283 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:16.891085  8526 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:16.821606 11152 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:16.878925 11600 consensus_meta.cc:287] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.623s	user 0.013s	sys 0.000s
I20260709 13:02:16.866484 11582 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:16.870014 11591 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:16.886895  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:16.895404  8427 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:16.899796  8349 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.566s (SENT) [suppressed 30 similar messages]
I20260709 13:02:16.913074  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:16.806083 11488 consensus_queue.cc:260] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:16.925542  9295 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:16.901511 11283 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.930680 11655 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:16.931396 11655 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.932281 11502 raft_consensus.cc:3055] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:16.932679 11502 raft_consensus.cc:740] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:16.933696 11502 consensus_queue.cc:260] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:16.934305  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:16.935002 11502 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:16.935315  8533 raft_consensus.cc:2393] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 9: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:16.937427  8456 raft_consensus.cc:2393] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 9: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:16.939620  8456 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36438
I20260709 13:02:16.941495 11283 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:16.945258  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:16.945392  9288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 471) took 1532 ms. Trace:
W20260709 13:02:16.946803  9292 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 466) took 2411 ms (client timeout 1535 ms). Trace:
W20260709 13:02:16.947268  9292 rpcz_store.cc:269] 0709 13:02:14.535593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.538890 (+  3297us) service_pool.cc:224] Handling call
0709 13:02:16.946420 (+2407530us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b54004b8cd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:16.946608 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2230396672}
I20260709 13:02:16.948817  8460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36448 (request call id 1973) took 1442 ms. Trace:
I20260709 13:02:16.949224  8460 rpcz_store.cc:276] 0709 13:02:15.506246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.237870 (+731624us) service_pool.cc:224] Handling call
0709 13:02:16.242593 (+  4723us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:16.589844 (+347251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.948559 (+358715us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b540040f1d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:16.948733 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":761696512}
W20260709 13:02:16.950449  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.951366 11583 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:16.954507 11572 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:16.955056  9291 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:02:16.962752  8386 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:16.957401  8351 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:16.965404  8459 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:02:16.970425  8351 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:16.921399 11612 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:16.977172  9296 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:16.973754  8453 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:16.980736  9260 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:16.983834  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:16.981611  8351 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:16.988538  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 324463us
I20260709 13:02:16.987476  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:17.070654  8459 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36446 (request call id 1895) took 1653 ms (client timeout 2092 ms). Trace:
I20260709 13:02:17.070844 11488 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:17.071379 11447 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:17.071906 11403 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:17.092669  9294 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:17.072667  9258 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:17.073220  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:17.073856  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:17.074333  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 84283.9us
I20260709 13:02:16.927735 11614 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:16.976440 11527 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:17.053625  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 72965.2us
I20260709 13:02:17.070525 11582 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:16.978909 11532 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:17.119777  8533 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:17.120862  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:17.125782  9295 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:17.081261  8456 raft_consensus.cc:606] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 13:02:17.081115  8385 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:17.081143  8459 rpcz_store.cc:269] 0709 13:02:15.335840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.336039 (+   199us) service_pool.cc:224] Handling call
0709 13:02:16.817153 (+1481114us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b58003044d0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c83e10aa 00007f36c8463447 00007f36c847bfe7 00007f36c847d7de 00007f36c848927c 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c
0709 13:02:16.982525 (+165372us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b54003c7154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:16.989687 (+  7162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085039872}
I20260709 13:02:16.945935  9288 rpcz_store.cc:276] 0709 13:02:15.343561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.343705 (+   144us) service_pool.cc:224] Handling call
0709 13:02:15.344004 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:15.344366 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:15.344395 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:16.171681 (+827286us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b2c00047b98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2
0709 13:02:16.219510 (+ 47829us) log.cc:844] Serialized 26 byte log entry
0709 13:02:16.239921 (+ 20411us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:16.430698 (+190777us) log.cc:844] Serialized 14 byte log entry
0709 13:02:16.576812 (+146114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.600161 (+ 23349us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:16.876100 (+275939us) raft_consensus.cc:1685] finished
0709 13:02:16.876235 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.876439 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17677,"prepare.queue_time_us":29816,"prepare.run_cpu_time_us":166,"prepare.run_wall_time_us":6611,"raft.queue_time_us":25196,"raft.run_cpu_time_us":398,"raft.run_wall_time_us":61628,"spinlock_wait_cycles":24610688,"thread_start_us":300037,"threads_started":3,"wal-append.queue_time_us":338344}
I20260709 13:02:17.126770  8456 raft_consensus.cc:614] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:17.081054  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 110861us
I20260709 13:02:17.127401  8458 raft_consensus.cc:606] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:17.128016  8458 raft_consensus.cc:614] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:17.087764  9289 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:17.085587 11612 raft_consensus.cc:697] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:17.093381  8457 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:17.096306  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:17.135672  8460 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:02:17.096635 11508 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.096585 11656 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:17.098045  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:17.099308 11578 consensus_meta.cc:287] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.522s	user 0.004s	sys 0.006s
I20260709 13:02:17.105773  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:17.113481  8386 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:17.153180  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:02:17.155367  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.117115 11527 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:17.119946 11532 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.124310 11447 raft_consensus.cc:697] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:17.119513 11582 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:17.157593  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 44319us
I20260709 13:02:17.116513 11655 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:17.165555  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:17.170959  8427 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:17.171656  8528 raft_consensus.cc:2410] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:02:17.154755 11479 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.173847  8424 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:17.175894  8526 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:17.181200  8427 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:17.161480 11527 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:17.164362 11532 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:17.175530 11648 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:17.173532 11582 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:17.174811 11454 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:17.154556 11614 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:17.197551  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:17.151580 11403 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:17.210546  8500 leader_election.cc:400] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8.
I20260709 13:02:17.212548  8500 leader_election.cc:403] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:17.213289  8459 raft_consensus.cc:1275] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:17.161867 11656 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:17.186019  9289 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:17.182466 11508 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:17.203950 11465 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:17.197438 11604 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:02:17.219789  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.231428  9296 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:17.251549  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:17.255595  9295 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
W20260709 13:02:17.215746  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 315940us
I20260709 13:02:17.197307 11479 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:17.266853  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:17.268363  8380 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:17.270797  8384 raft_consensus.cc:2393] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 9: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:02:17.271481  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 72085.3us
I20260709 13:02:17.272537  8501 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:17.256960 11578 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8.
W20260709 13:02:17.276922  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.265929 11530 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.248889 11465 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:17.283806  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.283842  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:17.259586 11593 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.286788  8386 raft_consensus.cc:2393] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 8: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:17.278483  8424 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:17.264482 11604 raft_consensus.cc:697] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:17.276186 11611 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:17.296104  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 116269us
I20260709 13:02:17.242846 11454 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:17.308307 11428 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:17.308772 11428 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.309119 11428 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:17.309835 11654 log.cc:927] Time spent T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:02:17.313565  9261 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:17.303537  8349 leader_election.cc:336] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.770s (SENT)
I20260709 13:02:17.314787  8349 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:17.292196 11465 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:17.326431  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:17.328339  8386 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:17.306213 11194 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:17.311309 11483 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:17.336499  8380 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:17.337965  8500 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:17.339223  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 60853.2us
I20260709 13:02:17.342406 11614 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:17.342944 11647 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:17.306550 11611 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:17.344911 11611 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:17.345191  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.345450 11604 consensus_queue.cc:237] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:17.274260 11447 consensus_queue.cc:237] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:17.349278  8385 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:17.352741 11665 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:17.281740 11612 consensus_queue.cc:237] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:17.353539  8500 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:17.354744 11508 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:17.355362 11508 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:17.356477 11403 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:17.316323 11530 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:17.357357 11479 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:17.358768 11530 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:17.359298 11194 raft_consensus.cc:697] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:17.360239 11194 consensus_queue.cc:237] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:17.361334  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 59881.9us
W20260709 13:02:17.362004  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.353729 11656 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:17.339571 11483 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.373442 11483 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:17.362777 11403 consensus_queue.cc:1059] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:17.318895 11575 consensus_queue.cc:1059] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:02:17.377939 11403 raft_consensus.cc:3055] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:17.378533 11403 raft_consensus.cc:740] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:17.378721 11575 raft_consensus.cc:3055] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:17.363762  8424 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:17.303088 11593 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:17.364390  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:17.367488 11283 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:17.342939 11213 consensus_meta.cc:287] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.000s
I20260709 13:02:17.369825  8458 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43296 (request call id 34) took 1710 ms. Trace:
I20260709 13:02:17.350279 11432 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:17.390015  9261 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:17.390229  8458 rpcz_store.cc:276] 0709 13:02:15.659568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.139909 (+480341us) service_pool.cc:224] Handling call
0709 13:02:17.369581 (+1229672us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b54003c7154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c847f853 00007f36cd44d60a 00007f36c69d37d4 00007f36c69d3762 00007f36c69d3691 00007f36c69d360c 00007f36c69d28c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:17.369728 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2208414080}
I20260709 13:02:17.400727 11403 consensus_queue.cc:260] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:17.402125 11403 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:17.402848 11283 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:17.402957 11454 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:17.379128 11575 raft_consensus.cc:740] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:17.405875 11465 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:17.406234 11575 consensus_queue.cc:260] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:17.408226 11465 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:17.419003  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 55341.1us
I20260709 13:02:17.408149 11575 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:17.393395 11213 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:17.431453 11213 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:17.443017  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:17.443475  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:17.444077  9296 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:17.444821  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:17.449816  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:17.456306 11664 log.cc:927] Time spent T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.154s	user 0.002s	sys 0.001s
I20260709 13:02:17.435101  8351 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:17.421554 11648 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:17.436250  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:17.436523 11589 consensus_queue.cc:1048] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:17.412987 11532 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:17.456864 11575 consensus_queue.cc:1059] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:17.458623  8377 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:02:17.461007  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.465909  8456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36438 (request call id 86) took 1177 ms. Trace:
I20260709 13:02:17.434118  8384 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:17.480800  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:17.492280  8424 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:17.495316  8381 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:17.490656  9296 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:17.497478  8456 rpcz_store.cc:276] 0709 13:02:16.288387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.939480 (+651093us) service_pool.cc:224] Handling call
0709 13:02:17.465685 (+526205us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b54003c7154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c847f853 00007f36cd44d60a 00007f36c69d37d4 00007f36c69d3762 00007f36c69d3691 00007f36c69d360c 00007f36c69d28c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:17.465814 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114131328}
I20260709 13:02:17.504444  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:17.505461  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 70433.8us
I20260709 13:02:17.509099  8383 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:17.516867  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:17.517732  8377 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:17.507757  8351 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:17.529899  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:17.539045 11403 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:17.528334 11428 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:17.539644 11403 raft_consensus.cc:697] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:17.539942  8424 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:17.543372  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 187656us
I20260709 13:02:17.543300  8385 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:02:17.536671  8351 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:17.481731 11648 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.547065  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:17.548116  8424 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:17.551836  8386 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:02:17.547036  8427 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:17.531100 11614 raft_consensus.cc:2804] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:17.556833  8377 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:17.559980  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:17.567135  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:17.568054  8530 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:17.553689 11648 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:17.431455 11527 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:17.552870 11583 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:17.577071  8528 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:17.531636 11454 consensus_queue.cc:1059] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:02:17.580590  8526 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
W20260709 13:02:17.582870  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.606531  8381 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:17.540603 11403 consensus_queue.cc:237] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:17.554615 11611 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:17.563129 11581 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:17.591359 11593 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:17.591689  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:17.591647 11483 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:17.592878  8500 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:17.593777  9296 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:17.550719 11561 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:02:17.618521 11656 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:17.598598  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:17.619549  8529 raft_consensus.cc:2410] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:02:17.582650  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:17.620224  8533 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:17.624850 11633 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:17.597594  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36438 (request call id 85) took 2119 ms. Trace:
I20260709 13:02:17.556854 11428 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:17.618368  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 47312.5us
I20260709 13:02:17.612115 11582 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:02:17.562186 11672 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:17.627259  8461 rpcz_store.cc:276] 0709 13:02:15.477963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.478067 (+   104us) service_pool.cc:224] Handling call
0709 13:02:17.597107 (+2119040us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54003c7154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c848b735 00007f36c84839fa 00007f36cd44b4c9 00007f36c69c7c54 00007f36c69c7be2 00007f36c69c7b11 00007f36c69c7a8c 00007f36c69c6d42 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:17.597375 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3323066240}
I20260709 13:02:17.632850  8533 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:17.578994 11614 raft_consensus.cc:697] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:17.634101  8386 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:02:17.643153  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:17.647322  8530 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:17.642422 11581 raft_consensus.cc:697] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:17.649806 11581 consensus_queue.cc:237] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:17.644636 11633 raft_consensus.cc:697] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:17.654498 11633 consensus_queue.cc:237] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:17.645155 11672 raft_consensus.cc:697] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:17.662160 11672 consensus_queue.cc:237] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:17.664426  8453 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67513665d04b44c292143601e7f66ac8"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:17.665278  8453 raft_consensus.cc:606] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:17.667953 11582 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:17.673544  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.679225 11614 consensus_queue.cc:237] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:17.686142  8455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:17.688563  8500 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:17.690212 11428 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:17.691548 11532 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:17.692624 11527 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:17.692692  8424 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:17.696673 11502 raft_consensus.cc:3055] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:17.698895 11432 raft_consensus.cc:3055] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:17.699466 11432 raft_consensus.cc:740] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:17.698982 11502 raft_consensus.cc:740] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:17.700503  8424 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:17.701683 11300 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:17.701802 11572 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:17.702240 11300 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.702471 11572 raft_consensus.cc:697] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:17.702749 11300 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:17.703462 11572 consensus_queue.cc:237] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:17.705833  8424 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:17.693395 11283 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:02:17.700450 11432 consensus_queue.cc:260] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:17.710116 11432 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:17.711500 11591 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:02:17.712029  8270 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 56cc480ba6f642e08bb2e547a0ef50a1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 105d6581548546b98eddd4ee7083bb12 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:02:17.694466  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 62924.2us
I20260709 13:02:17.699263  8500 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:17.722675  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:17.723320  8526 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:17.712069 11591 raft_consensus.cc:697] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:17.728022  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.700775 11502 consensus_queue.cc:260] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:17.738188  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.738052  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:17.737947  8426 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:17.753479  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.694624 11483 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:17.754289  8379 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 10: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:17.768718  8427 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:17.728856 11655 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:17.766852  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 230255us
I20260709 13:02:17.785198  8351 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:02:17.789100  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 89901us
I20260709 13:02:17.730625 11604 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:02:17.756528 11574 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:17.740546 11591 consensus_queue.cc:237] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:17.803287  8426 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:17.790630 11483 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:17.819638  8426 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:17.809693 11527 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:17.817004  8351 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:17.828429 11502 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:17.843143  8351 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:17.846021  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 45340.2us
I20260709 13:02:17.850093 11683 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:17.850870 11683 raft_consensus.cc:697] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:17.852033 11683 consensus_queue.cc:237] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:17.844674 11561 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:17.867107  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:02:17.869745  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 68767.5us
I20260709 13:02:17.870956  8455 raft_consensus.cc:606] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:17.871649  8455 raft_consensus.cc:614] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:17.871706  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.874433  8526 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
W20260709 13:02:17.881644  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 62091us
I20260709 13:02:17.885274  9261 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:17.895783  9261 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:17.905325  8500 leader_election.cc:400] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 8. Current term is 9.
I20260709 13:02:17.905812  8500 leader_election.cc:403] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:17.922994  9261 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:17.924198  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 63387.5us
W20260709 13:02:17.924299  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 53628.6us
I20260709 13:02:17.927198  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:17.928709  8380 raft_consensus.cc:2410] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:02:17.929497  8384 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:02:17.931007  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:17.881541 11465 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:17.934423  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:17.883407 11527 raft_consensus.cc:2764] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:02:17.936153  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:17.925995  8424 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:17.873428 11612 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.904919 11593 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:17.935388  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:17.940806  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:17.901773 11194 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:17.904397 10997 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:17.904143  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:17.954413  9295 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:17.904646 11656 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:02:17.941923 11483 raft_consensus.cc:697] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:17.944674 11655 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.961851 11428 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 8. Current term is 9.
I20260709 13:02:17.918229 11670 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:02:17.958292 11593 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:17.980351  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:17.964187  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:17.940282 11648 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:17.998807  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 76408.4us
I20260709 13:02:18.026090  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:17.985420 11655 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:18.028721  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:17.958115 11612 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:18.037915  8459 raft_consensus.cc:1275] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:02:17.976702 11583 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:18.041584  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 65827.8us
W20260709 13:02:18.046700  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 59871.5us
I20260709 13:02:17.997336 11593 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.052161  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:18.053025  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 125827us
W20260709 13:02:18.053789  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 170133us
W20260709 13:02:18.088819  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 165913us
W20260709 13:02:18.101871  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.109392  8453 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:18.110706  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:18.113848  8459 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:18.055855  9291 raft_consensus.cc:2393] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 7: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:18.117022  8500 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:18.129882 11656 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:18.130746 11656 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:18.131786 11583 raft_consensus.cc:697] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:18.132882 11583 consensus_queue.cc:237] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:18.129997 11569 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:18.137769 11483 consensus_queue.cc:237] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:18.176234  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 63330us
I20260709 13:02:18.186017  8461 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:02:18.191488 11655 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:18.175891 11656 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:18.192322 11655 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:18.193974  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.205361  8459 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
W20260709 13:02:18.177685 11674 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:02:18.213843  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 99643.1us
I20260709 13:02:18.192926 11655 raft_consensus.cc:697] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:02:18.226044  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 49030.6us
I20260709 13:02:18.227461 11575 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:18.264818  8535 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:02:18.276425  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 54416.6us
I20260709 13:02:18.287421 11593 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:18.290254 11655 consensus_queue.cc:237] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:18.294056  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 177137us
W20260709 13:02:18.295559 11688 log.cc:927] Time spent T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260709 13:02:18.279471 11604 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.319022  8458 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
W20260709 13:02:18.322520  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.333870  8527 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:18.300345  9260 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:18.332149 11300 consensus_meta.cc:287] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.627s	user 0.013s	sys 0.000s
I20260709 13:02:18.338423  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:18.347589  8386 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
W20260709 13:02:18.376225  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 438707us
I20260709 13:02:18.348701 11656 consensus_queue.cc:1059] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:02:18.386602 11682 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.335645 11648 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:18.349597 11701 log.cc:927] Time spent T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:02:18.350059 11502 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:18.397960  8526 raft_consensus.cc:3055] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:18.401610  8526 raft_consensus.cc:740] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:18.393555  8351 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:18.402895  8351 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:18.335482 11604 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:18.418743  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:18.390974 11656 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.392616 11527 consensus_queue.cc:1048] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:02:18.417032 11152 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:18.390472 11682 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:18.427196 11152 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:18.420939  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:18.413389 11581 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:18.430032 11581 raft_consensus.cc:697] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:18.431053 11581 consensus_queue.cc:237] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:18.431824  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:18.349401 11300 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:18.416301  8526 consensus_queue.cc:260] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:18.433948  8526 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.441632 11682 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:18.438865 11604 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:18.434386 11593 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:18.408818 11683 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:18.445749  9291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55734 (request call id 785) took 1002 ms. Trace:
I20260709 13:02:18.446360  9291 rpcz_store.cc:276] 0709 13:02:17.443359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.444516 (+  1157us) service_pool.cc:224] Handling call
0709 13:02:18.445534 (+1001018us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b5400047754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:18.445685 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1395910400}
I20260709 13:02:18.446466 11683 raft_consensus.cc:697] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:18.447868 11612 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:18.448469 11683 consensus_queue.cc:237] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
W20260709 13:02:18.437544 11687 log.cc:927] Time spent T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.280s	user 0.000s	sys 0.003s
I20260709 13:02:18.459604  8526 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:02:18.463786  8526 pending_rounds.cc:85] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 7
I20260709 13:02:18.434235 11300 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:18.471834  8377 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:18.473614  8457 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:18.463004  8427 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:18.464217  8526 pending_rounds.cc:107] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:02:18.478991  8526 raft_consensus.cc:2889] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:18.480532  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:18.429548 11152 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:18.484774  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:18.426126 11709 raft_consensus.cc:3055] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:18.488766  8378 raft_consensus.cc:2393] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 6: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:18.485842  8385 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:02:18.490206  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.507398  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:18.513305 11712 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.513899 11712 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:18.516130 11712 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:18.516623 11712 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:18.517218 11591 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:18.517644 11591 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.517993 11591 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.460489 11656 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:18.520437 11656 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:18.544674  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:18.545383  8385 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:18.602511 11710 log.cc:927] Time spent T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
W20260709 13:02:18.608390  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 66471us
W20260709 13:02:18.612859 11693 log.cc:927] Time spent T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
W20260709 13:02:18.629206  8332 auto_rebalancer.cc:893] Removing replace marker failed: Replica 105d6581548546b98eddd4ee7083bb12 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:02:18.629750  8332 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:02:18.630156  8534 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:18.504593 11682 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.122s
I20260709 13:02:18.635310 11447 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:02:18.630000  8332 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:02:18.494225 11709 raft_consensus.cc:740] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:18.641840 11709 consensus_queue.cc:260] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:18.642717 11465 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:18.643430 11465 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:18.645610  8452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 571) took 1816 ms. Trace:
I20260709 13:02:18.646085  8452 rpcz_store.cc:276] 0709 13:02:16.829490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.890955 (+ 61465us) service_pool.cc:224] Handling call
0709 13:02:16.900029 (+  9074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.152176 (+252147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.152223 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:17.600318 (+448095us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b2c0007a8e8. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2
0709 13:02:17.600756 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:02:17.869683 (+268927us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:17.869717 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.869792 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.436892 (+567100us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:18.645373 (+208481us) raft_consensus.cc:1685] finished
0709 13:02:18.645397 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.645528 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":198764,"raft.queue_time_us":216854,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":4393,"spinlock_wait_cycles":36565120,"thread_start_us":268536,"threads_started":1,"wal-append.queue_time_us":384200}
I20260709 13:02:18.647508 11283 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.648113 11283 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:18.651819 11283 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:18.660918  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.517028 11712 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:18.663049  8385 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:18.664111 11712 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:18.727319  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:18.728505  8453 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:18.643181 11709 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:18.784365  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:18.784803  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:18.790867  8526 raft_consensus.cc:1275] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:02:18.797416  9261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.043s	sys 0.032s
W20260709 13:02:18.799175  9261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.043s	sys 0.032s
W20260709 13:02:18.800860  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 573871us
W20260709 13:02:18.779665 11707 log.cc:927] Time spent T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.401s	user 0.001s	sys 0.003s
I20260709 13:02:18.863762  8529 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:18.839519 11465 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:18.864113 11647 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.868230 11647 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:18.871997  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:18.873011  8453 raft_consensus.cc:2410] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:02:18.875350  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:18.878082  8426 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:18.880885  8454 raft_consensus.cc:1240] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:02:18.881531  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.888137  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:18.890030  8530 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:02:18.888058  8526 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:18.893898  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:18.895586  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:18.817004 11591 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:18.896503  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.870831 11647 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:18.898363  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:18.900502  8534 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:02:18.902347  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.907998  8500 connection.cc:256] RPC call timeout handler was delayed by -1.1818803820000312s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
I20260709 13:02:18.915361  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:18.918071  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:18.900068 11604 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:18.918612  8457 raft_consensus.cc:2410] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:02:18.908577 10997 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.910451 11712 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:18.923530  8453 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:18.911000 11447 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.925845  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:18.928962 11447 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:18.930092 11591 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:18.931708 11447 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:18.933737 11716 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.937271  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:18.938194 11683 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:18.938767 11683 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:18.939544  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:18.941202  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:18.941973  8529 raft_consensus.cc:2410] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:18.944700  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:18.946055  8529 raft_consensus.cc:1240] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 9. Ops: []
W20260709 13:02:18.949963 11717 log.cc:927] Time spent T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:02:18.908183 11655 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:18.953804 11655 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:18.956650 11655 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:18.957381  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:18.958243  8529 raft_consensus.cc:2368] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8.
I20260709 13:02:18.958789  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:18.960547  8377 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:18.961105  8383 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:18.959856  8380 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:18.962328  8383 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:18.929201 11712 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:18.981654  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:18.981774  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:18.988739 11447 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:18.992729 11329 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.993439 11329 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:18.995460  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:18.981673  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:18.940891 11683 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:19.006306  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:19.008054  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.011957  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:18.998026 11707 log.cc:927] Time spent T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:02:19.017190  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:19.018110  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.023782  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.024673  8531 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:18.927939 10997 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:19.021934  8530 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 9: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:19.013830 11714 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.046397 11714 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:19.046890 11465 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:19.048166  9258 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:19.011636 11454 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.046411  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:19.049916  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.049934  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.055359  8385 raft_consensus.cc:2393] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 7: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:19.059655  8530 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:19.073447  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:19.079246  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:19.082928 11581 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.083616 11581 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:19.084197  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2162) took 1359 ms. Trace:
I20260709 13:02:19.039991 11329 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:19.087064  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:19.091306  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:19.084619  8532 rpcz_store.cc:276] 0709 13:02:17.724543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.724682 (+   139us) service_pool.cc:224] Handling call
0709 13:02:17.741225 (+ 16543us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:17.787212 (+ 45987us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:18.028603 (+241391us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.181164 (+152561us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:18.182093 (+   929us) log.cc:844] Serialized 52 byte log entry
0709 13:02:18.182298 (+   205us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:18.185849 (+  3551us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.669560 (+483711us) spinlock_profiling.cc:243] Waited 6.79 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:18.678739 (+  9179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.678856 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:19.083913 (+405057us) raft_consensus.cc:1685] finished
0709 13:02:19.083941 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.084135 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2873,"prepare.queue_time_us":321807,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":91,"raft.queue_time_us":18791,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":14335,"spinlock_wait_cycles":15619328,"thread_start_us":767581,"threads_started":3,"wal-append.queue_time_us":219496}
I20260709 13:02:19.101828  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:19.102681  9294 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.104735 10997 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:19.105023  9295 raft_consensus.cc:1240] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:02:19.105108  9287 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:19.107767  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.119729  8527 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:19.108999  9291 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 6. Current term is 7. Ops: [4.7-6.8]
I20260709 13:02:19.109768  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:19.121949  9289 raft_consensus.cc:2393] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 7: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:19.110579  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:19.072332 11454 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:19.128067  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.111917 11614 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:19.112529  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:19.068313 11713 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:19.114149 11730 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.114800 11728 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:19.105235  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:19.140600  9288 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:02:19.130137  9292 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:19.137517  8381 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:19.151916  9290 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:19.152220 11728 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:19.154820  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.154263  8534 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:19.160230 11712 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:19.140378 11713 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.162616  8379 raft_consensus.cc:1275] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:19.103386 11683 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:19.163357  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.172055  8530 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:02:19.163810  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.165793  8535 raft_consensus.cc:1275] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:02:19.174209  8535 pending_rounds.cc:85] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 2
I20260709 13:02:19.174484  8535 pending_rounds.cc:107] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:02:19.174752  8535 raft_consensus.cc:2889] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:19.166783  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.278554  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.279377  8534 raft_consensus.cc:2393] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 9: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:19.279500  8527 raft_consensus.cc:2393] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 8: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:19.109802 11714 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:19.286393  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.287305  8528 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:02:19.288276  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:19.296617  9294 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:02:19.298199  9292 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:19.161062  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:19.301714  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.300427  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:19.304715  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:19.305279  8535 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:19.304013  9291 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:02:19.279572 11709 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:19.312844 11709 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:19.315061 11709 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:19.323305  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.324489  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:19.330765  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.334946  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:19.344270  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.337217  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:19.339617 11669 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:19.153720 11730 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:19.343156  8349 leader_election.cc:336] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.566s (SENT)
I20260709 13:02:19.355816  8349 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:19.332173  9290 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:19.345237  9261 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:19.343425  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:19.349871  8530 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:02:19.374042  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:19.522890  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:19.525429  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 182320us
W20260709 13:02:19.394248  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 50726.3us
W20260709 13:02:19.401664  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.418665  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.344426  9288 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:19.245159  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:19.532929  8349 leader_election.cc:336] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.561s (SENT)
W20260709 13:02:19.533710  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 210982us
I20260709 13:02:19.531090  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:19.534466  8534 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.484630  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:19.531054  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.541814  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:19.533728  8349 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:19.466353  9292 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:19.548841  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:19.554883  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:19.553774  8535 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:02:19.553984  8527 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.566118  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.567353  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:19.568184  8530 raft_consensus.cc:2393] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 9: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:19.569250  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:19.571148  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 400957us
I20260709 13:02:19.571038  8530 raft_consensus.cc:2368] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8.
I20260709 13:02:19.572916  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.573279  8377 raft_consensus.cc:2393] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 13: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:19.557524  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:19.188591 11726 log.cc:927] Time spent T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:02:19.578677  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:19.562309  8382 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:19.584692  9261 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:19.580719  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:19.576982  8535 raft_consensus.cc:1275] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:02:19.581975  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:19.582764  9296 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:19.161708 11454 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:19.581915  8452 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:19.586740  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.475101 11633 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:19.588191  8453 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:19.584438  8455 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 5.
I20260709 13:02:19.469694 11648 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.161594 11728 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:19.589560  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:19.528636 11612 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:19.187245 11683 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.162010 11713 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.595706  8531 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:19.589354  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:19.596697  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 63803.8us
I20260709 13:02:19.596454  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:19.596510  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 255402us
I20260709 13:02:19.347018  9289 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:19.604638  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.599517  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:19.600288  8453 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:19.554540 11530 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:19.600224  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.607909  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:19.608378  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:19.601243  8533 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.609557  8535 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:19.590876  8530 raft_consensus.cc:2393] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 9: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:19.577847 11685 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:19.611322  9295 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:19.611529  9287 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:19.605423  8532 raft_consensus.cc:2376] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5. Re-sending same reply.
I20260709 13:02:19.521703 11452 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:02:19.529004 11600 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:02:19.484043 11670 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:02:19.591295 11682 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.588642 11604 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.587239 11647 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:19.622740  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 50599.7us
I20260709 13:02:19.546591 11152 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:02:19.623900  8531 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:02:19.625924  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:19.618489  8530 raft_consensus.cc:1240] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:19.607503 11683 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:19.631285  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:19.604200 11572 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:02:19.689886  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 62710.7us
I20260709 13:02:19.630712 11530 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:19.696266  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:19.687652  8531 pending_rounds.cc:85] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 6
I20260709 13:02:19.697516  8531 pending_rounds.cc:107] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:02:19.697860  8531 raft_consensus.cc:2889] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:19.698244  8531 pending_rounds.cc:107] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:02:19.698537  8531 raft_consensus.cc:2889] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:19.598425 11454 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:02:19.600605 11648 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:19.700292 11734 log.cc:927] Time spent T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:02:19.612313 11612 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:19.707798  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:19.720543  8379 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:02:19.710888  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.686362 11447 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.701895 10997 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.715005  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.779286  8531 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:02:19.717047  8533 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:19.772194  9292 raft_consensus.cc:2410] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:19.772202  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.709862  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:19.781235  9291 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:19.772903  8454 raft_consensus.cc:1240] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:19.685498 11604 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:19.706125 11647 raft_consensus.cc:697] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:19.701016 11611 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:02:19.643380 11682 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:19.701120 11572 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:19.928217  8426 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
W20260709 13:02:19.777841 11725 log.cc:927] Time spent T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:02:19.933285  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 347581us
I20260709 13:02:19.936090  8534 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:19.712050 11530 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:19.943457  8535 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:02:19.804538 11737 log.cc:927] Time spent T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:02:19.807304 10997 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:19.955344  8452 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
W20260709 13:02:19.939596 11738 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:02:19.956797  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:19.771798 11300 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.227s
I20260709 13:02:19.960383  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:19.966681  8528 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.804495 11712 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.950284 11562 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.969794  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:19.970703  8529 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 9: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:19.973421  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:19.974732  9261 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:19.977679  8385 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:19.978549  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:19.783857 11447 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:20.012825  8454 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:20.017725  9296 raft_consensus.cc:1240] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:20.019763  9296 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEARNER]: Advancing to term 7
I20260709 13:02:20.000955 11576 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:20.021534 11576 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.021916 11576 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:20.001117 11728 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:20.025461 11728 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.025852 11728 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:20.027614 11454 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:20.035074  9258 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:20.037421 11743 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:20.037925 11743 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.038249 11743 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:20.046183 11682 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:20.053874  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 362969us
I20260709 13:02:20.054991  8424 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:20.060322  9291 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:19.997437 11614 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:19.961047 11633 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 13:02:20.081341  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 153196us
W20260709 13:02:20.027673 11740 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:02:20.084385  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 398410us
I20260709 13:02:20.014950 11730 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:20.075795 11738 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:02:20.059890 11593 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.095201  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:20.000454 11712 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:20.082662 11739 log.cc:927] Time spent T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.388s	user 0.000s	sys 0.001s
I20260709 13:02:20.098973  8529 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:20.100121  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:20.100860  8534 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 4.
I20260709 13:02:19.998100 11562 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:20.089632 11452 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:20.091404 11647 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:20.091265 11194 raft_consensus.cc:2804] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:20.110321  8427 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:20.070117 11591 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:02:20.110263  8385 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:20.117770  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:20.116629  8349 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.041s	sys 0.053s
W20260709 13:02:20.118937  8349 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.041s	sys 0.053s
I20260709 13:02:20.104607 11730 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:20.098348 11489 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:20.113433 11194 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:20.107650 11648 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:20.123502  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:20.124140  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.095917 11600 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:02:20.112246 11452 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:20.132032 11194 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:20.140424 11452 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:20.136567 11489 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:20.137777  8529 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:20.139732 11530 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:20.150491  9296 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEARNER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:20.154495  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 528) took 1151 ms. Trace:
I20260709 13:02:20.105916 11593 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:20.123451 11730 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.110766 11611 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:02:20.156122  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:20.160353  8383 rpcz_store.cc:276] 0709 13:02:19.003376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.004841 (+  1465us) service_pool.cc:224] Handling call
0709 13:02:19.012859 (+  8018us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:19.041642 (+ 28783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.041672 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:19.049850 (+  8178us) log.cc:844] Serialized 52 byte log entry
0709 13:02:19.467780 (+417930us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:19.523265 (+ 55485us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.524064 (+   799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.524133 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.154247 (+630114us) raft_consensus.cc:1685] finished
0709 13:02:20.154267 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.154431 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9564,"prepare.queue_time_us":59437,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":30025,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":170,"thread_start_us":377345,"threads_started":1,"wal-append.queue_time_us":535994}
I20260709 13:02:20.155753 11703 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:20.175523  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:20.152633 11612 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:20.188868  8529 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
W20260709 13:02:20.189896  8527 consensus_meta.cc:287] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.001s
I20260709 13:02:20.218145  8527 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:20.175283 11730 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:20.192446  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:20.196156 11194 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:20.197532 11748 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:20.203848  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:20.151176 11672 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:02:20.225670  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:20.160566 11447 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:20.222613 11703 raft_consensus.cc:697] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:20.228942 11703 consensus_queue.cc:237] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:20.234400  8534 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:20.218824  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2099) took 1054 ms. Trace:
I20260709 13:02:20.219463  8458 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 1934) took 1271 ms. Trace:
W20260709 13:02:20.220906  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 185918us
I20260709 13:02:20.240427  8527 rpcz_store.cc:276] 0709 13:02:19.164053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.285138 (+121085us) service_pool.cc:224] Handling call
0709 13:02:20.218761 (+933623us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:20.241672  9258 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:20.225682  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 115423us
I20260709 13:02:20.245550  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:20.169626 11747 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:20.240540  8458 rpcz_store.cc:276] 0709 13:02:18.947908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.964770 (+ 16862us) service_pool.cc:224] Handling call
0709 13:02:19.007604 (+ 42834us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.571257 (+563653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.571286 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.571745 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.942311 (+370566us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:19.942354 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.942430 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.219280 (+276850us) raft_consensus.cc:1685] finished
0709 13:02:20.219297 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.219412 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":599608,"raft.queue_time_us":572586,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5319,"thread_start_us":330258,"threads_started":1,"wal-append.queue_time_us":519991}
I20260709 13:02:20.252486 11760 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:20.253369 11447 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:02:20.248376  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 129759us
I20260709 13:02:20.205054 11604 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:20.258503  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.222800 11572 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:20.265164  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:20.258811  8427 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:20.269542  8533 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:20.270916  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:20.271786  8379 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
W20260709 13:02:20.273242  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 151043us
I20260709 13:02:20.257277 10997 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:20.281268  8349 leader_election.cc:336] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.639s (SENT)
I20260709 13:02:20.282836  9293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 789) took 1123 ms. Trace:
I20260709 13:02:20.283269  9293 rpcz_store.cc:276] 0709 13:02:19.102473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.142634 (+ 40161us) service_pool.cc:224] Handling call
0709 13:02:19.143050 (+   416us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:19.143464 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.143489 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:19.144006 (+   517us) log.cc:844] Serialized 52 byte log entry
0709 13:02:19.602606 (+458600us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:19.602714 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.602850 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.225801 (+622951us) raft_consensus.cc:1685] finished
0709 13:02:20.225821 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.225942 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2567,"raft.queue_time_us":1182,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":100,"thread_start_us":458062,"threads_started":1,"wal-append.queue_time_us":634503}
I20260709 13:02:20.284425  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:20.285773  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:20.287145 11713 consensus_meta.cc:287] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.664s	user 0.009s	sys 0.000s
I20260709 13:02:20.287345 11452 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:20.287601 11713 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:20.289304  9294 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:20.290109  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:20.293156 11713 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:20.264417 11747 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:20.295562 11752 log.cc:927] Time spent T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:20.297029  8528 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:20.299746 11747 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:20.300489 11747 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.276552 11483 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:02:20.301129 11747 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:20.298561 11576 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:20.304973 11452 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:20.304042  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:20.275720 11604 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:20.303634  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 105848us
I20260709 13:02:20.297402  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:20.248451 11748 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:20.318590  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 77036.5us
W20260709 13:02:20.306082  8349 leader_election.cc:336] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.676s (SENT)
I20260709 13:02:20.316458  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:20.320014  8349 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:20.317718  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:20.321244  8379 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
W20260709 13:02:20.305073 11736 log.cc:927] Time spent T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.581s	user 0.014s	sys 0.008s
I20260709 13:02:20.328485  8533 raft_consensus.cc:3055] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:20.328904  8533 raft_consensus.cc:740] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:20.329399  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:20.329684  8533 consensus_queue.cc:260] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:20.330545  8533 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:20.334021 11576 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:20.334100 11655 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:20.334801 11655 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:20.336395  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:20.317812 11612 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.337604  8533 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:02:20.337523 11612 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:20.338024  8533 pending_rounds.cc:85] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 2
I20260709 13:02:20.338483  8533 pending_rounds.cc:107] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:02:20.338815  8533 raft_consensus.cc:2889] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:20.339273  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:20.339592  8270 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 56cc480ba6f642e08bb2e547a0ef50a1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 105d6581548546b98eddd4ee7083bb12 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:20.340049  8454 raft_consensus.cc:2410] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:20.303607 11747 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:20.297295 11759 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.297355 11562 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:20.297637 11712 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:20.347011  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:20.348572  8379 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:02:20.317510 11604 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.349896  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:20.351672  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:20.353425  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 47376.3us
W20260709 13:02:20.354104  8349 leader_election.cc:336] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.685s (SENT)
I20260709 13:02:20.354272  8379 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:20.354512  8349 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:20.355834  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:20.356540  8385 raft_consensus.cc:2393] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 6: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:20.359422  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:20.360109  8383 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:20.361896  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:20.362067  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:20.336956 11655 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:20.319186 11574 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:02:20.318069 11483 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:02:20.362669  8382 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
W20260709 13:02:20.366233  8349 leader_election.cc:336] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.702s (SENT)
I20260709 13:02:20.368824  8349 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:20.346783 11745 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:20.371142  9295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 494) took 1060 ms. Trace:
I20260709 13:02:20.357410 11604 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:20.361148 11530 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:20.353641 11747 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:20.357003 11709 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:20.357769 11593 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:20.338533 10997 consensus_queue.cc:1059] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:02:20.376605  9295 rpcz_store.cc:276] 0709 13:02:19.311022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.706798 (+395776us) service_pool.cc:224] Handling call
0709 13:02:19.927653 (+220855us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.927888 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:20.129238 (+201350us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.223411 (+ 94173us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.370593 (+147182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.370663 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:20.370796 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.370982 (+   186us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.371093 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20413,"prepare.queue_time_us":382765,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":68,"raft.queue_time_us":97157,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":23078,"spinlock_wait_cycles":32740096,"thread_start_us":409249,"threads_started":3,"wal-append.queue_time_us":120879}
I20260709 13:02:20.409912  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:20.413621  8532 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:20.414857  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:20.415314  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 49150.1us
I20260709 13:02:20.415498  8532 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:20.415992  8349 leader_election.cc:336] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.705s (SENT)
I20260709 13:02:20.341655 11583 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:02:20.416461  8349 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:20.370955 11648 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:20.377223 11454 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:20.438083  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2083) took 1432 ms. Trace:
I20260709 13:02:20.358068 11759 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:20.459699  8526 rpcz_store.cc:276] 0709 13:02:19.005742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.010020 (+  4278us) service_pool.cc:224] Handling call
0709 13:02:19.010428 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.016968 (+  6540us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:19.017011 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.026214 (+  9203us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.469944 (+443730us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:19.469988 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.470079 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.304537 (+834458us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:20.430927 (+126390us) raft_consensus.cc:1685] finished
0709 13:02:20.430955 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.437984 (+  7029us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23030016,"thread_start_us":380266,"threads_started":1,"wal-append.queue_time_us":561430}
I20260709 13:02:20.467862  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:20.468313  8526 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:20.462261 11745 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:20.475325  8526 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:20.477198  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:20.478070  8526 raft_consensus.cc:2410] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:02:20.481163  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:20.481876  8526 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
W20260709 13:02:20.482134 11749 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:02:20.484861  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:20.487468  9258 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:20.411368 11465 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
W20260709 13:02:20.512270  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 96298.1us
W20260709 13:02:20.513295  8349 leader_election.cc:336] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.706s (SENT)
I20260709 13:02:20.513759  8349 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:20.522902  9258 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:20.418190 11709 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:20.414490 11747 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:20.568117  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 54859.7us
W20260709 13:02:20.536093  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.585242  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.570088  8349 leader_election.cc:336] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.801s (SENT)
I20260709 13:02:20.597752  8349 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:20.490284 11760 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:20.532045 11751 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:20.520735 11767 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:20.532873 11753 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:20.532272 11714 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:20.654234  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 286273us
I20260709 13:02:20.701377  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:20.702193  8531 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:20.702826  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.625494 11454 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:20.725960  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:20.727150  8382 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 3.
W20260709 13:02:20.661801 11683 consensus_meta.cc:287] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.960s	user 0.012s	sys 0.000s
I20260709 13:02:20.651211 11745 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:20.649300 11753 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:20.651387 11194 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:20.651641 11751 raft_consensus.cc:697] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:20.742627  8500 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:20.709304 11612 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:20.752782  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:20.762869  8526 raft_consensus.cc:2410] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:02:20.764161  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 194096us
I20260709 13:02:20.629766 11760 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:20.765161  8349 leader_election.cc:336] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.832s (SENT)
I20260709 13:02:20.779910  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:20.780195  8427 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:20.782456  8424 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:20.782168  8427 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:20.786144  8500 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:20.749557 11769 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.729614 11454 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:20.751098 11753 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:20.760814 11712 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:20.862676  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 76652.6us
W20260709 13:02:20.855983  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 73875.5us
I20260709 13:02:20.880257  8500 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:20.859771 11483 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:20.860628  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:20.908169 11483 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:20.861927  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:20.908661 11483 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:20.801913 11611 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:20.909291 11611 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.909704 11611 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:20.911509 11730 consensus_meta.cc:287] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.669s	user 0.007s	sys 0.003s
I20260709 13:02:20.742287 11683 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:20.914757 11683 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:20.915539  8386 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 10: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:20.915642 11454 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:20.909056  8382 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:20.916019 11604 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:20.862728 11769 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:20.904971 11728 consensus_meta.cc:287] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.879s	user 0.007s	sys 0.002s
I20260709 13:02:20.918040 11728 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:20.919018 11769 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:20.920131 11728 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:20.921924 11743 consensus_meta.cc:287] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.883s	user 0.012s	sys 0.000s
I20260709 13:02:20.922160  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:20.922461 11743 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:20.923671 11604 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:20.864001 11774 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:20.881639 11764 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.420s	user 0.000s	sys 0.001s
I20260709 13:02:20.927237 11759 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:20.778961 11612 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.680400 11767 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:20.864398  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 99307.3us
W20260709 13:02:20.928514  8349 leader_election.cc:336] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.947s (SENT)
I20260709 13:02:20.858841 11714 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:20.799137 11530 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:02:20.929898 11767 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:20.784373 11194 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 13:02:20.900592 11709 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:20.901705 11760 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:20.901856 11779 log.cc:927] Time spent T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:02:20.905792 11747 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:20.906909 11751 consensus_queue.cc:237] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:20.928192 11612 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:20.950668  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:20.934509  8531 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:20.951330  8382 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:20.803755 11572 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:20.749640 11766 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:20.947695  8349 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:20.778008 11748 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:20.949338  8532 consensus_meta.cc:287] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.005s
I20260709 13:02:20.950281  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:20.924984 11743 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:20.953645  8379 raft_consensus.cc:2410] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:20.953708  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:20.948518 11530 consensus_queue.cc:1048] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:02:20.785296 11745 consensus_queue.cc:1059] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.161s
I20260709 13:02:20.953222  8532 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:20.972033  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:20.912029 11730 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:20.979359  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 44747.8us
I20260709 13:02:20.980471  8349 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:20.981143 11730 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:20.982156  9287 raft_consensus.cc:2368] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14.
I20260709 13:02:20.983194 11614 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:20.983301 11530 consensus_queue.cc:1048] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:20.984124 11530 consensus_queue.cc:1243] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer b8eb0ad4490645598004d862412f4e31 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:02:20.984594  8349 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:20.985647 11683 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:20.986990  8349 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:20.987793 11683 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:20.988998 11612 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:20.949608 11769 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:20.978397  8381 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:20.994881  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:20.961249 11611 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:20.997278 11611 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:20.997417  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:20.998088  8385 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:02:20.991042  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:20.998971  8378 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:20.999434  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:21.000025  8384 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:21.000865  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:21.001344  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:20.999008  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:21.002451  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:21.001408  8530 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:21.002481  8349 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:20.958850 11766 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:21.001940  8383 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:21.014369  8378 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:21.015234  8380 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:20.972033 11454 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:21.016353 11683 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:21.016762 11454 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:21.017354  8379 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:02:20.992132 11489 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:20.984128 11614 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:02:21.018728  8530 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:21.019166  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:21.026064  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:21.043442  8378 raft_consensus.cc:2410] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:21.018226 11683 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:21.036178  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:21.067448 11489 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:21.073607 11489 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:21.077265  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 74842us
I20260709 13:02:21.016078 11745 consensus_queue.cc:1059] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:02:20.993008 11483 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:21.081535  8349 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:21.082852  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2117) took 1513 ms. Trace:
I20260709 13:02:21.083360  8535 rpcz_store.cc:276] 0709 13:02:19.577130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.616254 (+ 39124us) service_pool.cc:224] Handling call
0709 13:02:19.942277 (+326023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.943838 (+  1561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.081767 (+1137929us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54000f78d0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:21.082784 (+  1017us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537706752}
I20260709 13:02:21.084791  8349 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:21.090306  8349 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:21.094762  8383 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:21.049638 11454 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:21.085906 11581 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:21.105983 11735 log.cc:927] Time spent T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 1.329s	user 0.000s	sys 0.016s
I20260709 13:02:21.106441 11483 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:21.101902 11769 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:21.107149 11614 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:21.117111  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 236933us
I20260709 13:02:21.095417 11489 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:21.140926  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.169611  8500 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:21.177245  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.177798  8500 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:21.178386 11769 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:21.180703 11769 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:21.168417 11612 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:21.181320 11796 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:21.182332  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 178730us
I20260709 13:02:21.184494  8500 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:21.185223  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 95055.9us
I20260709 13:02:21.185623  8500 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:21.186868  8349 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:21.188717  8500 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:21.191905  8500 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:21.193179  8500 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:21.168748 11581 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:21.176402 11614 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:21.187213 11769 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:21.187209 11748 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:21.189819 11766 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:21.202220  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:21.194343 11760 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:21.196220 11712 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:21.195684 11747 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:21.183717 11612 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:21.199385 11614 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:21.196585 11581 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:21.196884 11795 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:21.225785  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:21.212291 11796 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:21.213300 11709 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:21.208158 11793 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:21.235862  8383 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:02:21.213302 11683 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:21.245923  8500 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:21.248200 11612 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:21.248553  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:21.230382 11581 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:21.258206  9261 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:21.259040  8501 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:21.230506 11795 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:21.269604  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:21.271613  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:21.272512  8535 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:21.276039  9261 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:21.270709  8501 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:21.277565  8500 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:21.280107  8501 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:21.268814 11795 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.267493 11760 raft_consensus.cc:2764] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:21.283715  9261 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:21.288643  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:21.289433  9291 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:21.270691 11709 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:21.283491  8500 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:21.288086 11801 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.282498 11712 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:21.298102  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:21.278530 11751 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:21.281783 11713 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:21.307045  8424 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:21.304242  9261 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:21.283854 11748 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:21.285951 11769 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:21.244369 11793 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:21.304330  8500 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:21.315040  8500 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:21.308382  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:21.316759  9290 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:02:21.311157 11648 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:21.318640 11583 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:21.303056 11712 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:21.321914 11712 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:21.306835 11787 consensus_queue.cc:1059] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:02:21.309382 11766 raft_consensus.cc:2764] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:02:21.294754 11796 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:02:21.301772 11709 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:21.311157  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:21.302764 11700 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:21.295598  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:21.301625 11747 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:21.295850  8501 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:21.331375  8500 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:21.331409  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:21.310544 10997 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:21.330389  8424 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:21.307669 11713 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:21.339506  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 43732.1us
I20260709 13:02:21.310957 11748 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:21.343463  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:21.327975 11751 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.333935 11709 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:21.329847 11767 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:21.334295 11700 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.337338 11766 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:21.347343  8384 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:21.329355 11769 raft_consensus.cc:697] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 8 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:21.308351 11801 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:21.370985  9294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 493) took 2060 ms. Trace:
I20260709 13:02:21.371788  8384 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:02:21.338631 11747 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:21.338891 11648 raft_consensus.cc:697] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:21.362828  8535 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:21.345315 11759 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:21.363437  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:21.364805  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:21.371462  9294 rpcz_store.cc:276] 0709 13:02:19.310773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.555388 (+244615us) service_pool.cc:224] Handling call
0709 13:02:19.592152 (+ 36764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.289731 (+697579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.370731 (+1081000us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b54005d25d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:21.370919 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1602783616}
I20260709 13:02:21.376637  8530 raft_consensus.cc:2376] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7. Re-sending same reply.
I20260709 13:02:21.366182  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:21.378165  8532 raft_consensus.cc:2393] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 9: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:21.367367  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:21.340235 11713 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:21.345868 11748 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.372069  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:21.394055  8531 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:21.357846 10997 raft_consensus.cc:697] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:21.378209  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:21.396862  9291 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:21.351128 11774 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:21.358791 11700 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:21.410902  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:21.411607  8382 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:21.351349 11751 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:21.357347 11768 raft_consensus.cc:3055] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:21.345937  8501 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:21.374709  8527 pending_rounds.cc:85] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 1
I20260709 13:02:21.376411 11747 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:21.377815 11759 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:21.342068 11753 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:21.574407  8527 pending_rounds.cc:107] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:02:21.574913  8527 raft_consensus.cc:2889] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:21.412495  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:21.412796  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:21.392519  8526 raft_consensus.cc:1240] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:02:21.391681  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:21.612411  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:21.613807  8383 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:21.612607  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:21.612340  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 266465us
I20260709 13:02:21.616065  8501 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:21.412477 11806 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:21.396664 11530 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.220s
I20260709 13:02:21.593763 11759 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:21.698839  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 82855us
I20260709 13:02:21.595172 11768 raft_consensus.cc:740] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:21.610185 11774 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.733814  8501 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:21.613036 11730 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:21.750643  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 342225us
W20260709 13:02:21.751281  8386 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 2603) took 2559 ms (client timeout 1683 ms). Trace:
W20260709 13:02:21.754091  8386 rpcz_store.cc:269] 0709 13:02:19.161634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.188032 (+ 26398us) service_pool.cc:224] Handling call
0709 13:02:21.720484 (+2532452us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54003b7754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:21.720642 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3740240256}
W20260709 13:02:21.762053  8349 leader_election.cc:336] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 2.014s (SENT)
I20260709 13:02:21.762538  8349 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:21.730981 11806 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.696558 11805 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:21.719195 11583 raft_consensus.cc:697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:21.774103 11768 consensus_queue.cc:260] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:21.775799 11768 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:21.781771  9287 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 488) took 1541 ms (client timeout 1768 ms). Trace:
W20260709 13:02:21.782050 11802 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.410s	user 0.001s	sys 0.000s
W20260709 13:02:21.782440  9287 rpcz_store.cc:269] 0709 13:02:20.240071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.275955 (+ 35884us) service_pool.cc:224] Handling call
0709 13:02:21.781415 (+1505460us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b54006c1e54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:21.781653 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1533590784}
W20260709 13:02:21.787374 11794 log.cc:927] Time spent T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.499s	user 0.013s	sys 0.000s
I20260709 13:02:21.774953 11593 raft_consensus.cc:3055] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:21.761924 11766 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:21.799997 11614 consensus_meta.cc:287] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.000s
I20260709 13:02:21.790196 11806 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:21.790354 11805 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:21.792268 11593 raft_consensus.cc:740] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:21.697360 11648 consensus_queue.cc:237] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:21.697001 11769 consensus_queue.cc:237] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:21.799288 11793 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:21.756337 11730 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:21.755919 10997 consensus_queue.cc:237] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:21.808952 11766 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:21.835006 11489 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.001s	sys 0.005s
W20260709 13:02:21.881392 11489 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.001s	sys 0.006s
I20260709 13:02:21.747601 11774 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:21.829346 11647 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:21.837520 11805 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:21.835601 11614 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:21.860546 11766 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:21.857843 11793 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:21.855677  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 132813us
W20260709 13:02:21.866956 11194 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.004s	sys 0.004s
I20260709 13:02:21.910802  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2190) took 1568 ms. Trace:
W20260709 13:02:21.944289  8424 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.000s	sys 0.015s
I20260709 13:02:21.946736  8427 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:21.947525  8528 rpcz_store.cc:276] 0709 13:02:20.342132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.343699 (+  1567us) service_pool.cc:224] Handling call
0709 13:02:20.361002 (+ 17303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.633841 (+272839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.633870 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.633914 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:20.633952 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.910520 (+1276568us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54002ea254. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:21.910580 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.910733 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":626991360}
W20260709 13:02:21.957024  8424 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.000s	sys 0.015s
I20260709 13:02:21.889648 11818 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:21.869115 11583 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:21.896363 11801 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:21.909368 11774 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:21.948067  8501 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:21.892234 11530 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:02:21.965586 11300 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:21.990958  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:21.908383 11810 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:21.952178 11194 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.005s	sys 0.004s
I20260709 13:02:21.994556  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:21.995033  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 47080.8us
W20260709 13:02:21.966653  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 554807us
I20260709 13:02:21.968907 11753 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:21.908217 11655 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:21.974272  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 212199us
I20260709 13:02:21.976749  8500 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:21.974177  8427 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:22.014993  8349 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:21.982225  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:21.983053  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:21.983963  8460 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:21.984184  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:21.984539  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:21.954483 11751 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:21.960453 11813 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:21.994064  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:21.896541 11760 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:21.972092 11818 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:21.998359 11774 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:21.907498 11593 consensus_queue.cc:260] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:21.950619 11793 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:22.006188 11812 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:22.053045  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:22.021617  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 47546.9us
I20260709 13:02:22.023056  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:21.996150 11811 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:22.004799  8382 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:22.043251  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:22.047019  8426 connection.cc:256] RPC call timeout handler was delayed by -1.6076049790000297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260709 13:02:22.006440 11655 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:21.923763 11647 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:22.050338  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:22.021528 11816 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:22.061192  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:22.044485 11760 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:22.064810 11822 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:22.054347  8427 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:22.077035  9287 raft_consensus.cc:2393] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 5: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:22.078322  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:22.080919  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:22.094528  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:22.044126 11818 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:22.100689 11776 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:22.076836 11530 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:22.101323 11776 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:22.101826 11776 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:22.103767 11709 consensus_meta.cc:287] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.731s	user 0.004s	sys 0.005s
I20260709 13:02:22.092453  8457 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:02:22.080291 11811 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:22.069730 11730 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:22.066905 11593 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:22.096503  8426 connection.cc:256] RPC call timeout handler was delayed by -1.5270410969999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
I20260709 13:02:22.068049 11833 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.043738 11823 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:22.099993 11830 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:22.107558  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:22.100134  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 45894.7us
W20260709 13:02:22.113195  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.115221  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:22.077209 11655 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:22.104208 11709 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:22.059232 11774 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:22.133656  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 96233.7us
I20260709 13:02:22.068372 11812 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:22.137367 11712 consensus_meta.cc:287] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.815s	user 0.001s	sys 0.010s
I20260709 13:02:22.123193 11830 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.034597 11810 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:22.218986 11600 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.219273 11776 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:22.219554 11600 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:22.220393 11810 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:22.190909 11760 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:22.221240 11818 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:22.221549 11712 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:22.222745 11774 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:22.223358 11818 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:22.223721 11712 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:22.143939 11833 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:22.143496 11795 consensus_meta.cc:287] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.849s	user 0.011s	sys 0.000s
I20260709 13:02:22.092217 11816 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:22.160063  9288 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55720 (request call id 497) took 2577 ms (client timeout 1501 ms). Trace:
W20260709 13:02:22.302624  9288 rpcz_store.cc:269] 0709 13:02:19.583016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.617051 (+ 34035us) service_pool.cc:224] Handling call
0709 13:02:22.159779 (+2542728us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540008d9d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:22.159965 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2458468096}
I20260709 13:02:22.139042 11820 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:22.162372 11714 raft_consensus.cc:3055] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:02:22.091135  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 67464.4us
I20260709 13:02:22.140519  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:22.140982  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:22.196748  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:22.139155 11614 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:22.213938  8351 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.656s (SENT) [suppressed 30 similar messages]
I20260709 13:02:22.215409  8377 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:02:22.142031 11747 consensus_meta.cc:287] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.000s
I20260709 13:02:22.217226  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:22.218519 11830 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:22.162078  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:22.313212  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:22.137367 11814 log.cc:927] Time spent T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
W20260709 13:02:22.139828 11821 log.cc:927] Time spent T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260709 13:02:22.248193  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 271563us
W20260709 13:02:22.249449  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 127952us
W20260709 13:02:22.242915 11829 log.cc:927] Time spent T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:02:22.308713  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:22.338333  8530 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:22.338968  8349 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:22.340301 11776 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:22.213294  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:22.342012 11600 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:22.342278 11811 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:22.207911 11753 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:22.347144  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:22.319603  8500 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:22.183334 11759 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:22.244535 11709 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:22.361567  8386 raft_consensus.cc:1240] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:22.306116 11795 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:22.323347 11842 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:22.323719 11816 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:22.332032 11777 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:22.332687 11835 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.350126  8530 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:02:22.375731  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:22.226279 11682 consensus_queue.cc:1059] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.142s
W20260709 13:02:22.311955 11581 consensus_meta.cc:287] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.029s	user 0.011s	sys 0.002s
I20260709 13:02:22.240859 11833 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:22.356299  8500 leader_election.cc:400] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14.
I20260709 13:02:22.226686  8531 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:22.240162 11793 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:22.247732 11489 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:22.246031 11822 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:22.212203 11823 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:22.310247 11820 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:22.310079 11714 raft_consensus.cc:740] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:22.363514  8349 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:22.364493  8385 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 10: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:22.130163 11767 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:22.392652  8500 leader_election.cc:403] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:22.176964 11806 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:22.308770 11655 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:22.378770  9258 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:22.358934 11712 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:22.337242 11747 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:22.410621  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:22.509682  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 146211us
I20260709 13:02:22.413645  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:22.469192  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:22.360445 11753 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:22.497774  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 119088us
W20260709 13:02:22.499714  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 143586us
I20260709 13:02:22.363055 11633 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 13:02:22.506291  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 292354us
I20260709 13:02:22.515609  8528 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:22.519117 11839 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:22.540097  8378 raft_consensus.cc:2368] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6.
I20260709 13:02:22.390246 11835 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:22.552412  8532 raft_consensus.cc:1240] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:22.559604  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:22.412830 11820 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:22.565454  8500 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:22.507107 11709 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.399834 11581 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:22.603597  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2137) took 1230 ms. Trace:
W20260709 13:02:22.614166  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.604827  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:22.575044  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:22.627463  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:22.630311 11823 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:22.543352 11769 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14.
I20260709 13:02:22.542335 11682 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:22.655089  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:22.662614  8384 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:02:22.405362 11489 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:22.548267 11818 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:22.663616  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 98271.7us
I20260709 13:02:22.673889  8500 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:22.546497 11760 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:22.689035  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:22.376611 11842 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:22.546236 11774 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:22.614542  8529 rpcz_store.cc:276] 0709 13:02:21.373007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.373559 (+   552us) service_pool.cc:224] Handling call
0709 13:02:21.373880 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:21.679190 (+305310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.679234 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:21.745661 (+ 66427us) log.cc:844] Serialized 26 byte log entry
0709 13:02:21.946340 (+200679us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:22.044686 (+ 98346us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.053963 (+  9277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.054032 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.603401 (+549369us) raft_consensus.cc:1685] finished
0709 13:02:22.603419 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.603538 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108163,"prepare.queue_time_us":199049,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":101619,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":201822,"thread_start_us":378827,"threads_started":3,"wal-append.queue_time_us":262145}
I20260709 13:02:22.666944  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:22.389966 11777 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:22.605929 11810 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.547919 11811 consensus_queue.cc:1059] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.118s
I20260709 13:02:22.707931  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:22.708756  8529 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:22.678164  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:22.559481 11745 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:22.685655 11847 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:22.655459 11713 consensus_meta.cc:287] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 1.260s	user 0.015s	sys 0.000s
I20260709 13:02:22.540333 11833 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:22.691893  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:22.506070 11845 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.258s
I20260709 13:02:22.694810  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:22.506808 11767 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:22.542635 11816 consensus_queue.cc:1059] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 13:02:22.409192 11822 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:22.667770 11823 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:22.690999 11748 consensus_meta.cc:287] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 1.275s	user 0.011s	sys 0.002s
I20260709 13:02:22.662163 11682 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:22.715538  8349 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:22.715970  8527 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.033s	sys 0.060s
I20260709 13:02:22.716292  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:22.742089  8527 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.034s	sys 0.060s
I20260709 13:02:22.717665 11844 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:22.721334  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:22.699494 11805 consensus_meta.cc:287] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.753s	user 0.005s	sys 0.005s
I20260709 13:02:22.724400  8533 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:22.725044  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:22.725878  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:23.083868  8457 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:22.634294 11709 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:22.731051  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:22.732395  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:22.671316 11712 consensus_queue.cc:1059] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:02:23.093617  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:22.737942  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:23.095263  8528 raft_consensus.cc:2393] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 6: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:02:23.045094 11850 log.cc:927] Time spent T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.283s	user 0.000s	sys 0.000s
I20260709 13:02:22.880918  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:23.100077  8379 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:20.031757  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:22.774932  8530 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:23.050320 11489 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:22.789373  8426 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.014s	sys 0.033s
W20260709 13:02:23.001680 11859 log.cc:927] Time spent T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 13:02:22.772543  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2138) took 1398 ms. Trace:
I20260709 13:02:23.001924 11581 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:22.635823 11714 consensus_queue.cc:260] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:22.920331 11753 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:23.044626 11700 consensus_meta.cc:287] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 1.451s	user 0.006s	sys 0.005s
I20260709 13:02:23.069460 11576 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:02:23.121474  8380 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.007s	sys 0.018s
W20260709 13:02:22.998248 11852 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:02:22.919534 11655 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:22.914078 11828 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:22.773284  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:23.132534  8454 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 8: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:22.690754 11818 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:22.916347 11790 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:22.737514 11748 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:22.719750 11745 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:22.706494 11760 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:22.857438 11762 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:23.037880 11767 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:22.733716 11847 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:22.809062 11823 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:22.875478 11806 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:22.898447 11777 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:22.883064 11857 log.cc:927] Time spent T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:02:22.904830 11769 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:22.935633  8381 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.000s	sys 0.010s
I20260709 13:02:22.882122 11842 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:23.161058 11830 consensus_meta.cc:287] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.818s	user 0.004s	sys 0.008s
I20260709 13:02:22.721192 11713 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:22.725680 11833 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:23.160271 11767 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:22.843369 11835 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:22.876220 11792 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:22.714205 11774 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:22.718614 11810 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
W20260709 13:02:23.069069  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.082713  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:23.086352  8529 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:02:23.089061  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:23.192090  8452 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:23.109799  8527 rpcz_store.cc:276] 0709 13:02:21.373752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.374202 (+   450us) service_pool.cc:224] Handling call
0709 13:02:21.374492 (+   290us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:21.762421 (+387929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.762470 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:21.763050 (+   580us) log.cc:844] Serialized 52 byte log entry
0709 13:02:21.927019 (+163969us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:22.106037 (+179018us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.109668 (+  3631us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.772188 (+662520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.772271 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.772312 (+    41us) raft_consensus.cc:1685] finished
0709 13:02:22.772325 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.772469 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15055,"prepare.queue_time_us":68852,"prepare.run_wall_time_us":42,"raft.queue_time_us":307634,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":25445,"spinlock_wait_cycles":5976448,"thread_start_us":880717,"threads_started":3,"wal-append.queue_time_us":316938}
W20260709 13:02:23.034811 11849 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 13:02:23.080147 11447 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:23.197073 11833 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:23.124819  8533 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
W20260709 13:02:23.122195  8380 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.007s	sys 0.018s
I20260709 13:02:23.126293 11700 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:23.129844  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:23.133970  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2220) took 1011 ms. Trace:
I20260709 13:02:23.176007 11868 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:23.165581 11823 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:23.157274  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 69149.1us
W20260709 13:02:23.160791  9260 connection.cc:256] RPC call timeout handler was delayed by -1.3321043779999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
I20260709 13:02:23.163646  8526 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:23.168099  8381 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.003s	sys 0.018s
I20260709 13:02:23.089756 11805 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:23.127346 11820 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:23.157367 11581 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:23.134485 11576 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:23.193128 11844 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.777782 11682 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:23.180316 11861 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:02:23.186477  8379 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:02:23.169111 11762 raft_consensus.cc:697] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:23.186590 11822 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:23.189807 11709 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:23.189765 11792 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.190341 11454 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:23.190524 11593 consensus_meta.cc:287] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 1.054s	user 0.012s	sys 0.000s
I20260709 13:02:23.222395 11792 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:23.104630  8426 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.052s	sys 0.082s
W20260709 13:02:23.195410 11766 consensus_meta.cc:287] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 1.231s	user 0.009s	sys 0.003s
I20260709 13:02:23.197338  9293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 806) took 1174 ms. Trace:
W20260709 13:02:23.127535  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 103302us
I20260709 13:02:23.154963 11828 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:23.200089  8528 rpcz_store.cc:276] 0709 13:02:22.124217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.111381 (+987164us) service_pool.cc:224] Handling call
0709 13:02:23.133275 (+ 21894us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.133520 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.133558 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:23.133623 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:23.133676 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.133748 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.133893 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:23.142333  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2213) took 1031 ms. Trace:
I20260709 13:02:23.204629 11868 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:23.230108  8531 rpcz_store.cc:276] 0709 13:02:22.111220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.112867 (+  1647us) service_pool.cc:224] Handling call
0709 13:02:22.177399 (+ 64532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.393193 (+215794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.142036 (+748843us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b54002b8c54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:23.142255 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112754944}
I20260709 13:02:23.230760  8528 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:23.231351  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2222) took 1045 ms. Trace:
I20260709 13:02:23.231751  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 684) took 1045 ms. Trace:
W20260709 13:02:23.136770 11848 log.cc:927] Time spent T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:02:23.232008 11868 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:23.197540 11447 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:23.205734  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 76204.4us
I20260709 13:02:23.210585  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:23.214813  8535 raft_consensus.cc:1240] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:23.188442 11767 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:23.233847  8379 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:23.234858 11767 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:23.173408 11769 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:23.175982 11830 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:23.224473  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:23.208003 11806 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:23.238585  8380 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:23.239135 11769 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:23.239980  8534 raft_consensus.cc:1240] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:02:23.227202  9293 rpcz_store.cc:276] 0709 13:02:22.022579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.022712 (+   133us) service_pool.cc:224] Handling call
0709 13:02:22.044069 (+ 21357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.044461 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.044494 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.061828 (+ 17334us) log.cc:844] Serialized 26 byte log entry
0709 13:02:22.375765 (+313937us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:22.375822 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.376327 (+   505us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.197122 (+820795us) raft_consensus.cc:1685] finished
0709 13:02:23.197147 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.197279 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1938,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3729,"thread_start_us":264900,"threads_started":1,"wal-append.queue_time_us":577454}
I20260709 13:02:23.229322  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 554) took 1019 ms. Trace:
I20260709 13:02:23.207269 11844 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:23.231634  8528 rpcz_store.cc:276] 0709 13:02:22.185660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.230303 (+1044643us) service_pool.cc:224] Handling call
0709 13:02:23.230599 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.231149 (+   550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.231304 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:23.232281  8383 raft_consensus.cc:1240] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:23.159528 11790 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:23.242501  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 686) took 1055 ms. Trace:
I20260709 13:02:23.242839  8528 rpcz_store.cc:276] 0709 13:02:22.186990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.241783 (+1054793us) service_pool.cc:224] Handling call
0709 13:02:23.242061 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.242213 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.242235 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:23.242277 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:23.242304 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.242349 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.242438 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:23.244045 11790 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:23.244459  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 687) took 1057 ms. Trace:
I20260709 13:02:23.244845  8528 rpcz_store.cc:276] 0709 13:02:22.187266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.243694 (+1056428us) service_pool.cc:224] Handling call
0709 13:02:23.243969 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.244154 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.244180 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:23.244221 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:23.244257 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.244309 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.244414 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:23.245719 11830 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:23.246608  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 688) took 1059 ms. Trace:
I20260709 13:02:23.246976  8528 rpcz_store.cc:276] 0709 13:02:22.187563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.245921 (+1058358us) service_pool.cc:224] Handling call
0709 13:02:23.246188 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.246340 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.246364 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:23.246400 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:23.246433 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.246479 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.246564 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:23.232232  8531 rpcz_store.cc:276] 0709 13:02:22.186368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.231037 (+1044669us) service_pool.cc:224] Handling call
0709 13:02:23.231293 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.231453 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.231481 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:23.231535 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:23.231565 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.231616 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.231704 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:23.248571  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 692) took 1013 ms. Trace:
I20260709 13:02:23.248898  8528 rpcz_store.cc:276] 0709 13:02:22.235203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.247860 (+1012657us) service_pool.cc:224] Handling call
0709 13:02:23.248132 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.248288 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.248315 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:23.248352 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:23.248389 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.248437 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.248526 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:23.249289 11844 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:23.251403 11766 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:23.251757  8426 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:23.251989 11576 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:23.253278  8426 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:23.253556 11766 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:23.253702 11823 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:23.255095  8426 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:23.258651 11835 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:23.259213 11835 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:23.261287 11777 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:23.262624 11777 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:23.263651 11777 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:23.264137 11777 raft_consensus.cc:697] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:23.264225  8452 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:23.206926 11581 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:23.266342 11835 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:23.267117 11581 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:23.267761 11806 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:23.267904  8379 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4.
I20260709 13:02:23.268276 11806 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:23.268942 11813 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:23.264984 11777 consensus_queue.cc:237] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:23.257572  8501 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:23.273602  8528 raft_consensus.cc:1240] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:23.276903  8380 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:02:23.268952  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:23.272578  8386 raft_consensus.cc:1240] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:23.280154  8386 raft_consensus.cc:1240] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:23.281379  8386 raft_consensus.cc:1240] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:23.283674  8379 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 11: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:23.276333  8501 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:23.285836  8426 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:23.226905 11822 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:23.268472 11581 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:23.269513 11813 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:23.256556 11572 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:02:23.595376  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 309607us
I20260709 13:02:23.341221 11833 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:23.293296 11818 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:23.595512 11572 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:23.605589  8379 raft_consensus.cc:1240] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:23.594241 11581 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:23.606263  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2646) took 1100 ms. Trace:
I20260709 13:02:23.606647  8379 rpcz_store.cc:276] 0709 13:02:22.505925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.405392 (+899467us) service_pool.cc:224] Handling call
0709 13:02:23.605420 (+200028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.606037 (+   617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.606212 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:23.608171 11581 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:23.608981 11572 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:23.404140 11769 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:23.594764 11822 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:23.610450 11769 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:23.611840 11822 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:23.595454 11745 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:23.596400  8426 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:23.340637  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 100023us
I20260709 13:02:23.612653 11769 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:23.416668 11760 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:23.613641  9261 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:23.292568 11823 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:23.342022 11703 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:23.375279 11847 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:23.548804 11810 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:23.401551 11800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.676s	user 0.039s	sys 0.062s
I20260709 13:02:23.290858 11806 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:23.292963 11600 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:23.555940 11774 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:23.577694 11828 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:23.501981 11877 log.cc:927] Time spent T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:02:23.597052 11833 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:23.507751 11700 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:23.601521  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:23.865916  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.866338 11833 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:23.598415 11820 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:23.598872 11813 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:23.694507 11712 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:23.379853 11792 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:23.599931 11713 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:23.376591 11762 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:23.297230 11766 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:23.458215 11213 raft_consensus.cc:3055] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:23.877043  8531 raft_consensus.cc:1240] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:23.290827 11768 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.436125 11790 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.889772 11790 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:23.892445 11790 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:23.616394  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38894 (request call id 2225) took 1260 ms. Trace:
I20260709 13:02:23.241343  8381 rpcz_store.cc:276] 0709 13:02:22.209554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.210417 (+   863us) service_pool.cc:224] Handling call
0709 13:02:22.210718 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.210917 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:02:23.202508 (+991591us) log.cc:844] Serialized 14 byte log entry
0709 13:02:23.228963 (+ 26455us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:23.229020 (+    57us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:23.229058 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.229149 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.229270 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":197272,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":4287,"raft.queue_time_us":128,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":1017408,"threads_started":2}
I20260709 13:02:23.893117  8530 rpcz_store.cc:276] 0709 13:02:22.355966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.375396 (+ 19430us) service_pool.cc:224] Handling call
0709 13:02:23.616146 (+1240750us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54002ba554. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:23.616298 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":916296064}
I20260709 13:02:23.893775  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:23.894309  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:23.894959  8530 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:23.895869  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:23.723922  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:23.688428  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2221) took 1563 ms. Trace:
I20260709 13:02:23.673207  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2212) took 1562 ms. Trace:
W20260709 13:02:23.649961  8378 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 2625) took 2241 ms (client timeout 1893 ms). Trace:
I20260709 13:02:23.803831  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:23.749394  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:23.644882  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2215) took 1533 ms. Trace:
I20260709 13:02:23.642743  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2021) took 1103 ms. Trace:
W20260709 13:02:23.827203  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 230882us
I20260709 13:02:23.826555  8424 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:23.847568  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:23.847777  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:23.852484  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:23.614427 11823 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.640551 11747 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:23.614678 11753 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:23.671123 11655 raft_consensus.cc:3055] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:23.652449 11769 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:23.637799 11745 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:23.846695 11800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.174s	user 0.043s	sys 0.086s
I20260709 13:02:23.615338 11832 raft_consensus.cc:3055] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:23.632244 11812 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:23.828999 11670 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:23.701776 11759 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:23.691203 11844 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:23.672147 11843 raft_consensus.cc:1064] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:02:23.629805 11760 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:23.821354 11648 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.822650 11869 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:23.663414 11767 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.669615 11647 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:23.663336 11818 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.598969 11805 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:23.876029 11766 raft_consensus.cc:697] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 10 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:23.877621  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2141) took 1318 ms. Trace:
I20260709 13:02:23.876788  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2143) took 1316 ms. Trace:
I20260709 13:02:24.077631  8529 rpcz_store.cc:276] 0709 13:02:22.559586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.709516 (+149930us) service_pool.cc:224] Handling call
0709 13:02:23.877415 (+1167899us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b5400096d54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:23.877549 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":790848256}
I20260709 13:02:23.886046  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:23.870213 11833 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:23.876796 11213 raft_consensus.cc:740] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:23.888298  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:24.087275  8382 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:02:24.087358  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:23.892586  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2638) took 1544 ms. Trace:
I20260709 13:02:24.088088  8529 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:02:24.088271  8383 rpcz_store.cc:276] 0709 13:02:22.347948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.242038 (+894090us) service_pool.cc:224] Handling call
0709 13:02:23.242267 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.270563 (+ 28296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.270606 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:23.270647 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:23.270680 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.892349 (+621669us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b54001a77d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:23.892398 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.892527 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64581504}
I20260709 13:02:23.615064  9261 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:23.896328  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:24.091203  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 476164us
W20260709 13:02:24.075194 11843 raft_consensus.cc:1068] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: Unable to promote non-voter 446d9310dce14ff4afff2dc2d64f68d8: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:02:24.059108  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2142) took 1499 ms. Trace:
W20260709 13:02:24.059257  8378 rpcz_store.cc:269] 0709 13:02:21.408496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.412176 (+  3680us) service_pool.cc:224] Handling call
0709 13:02:23.649667 (+2237491us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b54003dd1d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:23.649856 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2126670208}
I20260709 13:02:24.060251  8457 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:02:24.095904  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:24.096464  8457 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.060854  8532 rpcz_store.cc:276] 0709 13:02:22.111832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.119541 (+  7709us) service_pool.cc:224] Handling call
0709 13:02:22.119806 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.553016 (+433210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.644584 (+1091568us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b5400096354. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:23.644807 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":994295168}
W20260709 13:02:23.956306  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.065290  8460 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
W20260709 13:02:23.932806  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 227585us
I20260709 13:02:24.069017  8526 rpcz_store.cc:276] 0709 13:02:22.110935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.119485 (+  8550us) service_pool.cc:224] Handling call
0709 13:02:22.193430 (+ 73945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.202136 (+1008706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.672866 (+470730us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b54002adfd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:23.673131 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2230803200}
I20260709 13:02:23.894361  8381 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:24.076040 11823 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.064898  8527 rpcz_store.cc:276] 0709 13:02:22.125430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.198368 (+1072938us) service_pool.cc:224] Handling call
0709 13:02:23.198679 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.235427 (+ 36748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.235457 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:23.235497 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:23.235530 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.688173 (+452643us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b540024c554. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:23.688225 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.688368 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84066688}
I20260709 13:02:24.101640  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:24.102680  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:24.073377  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 246887us
I20260709 13:02:24.069852  8454 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:02:24.076335  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.064832  8377 rpcz_store.cc:276] 0709 13:02:22.538841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.641713 (+1102872us) service_pool.cc:224] Handling call
0709 13:02:23.642121 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.642335 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.642370 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:23.642424 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:23.642474 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.642551 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.642674 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.076431  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:23.591058 11682 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:24.077732  8533 rpcz_store.cc:276] 0709 13:02:22.560098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.691605 (+131507us) service_pool.cc:224] Handling call
0709 13:02:23.876610 (+1185005us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b5400095454. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:23.876733 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24025856}
W20260709 13:02:23.956530 11824 log.cc:927] Time spent T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 1.944s	user 0.004s	sys 0.011s
I20260709 13:02:24.058723 11655 raft_consensus.cc:740] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:24.082062 11152 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:24.067809  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2019) took 1529 ms. Trace:
I20260709 13:02:24.100287  8461 raft_consensus.cc:1240] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:24.120213  8384 raft_consensus.cc:2393] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:24.096954  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.071465 11832 raft_consensus.cc:740] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:24.124526 11682 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:24.124377 11832 consensus_queue.cc:260] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:24.082311 11869 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:24.125463 11832 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:24.103186  8527 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.127014 11869 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:24.119238 11213 consensus_queue.cc:260] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:24.092264 11844 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.946101 11768 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:24.068121 11769 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:24.106320  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:24.102802  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:24.149142  9293 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:23.878422 11712 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:24.119475 11152 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.153479 11152 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.153713 11703 consensus_queue.cc:1059] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:24.076541 11648 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:24.108122  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:24.160988  8529 raft_consensus.cc:2393] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 6: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:24.116918  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:24.161736  8526 raft_consensus.cc:2393] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 10: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:24.119660  8379 rpcz_store.cc:276] 0709 13:02:22.538200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.608046 (+1069846us) service_pool.cc:224] Handling call
0709 13:02:23.608308 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.608492 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:23.609161 (+   669us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.067401 (+458240us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.067468 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:24.067531 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.067603 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.067753 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":838,"prepare.queue_time_us":227,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":4548,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":7563,"thread_start_us":456911,"threads_started":1}
I20260709 13:02:24.129110 11213 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:24.105410  8459 raft_consensus.cc:2410] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:24.141569  9292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 799) took 4036 ms. Trace:
I20260709 13:02:24.071201 11745 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:24.093613 11647 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:24.147207  8527 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:24.118427 11795 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:24.142234  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:24.074038 11760 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:24.082353 11767 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:24.166879 11712 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:24.167194 11805 consensus_queue.cc:1059] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:24.163695 11815 raft_consensus.cc:3055] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:24.170332  8424 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:24.204105 11815 raft_consensus.cc:740] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:24.204986  8424 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:24.205763 11815 consensus_queue.cc:260] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:24.207345 11815 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.171528  8427 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:24.171651 11465 consensus_queue.cc:1059] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:24.172078 11572 consensus_queue.cc:1059] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:24.168896 11583 consensus_queue.cc:1059] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:02:24.209228  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.209693  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.210470  8458 raft_consensus.cc:2393] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 6: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:24.210549  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.211380  8461 raft_consensus.cc:2410] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:24.212234  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.165225 11844 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:24.213827  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:24.214708 11844 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:24.215145  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:24.215242  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:24.216248  9293 raft_consensus.cc:2410] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:02:24.216583  8532 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:24.217386  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:24.217609  9288 raft_consensus.cc:1240] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:02:24.213308  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.218940  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:24.220530  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:24.176390  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2216) took 2064 ms. Trace:
I20260709 13:02:24.128852 11655 consensus_queue.cc:260] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:24.155313 11672 consensus_queue.cc:1059] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:02:24.138613 11547 consensus_queue.cc:1059] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:02:24.138818 11600 consensus_queue.cc:1059] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:02:24.092139 11833 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:24.094591  8528 rpcz_store.cc:276] 0709 13:02:22.559865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.321768 (+761903us) service_pool.cc:224] Handling call
0709 13:02:23.322311 (+   543us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:23.322856 (+   545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.322897 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:23.423099 (+100202us) log.cc:844] Serialized 52 byte log entry
0709 13:02:23.855592 (+432493us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:23.872227 (+ 16635us) log.cc:844] Serialized 14 byte log entry
0709 13:02:23.873866 (+  1639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.873936 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.058886 (+184950us) raft_consensus.cc:1685] finished
0709 13:02:24.058906 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.059047 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1398,"prepare.queue_time_us":16422,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":44,"raft.queue_time_us":1819,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":46454,"thread_start_us":225915,"threads_started":1,"wal-append.queue_time_us":442845}
I20260709 13:02:24.182070  8457 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:24.185467  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.190713  8527 raft_consensus.cc:1240] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:24.082579 11818 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:24.193327  8460 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:24.169355  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:24.211237  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.162531  9292 rpcz_store.cc:276] 0709 13:02:20.094043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.094216 (+   173us) service_pool.cc:224] Handling call
0709 13:02:20.104045 (+  9829us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:20.104412 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.104447 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:20.113172 (+  8725us) log.cc:844] Serialized 52 byte log entry
0709 13:02:21.777888 (+1664716us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b18003ca780. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c80250d1 00007f36c8440a0f
0709 13:02:21.829126 (+ 51238us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:21.829184 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.829595 (+   411us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.826588 (+1996993us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:24.130320 (+303732us) raft_consensus.cc:1685] finished
0709 13:02:24.130351 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.130540 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":42132,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":2986,"spinlock_wait_cycles":18576896,"thread_start_us":50945,"threads_started":1,"wal-append.queue_time_us":1831756}
I20260709 13:02:24.174901  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2223) took 1839 ms. Trace:
I20260709 13:02:24.253746  8531 rpcz_store.cc:276] 0709 13:02:22.335706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.248099 (+912393us) service_pool.cc:224] Handling call
0709 13:02:23.876880 (+628781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.877499 (+   619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.174696 (+297197us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b5400095450. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:24.174839 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1445386624}
I20260709 13:02:24.216269  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:24.221410  8534 rpcz_store.cc:276] 0709 13:02:22.112113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.113707 (+  1594us) service_pool.cc:224] Handling call
0709 13:02:22.145958 (+ 32251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:23.240358 (+1094400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.176103 (+935745us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000f73d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:24.176331 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2515412224}
I20260709 13:02:24.230834  8530 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.231500  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:24.235729  9295 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:24.250592  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:24.259861  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:24.229395 11776 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:24.243595 11846 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:24.275238  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 103773us
I20260709 13:02:24.250151 11655 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:24.186162 11766 consensus_queue.cc:237] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:24.251904 11792 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:24.289862  8529 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:24.263608  9290 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:24.261233 11670 raft_consensus.cc:3055] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:24.263317 11776 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:24.282984  8530 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:24.279209 11846 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:24.323930  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.283990 11682 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:24.287586 11713 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.308542 11813 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:24.342281 11813 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:24.344671 11813 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:24.346112 11818 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:24.321511 11776 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:24.350468 11833 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:24.357177 11777 raft_consensus.cc:3055] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:24.357604 11777 raft_consensus.cc:740] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:24.358398 11777 consensus_queue.cc:260] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:24.359597 11777 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:24.361827 11839 raft_consensus.cc:3055] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:24.361487 11713 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:24.362226 11839 raft_consensus.cc:740] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:24.334708 11572 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:24.317603 11670 raft_consensus.cc:740] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:24.404196  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.405130  8457 raft_consensus.cc:2393] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 9: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:24.390578 11714 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:24.391842  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:24.331969 11846 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.397580  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.409981  8455 raft_consensus.cc:2393] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 12: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:24.398475  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.411474  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.400293  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.412788  8453 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:02:24.417034  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:24.419109  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:24.419606  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.420490  9292 raft_consensus.cc:2410] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:02:24.421737  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.425194  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.425618  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.427150  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.425220  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2146) took 1864 ms. Trace:
W20260709 13:02:24.403414 11762 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.009s	sys 0.028s
I20260709 13:02:24.424576  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:24.362250 11682 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:24.609547  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2148) took 1794 ms. Trace:
I20260709 13:02:24.489648  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:24.501488  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:24.514130  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2647) took 1246 ms. Trace:
I20260709 13:02:24.399721 11572 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:24.649433  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.482263  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:24.645140  8526 rpcz_store.cc:276] 0709 13:02:22.815148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.165356 (+1350208us) service_pool.cc:224] Handling call
0709 13:02:24.189468 (+ 24112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.189646 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:24.221707 (+ 32061us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.609170 (+387463us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.609227 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:24.609292 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.609358 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.609491 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37548,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":1227,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":9380,"thread_start_us":387055,"threads_started":1}
W20260709 13:02:24.597453  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.597520  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:24.646705  8459 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
W20260709 13:02:24.481729 11762 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.009s	sys 0.029s
I20260709 13:02:24.442737  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:24.677469  8453 raft_consensus.cc:2410] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:02:24.613765  9289 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:24.658965  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:24.674526  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.632817  8426 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:24.674685  9296 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:24.591041 11769 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:24.615046 11745 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:24.658339  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.589793 11801 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:24.684419  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 51710.2us
I20260709 13:02:24.592177 11713 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:24.632511 11213 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:24.661163 11572 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:24.594901 11767 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:24.660956 11682 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:24.497875 11648 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:24.505358 11760 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:24.688905  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:24.682104 11712 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:24.649179  8385 rpcz_store.cc:276] 0709 13:02:23.267968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.650773 (+382805us) service_pool.cc:224] Handling call
0709 13:02:23.651180 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.865434 (+214254us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:23.865730 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.156324 (+290594us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.156388 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:24.156461 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.511146 (+354685us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54003dc7d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:24.513954 (+  2808us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.514052 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":611,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":2474,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":3256,"spinlock_wait_cycles":492189568,"thread_start_us":290220,"threads_started":1,"wal-append.queue_time_us":450225}
I20260709 13:02:24.589557 11152 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:24.636924 11815 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.676085 11844 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.685978  8500 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:24.685521 11604 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:24.717537  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:24.723619  8460 raft_consensus.cc:1240] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:02:24.724932  8426 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:24.726617  8500 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:24.506737 11839 consensus_queue.cc:260] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:24.734511  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 458235us
I20260709 13:02:24.731165  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:24.507215 11670 consensus_queue.cc:260] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:24.725241 11832 consensus_meta.cc:287] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.599s	user 0.007s	sys 0.011s
W20260709 13:02:24.734596  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 400190us
I20260709 13:02:24.707449 11213 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:24.746551 11152 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:24.747809 11213 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:24.748481  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:24.728758  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:24.749363  9288 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.743223  8427 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:24.749948  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47306 (request call id 699) took 1125 ms. Trace:
I20260709 13:02:24.750382  8530 rpcz_store.cc:276] 0709 13:02:23.624025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.895661 (+271636us) service_pool.cc:224] Handling call
0709 13:02:24.749777 (+854116us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54002add54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:24.749886 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769001216}
I20260709 13:02:24.750770  8500 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:24.752032  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:24.687551 11801 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:24.729465 11672 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:24.733336 11760 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:24.733176 11767 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:24.760828  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 260614us
I20260709 13:02:24.724121 11712 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:24.764290  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:24.764585 11670 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.770870 11712 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:24.771485 11712 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:24.727684 11815 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:24.778877 11815 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:24.779412 11801 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:24.779829 11572 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:24.781842 11880 log.cc:927] Time spent T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 1.184s	user 0.007s	sys 0.003s
I20260709 13:02:24.782727 11572 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:24.753908 11604 consensus_queue.cc:1059] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 13:02:24.788046 11823 consensus_meta.cc:287] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.629s	user 0.006s	sys 0.005s
I20260709 13:02:24.791992 11823 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:24.794133 11823 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:24.755831 11769 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:24.729285 11844 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:24.758986 11818 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:24.796368  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 693) took 2057 ms. Trace:
W20260709 13:02:24.796666  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 55269.2us
I20260709 13:02:24.799924  8426 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:24.800436  8386 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:24.799533  8532 rpcz_store.cc:276] 0709 13:02:22.739192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.149643 (+1410451us) service_pool.cc:224] Handling call
0709 13:02:24.149961 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.216939 (+ 66978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.796032 (+579093us) spinlock_profiling.cc:243] Waited 66.3 ms on lock 0x7b54000f78d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:24.796274 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152478080}
I20260709 13:02:24.802027  8385 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:24.803457  8381 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:24.762174 11760 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:24.764506 11767 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:24.787312 11547 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:24.765931 11839 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:24.813683  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:24.835964  8377 raft_consensus.cc:2368] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6.
I20260709 13:02:24.814158  8349 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:24.813776  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:24.838581  8383 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:24.754274 11776 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:24.840553  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.811879 11714 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.798806 11769 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:24.814263 11655 consensus_meta.cc:287] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.001s
I20260709 13:02:24.847644  8527 raft_consensus.cc:1240] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 10 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:24.852174  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:24.853180 11714 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:24.853739  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:24.854612 11776 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:24.854676  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:24.855948 11714 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:24.856169 11846 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:24.858687 11846 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:24.815294 11760 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:24.827428 11767 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.834870 11547 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:24.845680 11682 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:24.875391  8383 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
W20260709 13:02:24.877172  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 77334.1us
I20260709 13:02:24.861196 11769 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.873724 11547 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:24.881721 11899 raft_consensus.cc:3055] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:24.882467 11682 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:24.885983 11600 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:24.910810  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 158837us
W20260709 13:02:24.912526  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 98440.7us
I20260709 13:02:24.920643  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:02:24.914878  9290 consensus_meta.cc:287] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.001s
I20260709 13:02:24.922401  9290 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:24.923528  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:24.924757  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:24.908686 11682 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:24.916370  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:24.939337 11844 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:24.901422 11899 raft_consensus.cc:740] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:24.947115 11899 consensus_queue.cc:260] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:24.950073 11890 log.cc:927] Time spent T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.274s	user 0.004s	sys 0.001s
I20260709 13:02:24.951745  9294 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:24.952740 11682 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:24.955363  8377 raft_consensus.cc:2410] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:24.955904 11748 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:24.925275 11670 consensus_queue.cc:1059] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:24.960242  9288 raft_consensus.cc:2410] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:24.962067  9295 raft_consensus.cc:1240] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:24.948829 11899 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:24.964047  8500 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:24.975639  8427 leader_election.cc:400] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6.
I20260709 13:02:24.976027  8427 leader_election.cc:403] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:02:24.977281 11901 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:02:24.980858 11600 raft_consensus.cc:3055] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:24.981446 11600 raft_consensus.cc:740] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:24.982440 11600 consensus_queue.cc:260] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:24.983723 11600 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.986649 11768 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:24.970466 11896 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
W20260709 13:02:24.989605 11876 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 1.441s	user 0.015s	sys 0.000s
I20260709 13:02:24.998014  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:24.999720  8452 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:25.001097  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:25.005524  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.006398  8461 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 8: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:25.007277  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:25.007879  8455 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:25.010885 11760 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:25.014423 11465 raft_consensus.cc:3055] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:25.014978 11465 raft_consensus.cc:740] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:25.015930 11465 consensus_queue.cc:260] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:24.970747 11844 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:25.017426 11844 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:25.017846 11844 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.023669  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:25.025074  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 49592.1us
I20260709 13:02:25.026813  8427 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:25.027717  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:25.029158  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:25.030134  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.030355  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.030918  8532 raft_consensus.cc:2393] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 9: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:25.031069  8530 raft_consensus.cc:2393] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 4: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:25.033330  9294 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:02:25.035307  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.035626  8526 raft_consensus.cc:1240] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:02:25.035988  8529 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:25.036607  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.038342  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:25.039152  9294 raft_consensus.cc:2393] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 9: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:25.040936  9294 raft_consensus.cc:1240] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:02:25.041961  8460 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:25.043202  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:25.044955  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.050408  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.052035  8455 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:25.055306  8529 raft_consensus.cc:2393] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:25.008594 11547 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:25.057827  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.054050  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.061992  8526 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:02:25.062551  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:25.062862  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.063256  8530 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:25.063992  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:25.064669  8530 raft_consensus.cc:2393] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:25.065564  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.065591  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.066370  8530 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:25.067087  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.067237  8455 raft_consensus.cc:2410] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:02:25.068485  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.061741  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:25.071611  8529 raft_consensus.cc:2393] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 7: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:24.974099 11748 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:02:25.069118  8534 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:25.053618 11793 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.059232 11465 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.054474 11670 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6.
I20260709 13:02:25.060669 11776 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:25.056509 11760 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:25.078469  8529 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:25.089638  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.091529  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:25.081916  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.084645  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.097183  8379 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:25.098527  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.101282  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:25.074014 11845 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:25.101661  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.101800  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:25.102291  8534 raft_consensus.cc:2376] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5. Re-sending same reply.
I20260709 13:02:25.105099 11682 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:25.083616 11714 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.106549  8455 raft_consensus.cc:2376] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11. Re-sending same reply.
I20260709 13:02:25.107710  8379 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
W20260709 13:02:25.107954  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.110999  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:25.113107  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.113237  8379 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.088508 11808 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.092723 11833 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:25.112315  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:25.104103  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.117852  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:25.106352 11776 raft_consensus.cc:697] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:25.120384  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.121428  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2219) took 3001 ms. Trace:
I20260709 13:02:25.086545 11793 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:25.121832  8535 rpcz_store.cc:276] 0709 13:02:22.117733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.179815 (+ 62082us) service_pool.cc:224] Handling call
0709 13:02:22.180108 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.233570 (+1053462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.118985 (+1885415us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54000f87d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:25.119144 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2378963200}
I20260709 13:02:25.120409  8526 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:25.119573  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:25.125047  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.131008  8528 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:25.132830  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.133562 11547 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:25.134963  8535 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:25.138619  8526 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:25.121253 11703 raft_consensus.cc:3055] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:25.141474 11795 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:25.148207 11795 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:25.148801 11795 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:25.142129 11682 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:25.152386 11682 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:25.152727  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:25.144477 11839 consensus_queue.cc:1059] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:25.110672 11845 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:25.145539  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.145382  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:25.152854 11682 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.142000 11776 consensus_queue.cc:237] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:25.182263  8379 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:25.183252  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.158754 11795 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:25.184230  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:25.184455 11801 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:25.184785  8379 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.186889 11795 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:25.178140 11574 raft_consensus.cc:3055] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:25.180680  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.160115  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.121974 11808 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:25.190492 11845 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:25.190831 11808 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:25.126082 11760 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.162046  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2235) took 1305 ms. Trace:
W20260709 13:02:25.163120  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.188941  8381 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:25.192698 11822 raft_consensus.cc:3055] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:25.193094 11822 raft_consensus.cc:740] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:25.114270 11714 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:25.193900 11822 consensus_queue.cc:260] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:25.145535 11703 raft_consensus.cc:740] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:25.204011 11703 consensus_queue.cc:260] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:25.205324 11703 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:25.169524  8384 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 2023) took 2630 ms (client timeout 1921 ms). Trace:
W20260709 13:02:25.209904  8384 rpcz_store.cc:269] 0709 13:02:22.539439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.724598 (+185159us) service_pool.cc:224] Handling call
0709 13:02:25.169298 (+2444700us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002cbd54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:25.169450 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2348880128}
I20260709 13:02:25.124356 11833 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:25.172538  8380 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:25.173749  8382 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:25.173905  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.187748 11574 raft_consensus.cc:740] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:25.159456 11767 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:25.195915  8378 raft_consensus.cc:2376] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14. Re-sending same reply.
I20260709 13:02:25.179759  8349 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:25.191623  8527 rpcz_store.cc:276] 0709 13:02:23.857142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.253122 (+395980us) service_pool.cc:224] Handling call
0709 13:02:24.253492 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.848922 (+595430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.161808 (+312886us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b54002eb154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:25.161986 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1365927296}
W20260709 13:02:25.178200 11911 log.cc:927] Time spent T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:02:25.202876 11714 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:25.226948  8460 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:25.227227  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.236289  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:25.236518  8381 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
W20260709 13:02:25.230351  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 50644.5us
I20260709 13:02:25.236887  8381 pending_rounds.cc:85] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 7
I20260709 13:02:25.237365  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.231730  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.259423  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.260583  8382 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:02:25.232565  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:25.185132 11801 raft_consensus.cc:697] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:25.237365  8381 pending_rounds.cc:107] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:02:25.231020  8379 raft_consensus.cc:2410] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:02:25.249552  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:25.172506 11844 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:25.253607 11769 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:25.254216 11574 consensus_queue.cc:260] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:25.209167 11822 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:25.191643 11760 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:25.255882 11793 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:25.257335 11767 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:25.235608 11917 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:25.257817  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.237283  8349 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:25.232501  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.288419  8384 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:02:25.278720  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:25.289140  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 51939.4us
I20260709 13:02:25.289305  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.278117  8381 raft_consensus.cc:2889] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:25.278920  8454 raft_consensus.cc:2410] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:02:25.263761  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.279685  8457 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:25.262562  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:25.294409 11801 consensus_queue.cc:237] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:25.298929 11793 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:25.299425 11793 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:25.299813 11793 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:25.302232 11892 log.cc:927] Time spent T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.585s	user 0.000s	sys 0.004s
I20260709 13:02:25.302985 11804 raft_consensus.cc:3055] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:25.303429 11804 raft_consensus.cc:740] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:25.303855  8456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 613) took 1219 ms. Trace:
I20260709 13:02:25.304251 11804 consensus_queue.cc:260] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:25.288772 11917 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:25.289855  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.305532 11917 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:25.305706 11804 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:25.290853  8349 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:25.304643 11682 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:25.309753 11714 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:25.310180 11714 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.310498 11714 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.310848 11833 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:25.311321 11682 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:25.305907  8379 raft_consensus.cc:2393] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:25.311993  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:25.312435  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.312999  8379 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:02:25.313817  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:25.290100  8384 raft_consensus.cc:2393] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 8: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:25.315060  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:25.315230 11833 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.315763 11833 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:25.316080  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.317864 11833 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:25.317514 11714 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:25.333333  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.335075 11714 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:25.318154  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:25.336015  8378 raft_consensus.cc:2393] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:25.336822  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.337844  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.338567  8378 raft_consensus.cc:2410] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:02:25.339380  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2649) took 2070 ms. Trace:
I20260709 13:02:25.339653  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.319227 11447 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:25.341435  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:25.342198  8454 raft_consensus.cc:2393] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 12: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:25.342033  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.320120  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:25.343086  8379 raft_consensus.cc:2376] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10. Re-sending same reply.
I20260709 13:02:25.343365  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.344739  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:24.433050  8533 rpcz_store.cc:276] 0709 13:02:22.560819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.116425 (+1555606us) service_pool.cc:224] Handling call
0709 13:02:24.116710 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.116939 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:24.125576 (+  8637us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.424619 (+299043us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.424884 (+   265us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.424933 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:24.424984 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.425063 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.425173 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13042,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":84,"thread_start_us":282217,"threads_started":1}
I20260709 13:02:25.345336  8378 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.346635  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.347633  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:25.333451  8351 leader_election.cc:336] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.511s (SENT)
I20260709 13:02:25.348824  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:25.323459  9260 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:25.350216  9260 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:25.326400  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:25.351042  8386 raft_consensus.cc:2376] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 4. Re-sending same reply.
I20260709 13:02:25.352134  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.327787  8501 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:25.353266  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.354066 11774 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:25.354533 11774 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:25.354987 11774 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.357295  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.325536  9261 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:25.333355  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.329309 11793 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:25.364090  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:25.364362  8378 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:25.365553  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:25.366123  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.329737 11832 raft_consensus.cc:3055] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:25.262457  8427 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:25.367427  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 105044us
I20260709 13:02:25.367796  9261 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:25.332845  8530 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:25.339761  8380 rpcz_store.cc:276] 0709 13:02:23.268481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.092844 (+824363us) service_pool.cc:224] Handling call
0709 13:02:25.172370 (+1079526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.226352 (+ 53982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.339210 (+112858us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002cbd50. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:25.339326 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2474580736}
I20260709 13:02:25.320482  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.353376  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.358610  8527 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:25.327865  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:25.369483  8457 raft_consensus.cc:2393] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 8: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:25.313022  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.352806  8386 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:02:25.373807  8384 raft_consensus.cc:2393] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:25.374078  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:25.375182  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.379448  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:25.379716  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.380198  8527 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:25.380329  8533 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:25.381691 11714 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:25.381934  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.354041  8379 raft_consensus.cc:2393] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:25.360410  8452 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:02:25.382611  8533 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
W20260709 13:02:25.318605  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.384554  8379 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:25.384824  8426 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:25.304222  8456 rpcz_store.cc:276] 0709 13:02:24.084205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.084313 (+   108us) service_pool.cc:224] Handling call
0709 13:02:24.094030 (+  9717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:24.106563 (+ 12533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.106610 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:24.116700 (+ 10090us) log.cc:844] Serialized 26 byte log entry
0709 13:02:24.398458 (+281758us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:24.402967 (+  4509us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.403230 (+   263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.403316 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:25.301693 (+898377us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:25.303557 (+  1864us) raft_consensus.cc:1685] finished
0709 13:02:25.303641 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.303800 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37978,"prepare.queue_time_us":4274,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":12895,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":16731,"spinlock_wait_cycles":3730304,"thread_start_us":228278,"threads_started":1,"wal-append.queue_time_us":487589}
I20260709 13:02:25.379127  8349 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:25.361861  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.386379  8382 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 11: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:25.362957  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.387234  8377 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:25.387620  8386 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:25.363021  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:25.366400  8378 raft_consensus.cc:2393] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 7: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:25.330369  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.388816  8386 raft_consensus.cc:1275] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:25.389073  8381 raft_consensus.cc:2393] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:25.390069  8378 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:25.385815  8379 raft_consensus.cc:1240] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:25.391369  8531 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:25.392177  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.378461  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:25.395885  8530 raft_consensus.cc:2368] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 12. Current term is 13.
I20260709 13:02:25.392829  8529 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:25.393373  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.394291  8377 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:02:25.398993  8377 pending_rounds.cc:85] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 8
I20260709 13:02:25.399256  8377 pending_rounds.cc:107] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:02:25.399178  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.399744  8377 raft_consensus.cc:2889] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:25.405365  8386 raft_consensus.cc:1240] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:25.405591  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:25.407369  8349 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:25.407958  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:25.408528  8526 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.408748  8349 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:25.363595 11574 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.411355  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.411749  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.407805 11833 consensus_queue.cc:1059] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:25.412563  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.417876  8452 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:25.373649 11832 raft_consensus.cc:740] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:25.416550  8378 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:25.373437 11447 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:25.373572 11753 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:25.374562 11762 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:25.419015  8527 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:25.388577 11776 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:25.434882  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.435914  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.437563  8461 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:25.408700 11808 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:25.415424 11714 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:25.442516  8526 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:25.385414 11648 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:02:25.415382 11600 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:25.439581 11795 raft_consensus.cc:3055] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:25.445648 11776 raft_consensus.cc:697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:25.453975  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.455013  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.455703  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.457479  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:25.503751  8456 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:25.458777  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:25.461333 11769 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:25.445464 11753 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:25.473585  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:25.476420  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:25.477983  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.508504  8533 raft_consensus.cc:2393] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 13: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:25.479530  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:25.482491  8530 raft_consensus.cc:1240] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:25.486550  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:25.500838  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:25.421146 11757 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:02:25.445021 11714 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:25.509110  8500 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:25.512823  8460 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:02:25.514809  8500 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:25.475054 11808 raft_consensus.cc:697] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:25.440999 11547 consensus_queue.cc:1059] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:02:25.521044  8500 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:25.525748  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.452831 11917 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:25.528857  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:25.501426 11795 raft_consensus.cc:740] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:25.578889 11795 consensus_queue.cc:260] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:25.580443 11795 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:25.506202 11152 consensus_queue.cc:1059] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:02:25.582130 11898 raft_consensus.cc:3055] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:25.582697 11898 raft_consensus.cc:740] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:25.583575 11898 consensus_queue.cc:260] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:25.585212 11898 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.530385  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.586483  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:25.586963 11899 consensus_meta.cc:287] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.000s
I20260709 13:02:25.516898 11714 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.587507  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:25.587685  8455 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:25.588378  8459 raft_consensus.cc:2410] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:02:25.535121  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:25.522722 11600 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.534866 11844 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:25.542014 11906 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:25.589944 11600 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:25.534649  8282 catalog_manager.cc:5697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 4 to 5, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 5 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:02:25.535825  8283 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53494 (request call id 326) took 17528 ms (client timeout 15000 ms). Trace:
W20260709 13:02:25.593711  8283 rpcz_store.cc:269] 0709 13:02:08.086207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.141320 (+ 55113us) service_pool.cc:224] Handling call
0709 13:02:25.535720 (+17394400us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:17.275908 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:17.334928 (+ 59020us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:17.335007 (+    79us) write_op.cc:435] Acquired schema lock
0709 13:02:17.335089 (+    82us) tablet.cc:662] Decoding operations
0709 13:02:17.409673 (+ 74584us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:17.409761 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:17.409794 (+    33us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:02:17.411188 (+  1394us) tablet.cc:701] Row locks acquired
0709 13:02:17.411229 (+    41us) write_op.cc:260] PREPARE: finished
0709 13:02:17.411402 (+   173us) write_op.cc:270] Start()
0709 13:02:17.411544 (+   142us) write_op.cc:276] Timestamp: P: 1783602137411333 usec, L: 0
0709 13:02:17.411559 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:02:17.412314 (+   755us) log.cc:844] Serialized 7420 byte log entry
0709 13:02:17.973400 (+561086us) op_driver.cc:464] REPLICATION: finished
0709 13:02:18.509561 (+536161us) write_op.cc:301] APPLY: starting
0709 13:02:18.509675 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:18.510069 (+   394us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:18.510212 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:18.512254 (+  2042us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:18.512687 (+   433us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 13:02:18.512731 (+    44us) write_op.cc:312] APPLY: finished
0709 13:02:18.591969 (+ 79238us) log.cc:844] Serialized 132 byte log entry
0709 13:02:18.726479 (+134510us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:18.797301 (+ 70822us) write_op.cc:454] Released schema lock
0709 13:02:18.836851 (+ 39550us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:18.886198 (+ 49347us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:18.897774 (+ 11576us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":896064,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":508382,"apply.run_cpu_time_us":5236,"apply.run_wall_time_us":355479,"num_ops":19,"prepare.queue_time_us":434587,"prepare.run_cpu_time_us":36768,"prepare.run_wall_time_us":317784,"raft.queue_time_us":329818,"raft.run_cpu_time_us":42292,"raft.run_wall_time_us":218238,"replication_time_us":559450,"thread_start_us":829329,"threads_started":4,"wal-append.queue_time_us":213077,"wal-append.run_cpu_time_us":30473,"wal-append.run_wall_time_us":2004814}]]}
I20260709 13:02:25.543596  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:25.547880  9287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 506) took 1027 ms. Trace:
I20260709 13:02:25.513129 11767 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.598346 11767 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:25.512468 11655 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:25.524549 11748 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:25.519965 11769 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:25.522034 11753 raft_consensus.cc:697] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:02:25.603729  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.603657 11753 consensus_queue.cc:237] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:25.606261  8459 raft_consensus.cc:1275] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:25.554785 11547 raft_consensus.cc:3055] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:25.609356 11547 raft_consensus.cc:740] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:25.610507 11547 consensus_queue.cc:260] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:25.532553  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:25.561419 11776 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:25.555831  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:25.502660 11832 consensus_queue.cc:260] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:25.617980  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.618422  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.619081  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.621613  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:25.622841  8378 raft_consensus.cc:2410] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:02:25.597905  9287 rpcz_store.cc:276] 0709 13:02:24.520111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.744595 (+224484us) service_pool.cc:224] Handling call
0709 13:02:24.754982 (+ 10387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:24.758998 (+  4016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.759046 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:24.759528 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:02:25.337757 (+578229us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b18002d2200. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c80250d1 00007f36c8440a0f
0709 13:02:25.415776 (+ 78019us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:25.438927 (+ 23151us) log.cc:844] Serialized 14 byte log entry
0709 13:02:25.441057 (+  2130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.441153 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:25.547595 (+106442us) raft_consensus.cc:1685] finished
0709 13:02:25.547694 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.547826 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1901,"prepare.queue_time_us":22879,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":37,"raft.queue_time_us":31629,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":4070,"spinlock_wait_cycles":4661632,"thread_start_us":77840,"threads_started":1,"wal-append.queue_time_us":728310}
I20260709 13:02:25.574007 11760 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:25.575649 11808 consensus_queue.cc:237] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:25.577642 11793 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:25.512820 11670 consensus_queue.cc:1059] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:02:25.486613 11465 consensus_queue.cc:1059] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:02:25.631035 11832 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:25.637360  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.642413  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.592686  8282 catalog_manager.cc:5697] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 4, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 4 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.664238  8282 catalog_manager.cc:5697] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 7 to 8, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 8 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:25.668087  8282 catalog_manager.cc:5697] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 3 to 4, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 4 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:02:25.644922 11547 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:25.648324 11600 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:25.676874  8282 catalog_manager.cc:5697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 5 to 6, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 6 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.682265 11767 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:25.683353 11757 raft_consensus.cc:3055] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:25.683852 11757 raft_consensus.cc:740] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:25.682094 11670 raft_consensus.cc:3055] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:25.687361 11670 raft_consensus.cc:740] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:25.688179 11670 consensus_queue.cc:260] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:25.689353 11670 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.684585 11757 consensus_queue.cc:260] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:25.693766 11757 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:25.693813  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.694586  8282 catalog_manager.cc:5697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 4 to 7, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 7 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.695541 11760 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:25.706679 11760 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:25.710005 11760 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:25.711804  8282 catalog_manager.cc:5697] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 3 to 6, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 6 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.716212  8282 catalog_manager.cc:5697] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:25.505611 11774 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:25.800765  9258 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:25.805876  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.804643  8456 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:02:25.812239  8461 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
W20260709 13:02:25.813704  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.817217 11762 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:25.817668  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.818424  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.819116  8424 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:25.822917  8454 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:25.823127  8379 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:25.824600  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 456798us
I20260709 13:02:25.829726  9261 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:25.830948  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 470185us
W20260709 13:02:25.831120  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 413384us
W20260709 13:02:25.831580  8351 leader_election.cc:336] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.656s (SENT)
I20260709 13:02:25.832026  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:25.832082  8349 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:25.836894  8351 leader_election.cc:336] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.723s (SENT)
W20260709 13:02:25.838631  8351 leader_election.cc:336] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.831s (SENT)
W20260709 13:02:25.839906  8351 leader_election.cc:336] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.883s (SENT)
W20260709 13:02:25.840453  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.841749  8351 leader_election.cc:336] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.954s (SENT)
I20260709 13:02:25.842144  8351 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:25.846235  8351 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:25.846580  8424 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:25.852434  8349 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:25.853021  8501 leader_election.cc:336] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.205s (SENT)
I20260709 13:02:25.853500  8501 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:25.856694  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 496777us
I20260709 13:02:25.859311  9260 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:25.866087  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 345092us
I20260709 13:02:25.848513 11832 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:25.866947  8424 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:25.867791  8500 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:25.868268  8424 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:25.823709 11917 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:25.872996  8351 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:25.875743  8349 leader_election.cc:400] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 12. Current term is 13.
I20260709 13:02:25.876150  8349 leader_election.cc:403] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:02:25.834543 11682 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:25.871628  8282 catalog_manager.cc:5697] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:02:25.880839  8282 catalog_manager.cc:5697] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 5 to 6, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 6 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.883018  8282 catalog_manager.cc:5697] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 6 to 7, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 7 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.852255 11547 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:25.878844  8349 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:25.891373  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:25.869658 11813 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:25.869453 11745 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:25.864768 11839 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:25.888558 11832 consensus_queue.cc:1059] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:02:25.898250 11832 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:25.898627 11832 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.898945 11832 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:25.899629 11714 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:25.900818  8386 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:25.889827 11917 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:25.905198 11822 consensus_queue.cc:1059] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:25.906351 11793 raft_consensus.cc:3055] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:25.906863 11793 raft_consensus.cc:740] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:25.872937 11152 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:25.873471 11760 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:25.875178 11465 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:25.872641 11600 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:25.909607  8349 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:25.894153 11547 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:25.952553  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:25.884894  8282 catalog_manager.cc:5697] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 2 to 3, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 3 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.878238 11767 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:25.879403 11833 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:25.851598 11670 consensus_queue.cc:1059] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:02:25.909092 11795 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:25.956243  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:25.946054 11801 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:25.885552 11757 consensus_queue.cc:1059] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:02:25.909260 11745 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:25.936851  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.951258 11804 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:25.907801 11793 consensus_queue.cc:260] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:25.986181  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:25.958009 11899 raft_consensus.cc:3055] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:25.959183 11547 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:25.980412 11465 raft_consensus.cc:697] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:25.950178 11898 consensus_queue.cc:1059] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:02:25.980633 11612 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:02:25.988722 11762 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:25.997031  8282 catalog_manager.cc:5697] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:02:25.982805 11839 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:25.990785 11745 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.994822 11801 raft_consensus.cc:697] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:02:26.029793  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 156850us
I20260709 13:02:25.997519 11899 raft_consensus.cc:740] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:26.019066 11793 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.996469 11932 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:25.996774 11804 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:26.028244  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 168980us
I20260709 13:02:26.025043  8282 catalog_manager.cc:5697] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 3 to 4, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 4 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:26.042058  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 214718us
W20260709 13:02:26.043329  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 217395us
I20260709 13:02:26.038590  8351 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:26.046341  8351 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:26.026559 11931 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:26.051256  8351 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:26.053932  9260 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:26.033963 11760 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:26.026793 11839 raft_consensus.cc:697] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:26.059719  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:26.118618  9294 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:26.037550 11832 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.069808  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:26.070571  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:26.070233 11465 consensus_queue.cc:237] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.037158 11932 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.041206 11833 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.056945  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:26.076843  9258 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:26.078307  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:26.078389  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:26.078754  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:26.079290  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:26.079998  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:26.081194 11682 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:26.082348 11774 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:26.082825 11926 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:26.082361 11804 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:26.051657 11808 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:26.084791 11929 log.cc:927] Time spent T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:02:26.076637 11447 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:02:26.085768 11672 raft_consensus.cc:3055] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:26.088274 11822 raft_consensus.cc:3055] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:26.088397 11714 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:26.090495 11845 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.100587 11801 consensus_queue.cc:237] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.101732 11899 consensus_queue.cc:260] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.045399 11898 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:02:26.107084 11795 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 12. Current term is 13.
W20260709 13:02:26.117790  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 63936.7us
I20260709 13:02:26.078477 11931 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:02:26.111814 11547 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.163723  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:26.147347  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 70595.2us
I20260709 13:02:26.117466 11930 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:26.076066 11762 consensus_queue.cc:1059] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:02:26.153456  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:26.121176 11760 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.156981  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:26.129132 11932 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.142549 11682 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.159374  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:26.159957  9260 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:26.126235  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:26.153767 11822 raft_consensus.cc:740] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:26.170893  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:26.164728  9258 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:26.151206 11672 raft_consensus.cc:740] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:26.138613 11833 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:26.171126  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:26.160810 11937 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:26.175024  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:26.177870  9296 raft_consensus.cc:3055] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:26.178972  9296 raft_consensus.cc:740] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:26.181185 11946 raft_consensus.cc:3055] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:26.181597 11946 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:26.182344 11946 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.183604 11946 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.183970 11941 raft_consensus.cc:3055] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:26.184355 11941 raft_consensus.cc:740] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:26.184775 11672 consensus_queue.cc:260] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.185169 11941 consensus_queue.cc:260] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.185316  9296 consensus_queue.cc:260] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.186141 11672 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:26.186312 11941 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:26.186822  9296 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:26.173964 11938 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:02:26.161108 11703 consensus_queue.cc:1059] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:02:26.176623 11839 consensus_queue.cc:237] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.173796 11822 consensus_queue.cc:260] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.201308 11776 raft_consensus.cc:3055] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:26.205240 11813 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:26.209152 11822 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:26.207866 11776 raft_consensus.cc:740] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:26.213367 11832 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:26.213574 11776 consensus_queue.cc:260] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.215040 11776 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:26.219537 11833 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.221724 11833 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:26.226709 11932 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.228986 11932 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:26.256976  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.113363  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 62208.3us
W20260709 13:02:26.264430  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.268215  8351 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:26.254910  8282 catalog_manager.cc:5697] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 3 to 5, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 5 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:26.270833  8351 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:26.092509  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:26.283296  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2672) took 1229 ms. Trace:
W20260709 13:02:26.286177  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.286477  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.283151  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 322037us
I20260709 13:02:26.291383  8424 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:26.283875  8383 rpcz_store.cc:276] 0709 13:02:25.054168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.054306 (+   138us) service_pool.cc:224] Handling call
0709 13:02:25.058576 (+  4270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:25.058983 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.059029 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:25.063405 (+  4376us) log.cc:844] Serialized 26 byte log entry
0709 13:02:25.385211 (+321806us) spinlock_profiling.cc:243] Waited 5.27 ms on lock 0x7b180037f0c0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c80250d1 00007f36c8440a0f
0709 13:02:25.830497 (+445286us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:25.830552 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.834215 (+  3663us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:26.282418 (+448203us) raft_consensus.cc:1685] finished
0709 13:02:26.282499 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.283040 (+   541us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6581,"raft.queue_time_us":3974,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":9901,"spinlock_wait_cycles":12121216,"thread_start_us":445068,"threads_started":1,"wal-append.queue_time_us":814896}
I20260709 13:02:26.297734  8424 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:26.300645  8424 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:26.283171  8379 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:26.309360  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:26.310406  8532 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:26.312294  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.314404  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 149603us
I20260709 13:02:26.314798  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:26.315892  8529 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:26.316823  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 156763us
I20260709 13:02:26.323771  8533 raft_consensus.cc:1240] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:26.326113  8527 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:26.327168  9288 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:26.346130 11447 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:26.346824 11447 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.347290 11447 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.347565 11547 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:26.367998 11547 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:26.373111 11447 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.375787 11152 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:26.373733 11547 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:26.377218  8532 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:26.379197  8349 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:26.371021  9296 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:26.393637  8529 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:02:26.394904  8528 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:26.397629 11753 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:26.398990 11753 consensus_queue.cc:1059] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:26.401216  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.402495 11753 consensus_queue.cc:1059] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:26.404687 11600 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:26.405777 11600 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.411340 11760 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:26.417374 11768 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:26.418421 11768 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.412168 11760 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.424099 11760 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.408851 11600 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:26.431516  8349 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:26.432502 11793 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:26.432832 11714 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:26.433544  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 152967us
I20260709 13:02:26.433733 11714 raft_consensus.cc:697] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:26.436525  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:26.471522  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 171214us
W20260709 13:02:26.474133  9261 leader_election.cc:336] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.040s (SENT)
I20260709 13:02:26.436535 11793 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:26.477479  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 144846us
I20260709 13:02:26.466497 11753 raft_consensus.cc:3055] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:26.487282 11753 raft_consensus.cc:740] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:26.490362 11808 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:26.488502 11753 consensus_queue.cc:260] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.491964 11808 raft_consensus.cc:697] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:26.492832 11753 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:26.494071 11899 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:26.502912  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 182289us
I20260709 13:02:26.435542 11714 consensus_queue.cc:237] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.450845 11928 consensus_queue.cc:1059] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:02:26.513247 11745 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.515974 11745 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:26.517720  8386 raft_consensus.cc:1240] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:26.505704 11793 raft_consensus.cc:697] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:26.488335 11682 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.526969  9260 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:26.528960 11939 raft_consensus.cc:3055] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:26.536463 11447 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:26.539075 11682 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:26.520891 11768 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:26.543628  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:26.545693  8501 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:26.546814 11933 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:26.548316  8501 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:26.549186 11933 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:26.550007 11928 raft_consensus.cc:3055] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:26.550599 11928 raft_consensus.cc:740] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:26.552014 11928 consensus_queue.cc:260] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.552639  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:26.554028 11760 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:26.526248  8424 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:26.557430  8454 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:26.535106 11808 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.561146 11793 consensus_queue.cc:237] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.566464  8461 raft_consensus.cc:2410] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:26.566833 11768 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:26.534937 11939 raft_consensus.cc:740] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:26.569514  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:26.570324  8529 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.570360 11939 consensus_queue.cc:260] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:26.566273  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 77446.2us
I20260709 13:02:26.575624 11760 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:26.575793 11152 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:26.575834  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:26.576713  8528 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.576378 11760 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.572962 11939 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:26.580454 11447 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.582953 11760 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:26.585050  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 190227us
W20260709 13:02:26.588445  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 114623us
W20260709 13:02:26.586503  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 87957.1us
I20260709 13:02:26.594518  8500 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:26.603662  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 55475.6us
I20260709 13:02:26.604388  8528 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:26.609766 11760 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:26.610404 11760 raft_consensus.cc:697] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 9 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:26.611430 11648 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.611526 11760 consensus_queue.cc:237] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.614998  8349 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:26.619350  8529 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:26.621727 11953 consensus_queue.cc:1059] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:02:26.624758 11447 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.625415 11447 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.626499  8501 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:26.629952  8349 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:26.627161 11465 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:26.631841 11774 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:26.631968 11954 log.cc:927] Time spent T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.096s	user 0.004s	sys 0.000s
I20260709 13:02:26.628089  8427 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:26.635458 11928 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.629344 11933 raft_consensus.cc:2764] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:02:26.636423 11774 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.637426  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:26.641832  8500 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:26.643268  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:26.630995 11447 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:26.651911  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.653369  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 45672.5us
I20260709 13:02:26.655069 11769 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:26.658162 11940 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:26.658808 11940 raft_consensus.cc:697] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:26.662434  8386 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:02:26.664937 11152 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:26.665410 11152 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:26.665481  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:26.665902 11152 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:26.661291 11940 consensus_queue.cc:237] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.671034 11932 raft_consensus.cc:3055] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:26.671409 11932 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:26.672344 11932 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.674909  8500 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:26.675592  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:26.677465  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.655781 11672 consensus_queue.cc:1059] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:02:26.690527 11933 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.691987  8526 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:26.692574  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.700240  8528 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:02:26.715602  8532 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
W20260709 13:02:26.726646  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.694757 11774 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:26.698082 11933 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.738276 11951 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:26.738420  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 215173us
I20260709 13:02:26.739061 11951 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.742861 11648 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:26.738318 11801 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:26.746465 11801 raft_consensus.cc:697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:26.746695 11898 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:26.747429 11801 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.748848  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:26.751579  8529 raft_consensus.cc:2410] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:02:26.753063 11946 raft_consensus.cc:3055] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:26.753535 11946 raft_consensus.cc:740] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:26.754544 11946 consensus_queue.cc:260] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.755816 11946 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.757813 11951 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:26.758241 11943 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.758152  8461 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:26.758888 11943 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.761360  8384 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:26.765703  8461 raft_consensus.cc:1240] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:26.766768  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.767266  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.768150  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:26.770860 11648 consensus_queue.cc:1059] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:26.768986  8461 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.772650 11762 raft_consensus.cc:3055] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:26.773056 11762 raft_consensus.cc:740] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:26.774326 11762 consensus_queue.cc:260] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.775592 11762 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:26.773216  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.793409  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.735245  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 60461.9us
I20260709 13:02:26.736229 11769 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:26.807636  8501 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:02:26.809145  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.810480 11933 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:26.811178 11933 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:26.811668 11933 raft_consensus.cc:697] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:26.812674  8456 raft_consensus.cc:1240] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:26.811681  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:26.814551  9289 raft_consensus.cc:3055] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:26.814751  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:26.814963  8453 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.815060  9289 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:26.816186  9289 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.816619  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:26.817250  9289 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.817504  9295 raft_consensus.cc:2410] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:26.820276  9258 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:26.818537  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:26.826244  8461 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:02:26.818854  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:26.830027 11963 log.cc:927] Time spent T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:02:26.830255  9287 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:26.831468 11951 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.831547  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:26.832230 11951 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.834434 11951 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:26.836098 11939 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:26.836534 11939 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:26.834280  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 97158.9us
I20260709 13:02:26.812600 11933 consensus_queue.cc:237] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.836113  8500 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:26.844223  9293 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:26.847240  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:26.847900  8383 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:26.765899 11932 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:26.850072  8501 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:26.849107  8427 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:26.836897 11939 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.855225  8533 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 13:02:26.851495  9260 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:26.857342  9293 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:26.858531 11898 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.863687  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:26.859458 11769 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:26.881438  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 45438.8us
I20260709 13:02:26.885336  8528 raft_consensus.cc:1240] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:26.872588 11769 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:26.854285 11928 consensus_queue.cc:1059] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:02:26.883266  8461 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:26.884888  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:26.886610 11931 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:26.897444  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:26.900327  8501 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:26.901345  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.879832 11943 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:26.892668  8528 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:26.892589 11950 consensus_queue.cc:1059] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:02:26.893543  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:26.889824 11822 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:26.894380 11574 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:26.859103 11898 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.913254  8501 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:26.914162 11574 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:02:26.915110 11703 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.915695 11703 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:26.917435 11769 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:26.917845 11769 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:26.917955 11703 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:26.918280 11769 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.919492 11447 consensus_queue.cc:1059] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:26.920360  8500 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:26.916920 11574 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:26.921758  8500 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:26.922398  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:26.923166  8383 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:26.923578 11898 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:26.924448  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:26.924662  8427 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:26.925129 11760 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:26.925874 11760 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:26.926849 11951 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:26.926959 11774 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.927419 11951 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.907635 11931 raft_consensus.cc:697] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:26.926968  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:26.929479 11951 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:26.929678  8378 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 4.
I20260709 13:02:26.920497 11447 raft_consensus.cc:3055] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:26.929270 11774 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:26.930287 11447 raft_consensus.cc:740] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:26.929971 11931 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.931242 11447 consensus_queue.cc:260] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.932708 11447 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:26.906023 11953 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:02:26.934314  8427 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:26.935560 11898 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:26.935772 11703 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:26.937512 11898 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.937579 11703 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.938534  8378 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:26.928732  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:26.939081 11898 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.939024 11703 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:26.940362 11574 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:26.942097  8500 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:26.942876 11774 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:26.945647 11774 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:26.949270  8531 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:26.931625  8501 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:26.950202  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:26.907693 11822 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.956733  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:26.956422  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:26.968883  8453 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:26.960531 11822 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:26.953429 11950 consensus_queue.cc:1243] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer d653e71832b7402b9a03b46249d3b885 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:26.982795  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:26.906633 11933 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:27.004047 11939 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.956887 11574 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.005663  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:27.006560  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:27.010010  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:27.010463  8270 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 56cc480ba6f642e08bb2e547a0ef50a1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 105d6581548546b98eddd4ee7083bb12 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:27.011579  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:27.011334 11769 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:26.990705  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:26.999631 11970 log.cc:927] Time spent T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:02:27.022672  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:27.017763  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:26.956435 11774 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:27.024384  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:26.910221 11152 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.029175  8531 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:02:27.031279  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:27.033104  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:27.033676  8529 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:27.036266  8453 raft_consensus.cc:2393] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:27.039090  8456 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:02:27.039690  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:27.040269 11774 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:27.041456  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:27.042191  8526 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:27.029268 11808 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.043251 11808 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.044322 11822 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.045411 11808 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:27.045560  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:27.046531  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.046805 11152 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:27.047432 11152 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.047935 11152 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.048180  8424 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:27.023206 11574 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.051620  8454 raft_consensus.cc:1240] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:02:27.035832  8460 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:27.053478  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:27.053835  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:27.054625 11465 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.054731  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:27.055434 11465 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.057723 11768 raft_consensus.cc:3055] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:27.058120 11768 raft_consensus.cc:740] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:27.058478  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:27.058732 11801 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.059303  8456 raft_consensus.cc:2410] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:02:27.059064 11768 consensus_queue.cc:260] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.059280 11801 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.041457  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:27.060642  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.061302  8386 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:27.054997  8532 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:27.062605 11940 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:27.063143 11940 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.063422  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:27.063997  8379 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:27.062727  8383 raft_consensus.cc:1275] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:27.065485  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:27.065728  9260 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:27.066241  8533 raft_consensus.cc:2393] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 7: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:27.066476  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:27.066694 11932 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:27.067269 11932 raft_consensus.cc:697] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:27.067438  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:27.067744  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:27.054692  8460 raft_consensus.cc:2376] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13. Re-sending same reply.
I20260709 13:02:27.068557  8455 raft_consensus.cc:2410] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:02:27.069629  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:27.055660  8454 raft_consensus.cc:2376] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6. Re-sending same reply.
I20260709 13:02:27.078724  8459 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:27.079753  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:27.081797  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:27.068269 11932 consensus_queue.cc:237] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.087402  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:27.085443  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:27.088001  8460 raft_consensus.cc:2376] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5. Re-sending same reply.
I20260709 13:02:27.079501 11672 raft_consensus.cc:3055] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:27.080194 11943 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:27.095129  8383 raft_consensus.cc:1217] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Deduplicated request from leader. Original: 7.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 13:02:27.117530  8383 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:02:27.096393  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:27.089807 11600 consensus_queue.cc:1059] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:02:27.099704 11465 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:27.092677 11672 raft_consensus.cc:740] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:27.083027 11946 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.091293 11899 consensus_queue.cc:1048] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:02:27.099905 11769 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:27.105485  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:27.099901  9293 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:27.122771  8458 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:27.100988 11574 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:27.124294  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:27.107517  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:27.125209  9287 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:27.125583  8454 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:02:27.116215 11943 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.105186 11152 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:27.109472 11939 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:27.109582  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:27.110117 11822 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:27.096434 11937 consensus_queue.cc:1059] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:02:27.101850  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.132864  8386 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:27.110992  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:27.133905  8532 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.110999  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:27.112160  9289 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
W20260709 13:02:27.112949  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 161673us
I20260709 13:02:27.114476 11898 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.113981  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:27.081532 11768 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:27.124529 11801 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:27.102617  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.106855  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.134933  8377 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.130255  9296 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:27.146337 11946 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:27.155308  8501 leader_election.cc:336] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.661s (SENT)
I20260709 13:02:27.155606  8460 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:27.155774  8501 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:27.153523  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 192179us
I20260709 13:02:27.148874 11465 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.169824  8459 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.154443  9290 raft_consensus.cc:2410] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:02:27.158542  8382 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:27.162439  8427 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:27.178871 11946 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:27.179529 11946 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:27.179879 11946 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.180264 11946 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:27.180181 11465 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.182570 11465 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:27.188335  8532 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:27.158556 11822 consensus_queue.cc:1059] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 9.7, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:02:27.197537 11822 consensus_queue.cc:1243] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer d653e71832b7402b9a03b46249d3b885 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:27.193447  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.198366  8386 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:27.195374  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.200246 11940 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:27.201673 11931 raft_consensus.cc:3055] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:27.202237 11931 raft_consensus.cc:740] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:27.203325 11931 consensus_queue.cc:260] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.196482 11703 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.206192 11898 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:27.206545  8461 raft_consensus.cc:2368] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5.
I20260709 13:02:27.207612 11703 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:27.210011  8379 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:27.138916 11943 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.214658 11943 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:27.215451 11672 consensus_queue.cc:260] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.176358  8452 raft_consensus.cc:2368] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 8. Current term is 9.
I20260709 13:02:27.227134  8377 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:27.204816 11931 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:27.232930  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 171807us
I20260709 13:02:27.245435  8426 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:27.245617  8529 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:02:27.246865  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 158383us
I20260709 13:02:27.244017  9258 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:27.247804  8424 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:27.250721  8457 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
W20260709 13:02:27.261307  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.265305  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:27.266012  8532 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:27.283236  8459 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:27.252666 11801 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.252251 11672 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.298892  8384 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 14. Current term is 15. Ops: []
W20260709 13:02:27.299877  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.273574 11953 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:02:27.309746  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 167271us
I20260709 13:02:27.311389  8533 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:27.272432 11769 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:27.303498  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 58142.3us
I20260709 13:02:27.284083 11465 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:27.318533 11951 raft_consensus.cc:2804] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:27.326592 11951 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.327003 11951 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:27.321756 11952 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.329556 11952 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.331579 11952 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:27.313812 11981 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.332324 11981 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.334589 11981 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:27.341189  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.342310  8385 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:02:27.322013 11953 raft_consensus.cc:697] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:27.346488  8424 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:27.347259 11899 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:27.347729 11899 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:27.347321 11953 consensus_queue.cc:237] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.348094 11899 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.298761  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:27.349428  9290 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:27.325628  8384 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:27.302955 11801 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.314500 11946 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.352089 11801 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:27.353188 11946 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:27.353574  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:27.354290  8424 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:27.356514  8424 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:27.358198  8426 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:27.328773  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:27.362231  8381 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.363651  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:27.364470  8459 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:27.365453  8424 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:27.369359  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.356675 11898 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.375603  8384 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:27.379034  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.380112  8533 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:27.379953  8386 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:27.385533 11574 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:27.386510 11984 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:27.386940 11984 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.387283 11984 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:27.389443 11986 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.390084 11986 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.390292 11898 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.390884  8381 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:02:27.392228 11898 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:27.383600 11465 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:27.393275 11465 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:27.393656 11465 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:27.395923  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.397694  8426 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:27.398769  9260 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:27.398913  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:27.399457  8383 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.400238 11957 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:27.400661 11957 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.401000 11957 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.403398  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:27.404017  9293 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:27.405707  8426 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:27.405844  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:27.406418  8377 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:27.406620 11898 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:27.407006 11898 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.407356 11898 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:27.392228 11986 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:27.413218 11950 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:27.413563 11931 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:27.413990  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.414227 11931 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.414746 11931 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.414718  8378 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:27.416417  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:27.417104  8532 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:02:27.418215  9293 raft_consensus.cc:1240] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:27.420688  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:27.371876 11943 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:27.421850  8529 raft_consensus.cc:1275] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:27.425402 11943 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.453404 11943 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.453857  8349 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:27.455169 11714 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:27.421048  8383 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:27.426038 11899 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.458596  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.459578 11940 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:27.460282 11899 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:27.427922  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:27.461720  8529 raft_consensus.cc:1275] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:27.428263  8351 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:27.462890 11801 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:27.463291 11801 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.463645 11801 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.463773  8529 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:27.465250 11774 consensus_queue.cc:1059] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:27.465921  8351 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:27.466074 11774 consensus_queue.cc:1243] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer 446d9310dce14ff4afff2dc2d64f68d8 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:02:27.466956 11793 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:27.467247 11774 raft_consensus.cc:3055] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:27.467677 11774 raft_consensus.cc:740] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:02:27.469050  8501 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.516s (SENT) [suppressed 44 similar messages]
I20260709 13:02:27.468556 11774 consensus_queue.cc:260] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.430208 11930 raft_consensus.cc:1064] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:02:27.472003 11714 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:27.473105 11930 consensus_queue.cc:237] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.434064  8386 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:27.435757  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:27.478950  8378 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:27.424578  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.446360  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:27.483917  8384 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:27.447391  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.439996  8427 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:27.422303  8377 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:02:27.486886 11804 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:27.487317 11804 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:27.450842  8381 raft_consensus.cc:1240] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:02:27.487715 11804 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.447875 11769 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:27.490228 11774 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:27.486269  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 46352.3us
I20260709 13:02:27.499470  8349 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:27.501521 11793 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:27.512202  8427 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:27.513450  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.513671  8427 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:02:27.514415  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 140575us
I20260709 13:02:27.517633  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:27.517879 11672 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:27.518646 11672 raft_consensus.cc:697] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:27.520303  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 54508.5us
I20260709 13:02:27.521869  8378 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:27.522046  8529 raft_consensus.cc:1275] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:27.522482  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:27.523801  8532 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:27.526010 11940 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:27.528833  8427 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:27.542964  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:27.545599  8457 raft_consensus.cc:2410] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:27.545621  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:27.547403  8529 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:27.552246  8455 raft_consensus.cc:1240] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:27.553052  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:27.553115  8427 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:27.556293  8459 raft_consensus.cc:1240] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:27.560676  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:27.561331  8526 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.556962  8529 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:27.519657 11714 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:27.564442  8452 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:27.559363  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:27.566218  8351 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:27.565351  8460 raft_consensus.cc:1240] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:27.574214  8531 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:27.532521 11940 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:27.575438  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:27.571661 11600 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:27.571323  8532 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:27.576556  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:27.577191  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:27.545632 11899 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:27.588073  8533 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.559520 11950 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:27.596899  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:27.545192 11793 consensus_queue.cc:1048] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:02:27.572213 11714 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:27.543610 11808 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:02:27.564448 11152 consensus_queue.cc:1048] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:02:27.577659 11940 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:27.603340  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 134307us
I20260709 13:02:27.587548  8500 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:27.608753  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:27.609746  8529 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:27.596006 11950 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:27.617266  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 53922.1us
W20260709 13:02:27.617717  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.612687  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.611033  8532 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:27.613662  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:27.619985  8528 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:27.622792  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 46687.5us
I20260709 13:02:27.618641  8427 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:27.625012  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:27.598632 11447 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 13:02:27.629678  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 94240.4us
I20260709 13:02:27.600414 11932 consensus_queue.cc:1059] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:02:27.621945 11950 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.612924 11600 raft_consensus.cc:697] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:27.598876 11951 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:27.649865  8501 leader_election.cc:336] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.785s (SENT)
I20260709 13:02:27.648237  8528 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:27.651836  8500 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:27.652796  8501 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:27.631402  8284 catalog_manager.cc:5697] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 4 to 5, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 5 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.610697 11672 consensus_queue.cc:237] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.656545 11943 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:27.657370  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 99758.2us
I20260709 13:02:27.659631 11997 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:27.660641  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:27.661422 11793 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:27.663456 11991 log.cc:927] Time spent T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:02:27.665700 11994 log.cc:927] Time spent T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:02:27.668408  8501 leader_election.cc:336] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.831s (SENT)
I20260709 13:02:27.641987 11822 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:27.735737 11822 raft_consensus.cc:697] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:27.719098 11943 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:27.737036 11822 consensus_queue.cc:237] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.720918 11703 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.741911 11703 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.744441 11714 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.672885 11769 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.640992 11984 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.674728  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:27.678193 11931 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:27.679898 11988 log.cc:927] Time spent T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:27.681255 11957 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.682590 11801 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.684674 11939 raft_consensus.cc:3055] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:27.685657 11600 consensus_queue.cc:237] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.686144  8284 catalog_manager.cc:5697] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.687882 11951 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:27.689828  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:27.692791  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:27.694125 11465 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:27.695984  8282 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53484 (request call id 335) took 17595 ms (client timeout 15000 ms). Trace:
I20260709 13:02:27.707734  8452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:27.711052 11804 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.715538  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:27.716355  8424 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:27.717041  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:27.785626  8527 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:27.785907  8529 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.725485 11932 consensus_queue.cc:1059] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:27.732774  8455 raft_consensus.cc:1240] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:27.734606  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 66247.5us
W20260709 13:02:27.745179  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.745146  8384 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:27.630633 11990 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:27.744638 11703 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:27.747248  8526 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:27.749445  8533 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
W20260709 13:02:27.757781  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 97188.3us
I20260709 13:02:27.761294 11930 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:27.761425 11940 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.763584 11950 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.764585  8459 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:27.769946  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.776059 11774 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:27.775457  9296 raft_consensus.cc:2393] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 11: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:27.779167 11931 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:27.775480  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:27.779407 11801 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:27.783200  9293 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.783926  8452 raft_consensus.cc:606] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:27.783330  9288 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:27.787921  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:27.834261  8452 raft_consensus.cc:614] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:27.834671  8532 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.771971 11899 raft_consensus.cc:697] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:27.765708 11898 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.795531  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:27.841197  8457 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:27.805733  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.797981  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 81717.4us
I20260709 13:02:27.777150 11939 raft_consensus.cc:740] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:02:27.772459  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 97990.9us
I20260709 13:02:27.774746 11943 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:27.851876 11943 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.853772 12003 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.853315  8284 catalog_manager.cc:5697] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 7 to 8, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 8 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.854327 12003 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.854700 11943 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:27.855466 11943 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.855225  8284 catalog_manager.cc:5697] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.858317 11940 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:27.858598 11465 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:27.856092 11943 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:27.858996  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:27.859656  8528 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:27.862287 11957 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:27.863862  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:27.864570  8377 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.809959  8382 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:27.810935 11930 raft_consensus.cc:697] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:27.866508  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:27.866809 12003 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:27.811275  8351 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:27.867126  8534 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.864730 11898 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:27.868010  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 65219.8us
I20260709 13:02:27.868806  8351 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:27.869059  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:27.794808 11990 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.870981 11990 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:27.872069 11899 consensus_queue.cc:237] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.872696 11793 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:27.873051  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:27.873592 11793 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.873795  9289 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:27.874348 11793 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:02:27.874855  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.849643  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:27.875937  9290 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.812515 11714 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:27.814000 11984 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:27.817065 11950 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:27.817263  8501 leader_election.cc:336] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.842s (SENT)
I20260709 13:02:27.867084 11930 consensus_queue.cc:237] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.878357  8501 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:27.810235 11932 raft_consensus.cc:3055] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:27.819454 11804 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:27.824043  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.828878  8385 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:27.885771  8452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:27.840703  8427 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:27.886497  8452 raft_consensus.cc:606] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:27.847321  8500 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:27.886901  8452 raft_consensus.cc:614] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:27.795003 11933 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:27.841328 11672 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:27.848794  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:27.848877 11956 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:02:27.834869 11447 consensus_queue.cc:1059] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:02:27.849632  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:27.849769  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:27.851081  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:27.897102  8381 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:02:27.888523  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 79019.8us
I20260709 13:02:27.891058  8378 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:27.886890  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 46266.3us
I20260709 13:02:27.892437  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:27.903213  8426 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:27.906190  8529 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:27.909170  8382 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:27.909412  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 57253.2us
I20260709 13:02:27.910555  8424 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:27.904706  8284 catalog_manager.cc:5697] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 6 to 7, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 7 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.915048  8529 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:27.900075  8427 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:27.915930  8457 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:27.896055  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:02:27.916441  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 45959.8us
I20260709 13:02:27.919698  9292 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:27.919885  9293 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:27.920799  8377 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:27.918366  8424 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:27.912423  8284 catalog_manager.cc:5697] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 4 to 6, leader changed from <none> to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 6 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:27.922729  8526 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:27.926056  8381 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:27.926595  9260 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
W20260709 13:02:27.928887  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 81640.8us
I20260709 13:02:27.928964  8528 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:27.929585  8284 catalog_manager.cc:5697] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 8 to 9, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 9 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:27.932811  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:27.885906 11932 raft_consensus.cc:740] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:27.929998  8500 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:27.897327 11984 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:27.783725  8282 rpcz_store.cc:269] 0709 13:02:10.099866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.108218 (+  8352us) service_pool.cc:224] Handling call
0709 13:02:27.695615 (+17587397us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:26.474549 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:26.475405 (+   856us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:26.475470 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:02:26.475516 (+    46us) tablet.cc:662] Decoding operations
0709 13:02:26.488891 (+ 13375us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:26.503092 (+ 14201us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:26.504614 (+  1522us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:02:26.610210 (+105596us) tablet.cc:701] Row locks acquired
0709 13:02:26.610253 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:02:26.610420 (+   167us) write_op.cc:270] Start()
0709 13:02:26.610570 (+   150us) write_op.cc:276] Timestamp: P: 1783602146610353 usec, L: 0
0709 13:02:26.610593 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:02:26.611463 (+   870us) log.cc:844] Serialized 5952 byte log entry
0709 13:02:26.826848 (+215385us) op_driver.cc:464] REPLICATION: finished
0709 13:02:27.096587 (+269739us) write_op.cc:301] APPLY: starting
0709 13:02:27.096685 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:27.096999 (+   314us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:27.097166 (+   167us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:27.099028 (+  1862us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:27.099403 (+   375us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:02:27.099448 (+    45us) write_op.cc:312] APPLY: finished
0709 13:02:27.099858 (+   410us) log.cc:844] Serialized 107 byte log entry
0709 13:02:27.100070 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:27.100279 (+   209us) write_op.cc:454] Released schema lock
0709 13:02:27.100355 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:27.131863 (+ 31508us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:27.135723 (+  3860us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1176467,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":256675,"apply.run_cpu_time_us":4257,"apply.run_wall_time_us":26792,"num_ops":15,"prepare.queue_time_us":186521,"prepare.run_cpu_time_us":53806,"prepare.run_wall_time_us":232114,"raft.queue_time_us":74533,"raft.run_cpu_time_us":3113,"raft.run_wall_time_us":63882,"replication_time_us":216075,"thread_start_us":408143,"threads_started":4,"wal-append.queue_time_us":137603}]]}
I20260709 13:02:27.952759  9289 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:27.959482  8378 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:27.931069 11950 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:27.968078  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.964453  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.967713  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.969340  8381 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:27.969632  8377 raft_consensus.cc:2368] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 8. Current term is 9.
I20260709 13:02:27.937680 11804 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:27.968876  9288 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:27.970441  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.973737  8378 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:27.970747  8284 catalog_manager.cc:5697] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.976254  8532 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
W20260709 13:02:27.977640  8501 leader_election.cc:336] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.066s (SENT)
I20260709 13:02:27.948093 12003 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:27.940181 11774 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:27.941425 11946 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.978137  8501 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:28.002323  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:28.002485  8452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b3df375d584465c8712d996256828cf"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:28.003018  8384 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:02:28.003737  9290 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:28.004066  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:28.004655  8384 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:28.005589  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:28.007110  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:28.007869  8386 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
W20260709 13:02:28.015492  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.945437 11753 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:27.983088 11447 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:28.017899 11753 raft_consensus.cc:697] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:28.017935 11447 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:28.019263 11753 consensus_queue.cc:237] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:28.022130  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:27.947472 11931 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.985272  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:27.985633  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.986465  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.989238 11760 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:27.971405 11769 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:27.989668 11932 consensus_queue.cc:260] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:27.989979  8284 catalog_manager.cc:5697] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 4 to 7, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 7 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.991070  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.991744  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.972527 11804 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.996912  8527 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:28.003106  8452 raft_consensus.cc:606] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:28.037209  8452 raft_consensus.cc:614] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:27.983500 11940 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.008909  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.979349  8427 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:28.038580  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:28.026648  8383 raft_consensus.cc:2368] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 8. Current term is 9.
I20260709 13:02:28.039376  8381 raft_consensus.cc:2368] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:02:27.971731 11950 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.047745  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:27.968756 11984 raft_consensus.cc:697] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:27.992182  9292 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:28.045156  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:28.045532  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 66245us
I20260709 13:02:28.045873  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:28.046736  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:28.050303  8534 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:28.056383  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:28.060904  8379 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:27.982306 12003 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:28.059703  8427 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:28.068565  8427 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:28.069459  8427 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:28.070246 11703 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:28.070351  8427 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:28.070838 11703 raft_consensus.cc:697] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:28.071174 11822 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:28.071462 11465 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:28.072045 11465 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.072285 11152 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:28.071825 11703 consensus_queue.cc:237] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:28.072793 11152 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.073343 11152 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.073696  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:28.074992  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:28.075747  8386 raft_consensus.cc:2368] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10.
I20260709 13:02:28.076444  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:28.071771 11822 raft_consensus.cc:697] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:28.077988  8382 raft_consensus.cc:1240] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:02:28.072568 11465 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:28.079325  8382 raft_consensus.cc:1240] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:28.078135 11822 consensus_queue.cc:237] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:28.080719  8284 catalog_manager.cc:5697] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:28.081656 11984 consensus_queue.cc:237] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:28.044772 11931 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:28.082718  8284 catalog_manager.cc:5697] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 4 to 5, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 5 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:28.085040 11931 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:28.088150  8385 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:28.084501  8284 catalog_manager.cc:5697] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 3 to 5, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 5 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:28.089534  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:28.090458  8382 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:02:28.091735  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:28.092752  8381 raft_consensus.cc:2393] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 6: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:27.989269 11951 consensus_queue.cc:1059] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:02:28.040040 11804 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:28.097884  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:28.099037  8459 raft_consensus.cc:1240] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:28.100168  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.102876  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.098590  8284 catalog_manager.cc:5697] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:28.049633 11932 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.120182  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:28.121179  8452 raft_consensus.cc:2410] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:02:28.122005  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:28.057598 11950 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:28.122601  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:28.123797  8501 leader_election.cc:336] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.693s (SENT)
I20260709 13:02:28.125299  8501 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:28.124617  8284 catalog_manager.cc:5697] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 4 to 5, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 5 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:02:28.064848 11957 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:28.086091 12003 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:28.130517  8385 raft_consensus.cc:1240] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:02:28.142539  8459 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:28.146221  8459 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:28.149266  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:28.150054  8454 raft_consensus.cc:2393] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 12: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:28.150772  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:28.103252 11447 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:28.148744  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:28.056258 11940 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:28.140411  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 213691us
I20260709 13:02:28.123893 11946 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:28.143635 11600 raft_consensus.cc:3055] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:28.199000  8351 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:28.208956  8456 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:28.152035 11957 raft_consensus.cc:697] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:28.232277  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 67192.7us
I20260709 13:02:28.231071  8454 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:28.225194  8458 raft_consensus.cc:1275] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:02:28.213436  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 283470us
I20260709 13:02:28.235304  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:28.241168  8384 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:02:28.200518 11600 raft_consensus.cc:740] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:28.246500  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:28.244366  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 45492.8us
I20260709 13:02:28.247308  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:28.204047 12013 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:28.271328  8377 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:02:28.259122  8457 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:28.272912  8459 raft_consensus.cc:1275] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:28.275627  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:28.281960  8460 raft_consensus.cc:2393] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 12: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:28.244218 11999 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:28.205283 11946 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:28.293499  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:28.254158 11769 raft_consensus.cc:697] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:28.254666 11760 raft_consensus.cc:697] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 6 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:02:28.300800  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 177024us
I20260709 13:02:28.310379 12020 raft_consensus.cc:2764] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:28.303886 11930 raft_consensus.cc:2764] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:02:28.312038 12013 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:28.345211  8501 leader_election.cc:336] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.073s (SENT)
I20260709 13:02:28.325409 11931 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.335405 11768 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:28.364537  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 82997.9us
I20260709 13:02:28.341399 11152 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:28.362087 12011 log.cc:927] Time spent T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:02:28.302532 11600 consensus_queue.cc:260] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:28.365911 11768 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:28.375445 11600 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:28.360466 11931 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:28.369158 11769 consensus_queue.cc:237] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:28.387220 11931 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:28.374009  8351 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:28.390754  8455 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:28.323077 11957 consensus_queue.cc:237] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:28.393502  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.376852 11768 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:28.402119 11152 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:28.403339 11950 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:28.404578  8461 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:28.406769 11465 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:28.412732 12017 log.cc:927] Time spent T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:02:28.390187 11931 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.408825 11465 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:28.417833 12018 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 13:02:28.426957  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 56864.7us
I20260709 13:02:28.418526 11672 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:28.424806  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.390834 11940 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:28.396147 11930 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:28.427796  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:28.435983 11939 consensus_queue.cc:260] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:28.441335  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 105560us
W20260709 13:02:28.442008  8501 leader_election.cc:336] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.105s (SENT)
I20260709 13:02:28.442350  8501 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:28.443733 12013 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:28.445623  8501 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:28.446183  9261 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:28.447224  8501 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:28.448352  8501 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:28.448541 12019 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:28.449059 12020 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:28.449385 12013 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:28.451534  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 471408us
I20260709 13:02:28.452294  8424 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:28.454161  8424 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:28.454617 11943 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:28.455435  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 130953us
I20260709 13:02:28.455559 11899 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:28.456182 11899 raft_consensus.cc:697] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:28.456691  8426 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:28.457119 11899 consensus_queue.cc:237] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:28.457726  8426 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:28.458118 12024 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:28.413709 11760 consensus_queue.cc:237] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:28.458619 12024 raft_consensus.cc:697] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:28.459028  8426 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:28.459528 12024 consensus_queue.cc:237] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:28.460490 11986 raft_consensus.cc:2804] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:28.461015 11986 raft_consensus.cc:697] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:28.456781 11998 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:28.461979 11986 consensus_queue.cc:237] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:28.472998  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 237767us
I20260709 13:02:28.458140 11946 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:28.474577  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.432322 11672 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.476637  8500 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:28.480757  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:28.485102  9292 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:02:28.485466  9292 pending_rounds.cc:85] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting all ops after (but not including) 7
I20260709 13:02:28.485735  9288 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:02:28.485841  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:28.486130  9288 pending_rounds.cc:85] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Aborting all ops after (but not including) 10
I20260709 13:02:28.474438 11574 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:28.488963  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:28.489137  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:28.489878  9290 raft_consensus.cc:2410] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:28.490161  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:28.486366  9288 pending_rounds.cc:107] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:02:28.490785  9288 raft_consensus.cc:2889] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:28.475737 11930 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:28.483198 12020 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:28.476008 11998 raft_consensus.cc:697] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:28.496284 11998 consensus_queue.cc:237] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:28.482560 11950 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:28.427910 11804 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:28.489756  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 62038.7us
I20260709 13:02:28.474761 11953 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:28.480873  8500 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:28.480803  8501 leader_election.cc:400] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10.
I20260709 13:02:28.504880  8501 leader_election.cc:403] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:02:28.498845  9292 pending_rounds.cc:107] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:02:28.505826  9292 raft_consensus.cc:2889] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:28.507344  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:28.507505 11953 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:28.508005 11953 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:28.483877 11932 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:02:28.508167  9295 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:02:28.430537 11931 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:28.507943  8377 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.479897 11152 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:28.522243  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.525890  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:28.526137  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:28.526638  8378 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:28.530057  8377 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:28.531064  8351 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:28.539320 11804 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:28.479362 12019 consensus_queue.cc:1059] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:02:28.510854 12020 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:28.541790  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:28.561604  8378 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
W20260709 13:02:28.544544 11990 consensus_meta.cc:287] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.002s
I20260709 13:02:28.565068  8455 raft_consensus.cc:1240] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:28.533499 11774 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10.
I20260709 13:02:28.543771 11956 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.573424  8379 raft_consensus.cc:1275] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:02:28.574762  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.547732 12013 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:28.579568  9292 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:02:28.527066 11152 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:28.581019  9292 pending_rounds.cc:85] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting all ops after (but not including) 7
I20260709 13:02:28.551074 12027 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.583572  9292 pending_rounds.cc:107] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:02:28.589849  9292 raft_consensus.cc:2889] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:28.563252 11574 raft_consensus.cc:697] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:28.551918 11930 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:28.582782  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 108436us
I20260709 13:02:28.568782 12019 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.596774  8501 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:28.582154 12028 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.598331  8461 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:28.599186  9293 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 LEARNER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:28.604755  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:28.597478 11672 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:28.605937 12020 consensus_queue.cc:1059] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:28.607235 11152 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:28.609587 12030 log.cc:927] Time spent T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:02:28.609587 11672 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:28.611735  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 107307us
I20260709 13:02:28.612363  8351 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:28.622650 11931 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:28.613310 12028 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:28.627722  8351 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:28.628839 11714 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:28.583045 11956 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:28.632509  8452 raft_consensus.cc:1240] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:28.574690 11990 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:28.604179 12013 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:28.634624  8351 leader_election.cc:400] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5.
I20260709 13:02:28.634961  8351 leader_election.cc:403] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:28.635313  8379 raft_consensus.cc:1275] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:28.629366 11714 raft_consensus.cc:697] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:28.595134 12027 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:28.637061 11714 consensus_queue.cc:237] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:28.638263 12027 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:28.638455 11939 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.629269 11940 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:28.641538 11930 consensus_queue.cc:1059] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:28.644613 11760 raft_consensus.cc:3055] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:28.645040 11760 raft_consensus.cc:740] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:28.645987 11760 consensus_queue.cc:260] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:28.647478 11760 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:28.618090 12020 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.639415  8501 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:28.657045  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:28.613422 11774 consensus_queue.cc:1059] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:02:28.658116  8379 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:28.662882 11956 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:28.663487  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:28.668810  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 47151.1us
I20260709 13:02:28.669174  8384 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:28.618762 12019 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:28.666987 11574 consensus_queue.cc:237] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:28.682722 12019 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:28.665401 11801 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 4. Current term is 5.
I20260709 13:02:28.658871 12020 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:28.687760 12020 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:28.680739 11769 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:28.688501 11769 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:28.689942  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:28.690588  8452 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:28.691527 12002 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.692051 12002 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:28.692299 11152 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:28.694151 12002 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:28.696837  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:28.697552  9295 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:28.700302  9260 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:28.674796  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:28.675282  8534 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:02:28.712121  8534 pending_rounds.cc:85] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 9
I20260709 13:02:28.712393  8534 pending_rounds.cc:107] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:02:28.712649  8534 raft_consensus.cc:2889] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:28.676229  8527 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:28.677073  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:28.677943  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:28.714962  8535 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:28.678017  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:28.715911  8533 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:28.678280  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:28.716862  8532 raft_consensus.cc:2393] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 7: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:28.678800  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:28.679723  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:28.680136  8427 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:28.690663 11769 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:28.714366  8530 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:28.700771 12013 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:28.653872 11940 raft_consensus.cc:697] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:28.654363 12003 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:28.726214  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:28.727056  8427 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:28.727388  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:28.728286  8532 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:28.671514  8351 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:28.710832  8426 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:28.717557  8526 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:28.717576  8529 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:28.734112  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:28.722219  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:28.722621  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:28.724558  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:28.735744  9293 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:28.736313  8533 raft_consensus.cc:2393] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 6: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:28.734356  8528 raft_consensus.cc:1275] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:28.736845  8426 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:28.738090  8379 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:28.739801  8427 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:28.743547  8527 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:28.745482  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:28.746102  8535 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:28.750859  8458 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:02:28.754886  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 83539.5us
I20260709 13:02:28.756356  8351 leader_election.cc:400] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 8. Current term is 9.
I20260709 13:02:28.734333 11986 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:28.756675  8351 leader_election.cc:403] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:02:28.757455 12002 consensus_queue.cc:1048] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:28.750402 11152 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:28.759096 11152 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:28.759464 11152 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.759837 11152 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.761184  8427 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:28.723608 11932 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:28.769344  9258 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:28.770769  8385 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:28.786914  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:28.794423  8532 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:02:28.795565  8528 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:02:28.741616 11822 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:28.800109 12027 raft_consensus.cc:3055] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:28.800670 12027 raft_consensus.cc:740] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:28.801928 12027 consensus_queue.cc:260] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:28.803274 12027 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.806746 12020 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:28.819206  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:28.751698 11990 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:28.762763 11951 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:28.821411  8379 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:28.822708  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:28.807590 12020 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:28.822204  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:28.771749 11753 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:02:28.766355 11932 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.829123  8530 raft_consensus.cc:2393] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 6: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:02:28.829228  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 73008.8us
I20260709 13:02:28.834002  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:28.812117 11986 raft_consensus.cc:697] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:28.812805 11774 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:28.813721 11822 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.824203 11714 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 8. Current term is 9.
I20260709 13:02:28.820602 11898 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:02:28.836550 12035 log.cc:927] Time spent T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c: Append to log took a long time: real 0.168s	user 0.002s	sys 0.000s
I20260709 13:02:28.848073  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:28.853039  8528 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:28.788697 11899 consensus_queue.cc:1048] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:02:28.793666 11768 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:02:28.858814  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:28.835145 11932 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.840210 12028 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:28.812426 11943 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:02:28.859973  8532 raft_consensus.cc:2368] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 12. Current term is 13.
I20260709 13:02:28.877559  8535 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:28.861528 12031 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:02:28.862825  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:28.858721  8528 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:28.826092 12024 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:02:28.842883 11801 consensus_queue.cc:1059] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:02:28.849186 11930 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:02:28.867445 12046 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:28.868688 12003 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:28.846302 11999 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
W20260709 13:02:28.935797  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 146507us
I20260709 13:02:28.873407 11986 consensus_queue.cc:237] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:28.874048 11714 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:28.863042 11898 raft_consensus.cc:697] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:28.851164 11447 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:28.847512 11822 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.787475 11940 consensus_queue.cc:237] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:28.846871 11951 raft_consensus.cc:697] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:28.887583  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:28.943521  9289 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:02:28.929397  9288 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60"
dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:54044
W20260709 13:02:28.945036 12048 log.cc:927] Time spent T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:02:28.937414  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:28.947175 11953 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:28.954396 12000 raft_consensus.cc:3055] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:28.954905 12000 raft_consensus.cc:740] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:28.955789 12000 consensus_queue.cc:260] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:28.956841 12000 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:28.932973  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:28.872785  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:28.848380 11774 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:28.937826  8501 leader_election.cc:336] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.922s (SENT)
I20260709 13:02:28.938962  9260 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
W20260709 13:02:29.026106  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 87261us
I20260709 13:02:29.026635  8385 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:28.944972 12020 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:28.957158 11951 consensus_queue.cc:237] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:28.944757  9288 raft_consensus.cc:606] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:28.859615 12002 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.930315  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:28.967649  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 129416us
I20260709 13:02:28.965798  9291 raft_consensus.cc:1240] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:28.962999  8528 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:28.990759  8500 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:29.036635  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 239117us
I20260709 13:02:29.032827  9293 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:28.940784 11447 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.885645 11950 consensus_queue.cc:1048] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
W20260709 13:02:29.042277  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 57931.6us
I20260709 13:02:29.042795  8501 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:28.990235 11990 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:28.991250 11152 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:29.050213  8530 raft_consensus.cc:1240] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:29.053709  8424 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:29.057412 11447 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:29.051388 12002 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:29.088470 11898 consensus_queue.cc:237] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:29.089783 12049 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:29.090657 12002 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:29.105923  8532 raft_consensus.cc:1275] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:02:29.106366  8532 pending_rounds.cc:85] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 3
I20260709 13:02:29.106617  8532 pending_rounds.cc:107] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:02:29.106884  8532 raft_consensus.cc:2889] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:29.041531 11931 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:29.106389  8461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
W20260709 13:02:29.116817 12047 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:02:29.090953 12022 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:29.118584  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 186788us
I20260709 13:02:29.056737 12020 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:29.142537  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 208443us
W20260709 13:02:29.143893  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.147289  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 93759.1us
I20260709 13:02:29.148440  8424 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:29.122004 11953 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:29.112902 11931 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.130743 12020 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.165815  8426 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:29.199491  8349 leader_election.cc:400] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 12. Current term is 13.
I20260709 13:02:29.129715 12046 raft_consensus.cc:697] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:02:29.199918  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 51604.3us
I20260709 13:02:29.199906  8349 leader_election.cc:403] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.205184 11152 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:29.118664 12022 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:29.215322 12022 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:29.217563 11152 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:29.218480  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:29.219303  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 449981us
I20260709 13:02:29.107594 11990 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:29.220535  9258 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:29.155097 11957 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:02:29.222898  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 186590us
I20260709 13:02:29.224751  9258 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:29.142577 11999 consensus_queue.cc:1059] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:02:29.167068 11931 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:29.223752  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 59157.6us
I20260709 13:02:29.231494  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:29.206207 11769 consensus_queue.cc:1059] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:02:29.229059 11953 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:29.240355 12044 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:29.239745  8351 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:29.202154 12020 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.239554 12064 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:29.242805  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 77102.2us
I20260709 13:02:29.260182 12063 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.260937 12063 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:29.261772  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:29.264214  8461 raft_consensus.cc:606] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:29.275763 12063 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:29.277268  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:29.287817  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:29.241376 12028 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:29.301789  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 71599us
W20260709 13:02:29.304713  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 65061.7us
I20260709 13:02:29.254834 12002 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:29.252517 11957 raft_consensus.cc:697] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:29.318004 11930 raft_consensus.cc:3055] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:29.328107 11648 raft_consensus.cc:993] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
W20260709 13:02:29.333091 12060 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:02:29.288828 11822 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:29.333536 11957 consensus_queue.cc:237] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:29.338409 12056 consensus_queue.cc:1059] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:02:29.339150 12054 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 13:02:29.339936 11822 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:29.338016  8384 raft_consensus.cc:3055] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:29.340960  8384 raft_consensus.cc:740] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:29.297771 11951 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.354792  8380 raft_consensus.cc:1275] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:29.352632  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:29.355867  8379 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:29.306226 11986 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.306432 12028 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:29.354424  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 47461.1us
I20260709 13:02:29.287422 11447 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:29.368419  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:29.372335  8528 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:29.335402 11648 raft_consensus.cc:1081] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:02:29.334946 11930 raft_consensus.cc:740] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:29.370448  8384 consensus_queue.cc:260] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:29.375259  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 117282us
I20260709 13:02:29.379374  8379 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:29.318241 11940 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:02:29.349713 12002 raft_consensus.cc:697] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:29.365195 12028 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:29.389669  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 80210.2us
W20260709 13:02:29.375830  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 146618us
W20260709 13:02:29.385610 12055 log.cc:927] Time spent T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:02:29.398293  8384 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:29.382995 12053 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:02:29.400277  8380 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:29.394136  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:29.417582  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 52055.7us
I20260709 13:02:29.417939  8379 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:29.382476  8427 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:29.401670  8501 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:29.408876  8452 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:02:29.414117  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:29.420063  8384 raft_consensus.cc:1275] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:02:29.421029  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:29.421934  8384 pending_rounds.cc:85] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 3
I20260709 13:02:29.422181  8384 pending_rounds.cc:107] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:02:29.422413  8384 raft_consensus.cc:2889] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:29.422899  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:29.423301  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:29.423884  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:29.427995  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:29.428371  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 107516us
I20260709 13:02:29.428814  8381 raft_consensus.cc:2393] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:29.430406  8532 raft_consensus.cc:1275] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:29.432482  8528 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:29.432511  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:29.433442  8526 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:29.433871  8458 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:02:29.434643  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:29.435359  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 53010.9us
I20260709 13:02:29.424095  8380 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:29.437132  8455 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:29.369439 11986 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:29.362208 11951 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:29.384344 11600 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:02:29.435109 12022 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:29.439807 12054 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:29.482517 12070 log.cc:927] Time spent T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:29.431527 11999 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:02:29.427914 12074 consensus_queue.cc:1048] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:02:29.359128 12046 consensus_queue.cc:237] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:29.459797 11930 consensus_queue.cc:260] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:29.705289  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:29.701771  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:29.706483  8532 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:29.706537  8384 raft_consensus.cc:2393] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 8: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:29.700417 12066 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.291s
I20260709 13:02:29.706533  8526 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:29.486730 12061 consensus_queue.cc:1048] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.420s
I20260709 13:02:29.703667  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:29.709385  8380 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
W20260709 13:02:29.709270  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 280255us
W20260709 13:02:29.702193  8501 leader_election.cc:336] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.516s (SENT)
I20260709 13:02:29.711467  8501 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:29.712091  9291 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:29.713263  8384 raft_consensus.cc:1240] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:02:29.706573  8529 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:29.715330  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:29.521267  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 81227.1us
I20260709 13:02:29.717357  8384 raft_consensus.cc:1240] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:29.719025  8382 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:29.723667  8384 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:29.725286  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:29.726253  8384 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:02:29.728410  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:29.740924  8532 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:29.743330  8351 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:29.743666  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:29.744243  9291 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:29.749786  8351 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:29.750962 12057 log.cc:927] Time spent T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.709s	user 0.000s	sys 0.003s
I20260709 13:02:29.547765 11822 consensus_queue.cc:1048] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.204s
I20260709 13:02:29.753319 11822 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.753508  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2207) took 1011 ms. Trace:
I20260709 13:02:29.753823 11822 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:29.753891  8534 rpcz_store.cc:276] 0709 13:02:28.742592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.742812 (+   220us) service_pool.cc:224] Handling call
0709 13:02:28.743118 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:28.747969 (+  4851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:28.747997 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:28.748448 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:02:28.860822 (+112374us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:28.860875 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.863540 (+  2665us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:29.750619 (+887079us) spinlock_profiling.cc:243] Waited 68.9 ms on lock 0x7b24001fd108. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c521e9c4 00007f36c521cacb 00007f36c53d7dc9 00007f36c53d7a55 00007f36c53d709d 00007f36c800910e 00007f36c802088c 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221
0709 13:02:29.753210 (+  2591us) raft_consensus.cc:1685] finished
0709 13:02:29.753233 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:29.753448 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17337,"raft.queue_time_us":7099,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":4450,"spinlock_wait_cycles":158392064,"thread_start_us":21427,"threads_started":1,"wal-append.queue_time_us":137318}
I20260709 13:02:29.755633 11939 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.755741 12022 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:29.756201 11939 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:29.758484 11939 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:29.758920  8386 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:29.759487  9293 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:29.785660  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:29.708709 11648 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.599399 12063 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:29.793159  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 91001.3us
I20260709 13:02:29.794843  8501 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:29.710008 12075 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.511094 12054 raft_consensus.cc:697] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:29.802388  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.683382 12081 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:29.598770 12062 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:29.745646 11672 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:29.823638  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 73950.5us
I20260709 13:02:29.829013  8351 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:29.549643 12002 consensus_queue.cc:237] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:29.789111 11939 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.760911 12000 consensus_queue.cc:1059] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:02:29.487854 11990 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:29.818236 12044 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:29.962409 11760 raft_consensus.cc:3055] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:29.963007 11760 raft_consensus.cc:740] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:29.878345 12062 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:29.807772 12063 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:29.979769 12063 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:29.960883 11774 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:29.983914 11774 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.984644 11774 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:29.988574 11774 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:29.878693 11939 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:29.990041 11774 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.990746 11774 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:29.991897 11939 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:29.833307 12081 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:29.993953 11774 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:29.995257 12081 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:29.836920 11672 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:30.001791 11774 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.002453 11774 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:30.008246 11774 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:30.012326 12085 log.cc:927] Time spent T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:02:29.878110 12073 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.025656 12073 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:29.841971 12022 consensus_queue.cc:1059] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.191s
I20260709 13:02:30.029498 11774 raft_consensus.cc:3055] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:30.030022 11774 raft_consensus.cc:740] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:30.031055 11774 consensus_queue.cc:260] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.032680 11774 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:29.820685 12075 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.044090 12075 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:30.050354 12069 log.cc:927] Time spent T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:02:30.060164 12081 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:30.061287 11804 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:30.065434 12050 log.cc:927] Time spent T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
W20260709 13:02:30.070031 12079 log.cc:927] Time spent T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:02:29.884400 11986 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:30.073627 12054 consensus_queue.cc:237] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:29.807919 11648 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.077765 11648 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:30.078063 12065 raft_consensus.cc:3055] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:30.078501 12065 raft_consensus.cc:740] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:30.079319 12065 consensus_queue.cc:260] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.080325 12065 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:30.086750  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2217) took 1219 ms. Trace:
I20260709 13:02:30.087375  8527 rpcz_store.cc:276] 0709 13:02:28.833951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.994348 (+160397us) service_pool.cc:224] Handling call
0709 13:02:29.058657 (+ 64309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:29.244784 (+186127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:29.244829 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:29.244883 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:29.244935 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.053508 (+808573us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54002ad0d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:30.053575 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.053732 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":427488640}
W20260709 13:02:30.032956 12013 consensus_meta.cc:287] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 1.299s	user 0.005s	sys 0.005s
I20260709 13:02:30.107331 11951 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:30.110131 11822 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:30.111905 12073 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:30.119259  9291 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:29.964107 11760 consensus_queue.cc:260] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.123190  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43296 (request call id 40) took 1017 ms. Trace:
W20260709 13:02:30.139528 12020 consensus_meta.cc:287] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.839s	user 0.009s	sys 0.000s
W20260709 13:02:30.114741 11932 consensus_meta.cc:287] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 1.219s	user 0.006s	sys 0.008s
W20260709 13:02:30.136878 12028 consensus_meta.cc:287] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.714s	user 0.007s	sys 0.000s
W20260709 13:02:30.146347 11714 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:02:30.114356 12013 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:30.151181  8461 rpcz_store.cc:276] 0709 13:02:29.106142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.106270 (+   128us) service_pool.cc:224] Handling call
0709 13:02:30.122963 (+1016693us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b540040e7d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c847f853 00007f36cd44d60a 00007f36c69d37d4 00007f36c69d3762 00007f36c69d3691 00007f36c69d360c 00007f36c69d28c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:30.123080 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357900544}
I20260709 13:02:30.184532  8526 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:30.187325  8526 raft_consensus.cc:1275] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:30.189249  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:30.189047 12028 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.190531  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:30.191537  8456 raft_consensus.cc:2393] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 9: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:30.191970  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:30.170562  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 341607us
I20260709 13:02:30.181900  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:30.193814  8534 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:30.193938  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:30.126432 12065 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:30.190147 11931 consensus_meta.cc:287] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.912s	user 0.011s	sys 0.001s
I20260709 13:02:30.185626  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:30.197754  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:30.198122  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:30.198413  8533 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:30.198861  8453 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:30.200024  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:30.200970  8455 raft_consensus.cc:2393] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 11: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:30.184037 12003 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.202991 12065 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.203850 12028 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:30.203657 12003 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.204541 12066 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:30.205761 12003 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:30.205986  8527 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:30.159684 12073 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:30.197177  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:30.206753  8452 raft_consensus.cc:2393] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 8: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:30.206537 12073 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.205469 11931 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.207705  8535 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:30.197260  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:30.210039  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.217518  8501 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:02:30.243928  9261 leader_election.cc:336] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.605s (SENT)
I20260709 13:02:30.245393  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:30.189271 11760 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:30.248934  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:30.229696 12064 consensus_meta.cc:287] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.920s	user 0.011s	sys 0.000s
I20260709 13:02:30.265811  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:30.251194  8452 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:02:30.196394 11714 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:30.254398  9288 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:02:30.254931  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:30.255326 12013 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:30.255749 12052 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:02:30.243929 12092 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.247516 12028 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:02:30.258404  9261 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:30.202049 11999 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:02:30.259157  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:30.277362  8377 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:30.260452  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:30.260577 12082 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.260964 12083 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.261298 12091 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.261677 11986 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.262681 12003 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:30.263115 11703 consensus_queue.cc:1048] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:30.264562  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:30.265818  9296 raft_consensus.cc:2393] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 11: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:30.251031  9291 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:30.266588  8384 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:30.267477  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:30.309966  8386 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:30.310117  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 365793us
I20260709 13:02:30.311339 12040 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:30.269604  9293 raft_consensus.cc:2393] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 8: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:30.269493  8501 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:30.270356  8453 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:02:30.244782 11990 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:30.314455  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 45038.3us
I20260709 13:02:30.315053 11990 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.316203 12022 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:30.184101 11932 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.317342 11769 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:30.318928 11932 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:30.319037 11769 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:30.171187 12020 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.319911 11769 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.321635 12020 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:30.322566  9290 raft_consensus.cc:2368] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 8. Current term is 9.
I20260709 13:02:30.272691  8535 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:30.273484  8455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:30.258837  8424 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:30.272789  8351 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:30.265678 12065 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:30.275184 12081 consensus_queue.cc:1059] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:02:30.280229  9261 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:30.330593  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 50459.7us
I20260709 13:02:30.278270 11648 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:30.280903 12082 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:30.323781  8455 raft_consensus.cc:606] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:02:30.335848  8455 raft_consensus.cc:614] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:30.324824  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 52168us
I20260709 13:02:30.249831 12066 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:02:30.270812 12013 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:30.305459 11774 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.268493 12064 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 12. Current term is 13.
W20260709 13:02:30.323575  8352 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.004s	sys 0.014s
W20260709 13:02:30.324177  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 65414.6us
I20260709 13:02:30.272217 12044 consensus_queue.cc:1059] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:02:30.316745 12022 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:30.306661 12083 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:30.329015 11714 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:30.377707 11714 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.378152 11714 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:30.378427 11447 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:30.323271 11986 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.345788  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:30.389010  8386 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:30.275780 12092 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:30.339269 11932 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:30.323395 12086 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:30.338188 12062 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:30.342490 12013 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:30.373756 12022 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:30.367580  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:30.408727  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 97097.5us
W20260709 13:02:30.353601  8352 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.004s	sys 0.014s
I20260709 13:02:30.371191  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:30.369261  9261 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:30.409916  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:30.305351 12000 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:30.375511  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:30.413726  8381 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
W20260709 13:02:30.376408 12076 log.cc:927] Time spent T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:02:30.377239  8455 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:30.360038 12046 raft_consensus.cc:3055] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:30.382510  8424 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:30.392198  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:30.392313  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:30.308030 12091 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.367082  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:30.422483  8384 raft_consensus.cc:2410] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:02:30.357890 12065 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:02:30.449512  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:30.351265 11774 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:30.411304  9291 raft_consensus.cc:1240] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:30.410061 12044 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.378425 11769 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:30.417062  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:02:30.472981  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 50556.1us
I20260709 13:02:30.473835  9292 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:30.419301  8453 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:30.415979  8383 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:30.475327  9261 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:30.447037  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2212) took 1702 ms. Trace:
I20260709 13:02:30.447623  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:30.476722  9289 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
W20260709 13:02:30.448563  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 66137.9us
I20260709 13:02:30.477272  8380 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:02:30.433552 11648 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:30.450084  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:30.450367  9288 raft_consensus.cc:2410] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:02:30.406631 11990 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:30.391647 11946 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:02:30.412333  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:30.484704  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:30.415557 11447 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:30.487723  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:30.420349 12046 raft_consensus.cc:740] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:30.421967 12000 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:30.450119 12040 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:30.491895  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:30.491706  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2775) took 1266 ms. Trace:
I20260709 13:02:30.472922 11931 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:30.510447  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:30.511072  8455 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:30.511134  8424 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:30.396253 12099 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:02:30.491676  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:30.509016  8385 rpcz_store.cc:276] 0709 13:02:29.225768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.226295 (+   527us) service_pool.cc:224] Handling call
0709 13:02:29.226699 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:29.240026 (+ 13327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:29.240068 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:29.240586 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:02:29.357554 (+116968us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:29.357591 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.357666 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:30.303215 (+945549us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b18003be2a0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:02:30.491423 (+188208us) raft_consensus.cc:1685] finished
0709 13:02:30.491444 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.491638 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40431,"raft.queue_time_us":76597,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":34277,"spinlock_wait_cycles":23091072,"thread_start_us":73248,"threads_started":1,"wal-append.queue_time_us":103737}
I20260709 13:02:30.515954  8453 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:30.497220  9295 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:02:30.495900 12091 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:30.454943 12073 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:30.495719  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.397900 12100 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:02:30.514529  9292 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:02:30.491212 12044 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.496305 11447 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.524005 11990 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:30.524554 12105 log.cc:927] Time spent T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:30.527958 12000 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:30.528679  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:30.476347  8531 rpcz_store.cc:276] 0709 13:02:28.744539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.797783 (+ 53244us) service_pool.cc:224] Handling call
0709 13:02:28.822362 (+ 24579us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:28.822790 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:28.822819 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:28.825968 (+  3149us) log.cc:844] Serialized 78 byte log entry
0709 13:02:29.090228 (+264260us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:29.090861 (+   633us) log.cc:844] Serialized 14 byte log entry
0709 13:02:29.096551 (+  5690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.096658 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:30.347234 (+1250576us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b24001fd108. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c521e9c4 00007f36c521cacb 00007f36c53d7dc9 00007f36c53d7a55 00007f36c53d6fb0 00007f36c804d488 00007f36c804dbe8 00007f36c8025398 00007f36c802076a 00007f36c801fbb6
0709 13:02:30.423526 (+ 76292us) raft_consensus.cc:1685] finished
0709 13:02:30.446796 (+ 23270us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.446972 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5248,"prepare.queue_time_us":179,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":5485,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":24006,"spinlock_wait_cycles":11913984,"thread_start_us":239145,"threads_started":1,"wal-append.queue_time_us":359113}
I20260709 13:02:30.494253 12063 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:30.537036  9289 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:30.537482  8501 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:30.540547  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:30.567634  9292 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:30.543053  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:30.488159 11769 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:30.416337 12098 consensus_queue.cc:1059] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:02:30.523528 11774 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:30.549749 12044 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:30.495718 11648 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.550678 12056 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:30.551185 12013 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:30.545624 12092 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:30.615510  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:30.553941 12117 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.492292 12101 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:30.566025  8529 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:30.572193 12118 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:30.573375 12116 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:30.578184  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.579417  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:30.581317 11769 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:30.586930 11774 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:30.587525 12000 raft_consensus.cc:3055] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:02:30.595103  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 84027.7us
I20260709 13:02:30.649415  8424 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:30.603523 12044 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:30.600750  8455 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:30.565444 11447 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:30.618989 11950 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:30.530581 11998 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
W20260709 13:02:30.611795  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 50130.7us
I20260709 13:02:30.616508  9295 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
W20260709 13:02:30.619544  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 145462us
I20260709 13:02:30.621656  8500 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:30.558069 11465 consensus_queue.cc:1048] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:02:30.556880 11714 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:30.643162  8531 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:30.593143 12063 raft_consensus.cc:697] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:30.487777 12096 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:02:30.570894 11990 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:30.651798  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 114364us
W20260709 13:02:30.658370  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 184662us
I20260709 13:02:30.670802  8501 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:30.663862  8500 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:30.652971 11774 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.673979  8500 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:30.654268 11950 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.677042  8500 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:30.658658 12078 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:30.653304 12101 raft_consensus.cc:697] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:30.635680 11574 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:02:30.656286 11986 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:30.652151 12000 raft_consensus.cc:740] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:30.687086  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:30.687088  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:30.583429 12046 consensus_queue.cc:260] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:30.686707  8384 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:02:30.656172 12083 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:30.640450 12117 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:30.679026 11774 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:30.687372  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:30.702630  8533 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:30.656625 12044 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.682605 11950 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:30.683938 12078 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.669518 12099 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
W20260709 13:02:30.722590  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 51845.1us
I20260709 13:02:30.651190 12116 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.675936 11600 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 13:02:30.724689  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.710974 12046 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.720872 11760 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:30.740150  8534 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:30.710588 12130 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:30.742372  8529 raft_consensus.cc:1275] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:30.723860 12078 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:30.654170 12118 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:02:30.726241 11940 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.710860 12092 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 13:02:30.750347  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 94436.5us
W20260709 13:02:30.732815 12108 log.cc:927] Time spent T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.251s	user 0.001s	sys 0.001s
I20260709 13:02:30.717559  8500 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:30.761572  8455 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:30.763170  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:30.764423  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:30.764829  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:30.783594  8459 raft_consensus.cc:2393] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:30.741981 12136 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:30.726444 12121 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:30.765784  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:30.778223  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:30.790493  8384 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 5.
I20260709 13:02:30.749219 12130 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:30.716702 12093 consensus_queue.cc:1175] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b8eb0ad4490645598004d862412f4e31" responder_term: 10 status { last_received { term: 10 index: 8 } last_committed_idx: 7 last_received_current_leader { term: 10 index: 8 } }
I20260709 13:02:30.741245 12103 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:30.789067  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 62333.8us
I20260709 13:02:30.815904  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:30.813488  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:30.828660  8381 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:30.829187  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:30.831449  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:30.836263  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:30.837020  8457 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
W20260709 13:02:30.841661  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 154650us
I20260709 13:02:30.832239  8531 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:30.757454 12044 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:30.774017 12118 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:30.770795 12117 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:30.861898  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:30.867663  8531 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:30.781534 11931 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:30.732512 12000 consensus_queue.cc:260] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.878479 12125 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:30.878333 11931 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.879045 12125 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:30.880649 11931 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:30.873664 11714 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:30.881703 11990 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:30.881832 12139 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:30.882259 11990 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:30.782506 12073 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:30.883091 12073 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.781827 11940 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:30.729377 12063 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.886546  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:30.861258 12136 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:30.830682 12130 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.963459  8384 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:02:30.970160  8384 pending_rounds.cc:85] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 6
I20260709 13:02:30.970474  8384 pending_rounds.cc:107] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:02:30.940246  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:30.970784  8384 raft_consensus.cc:2889] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:30.962708  8385 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:30.972146  8531 raft_consensus.cc:2410] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:30.972553 11760 raft_consensus.cc:697] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 7 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:02:30.950846  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 133022us
I20260709 13:02:30.961320  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:30.994763  8454 raft_consensus.cc:1240] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:30.997838  8426 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
W20260709 13:02:30.943945 12022 consensus_meta.cc:287] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.000s
W20260709 13:02:30.999056  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 281550us
W20260709 13:02:31.001432  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 155282us
I20260709 13:02:30.887657 12073 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:30.812345 12121 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:30.878505 12131 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:30.876626 12117 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:31.009181  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 155487us
I20260709 13:02:30.961756 12144 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:30.939800 12116 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:30.968339 12000 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.890901 12013 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:31.012169  8500 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:30.896763 11648 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:30.829062 12101 consensus_queue.cc:237] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:31.020568  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:31.021360  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:31.052167  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.866994 12103 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:31.080449  8381 raft_consensus.cc:2410] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:02:31.023438 12134 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:02:31.079473  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:31.076056  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 65954.2us
I20260709 13:02:31.087044  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:31.087100  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.021417 11940 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:31.018390 12140 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.017817 12044 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:31.079036  8531 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:31.080025 12125 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:31.075857 12143 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:31.105734 12099 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:31.106405 12099 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:31.107201 12146 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.083593 12116 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:31.022706 12154 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 13:02:31.108116 12146 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:31.107301  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:31.110620  8381 raft_consensus.cc:1275] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:31.111375 12146 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:31.013522 12022 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:31.112780 11760 consensus_queue.cc:237] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:31.113760 12022 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:31.115252 12140 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:31.116640 12103 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:31.118233 12140 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:31.118564 12082 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:31.120652 12020 raft_consensus.cc:3055] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:31.121111 12020 raft_consensus.cc:740] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:31.121917 12020 consensus_queue.cc:260] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:31.106040 12143 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:31.021771 12147 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:31.128619  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:31.013974 11898 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:02:31.108695 12099 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:31.024467 11950 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:31.068936 12144 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:31.205510  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:31.181828  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:31.157019  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:31.253394  8456 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:31.245240 12111 log.cc:927] Time spent T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.697s	user 0.001s	sys 0.001s
W20260709 13:02:31.251303 11774 consensus_meta.cc:287] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.005s
W20260709 13:02:31.176925 12142 log.cc:927] Time spent T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:02:31.248236 12143 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:31.274130  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:31.078322 12117 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:31.133597 11940 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:31.186897 12130 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:31.246410  8528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:47306
I20260709 13:02:31.312095  8528 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:31.312611  8528 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.178759 12121 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:31.135054 12147 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.296054  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:31.151706 12154 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:31.315938  8531 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
W20260709 13:02:31.188172 12113 log.cc:927] Time spent T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.063s	user 0.002s	sys 0.000s
I20260709 13:02:31.246636 12135 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:31.219684 11447 consensus_meta.cc:287] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.000s
I20260709 13:02:31.328974  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:31.140944 12146 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:31.131507 12116 raft_consensus.cc:697] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:31.134136 12044 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:31.164063 12022 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:31.332103  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:31.332093  8501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.004s	sys 0.013s
I20260709 13:02:31.284255 12156 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:31.335093  8501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.005s	sys 0.013s
I20260709 13:02:31.177749 12103 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.145s
W20260709 13:02:31.342594  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.273312 12078 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:31.353434  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 260144us
I20260709 13:02:31.322470 12147 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.362317  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:31.363036  8531 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:31.358004  8528 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:31.364843  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 2025) took 1120 ms. Trace:
I20260709 13:02:31.365492  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:31.310722 11774 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:31.365244  8461 rpcz_store.cc:276] 0709 13:02:30.244016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.244516 (+   500us) service_pool.cc:224] Handling call
0709 13:02:30.244834 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:30.264240 (+ 19406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:30.264292 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:30.264925 (+   633us) log.cc:844] Serialized 26 byte log entry
0709 13:02:30.398019 (+133094us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:30.422699 (+ 24680us) log.cc:844] Serialized 14 byte log entry
0709 13:02:30.448627 (+ 25928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.448712 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:31.023362 (+574650us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b180040e5e0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:02:31.364463 (+341101us) raft_consensus.cc:1685] finished
0709 13:02:31.364612 (+   149us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:31.364769 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111533,"prepare.queue_time_us":24713,"prepare.run_wall_time_us":3306,"raft.queue_time_us":45559,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":36066,"spinlock_wait_cycles":30938368,"thread_start_us":132622,"threads_started":1,"wal-append.queue_time_us":294649}
I20260709 13:02:31.361737  8349 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:31.402127  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:31.317215 11940 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:31.335613 11447 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:31.401311  8349 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:31.405030  8377 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:02:31.331516 12154 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:31.459308  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.360033 12151 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:31.483880  8349 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:31.523305  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 92161.7us
I20260709 13:02:31.332911 12135 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:31.484797  9287 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:31.484125  8501 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:31.493124  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.526839  8528 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:31.483999  8529 raft_consensus.cc:1240] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:31.427435 12143 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:31.528378 12122 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:31.359553 12146 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:31.530014 12143 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:31.532439 12148 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:31.533048 12148 raft_consensus.cc:697] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 10 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:31.360466 12022 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:31.541090  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:47306 (request call id 758) took 2093 ms. Trace:
I20260709 13:02:31.528192  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:31.404479 12153 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:31.347559 12156 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:31.372015 12157 consensus_queue.cc:1059] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.164s
W20260709 13:02:31.528631  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 98908.4us
W20260709 13:02:31.484903 12142 log.cc:927] Time spent T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:02:31.537806 12150 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:02:31.539536 12144 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:31.527974  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:31.577636  8377 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:02:31.504508 12013 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:31.545840  8533 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:31.542501  8528 rpcz_store.cc:276] 0709 13:02:29.441689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.234506 (+1792817us) service_pool.cc:224] Handling call
0709 13:02:31.527323 (+292817us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:31.486197 12164 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:31.535239 12122 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:31.587890  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:31.605492  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2789) took 1884 ms. Trace:
I20260709 13:02:31.546700 12153 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:31.527611 12151 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:31.584559 12088 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:31.605995  8382 rpcz_store.cc:276] 0709 13:02:29.720909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.744832 (+ 23923us) service_pool.cc:224] Handling call
0709 13:02:29.745246 (+   414us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:30.211390 (+466144us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:30.256391 (+ 45001us) log.cc:844] Serialized 14 byte log entry
0709 13:02:30.472476 (+216085us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:30.499250 (+ 26774us) log.cc:844] Serialized 52 byte log entry
0709 13:02:30.499420 (+   170us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:30.499451 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.499512 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:31.218931 (+719419us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:31.583939 (+365008us) raft_consensus.cc:1685] finished
0709 13:02:31.605289 (+ 21350us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:31.605436 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79002,"prepare.queue_time_us":10977,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":194767,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":141387,"spinlock_wait_cycles":47804416,"thread_start_us":558027,"threads_started":2,"wal-append.queue_time_us":240545}
I20260709 13:02:31.656651  8457 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:31.656347  8458 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:31.623762  8456 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:02:31.617424  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 609) took 1225 ms. Trace:
I20260709 13:02:31.659119  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:31.675614  9290 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 532) took 2747 ms (client timeout 2045 ms). Trace:
I20260709 13:02:31.677618  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:31.534040 12148 consensus_queue.cc:237] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:31.584343 12131 raft_consensus.cc:3055] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:02:31.678215  9290 rpcz_store.cc:269] 0709 13:02:28.877066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.885384 (+  8318us) service_pool.cc:224] Handling call
0709 13:02:31.623856 (+2738472us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400773154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:31.624022 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3164093312}
I20260709 13:02:31.531288 12116 consensus_queue.cc:237] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:31.680537  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:31.658435 12046 consensus_meta.cc:287] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.916s	user 0.014s	sys 0.008s
I20260709 13:02:31.678750  8528 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:31.678354  8379 rpcz_store.cc:276] 0709 13:02:30.391881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.410307 (+ 18426us) service_pool.cc:224] Handling call
0709 13:02:30.410631 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:30.610997 (+200366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:30.611066 (+    69us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:30.611872 (+   806us) log.cc:844] Serialized 52 byte log entry
0709 13:02:30.842901 (+231029us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:30.843789 (+   888us) log.cc:844] Serialized 14 byte log entry
0709 13:02:30.973606 (+129817us) log.cc:844] Serialized 14 byte log entry
0709 13:02:30.996079 (+ 22473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.996170 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:31.617188 (+621018us) raft_consensus.cc:1685] finished
0709 13:02:31.617208 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:31.617351 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72420,"prepare.queue_time_us":467,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":103,"raft.queue_time_us":128104,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":18629,"thread_start_us":454059,"threads_started":3,"wal-append.queue_time_us":302154}
I20260709 13:02:31.604434 12122 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.610863 11950 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:31.685451  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:31.618111 12153 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:31.660764 12157 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:31.676522 11447 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:31.661490 12156 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:31.693383 11940 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:31.693601 11930 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:31.694072 12160 log.cc:927] Time spent T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:02:31.681407 12131 raft_consensus.cc:740] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:31.697119  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:31.699153  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:31.700405  8379 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
W20260709 13:02:31.700913  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.701529  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:31.707758  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.695423 12165 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:31.705065 12078 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:31.713857 12022 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:31.691553 12130 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:31.711166 12166 log.cc:927] Time spent T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:02:31.683279 12088 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:31.721464  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:31.722260 12151 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:31.723114  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:31.723227  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:31.723873  8377 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
I20260709 13:02:31.723942 12088 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:31.724475 11774 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:31.711138 12131 consensus_queue.cc:260] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:31.726023 12131 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:31.711099 12165 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:31.724495  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:31.732813  8526 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:31.724772  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:31.735332  8377 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.736404  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:31.755115  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.757305  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:31.773351  8528 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
W20260709 13:02:31.740479 12000 consensus_meta.cc:287] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.656s	user 0.007s	sys 0.004s
I20260709 13:02:31.778905  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:31.779491 12165 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:31.780337  8379 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:31.782307  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:31.787005  8377 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:02:31.697237 12157 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:31.800817  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:31.753836 12151 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:31.754053 12130 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:31.775125 11940 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:31.780678 12162 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:02:31.764108 12135 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:31.806370  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:31.808892  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:31.757134 12147 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:31.802065 12172 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.821919  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:31.823212  8381 raft_consensus.cc:2410] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:02:31.834784 12114 log.cc:927] Time spent T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 1.312s	user 0.002s	sys 0.000s
I20260709 13:02:31.811420 11940 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:31.824904 12172 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:31.839157 11672 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:31.839843 12172 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:31.840948 11769 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:31.841758  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2333) took 1069 ms. Trace:
I20260709 13:02:31.842154  8534 rpcz_store.cc:276] 0709 13:02:30.772827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.773447 (+   620us) service_pool.cc:224] Handling call
0709 13:02:30.773704 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:30.967641 (+193937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:30.967672 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.006306 (+ 38634us) log.cc:844] Serialized 26 byte log entry
0709 13:02:31.485518 (+479212us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:31.485567 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.485647 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:31.841515 (+355868us) raft_consensus.cc:1685] finished
0709 13:02:31.841537 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:31.841697 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15939,"raft.queue_time_us":80996,"spinlock_wait_cycles":11519360,"thread_start_us":554733,"threads_started":2,"wal-append.queue_time_us":621058}
I20260709 13:02:31.843840  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:31.844410  8534 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:31.845708  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:31.805413 12151 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:31.760833 12153 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:31.828184  9258 connection.cc:256] RPC call timeout handler was delayed by -1.014333406999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
I20260709 13:02:31.846248  8534 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:31.849256  8379 raft_consensus.cc:1240] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:31.805721 12130 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:31.852824 11940 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:31.850028  9258 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:31.854713 11447 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:31.855902  8380 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 2089) took 2145 ms (client timeout 1798 ms). Trace:
I20260709 13:02:31.856238 11447 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:02:31.856364  8380 rpcz_store.cc:269] 0709 13:02:29.710450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.716774 (+  6324us) service_pool.cc:224] Handling call
0709 13:02:31.855701 (+2138927us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54002f94d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:31.855799 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1448244608}
I20260709 13:02:31.860448 12127 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.861609 12127 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:31.863224  8377 raft_consensus.cc:2410] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:02:31.868009 12146 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:31.871809  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:31.878633  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:31.879012 12157 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:31.879493  8530 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:31.880539  8386 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.052s	user 0.002s	sys 0.012s
W20260709 13:02:31.880877  8386 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.002s	sys 0.012s
I20260709 13:02:31.881285  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2090) took 2165 ms. Trace:
I20260709 13:02:31.882869  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2791) took 1107 ms. Trace:
I20260709 13:02:31.881742  8378 rpcz_store.cc:276] 0709 13:02:29.710745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.711525 (+   780us) service_pool.cc:224] Handling call
0709 13:02:29.770993 (+ 59468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:30.049411 (+278418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:30.049459 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:30.049519 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:30.049586 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.875584 (+1825998us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b540013e2d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:31.875655 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:31.875814 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":639609216}
I20260709 13:02:31.885890  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:31.886462  8534 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:31.883596  8386 rpcz_store.cc:276] 0709 13:02:30.775155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.775527 (+   372us) service_pool.cc:224] Handling call
0709 13:02:30.775803 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:30.776113 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:30.776146 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:30.784021 (+  7875us) log.cc:844] Serialized 26 byte log entry
0709 13:02:31.882416 (+1098395us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:31.882472 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.882567 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:31.882625 (+    58us) raft_consensus.cc:1685] finished
0709 13:02:31.882643 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:31.882791 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106201,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":1052344,"threads_started":1,"wal-append.queue_time_us":584502}
I20260709 13:02:31.895866  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:31.900745 12153 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:31.906394  8530 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
W20260709 13:02:32.074568  8453 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53010 (request call id 677) took 1549 ms (client timeout 2046 ms). Trace:
W20260709 13:02:32.064196  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.104816  9258 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:32.072607  9296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 531) took 3195 ms (client timeout 2013 ms). Trace:
W20260709 13:02:31.922775  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:32.075176  8383 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48484 (request call id 604) took 1815 ms (client timeout 2084 ms). Trace:
I20260709 13:02:31.904597  8382 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 5.
W20260709 13:02:32.107219  8383 rpcz_store.cc:269] 0709 13:02:30.260121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.260237 (+   116us) service_pool.cc:224] Handling call
0709 13:02:32.074977 (+1814740us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54002fa3d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:32.075081 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315382016}
I20260709 13:02:32.108040  9258 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:32.106719  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:32.109639  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:32.106462  9296 rpcz_store.cc:269] 0709 13:02:28.876762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.877265 (+   503us) service_pool.cc:224] Handling call
0709 13:02:32.072360 (+3195095us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54000c1f54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:32.072529 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2827640192}
W20260709 13:02:32.103924  8453 rpcz_store.cc:269] 0709 13:02:30.524663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.528380 (+  3717us) service_pool.cc:224] Handling call
0709 13:02:32.074305 (+1545925us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b54001e69d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:32.074456 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1921914624}
I20260709 13:02:32.080212  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:32.117659  9287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 880) took 1567 ms. Trace:
I20260709 13:02:32.124235  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:32.163493  8530 raft_consensus.cc:2393] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 11: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:32.135867  8528 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 7 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:31.946254 12155 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.632s	user 0.002s	sys 0.001s
W20260709 13:02:32.071780 12137 log.cc:927] Time spent T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.961s	user 0.001s	sys 0.001s
I20260709 13:02:32.124260  9287 rpcz_store.cc:276] 0709 13:02:30.530686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.530822 (+   136us) service_pool.cc:224] Handling call
0709 13:02:30.550307 (+ 19485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.531674 (+981367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.098058 (+566384us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b540049fcd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:32.098349 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2148684672}
W20260709 13:02:31.948871 12171 log.cc:927] Time spent T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 13:02:32.168741  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 59210.3us
I20260709 13:02:32.166677  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:32.077054 12020 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:31.908656 12130 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:32.004387 11953 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:32.069295 12013 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:32.236440  8454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36448 (request call id 2065) took 2062 ms. Trace:
W20260709 13:02:32.275784  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.225400  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:32.236223  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2223) took 1676 ms. Trace:
I20260709 13:02:32.297720  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2336) took 1521 ms. Trace:
I20260709 13:02:32.112491 12083 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.317296  8533 rpcz_store.cc:276] 0709 13:02:30.776694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.726752 (+950058us) service_pool.cc:224] Handling call
0709 13:02:31.727076 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.727411 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.727443 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.728381 (+   938us) log.cc:844] Serialized 26 byte log entry
0709 13:02:31.878101 (+149720us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:31.878145 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.878220 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.297406 (+419186us) raft_consensus.cc:1685] finished
0709 13:02:32.297430 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.297627 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4176,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":17788,"thread_start_us":123833,"threads_started":1,"wal-append.queue_time_us":529530}
I20260709 13:02:32.319121  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.241667 12066 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.320094  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.320786 12066 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.321364  8461 raft_consensus.cc:2410] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:02:32.318928 12083 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:32.322489  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.323583 12083 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:32.319655  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:32.314594  8454 rpcz_store.cc:276] 0709 13:02:30.173999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.189336 (+ 15337us) service_pool.cc:224] Handling call
0709 13:02:30.189613 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.005327 (+815714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.234119 (+1228792us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b5400159fd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:32.236372 (+  2253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1851058048}
I20260709 13:02:32.324510 12066 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:32.325501  8530 raft_consensus.cc:2393] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 11: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:32.118031 11999 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.326817  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.324462  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:32.332793  8453 raft_consensus.cc:2393] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
W20260709 13:02:32.334105  9260 connection.cc:256] RPC call timeout handler was delayed by -1.2917354839999575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
I20260709 13:02:32.163349 11714 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.327425  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2222) took 1767 ms. Trace:
I20260709 13:02:32.328285  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:32.328711  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.342908  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:32.232753 12139 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.312943 11703 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.249953 12064 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:31.946297 12151 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:32.333470 12091 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:02:32.346738 11703 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.326148 12097 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:32.349409 12099 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:31.944515 12147 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:32.349915 12097 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.351311 12147 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:32.351533 12091 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:32.351886 12147 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.352065 12091 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:32.352523 12097 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:32.329974 11953 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.353564  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:32.354130 12147 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:32.354810 11953 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:32.354830  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:32.336686  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:32.327196  8533 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:32.339784  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:32.358493  8384 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:32.262440 11447 raft_consensus.cc:2804] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:32.225430 12086 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.376587  8384 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:32.341502  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.377197 12086 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:32.379304 12086 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:32.361198 11953 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.380218 11953 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.382136  8424 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:32.343443  8534 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:32.361238 11447 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.342666 12179 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:32.383443 12179 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.385371  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2331) took 1629 ms. Trace:
I20260709 13:02:32.385555 12179 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:32.383029  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.387467  8452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 668) took 1991 ms. Trace:
I20260709 13:02:32.385756  8529 rpcz_store.cc:276] 0709 13:02:30.755878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.774824 (+ 18946us) service_pool.cc:224] Handling call
0709 13:02:30.775097 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.531167 (+756070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.385134 (+853967us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b5400095454. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:32.385316 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504740608}
I20260709 13:02:32.388482  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.326050 12013 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:32.387840  8452 rpcz_store.cc:276] 0709 13:02:30.408358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.412807 (+  4449us) service_pool.cc:224] Handling call
0709 13:02:30.449598 (+ 36791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:30.484581 (+ 34983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:30.484610 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:30.513523 (+ 28913us) log.cc:844] Serialized 26 byte log entry
0709 13:02:30.636397 (+122874us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:30.636439 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.387134 (+1750695us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x7b5400278154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:32.387178 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.387219 (+    41us) raft_consensus.cc:1685] finished
0709 13:02:32.387231 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.387415 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43671,"raft.queue_time_us":1453,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":4220,"spinlock_wait_cycles":79629696,"thread_start_us":106598,"threads_started":1,"wal-append.queue_time_us":189140,"wal-append.run_cpu_time_us":1759,"wal-append.run_wall_time_us":1032303}
I20260709 13:02:32.389701  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2341) took 1577 ms. Trace:
I20260709 13:02:32.390064  8529 rpcz_store.cc:276] 0709 13:02:30.812805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.388976 (+1576171us) service_pool.cc:224] Handling call
0709 13:02:32.389253 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.389414 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.389438 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:32.389476 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:32.389511 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.389565 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.389655 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:32.342466  8527 rpcz_store.cc:276] 0709 13:02:30.559751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.559875 (+   124us) service_pool.cc:224] Handling call
0709 13:02:30.578982 (+ 19107us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:30.773007 (+194025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:30.773034 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:30.795345 (+ 22311us) log.cc:844] Serialized 556 byte log entry
0709 13:02:31.079665 (+284320us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:31.079714 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.260146 (+1180432us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54000f8cd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:32.260201 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.260250 (+    49us) raft_consensus.cc:1685] finished
0709 13:02:32.260264 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.327365 (+ 67101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445356928,"thread_start_us":254849,"threads_started":1,"wal-append.queue_time_us":492382}
I20260709 13:02:32.392946  8534 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:32.082314 12122 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:32.345726  8459 raft_consensus.cc:2393] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 5: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:32.394024  8386 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:02:32.394398  8386 pending_rounds.cc:85] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 6
I20260709 13:02:32.394471  8534 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:32.197458 12178 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:32.346928  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:32.342685 11801 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.395176 12178 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.395515 12122 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:32.171049 12154 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:32.346295 11714 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.396421  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2231) took 1275 ms. Trace:
I20260709 13:02:32.382311 11953 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:32.396978  8534 rpcz_store.cc:276] 0709 13:02:31.120890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.393828 (+1272938us) service_pool.cc:224] Handling call
0709 13:02:32.394072 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.396190 (+  2118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.396371 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:32.397796 11714 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:32.340715  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:32.398533 11957 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:32.383025 11447 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:32.398926 11957 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.399291 11957 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:32.359781 12139 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.395573 12178 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:32.395555 11801 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.401733  9258 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:32.402627 11801 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:32.394701  8386 pending_rounds.cc:107] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:02:32.405411  8386 raft_consensus.cc:2889] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:32.333624 11999 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:32.407829 11999 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:32.408475 12110 log.cc:927] Time spent T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 1.878s	user 0.004s	sys 0.007s
I20260709 13:02:32.410229  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2321) took 2230 ms. Trace:
I20260709 13:02:32.410993  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:32.328336  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 157094us
I20260709 13:02:32.410543  8424 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:32.412777 12127 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:32.413378 12024 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:32.413565 12127 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:32.413852 12024 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.413911 12044 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:32.414237 12154 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:32.410207 11957 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.414393 12024 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:32.410611  8532 rpcz_store.cc:276] 0709 13:02:30.179694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.180740 (+  1046us) service_pool.cc:224] Handling call
0709 13:02:30.180999 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:30.181373 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:30.181399 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:30.189971 (+  8572us) log.cc:844] Serialized 26 byte log entry
0709 13:02:30.310042 (+120071us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:30.410878 (+100836us) log.cc:844] Serialized 14 byte log entry
0709 13:02:30.411185 (+   307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.411268 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.407926 (+1996658us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:32.409927 (+  2001us) raft_consensus.cc:1685] finished
0709 13:02:32.410018 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.410142 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":215595,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":95815,"raft.run_cpu_time_us":1724,"raft.run_wall_time_us":23572,"spinlock_wait_cycles":34399104,"thread_start_us":217932,"threads_started":2,"wal-append.queue_time_us":281105}
I20260709 13:02:32.416044  8424 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:32.418550  8351 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:32.408555  8380 raft_consensus.cc:2393] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 13: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:32.375981 11703 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:32.362541  8427 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:32.316412  8535 rpcz_store.cc:276] 0709 13:02:30.560015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.560288 (+   273us) service_pool.cc:224] Handling call
0709 13:02:30.560608 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:30.668069 (+107461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:30.668099 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:30.687383 (+ 19284us) log.cc:844] Serialized 26 byte log entry
0709 13:02:30.963802 (+276419us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:30.963941 (+   139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.964242 (+   301us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.071100 (+1106858us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:32.197633 (+126533us) raft_consensus.cc:1685] finished
0709 13:02:32.197664 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.236134 (+ 38470us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25686,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":30567808,"thread_start_us":308247,"threads_started":2,"wal-append.queue_time_us":322639}
I20260709 13:02:32.421850  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:32.422401  9258 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:32.422684  8530 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:32.352922 12117 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:32.436378  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:32.437633  8535 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:32.439461  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 77004.7us
I20260709 13:02:32.438264  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.346197 12066 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:32.438452  9258 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:32.450376  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 362959us
I20260709 13:02:32.451581  8385 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:32.452265  8349 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:32.453956  8349 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:32.435649 11930 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:32.433238 12179 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:32.421494 11999 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:32.421404 11953 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:32.450394  8427 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:32.438906 12154 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.466941  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.447465 12101 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:32.474670  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.444442 11703 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:32.476116 11703 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.476574 11703 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:32.361752 12064 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:32.478824 12064 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:32.441479 12131 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.479525 12131 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.480167 12139 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:32.450609 12083 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:32.454247 11714 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:32.481120 12083 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.481395 11714 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.482048 12131 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:32.441902 11990 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:02:32.482708  8501 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.639s (SENT) [suppressed 8 similar messages]
I20260709 13:02:32.483270 12083 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:32.483558 11714 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:32.467959  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.484421  8455 raft_consensus.cc:2393] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 11: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:32.473351  8349 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:32.485419  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:32.442149 12127 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.486052  8385 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:02:32.486182 12127 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.458077 12119 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:32.487160 12119 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:32.487588 12119 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:32.465075 12092 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:02:32.488739 12044 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.484266  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.485419  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.489269 12044 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:32.489931  8454 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:02:32.448464 11801 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:32.485761  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.490511 11801 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.491879 11898 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:32.492551 11898 consensus_queue.cc:1048] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:32.493361 12086 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:32.493435 12091 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:32.493854 12086 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.494251 12086 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:32.482738 11990 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:32.495046 11447 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.496685 11990 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:32.470312  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:32.485795  8349 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:32.475167 12101 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:32.501243 12101 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:32.501427  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.507112  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.450150 12066 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:32.512123  8500 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:32.510249  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.520912 11447 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:32.524770  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:32.479455 12186 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:32.531031 12186 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:32.472813 12179 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.531445 12064 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:02:32.533483 12179 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:32.499827 12063 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:32.535416 12063 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:32.535853 12063 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:32.473556 11953 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.538982 11953 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:32.526336  8349 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:32.541421  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.542550 11957 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:32.544193 12186 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:32.544603 12186 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:32.546326 12143 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:32.547042 12143 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:32.547456 12143 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.547881 12143 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:32.547655 12024 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:32.530915  8500 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:32.549518 12131 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:32.550351 12013 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.550885  8500 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:32.553880  8501 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:32.472108 11930 raft_consensus.cc:697] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:32.492470 11801 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:32.555289  8501 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:32.447270 12178 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.510912 11990 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:32.564425  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.467839 12149 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:02:32.564720  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.589498  8460 raft_consensus.cc:1240] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:02:32.510413 11714 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:32.590253  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.571830  8500 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:32.567171  8501 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:32.572438  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.488783 12127 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:32.499970 11804 consensus_queue.cc:1059] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:02:32.472621 11999 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:32.498735 12154 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.623169 12154 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:32.626034  8377 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:02:32.627601 12139 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:32.628151 12139 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.629925  8459 raft_consensus.cc:1240] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:02:32.630977  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:32.631259 12159 log.cc:927] Time spent T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 1.134s	user 0.003s	sys 0.007s
I20260709 13:02:32.632222  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.632295  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.632962  8455 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:02:32.633298  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.633965  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.634058 12063 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.634735  8461 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:32.636125 12063 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:32.636775 12139 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:32.640552 12044 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:32.636703 12119 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.642576  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2339) took 1865 ms. Trace:
I20260709 13:02:32.642956  8528 rpcz_store.cc:276] 0709 13:02:30.777563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.777401 (+999838us) service_pool.cc:224] Handling call
0709 13:02:31.804790 (+ 27389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.164831 (+360041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.642296 (+477465us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54000ac154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:32.642507 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":760718592}
I20260709 13:02:32.644407  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:32.613355 11930 consensus_queue.cc:237] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:32.614488 11999 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:32.614953 12178 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:32.566923 12020 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:32.572340 12013 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:32.645061  8528 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
W20260709 13:02:32.662005  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 94902.1us
I20260709 13:02:32.645920  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:32.662771  8501 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:32.664060  8501 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:32.652701  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:32.653909  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:32.655223  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:32.655788  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:32.661566  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 89817.2us
I20260709 13:02:32.677165  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:32.677636  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:32.669296  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:32.678532  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:32.655943  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:32.656517  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.680078  9293 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:32.680382  8384 raft_consensus.cc:1240] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:32.654608  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:32.656756  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:32.692119  8501 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:32.693570  8501 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:32.673333  9291 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:32.679031  9289 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:32.696317  8386 raft_consensus.cc:2393] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 9: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:32.690894  8500 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:32.699128  8501 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:32.611047 11714 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:32.701437  9295 raft_consensus.cc:2393] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 8: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:32.701647 11714 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:32.702404 12117 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:32.703167 12117 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:32.704429  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:32.705221  9290 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:32.705336  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:32.706276  9288 raft_consensus.cc:2410] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:02:32.706769  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:32.707690  8386 raft_consensus.cc:2393] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 9: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:32.707154 11801 raft_consensus.cc:2955] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 2 to 7, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:32.708107 12143 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:32.708592  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:32.651958 12189 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:32.710034 12086 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:32.797447  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.653525 12020 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:32.710809 12130 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:32.715425 12143 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:32.710124  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:32.689886 12157 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:32.719884  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.690058 12136 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:32.690258 12044 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:32.722131  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:32.723227  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:32.725934  8386 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:32.727481  8501 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:32.815231  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 87839.1us
I20260709 13:02:32.816561  8501 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:32.818815  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 380416us
I20260709 13:02:32.795399  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:32.819617  8377 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:02:32.795531  9260 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:32.820145  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:32.820976  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 159773us
I20260709 13:02:32.658264 12066 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:32.645881 12024 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:32.646584 12119 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:32.661707 11957 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:32.807862  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2235) took 1439 ms. Trace:
I20260709 13:02:32.690521 12154 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:32.728920  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.724650 12013 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:32.829941  8526 rpcz_store.cc:276] 0709 13:02:31.360809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.658884 (+298075us) service_pool.cc:224] Handling call
0709 13:02:32.800007 (+1141123us) spinlock_profiling.cc:243] Waited 54.5 ms on lock 0x7b5400095e54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:32.800121 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125353216}
I20260709 13:02:32.720754 12186 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.729970  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:32.803265  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:32.840482  8384 raft_consensus.cc:2410] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:02:32.821796  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:32.822703  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:32.822283  9258 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:32.841926  8379 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:32.842058  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:32.797295 12117 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:32.826706  9260 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:32.828317  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:32.806219 12020 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:32.840322  9288 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:02:32.805228  8528 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:32.698050 11703 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:32.646878 11990 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.813191 12136 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:32.855338  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:32.856173  9290 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:32.699970 12101 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.817600 12044 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:32.853632  9287 raft_consensus.cc:2393] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 8: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:32.850087  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:32.829452 12157 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:32.866022  9260 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:32.876250  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:32.827873 11465 consensus_queue.cc:1059] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:02:32.801666 12189 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:32.878623 11447 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:32.837965 12013 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.878343 11465 consensus_queue.cc:1243] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer b8eb0ad4490645598004d862412f4e31 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:32.832738 12187 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:32.899235  8377 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:32.903280  9260 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:32.886030  8526 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:32.854246 12185 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:32.942879  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:32.943596  9290 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:32.861881 12136 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:32.955283  8382 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.013s	sys 0.028s
W20260709 13:02:32.955976  8382 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.013s	sys 0.028s
I20260709 13:02:32.867198 12044 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:33.011116  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 107959us
I20260709 13:02:33.012295  9260 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:33.013502  8535 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.014s	sys 0.023s
W20260709 13:02:33.013860  8535 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.014s	sys 0.023s
I20260709 13:02:32.884912 12178 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.844177 11957 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:33.087661  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:32.857288 12063 consensus_queue.cc:1059] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:02:33.104140  9287 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:33.102154  9294 raft_consensus.cc:2410] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:32.889674 12013 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:33.103289  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:33.097059  8533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.025s	sys 0.017s
W20260709 13:02:33.009361  8534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.018s	sys 0.018s
W20260709 13:02:33.111618  8534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.019s	sys 0.018s
W20260709 13:02:32.944245 11946 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.015s	sys 0.024s
W20260709 13:02:33.112568  8533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.025s	sys 0.017s
I20260709 13:02:33.112448  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:32.934556 12187 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.847267 12154 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:33.011932 11953 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:33.116083  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 103875us
I20260709 13:02:33.130228  8379 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:33.130604  8528 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:33.116954 11447 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:33.131861  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:32.943357 11760 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:33.137701  8528 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
W20260709 13:02:33.104890 12062 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.019s	sys 0.027s
I20260709 13:02:33.088517 12157 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:33.150808  8427 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.016s	sys 0.031s
W20260709 13:02:33.152593  8427 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.016s	sys 0.031s
W20260709 13:02:33.154632  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 663100us
W20260709 13:02:33.127223  9259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.019s	sys 0.031s
W20260709 13:02:33.156746  9259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.019s	sys 0.031s
W20260709 13:02:33.149188 12062 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.020s	sys 0.027s
W20260709 13:02:33.171929  8532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.013s	sys 0.041s
I20260709 13:02:33.191206  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:33.191885  8528 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:33.115540 12185 raft_consensus.cc:697] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:33.113505 12190 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:33.129155 12187 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:33.201200  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:33.203323 11703 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:33.205499  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:33.206863  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:33.205515  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:33.172637  8380 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:33.208673  9288 raft_consensus.cc:2393] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 12: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
W20260709 13:02:33.191217  8532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.015s	sys 0.043s
I20260709 13:02:33.118156 12131 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:33.129436 11953 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.215023  9261 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:33.114567 12178 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:33.215394 12154 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:33.218788  9261 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:33.222906  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:33.219383  8499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.016s	sys 0.092s
W20260709 13:02:33.223873  8499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.016s	sys 0.092s
I20260709 13:02:33.223563  9294 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:02:33.225747 11447 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:33.226269 11447 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.226660 11447 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.228226  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:33.228607  9261 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:33.229555  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:33.232107  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:33.218026 11953 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:33.153713 12157 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:33.220335 11930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.008s	sys 0.025s
W20260709 13:02:33.234491  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 71459.3us
I20260709 13:02:33.250857  8427 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:33.261456  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:33.262240  9294 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:33.259297  9292 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.018s	sys 0.056s
W20260709 13:02:33.264345  9292 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.018s	sys 0.056s
I20260709 13:02:33.268723  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:33.271169  8426 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.003s	sys 0.028s
W20260709 13:02:33.296110  8426 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.004s	sys 0.029s
W20260709 13:02:33.296512  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 696119us
I20260709 13:02:33.234040 12086 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:33.265779 11930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.008s	sys 0.025s
I20260709 13:02:33.294647  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:33.240661 12151 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:33.317008  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:33.318034  9287 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:02:33.324839  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2228) took 2205 ms. Trace:
I20260709 13:02:33.327379  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:33.328474 12157 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:33.331805 11801 consensus_meta.cc:287] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.584s	user 0.007s	sys 0.000s
I20260709 13:02:33.317903 12185 consensus_queue.cc:237] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:33.337890 12178 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:33.338680 12178 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:33.339097 12178 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:33.339512 12178 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.325363  8529 rpcz_store.cc:276] 0709 13:02:31.119950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.390916 (+1270966us) service_pool.cc:224] Handling call
0709 13:02:32.391165 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.391358 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:32.885650 (+494292us) log.cc:844] Serialized 14 byte log entry
0709 13:02:33.322376 (+436726us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:33.322450 (+    74us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:33.322521 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.322594 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.324764 (+  2170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":816922,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":3176,"thread_start_us":929239,"threads_started":2}
W20260709 13:02:33.341665 12192 log.cc:927] Time spent T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:02:33.346108  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:33.356106  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:33.272078 12097 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:33.369135  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:33.372213  8529 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:33.368974  8528 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:33.381340  9294 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
W20260709 13:02:33.336493 11714 consensus_meta.cc:287] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.634s	user 0.007s	sys 0.000s
I20260709 13:02:33.386660 11447 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:33.411847  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:33.412247  9288 raft_consensus.cc:2393] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 11: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
W20260709 13:02:33.324357  8501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.020s	sys 0.027s
I20260709 13:02:33.414832  8529 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
W20260709 13:02:33.415657  8501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.020s	sys 0.027s
I20260709 13:02:33.416261  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:33.416389  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 599865us
I20260709 13:02:33.417146  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:33.235208 12190 consensus_queue.cc:1059] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:02:33.410607  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:33.421487  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:33.418860  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:33.408054  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:33.407860  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:33.424808  8529 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:33.405194  8380 raft_consensus.cc:2410] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:33.424926 11447 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:33.432878  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:33.427891  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2240) took 1593 ms. Trace:
W20260709 13:02:33.442816  8500 leader_election.cc:336] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Timed out: RequestConsensusVote RPC to 127.7.25.196:40669 timed out after 2.013s (SENT)
I20260709 13:02:33.409118 12097 raft_consensus.cc:697] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:33.443403  8500 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:33.444075 11447 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:33.444604 11447 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:33.444931 11447 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:33.415994 12189 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:33.417369  8501 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:02:33.489914  8351 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.009s	sys 0.067s
I20260709 13:02:33.415303 12101 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:33.416209 12203 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:02:33.375162 12186 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:33.413794 12151 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:33.420639 11714 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:33.432732  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:33.498498  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:33.666220  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 248940us
I20260709 13:02:33.666391  8528 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:33.667055  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38894 (request call id 2345) took 1175 ms. Trace:
W20260709 13:02:33.618193  8284 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59480 (request call id 202) took 14007 ms (client timeout 15000 ms). Trace:
I20260709 13:02:33.667644  8528 rpcz_store.cc:276] 0709 13:02:32.492093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.432469 (+940376us) service_pool.cc:224] Handling call
0709 13:02:33.666995 (+234526us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:33.431651  8527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.006s	sys 0.017s
W20260709 13:02:33.668793  8527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.016s	sys 0.026s
W20260709 13:02:33.665549  8351 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.020s	sys 0.075s
I20260709 13:02:33.579885  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:33.431599  9294 raft_consensus.cc:2393] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 11: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
W20260709 13:02:33.669772  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 743740us
W20260709 13:02:33.625027  8500 leader_election.cc:336] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Timed out: RequestConsensusVote RPC to 127.7.25.196:40669 timed out after 2.045s (SENT)
I20260709 13:02:33.582954  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:33.668838  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:33.434105  8535 rpcz_store.cc:276] 0709 13:02:31.834213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.439739 (+605526us) service_pool.cc:224] Handling call
0709 13:02:32.439995 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.440171 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:33.089536 (+649365us) log.cc:844] Serialized 14 byte log entry
0709 13:02:33.427190 (+337654us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:33.427309 (+   119us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:33.427422 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.427564 (+   142us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.427813 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":777775,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":137,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8434,"thread_start_us":881966,"threads_started":2}
I20260709 13:02:33.672186  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:33.667063  8501 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:33.703096  8528 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.494949  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:33.703678  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:33.705833  8535 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:33.706609  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2243) took 1006 ms. Trace:
I20260709 13:02:33.707005  8535 rpcz_store.cc:276] 0709 13:02:32.700407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.703417 (+1003010us) service_pool.cc:224] Handling call
0709 13:02:33.706552 (+  3135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:33.703354  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:33.707976  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:33.644277 11447 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:33.434475 11986 consensus_queue.cc:1059] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.286s
I20260709 13:02:33.578912 12179 raft_consensus.cc:3055] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:33.733625  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:33.718036  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:33.775269  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:33.549796 12190 raft_consensus.cc:3055] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:33.743033  8385 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:33.559051 12204 log.cc:927] Time spent T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:02:33.781042  8528 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:33.432564 12118 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:33.489609 12157 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:33.469599 11957 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:33.706454 12187 consensus_meta.cc:287] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.002s
I20260709 13:02:33.549383 12210 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:02:33.577968 12200 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 13:02:33.623490 12211 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:33.574496 12136 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:33.793977 11447 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:33.578612 12191 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 13:02:33.875527  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:33.861642  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:33.822722  8535 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:33.943270  8384 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:33.862583  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:33.951052  8526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38894 (request call id 2352) took 1457 ms (client timeout 1846 ms). Trace:
W20260709 13:02:33.950902  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 283897us
W20260709 13:02:33.965926  8526 rpcz_store.cc:269] 0709 13:02:32.493760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.875918 (+382158us) service_pool.cc:224] Handling call
0709 13:02:33.950897 (+1074979us) spinlock_profiling.cc:243] Waited 8.92 ms on lock 0x7b54000f8cd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:33.950999 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20508416}
I20260709 13:02:33.966751  8501 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:33.718390 12149 raft_consensus.cc:3055] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:33.972728  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:33.667853  8284 rpcz_store.cc:269] 0709 13:02:19.632569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.693516 (+ 60947us) service_pool.cc:224] Handling call
0709 13:02:33.618013 (+13924497us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:28.381492 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:28.382122 (+   630us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:28.382158 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:02:28.382176 (+    18us) tablet.cc:662] Decoding operations
0709 13:02:28.383485 (+  1309us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:28.383544 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:28.383581 (+    37us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:02:28.384701 (+  1120us) tablet.cc:701] Row locks acquired
0709 13:02:28.384723 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:02:28.384887 (+   164us) write_op.cc:270] Start()
0709 13:02:28.385011 (+   124us) write_op.cc:276] Timestamp: P: 1783602148384837 usec, L: 0
0709 13:02:28.385032 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:02:28.470528 (+ 85496us) log.cc:844] Serialized 5594 byte log entry
0709 13:02:29.237276 (+766748us) op_driver.cc:464] REPLICATION: finished
0709 13:02:29.264837 (+ 27561us) write_op.cc:301] APPLY: starting
0709 13:02:29.264919 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:29.265196 (+   277us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:29.265304 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:29.266931 (+  1627us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:29.267258 (+   327us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:02:29.267323 (+    65us) write_op.cc:312] APPLY: finished
0709 13:02:29.267759 (+   436us) log.cc:844] Serialized 101 byte log entry
0709 13:02:29.267943 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:29.268090 (+   147us) write_op.cc:454] Released schema lock
0709 13:02:29.268142 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:29.268571 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:29.268600 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3063913,"reported_tablets":33,"spinlock_wait_cycles":62720,"child_traces":[["op",{"apply.queue_time_us":27269,"apply.run_cpu_time_us":3692,"apply.run_wall_time_us":3693,"num_ops":14,"prepare.queue_time_us":69688,"prepare.run_cpu_time_us":19647,"prepare.run_wall_time_us":167476,"raft.queue_time_us":298164,"raft.run_cpu_time_us":8220,"raft.run_wall_time_us":99929,"replication_time_us":836859,"thread_start_us":361478,"threads_started":4,"wal-append.queue_time_us":156474,"wal-append.run_cpu_time_us":27176,"wal-append.run_wall_time_us":1639024}]]}
W20260709 13:02:33.859266 12013 consensus_meta.cc:287] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.730s	user 0.008s	sys 0.001s
I20260709 13:02:33.869125  8349 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:33.870747  8351 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:33.848914  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:33.944135 12044 consensus_meta.cc:287] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.835s	user 0.007s	sys 0.006s
I20260709 13:02:33.855154  8379 raft_consensus.cc:1275] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:02:33.953575  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 44619.6us
W20260709 13:02:33.948635 12178 consensus_meta.cc:287] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.002s
I20260709 13:02:33.845907  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2817) took 1505 ms. Trace:
I20260709 13:02:33.982473  8378 rpcz_store.cc:276] 0709 13:02:32.340173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.355812 (+ 15639us) service_pool.cc:224] Handling call
0709 13:02:32.356069 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.356311 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:32.356642 (+   331us) log.cc:844] Serialized 14 byte log entry
0709 13:02:33.845478 (+1488836us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:33.845545 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:33.845615 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.845707 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.845843 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1026351,"prepare.queue_time_us":564,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":1012235,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":103,"thread_start_us":476831,"threads_started":1,"wal-append.queue_time_us":810904}
I20260709 13:02:33.856660 12143 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.490363 11990 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:33.717669 12209 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 13:02:33.733984 12197 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:02:33.742118 12205 log.cc:927] Time spent T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:02:33.795616  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:33.861678 12153 consensus_queue.cc:1059] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
I20260709 13:02:33.968111  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:33.846964 12198 log.cc:927] Time spent T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:33.965938  9289 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
W20260709 13:02:33.836714 11953 consensus_meta.cc:287] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.571s	user 0.006s	sys 0.002s
W20260709 13:02:33.863281 12201 log.cc:927] Time spent T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.260s	user 0.000s	sys 0.000s
W20260709 13:02:33.847600 12214 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:02:33.844866  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2807) took 1510 ms. Trace:
I20260709 13:02:33.824358 12190 raft_consensus.cc:740] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:33.986289  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:33.852056 12122 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:33.847087 11804 raft_consensus.cc:3055] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:33.954896  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2242) took 1254 ms. Trace:
I20260709 13:02:33.859964 12066 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.853684 12062 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:33.790513 12179 raft_consensus.cc:740] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:33.969520 12210 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:33.856019 12119 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:33.989188  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2234) took 2629 ms. Trace:
I20260709 13:02:33.839329 12131 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:33.990043  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:34.010075 12098 consensus_queue.cc:1059] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:02:33.988237  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:33.972961 12149 raft_consensus.cc:740] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:33.968133 12211 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:33.855455 12154 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:33.493146 12097 consensus_queue.cc:237] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:34.004849  8528 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:33.842022  8453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 2058) took 1039 ms. Trace:
I20260709 13:02:34.064940  8453 rpcz_store.cc:276] 0709 13:02:32.802418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.802551 (+   133us) service_pool.cc:224] Handling call
0709 13:02:32.802902 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.145257 (+342355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.145287 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:33.145331 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:33.145369 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.841670 (+696301us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b5400341a54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:33.841742 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.841940 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":786734848}
I20260709 13:02:34.066375  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2238) took 2464 ms. Trace:
I20260709 13:02:34.010696  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:34.018389  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:33.848361 12127 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.021678  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47306 (request call id 776) took 1178 ms. Trace:
I20260709 13:02:34.044450 12153 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:34.016254  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 391225us
I20260709 13:02:34.024369  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 772) took 1919 ms. Trace:
I20260709 13:02:34.026582  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:34.025643 11953 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:34.031749  8535 rpcz_store.cc:276] 0709 13:02:32.700108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.707731 (+1007623us) service_pool.cc:224] Handling call
0709 13:02:33.954839 (+247108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.076769  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:34.077494  8535 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 6.
I20260709 13:02:34.077912  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47306 (request call id 777) took 1231 ms. Trace:
I20260709 13:02:34.051235 12131 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.964308 12187 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:34.035809  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:33.849048 12144 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.985826 12013 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:34.016932 11990 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:33.992445 11957 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 13:02:34.028264 12020 consensus_meta.cc:287] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 1.146s	user 0.012s	sys 0.000s
I20260709 13:02:33.997561 11898 consensus_queue.cc:1048] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:02:34.050439 12119 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:34.043439  8534 rpcz_store.cc:276] 0709 13:02:31.359871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.397681 (+1037810us) service_pool.cc:224] Handling call
0709 13:02:32.397999 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.435342 (+ 37343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.435386 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:32.441269 (+  5883us) log.cc:844] Serialized 26 byte log entry
0709 13:02:33.112233 (+670964us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:33.112270 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.112333 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:33.988943 (+876610us) raft_consensus.cc:1685] finished
0709 13:02:33.988966 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.989129 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36931,"raft.queue_time_us":40810,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":3725,"thread_start_us":640899,"threads_started":1,"wal-append.queue_time_us":807241}
I20260709 13:02:33.990233 12178 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:34.033339 12227 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:33.997176 12143 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:34.110992 12143 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:34.055392  9294 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:34.112674  9294 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:34.057832  9292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 558) took 1400 ms. Trace:
I20260709 13:02:34.032960 11804 raft_consensus.cc:740] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:34.116816 11804 consensus_queue.cc:260] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:34.117970 11804 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:34.121652  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:34.122231 12193 log.cc:927] Time spent T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.855s	user 0.002s	sys 0.000s
W20260709 13:02:34.126034 12223 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 13:02:34.129956  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:34.058569  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 187763us
I20260709 13:02:34.068483  8526 rpcz_store.cc:276] 0709 13:02:32.843668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.967343 (+1123675us) service_pool.cc:224] Handling call
0709 13:02:34.021600 (+ 54257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:33.964453 12199 consensus_queue.cc:1059] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:02:34.070729  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:34.070736  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:34.026242  8383 rpcz_store.cc:276] 0709 13:02:32.334927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.335097 (+   170us) service_pool.cc:224] Handling call
0709 13:02:32.335461 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.335714 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:32.347843 (+ 12129us) log.cc:844] Serialized 14 byte log entry
0709 13:02:32.825351 (+477508us) log.cc:844] Serialized 14 byte log entry
0709 13:02:33.203582 (+378231us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b18003bdf40. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53662a6 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1
0709 13:02:33.204855 (+  1273us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b18003bdf40. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:02:33.844149 (+639294us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b18003bdf40. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c5312c0a 00007f36cea52219 00007f36c539aa40 00007f36c53954e4 00007f36c5395455 00007f36c847d060 00007f36c848f716 00007f36c84a0287 00007f36c84a0208
0709 13:02:33.844386 (+   237us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:33.844456 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:33.844526 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.844626 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.844790 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":987970,"prepare.queue_time_us":23814,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":76,"raft.queue_time_us":1023284,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":14019,"spinlock_wait_cycles":62105984,"thread_start_us":476242,"threads_started":1,"wal-append.queue_time_us":882455}
I20260709 13:02:34.073939  8500 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:34.066936  8532 rpcz_store.cc:276] 0709 13:02:31.602539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.416265 (+813726us) service_pool.cc:224] Handling call
0709 13:02:32.416631 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.440038 (+ 23407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.440082 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:32.450852 (+ 10770us) log.cc:844] Serialized 26 byte log entry
0709 13:02:33.206229 (+755377us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b480012c258. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36cd3aeaa1 00007f36cd3a5b37 00007f36cd3a59ca 00007f36cd49d26f 00007f36cd49cf37 00007f36cd4b155c 00007f36cd4b1508 00007f36cd4b1488 00007f36cd4b1443 00007f36cd4b06ec 00007f36cc3daa96
0709 13:02:33.209580 (+  3351us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:33.209637 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.209729 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.056262 (+846533us) raft_consensus.cc:1685] finished
0709 13:02:34.056286 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.066291 (+ 10005us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22986,"raft.queue_time_us":23678,"raft.run_cpu_time_us":12325,"raft.run_wall_time_us":764636,"spinlock_wait_cycles":6076160,"thread_start_us":712099,"threads_started":1,"wal-append.queue_time_us":916520}
I20260709 13:02:34.078202  8535 rpcz_store.cc:276] 0709 13:02:32.846216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.076443 (+1230227us) service_pool.cc:224] Handling call
0709 13:02:34.077861 (+  1418us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.003460 12157 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:34.077912  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2229) took 2957 ms. Trace:
I20260709 13:02:34.140340  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:34.070667 12081 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:34.073529  8530 rpcz_store.cc:276] 0709 13:02:32.104574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.444237 (+339663us) service_pool.cc:224] Handling call
0709 13:02:32.465655 (+ 21418us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:32.471849 (+  6194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.471896 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:32.472599 (+   703us) log.cc:844] Serialized 52 byte log entry
0709 13:02:32.956928 (+484329us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:32.956983 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.961170 (+  4187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.024109 (+1062939us) raft_consensus.cc:1685] finished
0709 13:02:34.024132 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.024294 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":252,"raft.queue_time_us":3147,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":6113,"thread_start_us":447028,"threads_started":1,"wal-append.queue_time_us":756147}
I20260709 13:02:34.143755  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:34.144544  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:34.145323  8534 raft_consensus.cc:2410] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:02:34.073539 12154 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:34.082239  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 115552us
I20260709 13:02:34.044651 12228 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:34.088066  8531 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:34.088788  8528 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:02:34.091985  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:34.147447  8378 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:34.148123  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:34.039266 12066 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:34.062886 11714 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:34.066005 12091 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.043856 12062 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:34.094004  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:34.094843  9290 raft_consensus.cc:1240] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:02:34.073350 12153 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.985913 12044 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:34.081614 12117 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:34.077987 12098 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:34.102473  9287 raft_consensus.cc:2393] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 10: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:34.103617  9288 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:34.104076  9258 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:34.070765 12127 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:34.106573 12232 raft_consensus.cc:3055] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:34.098459 12020 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:34.108880 12065 raft_consensus.cc:3055] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:34.196581 12232 raft_consensus.cc:740] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:34.204097 12065 raft_consensus.cc:740] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:34.204785 12232 consensus_queue.cc:260] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:34.141237  8535 raft_consensus.cc:2393] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 7: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:34.206235  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2260) took 1191 ms. Trace:
I20260709 13:02:34.206708  8535 rpcz_store.cc:276] 0709 13:02:33.014594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.140081 (+1125487us) service_pool.cc:224] Handling call
0709 13:02:34.206155 (+ 66074us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.207587  8529 raft_consensus.cc:2393] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 7: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:34.148262 12086 consensus_queue.cc:1059] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:02:34.116223  9292 rpcz_store.cc:276] 0709 13:02:32.657318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.657422 (+   104us) service_pool.cc:224] Handling call
0709 13:02:32.657916 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.658315 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.658339 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:32.659364 (+  1025us) log.cc:844] Serialized 556 byte log entry
0709 13:02:33.264832 (+605468us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:33.264870 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.264933 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.057615 (+792682us) raft_consensus.cc:1685] finished
0709 13:02:34.057635 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.057774 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":605097,"threads_started":1,"wal-append.queue_time_us":839234}
I20260709 13:02:34.152177  9289 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:02:34.152693  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 78838.2us
I20260709 13:02:34.156199  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2248) took 1352 ms. Trace:
I20260709 13:02:34.157693  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:34.147156  8501 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:34.159592  8526 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:02:34.162987  8424 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:34.164716  9260 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:34.093194 12144 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:34.166175  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47306 (request call id 780) took 1300 ms. Trace:
I20260709 13:02:34.166905  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:34.167963  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:34.171103  8351 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:34.116742 12178 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:34.239427  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 92360.8us
W20260709 13:02:34.158491 12212 log.cc:927] Time spent T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:02:34.143198 12081 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:34.184186  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 80135.7us
I20260709 13:02:34.169600 12091 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:34.265023  8453 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:02:34.174075  8459 raft_consensus.cc:2955] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 2 to 7, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:34.193673  9295 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:34.157855 12227 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:34.159137 12136 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:34.157754 12157 raft_consensus.cc:697] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:34.199332  8379 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:02:34.200646  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:34.090552 12190 consensus_queue.cc:260] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:34.204972 12065 consensus_queue.cc:260] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:34.207922  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:34.140463  8527 rpcz_store.cc:276] 0709 13:02:31.120254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.393400 (+1273146us) service_pool.cc:224] Handling call
0709 13:02:32.393645 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.393836 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:32.823396 (+429560us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.077423 (+1254027us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.077590 (+   167us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.077637 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:34.077685 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.077747 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.077861 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":823956,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":6005,"raft.queue_time_us":347500,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":9088,"thread_start_us":1679222,"threads_started":4,"wal-append.queue_time_us":1189779}
I20260709 13:02:34.141947  9296 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:02:34.201428 12206 log.cc:927] Time spent T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.779s	user 0.005s	sys 0.000s
I20260709 13:02:34.138705 12151 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:34.222759  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:34.239830  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:34.241397  8455 raft_consensus.cc:2393] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 6: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:34.222656  9292 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:34.231807  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:34.224452  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 61538.2us
I20260709 13:02:34.172966 12153 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:34.223142  8534 rpcz_store.cc:276] 0709 13:02:32.803577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.100114 (+1296537us) service_pool.cc:224] Handling call
0709 13:02:34.156132 (+ 56018us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.228055  8528 rpcz_store.cc:276] 0709 13:02:32.864798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.795352 (+930554us) service_pool.cc:224] Handling call
0709 13:02:34.165326 (+369974us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:34.227509  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 62828.5us
I20260709 13:02:34.915175  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:34.916307  9260 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:34.229553  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38894 (request call id 2353) took 1735 ms. Trace:
I20260709 13:02:34.917361  8532 rpcz_store.cc:276] 0709 13:02:32.493991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.139762 (+1645771us) service_pool.cc:224] Handling call
0709 13:02:34.229454 (+ 89692us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.096820 12149 consensus_queue.cc:260] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:34.242862  8377 raft_consensus.cc:2410] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:02:34.235989  8378 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:34.926349  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 2838) took 1073 ms. Trace:
I20260709 13:02:34.926854  8378 rpcz_store.cc:276] 0709 13:02:33.852719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.074049 (+221330us) service_pool.cc:224] Handling call
0709 13:02:34.926286 (+852237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.916239  8527 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:34.221881  8530 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.192117 12063 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:34.244302  9289 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:02:34.244979  8501 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:34.245718  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 376685us
I20260709 13:02:34.187245  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:34.256619  9258 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
W20260709 13:02:34.257377  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 86338.9us
I20260709 13:02:34.258074 11714 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:34.935602 11714 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.258522 12081 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:34.936014  9287 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55734 (request call id 887) took 1641 ms (client timeout 1587 ms). Trace:
W20260709 13:02:34.936779  9287 rpcz_store.cc:269] 0709 13:02:33.294991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.322407 (+ 27416us) service_pool.cc:224] Handling call
0709 13:02:34.935609 (+1613202us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b54006310d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:34.935836 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1776713600}
I20260709 13:02:34.939567  9287 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:34.244302 12229 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:34.259735 12086 raft_consensus.cc:3055] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:34.940923  9287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 901) took 1253 ms. Trace:
I20260709 13:02:34.941382 12086 raft_consensus.cc:740] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:34.941649 12229 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:34.942253 12229 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.942652 12229 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:34.942322 12086 consensus_queue.cc:260] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:34.943387 12086 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:34.241945 12189 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:34.262005 12211 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:34.255669 11990 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:02:34.262466 12020 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:34.936040 11714 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:34.948271 12153 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:34.243615 12092 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:34.263280 12013 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:34.211897 12234 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:34.949770  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:34.949589 12234 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:34.950495  8534 raft_consensus.cc:2393] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 11: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:02:34.950935  8534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2244) took 2250 ms (client timeout 2858 ms). Trace:
W20260709 13:02:34.951277  8534 rpcz_store.cc:269] 0709 13:02:32.700640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.930804 (+2230164us) service_pool.cc:224] Handling call
0709 13:02:34.950882 (+ 20078us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.951673 12234 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:34.951745  8381 raft_consensus.cc:1240] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:02:34.198805 12098 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:34.909771  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 614) took 2232 ms. Trace:
I20260709 13:02:34.952126  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:34.952450  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2829) took 1102 ms. Trace:
I20260709 13:02:34.952378  8385 rpcz_store.cc:276] 0709 13:02:32.677673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.677804 (+   131us) service_pool.cc:224] Handling call
0709 13:02:32.722780 (+ 44976us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.826691 (+1103911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.909565 (+1082874us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540026aa54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:34.909720 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2345870080}
I20260709 13:02:34.400024 12154 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:34.393584 12118 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.953922  8385 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:02:34.953894 12118 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:34.954685  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2830) took 1104 ms. Trace:
I20260709 13:02:34.955016  8385 rpcz_store.cc:276] 0709 13:02:33.850733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.953391 (+1102658us) service_pool.cc:224] Handling call
0709 13:02:34.953704 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.954451 (+   747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.954637 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:34.439658 12225 log.cc:927] Time spent T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.351s	user 0.000s	sys 0.001s
I20260709 13:02:34.909713  8535 raft_consensus.cc:2410] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:02:34.956797  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.504864 12144 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:34.908237  9296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 892) took 1553 ms. Trace:
I20260709 13:02:34.911764  9292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 894) took 1473 ms. Trace:
I20260709 13:02:34.957566 12136 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:34.957818  9292 rpcz_store.cc:276] 0709 13:02:33.438436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.222025 (+783589us) service_pool.cc:224] Handling call
0709 13:02:34.222401 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.911513 (+689112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.911693 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.959236  9292 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:34.959786  9292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 905) took 1135 ms. Trace:
I20260709 13:02:34.960090  9292 rpcz_store.cc:276] 0709 13:02:33.824837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.958637 (+1133800us) service_pool.cc:224] Handling call
0709 13:02:34.958877 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.959537 (+   660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.959730 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.908043  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:34.962016  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:34.963068  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2818) took 2622 ms. Trace:
I20260709 13:02:34.963770  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2833) took 1112 ms. Trace:
I20260709 13:02:34.964119  8383 rpcz_store.cc:276] 0709 13:02:33.851435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.963074 (+1111639us) service_pool.cc:224] Handling call
0709 13:02:34.963294 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.963464 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.963490 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.963530 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:34.963572 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.963625 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.963721 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.240518 11760 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.965365 11760 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:34.967589 11760 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:34.913661  8424 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
W20260709 13:02:34.968667  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 55118.2us
I20260709 13:02:34.776957 12062 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:34.969378  8424 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:34.918216  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:34.239344 12228 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:34.970170  8386 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:34.970264 12228 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:34.971123 11957 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:34.971524 11957 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:34.971913 11957 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.972429 12228 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:34.922287  9288 raft_consensus.cc:1240] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:34.956068 12118 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:34.952972  8381 rpcz_store.cc:276] 0709 13:02:33.850473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.951208 (+1100735us) service_pool.cc:224] Handling call
0709 13:02:34.951530 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.952214 (+   684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.952399 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.973351  9288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 898) took 1354 ms. Trace:
I20260709 13:02:34.973791  9288 rpcz_store.cc:276] 0709 13:02:33.619089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.921658 (+1302569us) service_pool.cc:224] Handling call
0709 13:02:34.922055 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.973096 (+ 51041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.973296 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:34.927551  8527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38894 (request call id 2359) took 2431 ms (client timeout 2983 ms). Trace:
I20260709 13:02:34.265684 12187 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:34.929940  8349 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:34.929972  9289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 896) took 1325 ms. Trace:
W20260709 13:02:34.975659  8527 rpcz_store.cc:269] 0709 13:02:32.495714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.914862 (+2419148us) service_pool.cc:224] Handling call
0709 13:02:34.927497 (+ 12635us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:34.976408  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 46559.7us
I20260709 13:02:34.976594 12092 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:34.976783  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:34.976061  9289 rpcz_store.cc:276] 0709 13:02:33.604197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.243725 (+639528us) service_pool.cc:224] Handling call
0709 13:02:34.244067 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.929608 (+685541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.929901 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:34.978736  8349 connection.cc:256] RPC call timeout handler was delayed by -1.0570244799999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
W20260709 13:02:34.979099  8349 connection.cc:256] RPC call timeout handler was delayed by -1.0497362469999985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
I20260709 13:02:34.980047 12154 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:34.980453 12154 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:34.980804 12154 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:34.930482  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:34.963279  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:34.981043  8424 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:34.981666  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 51260.3us
I20260709 13:02:34.982676  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:34.242990 12232 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:34.693928 12131 consensus_meta.cc:287] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.000s
I20260709 13:02:34.931183  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:34.242106 11953 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:34.435298 12226 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.362s	user 0.000s	sys 0.001s
W20260709 13:02:34.444077 12185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.003s	sys 0.004s
W20260709 13:02:34.932456  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 709738us
I20260709 13:02:34.933950 12065 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.935108  9291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 900) took 1307 ms. Trace:
I20260709 13:02:34.944783 12149 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:35.027875  8500 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:34.956125  8385 raft_consensus.cc:1240] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:34.916033 12151 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.983443 11940 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.982923  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:34.984234 11957 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:34.984627  8386 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:34.984704 12062 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:34.985163  9296 rpcz_store.cc:276] 0709 13:02:33.359184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.129682 (+770498us) service_pool.cc:224] Handling call
0709 13:02:34.141723 (+ 12041us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.907886 (+766163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.908171 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.985285 12081 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:35.037889 12154 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:35.039108 12081 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:35.040129 12154 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:35.044409  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:35.045264  8528 raft_consensus.cc:2393] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 11: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:35.045617  9290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 569) took 1916 ms. Trace:
I20260709 13:02:35.035641 11940 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:35.046089  9290 rpcz_store.cc:276] 0709 13:02:33.128933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.129747 (+   814us) service_pool.cc:224] Handling call
0709 13:02:33.130085 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.166545 (+1036460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.045321 (+878776us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b54004ec854. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:35.045521 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2218101120}
I20260709 13:02:35.047699 12179 consensus_queue.cc:260] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:35.048254 11940 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:35.048790 12179 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:35.034377 12151 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:35.054934 12190 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:35.055337 12151 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:35.056332  8386 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:35.056936  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2836) took 1204 ms. Trace:
W20260709 13:02:34.688591  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 458051us
I20260709 13:02:35.057335  8386 rpcz_store.cc:276] 0709 13:02:33.852208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.055891 (+1203683us) service_pool.cc:224] Handling call
0709 13:02:35.056163 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.056713 (+   550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.056882 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.058359 11672 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.058849 11672 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:35.059991  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 2826) took 1210 ms. Trace:
I20260709 13:02:35.060375  8379 rpcz_store.cc:276] 0709 13:02:33.849773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.067806 (+218033us) service_pool.cc:224] Handling call
0709 13:02:35.059815 (+992009us) spinlock_profiling.cc:243] Waited 60.1 ms on lock 0x7b540013c9d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:35.059932 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138205568}
I20260709 13:02:34.986981 11714 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:34.987709 12098 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:34.988162 12229 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:34.989198 12153 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:34.941668  9287 rpcz_store.cc:276] 0709 13:02:33.687197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.938576 (+1251379us) service_pool.cc:224] Handling call
0709 13:02:34.939220 (+   644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.940340 (+  1120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.940738 (+   398us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:34.992350  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.033653 12097 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:34.997048  9295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 891) took 1652 ms. Trace:
I20260709 13:02:34.997259 12186 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:34.997717 12189 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:02:34.996897  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 740343us
I20260709 13:02:35.075613  9295 rpcz_store.cc:276] 0709 13:02:33.345495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.123872 (+778377us) service_pool.cc:224] Handling call
0709 13:02:34.185765 (+ 61893us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.908979 (+723214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.996872 (+ 87893us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b54004948d0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:34.996996 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141631360}
I20260709 13:02:34.996014  9294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 888) took 1681 ms. Trace:
I20260709 13:02:35.065749 12062 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:35.083678  8529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38894 (request call id 2358) took 2588 ms (client timeout 2248 ms). Trace:
I20260709 13:02:35.079196  9294 rpcz_store.cc:276] 0709 13:02:33.314702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.113621 (+798919us) service_pool.cc:224] Handling call
0709 13:02:34.113926 (+   305us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:34.114336 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.114360 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:34.114992 (+   632us) log.cc:844] Serialized 52 byte log entry
0709 13:02:34.196548 (+ 81556us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:34.243615 (+ 47067us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.995410 (+751795us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b1800419500. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c5312c0a 00007f36cea52219 00007f36c539aa40 00007f36c53954e4 00007f36c5395455 00007f36c847d060 00007f36c848f716 00007f36c84a0287 00007f36c84a0208
0709 13:02:34.995608 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.995678 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.995719 (+    41us) raft_consensus.cc:1685] finished
0709 13:02:34.995806 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.995956 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18857,"prepare.queue_time_us":47517,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":777900,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":3472,"spinlock_wait_cycles":28766080,"thread_start_us":81072,"threads_started":1,"wal-append.queue_time_us":140336}
I20260709 13:02:35.088336 11714 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:35.006899  8530 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
W20260709 13:02:35.008250  8531 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2254) took 2157 ms (client timeout 2079 ms). Trace:
I20260709 13:02:35.008981  8534 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:34.390714 12210 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:34.770200 12066 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:35.017670  8459 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.014s	sys 0.031s
I20260709 13:02:34.803212 12127 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:35.018221  8532 raft_consensus.cc:2410] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:02:34.792393 12044 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:34.505471 12119 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:35.029065  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2831) took 1178 ms. Trace:
I20260709 13:02:35.099583  8385 rpcz_store.cc:276] 0709 13:02:33.850963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.955685 (+1104722us) service_pool.cc:224] Handling call
0709 13:02:34.955957 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.028851 (+ 72894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.029021 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:35.021299  8526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2250) took 2199 ms (client timeout 2219 ms). Trace:
I20260709 13:02:35.029609  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:35.101284  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 71724.2us
I20260709 13:02:35.027129  9291 rpcz_store.cc:276] 0709 13:02:33.627892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.934210 (+1306318us) service_pool.cc:224] Handling call
0709 13:02:34.934546 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.934745 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.934784 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.934832 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:34.934873 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.934931 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.935051 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.102699  8500 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:35.104216  8500 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:35.030510  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 2821) took 1182 ms. Trace:
W20260709 13:02:35.031508  8380 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48484 (request call id 613) took 2355 ms (client timeout 1557 ms). Trace:
W20260709 13:02:35.027107 12185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.260s	user 0.003s	sys 0.024s
I20260709 13:02:35.034703  8383 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:35.046317  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:35.061259  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:35.111011  9290 raft_consensus.cc:2393] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 10: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:35.061287 11672 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:35.062520  9296 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:02:35.111359  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:35.065709  8527 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:35.112069  8528 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:34.930601  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:35.113097  8384 raft_consensus.cc:2393] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 11: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:02:34.985888  8535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2245) took 2256 ms (client timeout 2677 ms). Trace:
I20260709 13:02:35.028213 12118 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:34.993644 12091 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:34.996431  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 80237.4us
I20260709 13:02:35.078660  9258 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:34.963454  8382 rpcz_store.cc:276] 0709 13:02:32.340428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.358672 (+ 18244us) service_pool.cc:224] Handling call
0709 13:02:32.359090 (+   418us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:32.412703 (+ 53613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.412734 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:32.413366 (+   632us) log.cc:844] Serialized 52 byte log entry
0709 13:02:32.956558 (+543192us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:33.423902 (+467344us) log.cc:844] Serialized 14 byte log entry
0709 13:02:33.855851 (+431949us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.072743 (+216892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.962710 (+889967us) spinlock_profiling.cc:243] Waited 53.2 ms on lock 0x7b54003b6d54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:34.962758 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.962867 (+   109us) raft_consensus.cc:1685] finished
0709 13:02:34.962881 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.963018 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":483731,"prepare.queue_time_us":254073,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":435164,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":235,"spinlock_wait_cycles":122339328,"thread_start_us":1072716,"threads_started":3,"wal-append.queue_time_us":1214583}
I20260709 13:02:35.134889  8384 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:35.135597  8384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2841) took 1175 ms. Trace:
I20260709 13:02:35.020666 12131 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:35.089318  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2340) took 4298 ms. Trace:
W20260709 13:02:35.135871  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 57326.1us
W20260709 13:02:35.089496  8530 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38894 (request call id 2361) took 2593 ms (client timeout 2725 ms). Trace:
W20260709 13:02:35.089468  8531 rpcz_store.cc:269] 0709 13:02:32.851262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.962738 (+1111476us) service_pool.cc:224] Handling call
0709 13:02:35.008044 (+1045306us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x7b5400077bd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:35.008176 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88382208}
W20260709 13:02:35.090579  8529 rpcz_store.cc:269] 0709 13:02:32.495446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.494620 (+999174us) service_pool.cc:224] Handling call
0709 13:02:35.083395 (+1588775us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b5400169254. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:35.083582 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1153661184}
I20260709 13:02:35.093590  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2840) took 1203 ms. Trace:
W20260709 13:02:35.095854  8459 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.014s	sys 0.032s
W20260709 13:02:35.097047  8532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38894 (request call id 2355) took 2602 ms (client timeout 3246 ms). Trace:
W20260709 13:02:35.140228  8532 rpcz_store.cc:269] 0709 13:02:32.494667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.918169 (+2423502us) service_pool.cc:224] Handling call
0709 13:02:35.096986 (+178817us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:35.100744  8526 rpcz_store.cc:269] 0709 13:02:32.821843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.143535 (+1321692us) service_pool.cc:224] Handling call
0709 13:02:35.021158 (+877623us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b54000aa354. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:35.021250 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35022592}
I20260709 13:02:35.143472  8526 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:02:35.143916  8534 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:35.144337  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2344) took 2652 ms. Trace:
W20260709 13:02:35.031070  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 48219.5us
I20260709 13:02:35.145632 12186 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:35.145747  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:35.146867 12119 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:35.147149  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:35.118902 12210 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:35.114078 12151 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:35.148705 12127 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:35.136330 12118 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:35.149133 12127 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:35.149565 12127 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:35.149901  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:35.105392  8380 rpcz_store.cc:269] 0709 13:02:32.677304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.677434 (+   130us) service_pool.cc:224] Handling call
0709 13:02:35.031328 (+2353894us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b5400269b54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:35.031449 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1136938880}
I20260709 13:02:35.105244  8377 rpcz_store.cc:276] 0709 13:02:33.848477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.848619 (+   142us) service_pool.cc:224] Handling call
0709 13:02:35.020716 (+1172097us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54002cbd54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:35.030450 (+  9734us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615927552}
I20260709 13:02:35.085870 12062 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:35.084710 12189 raft_consensus.cc:697] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:35.067135  9293 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
W20260709 13:02:35.113443  8535 rpcz_store.cc:269] 0709 13:02:32.700863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.207580 (+1506717us) service_pool.cc:224] Handling call
0709 13:02:34.957471 (+749891us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.153980  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:35.154140  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:35.154592  8535 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:35.115491  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2834) took 1263 ms. Trace:
I20260709 13:02:35.155246  8529 raft_consensus.cc:2393] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:35.070894 12157 consensus_queue.cc:237] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:35.103978 12229 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:35.157958  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:35.158725  8385 raft_consensus.cc:1240] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:35.159032  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:35.138633  8530 rpcz_store.cc:269] 0709 13:02:32.496200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.143460 (+1647260us) service_pool.cc:224] Handling call
0709 13:02:35.089439 (+945979us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.160024  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:35.150846  8531 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:35.160524  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2844) took 1018 ms. Trace:
I20260709 13:02:35.160539  8535 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:35.160934  8380 rpcz_store.cc:276] 0709 13:02:34.142072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.159806 (+1017734us) service_pool.cc:224] Handling call
0709 13:02:35.160064 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.160241 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.160266 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.160305 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:35.160336 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.160386 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.160475 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.144764  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47306 (request call id 783) took 1045 ms. Trace:
I20260709 13:02:35.151499  8351 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:35.135912  8384 rpcz_store.cc:276] 0709 13:02:33.960213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.114318 (+1154105us) service_pool.cc:224] Handling call
0709 13:02:35.134716 (+ 20398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.135355 (+   639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.135549 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.144964  8526 rpcz_store.cc:276] 0709 13:02:32.491861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.142734 (+2650873us) service_pool.cc:224] Handling call
0709 13:02:35.143160 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:35.143998 (+   838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.144265 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.162582  8534 rpcz_store.cc:276] 0709 13:02:34.099702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.982221 (+882519us) service_pool.cc:224] Handling call
0709 13:02:35.144672 (+162451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.163883  8526 raft_consensus.cc:1240] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:35.033048 12228 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:35.171345  9293 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 545) took 1966 ms (client timeout 2091 ms). Trace:
I20260709 13:02:35.172506  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:35.172956  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:35.173506  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2842) took 1211 ms. Trace:
I20260709 13:02:35.174220  9295 raft_consensus.cc:2393] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 11: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:35.174104  8385 rpcz_store.cc:276] 0709 13:02:33.963471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.118648 (+1155177us) service_pool.cc:224] Handling call
0709 13:02:35.158526 (+ 39878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.159090 (+   564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.173452 (+ 14362us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.155514  8383 rpcz_store.cc:276] 0709 13:02:33.851706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.965063 (+1113357us) service_pool.cc:224] Handling call
0709 13:02:35.034537 (+ 69474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.110609 (+ 76072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.115244 (+  4635us) spinlock_profiling.cc:243] Waited 51.5 ms on lock 0x7b54003b7750. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:35.115419 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118524160}
I20260709 13:02:35.114583 11760 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:35.164405  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 127794us
I20260709 13:02:35.137202  8533 rpcz_store.cc:276] 0709 13:02:30.791421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.421240 (+1629819us) service_pool.cc:224] Handling call
0709 13:02:32.443946 (+ 22706us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:32.448851 (+  4905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.448893 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:32.457191 (+  8298us) log.cc:844] Serialized 52 byte log entry
0709 13:02:33.115502 (+658311us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:33.115548 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.115622 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.068652 (+953030us) spinlock_profiling.cc:243] Waited 7.34 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:35.081300 (+1012648us) raft_consensus.cc:1685] finished
0709 13:02:35.081331 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.089238 (+  7907us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4384,"raft.queue_time_us":5212,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5057,"spinlock_wait_cycles":16874752,"thread_start_us":605240,"threads_started":1,"wal-append.queue_time_us":823074}
I20260709 13:02:35.175392  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:02:35.178224  8426 connection.cc:256] RPC call timeout handler was delayed by -1.3688454730000217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 13:02:35.178751  8426 connection.cc:256] RPC call timeout handler was delayed by -1.2842454729999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
I20260709 13:02:35.178946  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:02:35.171919  9293 rpcz_store.cc:269] 0709 13:02:33.205267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.715677 (+510410us) service_pool.cc:224] Handling call
0709 13:02:35.171135 (+1455458us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54004ea7d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:35.171276 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2915777408}
W20260709 13:02:35.179965  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.168200  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:35.169435  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:35.169579  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:35.133826  9260 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:35.180923  8529 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:35.181100  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:35.181836  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:35.175879  8535 raft_consensus.cc:1275] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:02:35.182569  8535 pending_rounds.cc:85] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 3
I20260709 13:02:35.182919  8535 pending_rounds.cc:107] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:02:35.183399  8535 raft_consensus.cc:2889] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:35.183713  9291 raft_consensus.cc:2368] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10.
I20260709 13:02:35.184362  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2348) took 2691 ms. Trace:
I20260709 13:02:35.184865  8535 rpcz_store.cc:276] 0709 13:02:32.492797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.161659 (+2668862us) service_pool.cc:224] Handling call
0709 13:02:35.161996 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.184046 (+ 22050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.184293 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.186944  8351 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:35.181697  9290 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:35.188685  8500 leader_election.cc:400] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10.
I20260709 13:02:35.165735  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2349) took 2672 ms. Trace:
I20260709 13:02:35.190399  8526 rpcz_store.cc:276] 0709 13:02:32.493022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.163283 (+2670261us) service_pool.cc:224] Handling call
0709 13:02:35.163638 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.165409 (+  1771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.165653 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:35.179651  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.181614  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 47875.2us
I20260709 13:02:35.173502  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:35.193050  9289 raft_consensus.cc:2376] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11. Re-sending same reply.
W20260709 13:02:35.193800  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.194114  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:35.147255 12119 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:35.195658  8500 leader_election.cc:403] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:35.196439  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2347) took 2703 ms. Trace:
I20260709 13:02:35.196820  8530 rpcz_store.cc:276] 0709 13:02:32.492553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.159909 (+2667356us) service_pool.cc:224] Handling call
0709 13:02:35.195981 (+ 36072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.196148 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.196174 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.196215 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:35.196244 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.196291 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.196390 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.198279  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:35.199396  8351 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:35.167066  8527 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:35.155220  9258 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:35.189673  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:35.196128  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.202185  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:02:35.202764  8426 connection.cc:256] RPC call timeout handler was delayed by -1.1324409630000218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
I20260709 13:02:35.154647  8379 rpcz_store.cc:276] 0709 13:02:33.889820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.077506 (+1187686us) service_pool.cc:224] Handling call
0709 13:02:35.092896 (+ 15390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.093156 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.093194 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.093259 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:35.093307 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.093380 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.093518 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:35.201522  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 46392.6us
I20260709 13:02:35.200814  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:35.205672  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:35.209583  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:35.209969  8531 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:35.210371  9293 raft_consensus.cc:2393] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 9: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:35.170660 12185 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.204917  9258 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:35.205649  9287 raft_consensus.cc:2376] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11. Re-sending same reply.
I20260709 13:02:35.214277  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:35.224493  9261 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:35.217432  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:35.219650  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.217515  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:35.220176  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:35.218142  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:35.227072  8458 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:35.227612  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:35.227882  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:35.217784  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:35.227689  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:35.228935  8456 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:35.170971 12228 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:35.224964  9291 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:35.131953 12227 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:02:35.247916  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:35.228144 12224 consensus_queue.cc:1059] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:35.228542  8454 raft_consensus.cc:2410] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:35.192016 12066 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:35.230134  9261 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:35.191253 12190 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:35.352771  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:35.203006 12098 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:35.232743  8383 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:35.215493  8500 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:35.195598 11760 raft_consensus.cc:697] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 8 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:35.360642  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:35.361176 12224 raft_consensus.cc:3055] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:35.361485 11760 consensus_queue.cc:237] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:35.222152  8283 catalog_manager.cc:5697] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:35.238816  8379 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:35.212884 11672 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:35.365717  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 627) took 1196 ms. Trace:
I20260709 13:02:35.222468 11801 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:35.241775  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2846) took 1071 ms. Trace:
I20260709 13:02:35.239246  8533 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:02:35.242462  8459 raft_consensus.cc:1240] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:35.372522  8380 rpcz_store.cc:276] 0709 13:02:34.170505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.240719 (+1070214us) service_pool.cc:224] Handling call
0709 13:02:35.241114 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.241339 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.241376 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.241433 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:35.241487 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.241560 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.241695 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.349812  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:35.353061  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 120999us
W20260709 13:02:35.353308  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 123288us
I20260709 13:02:35.378444  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:35.201550 12119 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:35.378963  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2360) took 2883 ms. Trace:
I20260709 13:02:35.379428  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:35.379376  8533 rpcz_store.cc:276] 0709 13:02:32.495947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.203449 (+2707502us) service_pool.cc:224] Handling call
0709 13:02:35.238939 (+ 35490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:35.378697 (+139758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.378912 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.204873 12153 raft_consensus.cc:2764] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:35.211191 11940 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:35.357697  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 628) took 1188 ms. Trace:
I20260709 13:02:35.350368 12219 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.391338  8383 rpcz_store.cc:276] 0709 13:02:34.169786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.231983 (+1062197us) service_pool.cc:224] Handling call
0709 13:02:35.232327 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.357362 (+125035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.357626 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:35.357959  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 142544us
I20260709 13:02:35.366050  8379 rpcz_store.cc:276] 0709 13:02:34.169133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.203755 (+1034622us) service_pool.cc:224] Handling call
0709 13:02:35.238634 (+ 34879us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.365465 (+126831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.365661 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.205025 11714 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:35.395915 11714 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.396414 11714 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:35.221647 12199 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:35.349879  8455 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:35.397370 12093 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:02:35.397722  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:35.380396  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:35.399439  9290 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
W20260709 13:02:35.400602  8527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2261) took 2307 ms (client timeout 2889 ms). Trace:
I20260709 13:02:35.400776  8528 raft_consensus.cc:1240] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:02:35.400871  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 1.15586e+06us
W20260709 13:02:35.401014  8527 rpcz_store.cc:269] 0709 13:02:33.093428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.976553 (+1883125us) service_pool.cc:224] Handling call
0709 13:02:35.400411 (+423858us) spinlock_profiling.cc:243] Waited 88.2 ms on lock 0x7b54000f87d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:35.400537 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202900864}
I20260709 13:02:35.226155 12044 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10.
I20260709 13:02:35.383157  8351 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:35.367517  8283 catalog_manager.cc:5697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 5 to 7, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 7 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.231700 11953 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:35.364774 12136 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:35.386894  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:35.420693  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.230856 12210 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:35.354420 12228 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:35.351317 12063 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:35.354569 12229 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.395071  8500 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:35.406874  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:35.407783  8455 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:02:35.407300  8283 catalog_manager.cc:5697] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 6 to 10, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 10 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.358158 12187 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:35.444749  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 49753us
I20260709 13:02:35.408855  8527 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:35.406847  8351 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:35.423220  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:35.361522 12224 raft_consensus.cc:740] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:35.231177 12185 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:35.431821  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:35.437577  8530 raft_consensus.cc:2393] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
W20260709 13:02:35.455961  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 49343.2us
I20260709 13:02:35.447429  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2363) took 2870 ms. Trace:
I20260709 13:02:35.413753 12093 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:35.477747  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2342) took 2986 ms. Trace:
I20260709 13:02:35.478552  8351 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:35.479475 12144 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:35.479612  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:35.479969 12144 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.480333 12144 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:35.480966  8351 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:35.482486  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:35.486900 12086 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:35.480966 12153 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:35.487640 12086 raft_consensus.cc:697] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:35.488914 12086 consensus_queue.cc:237] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:35.438858  8283 catalog_manager.cc:5697] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 6 to 9, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 9 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:02:35.493045  8283 catalog_manager.cc:5697] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 4 to 7, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 7 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:35.495138  8283 catalog_manager.cc:5697] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:02:35.478363  8528 rpcz_store.cc:276] 0709 13:02:32.491359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.118470 (+2627111us) service_pool.cc:224] Handling call
0709 13:02:35.400542 (+282072us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:35.401307 (+   765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.477461 (+ 76154us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54000f87d0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:35.477666 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615571840}
W20260709 13:02:35.502197  8381 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.022s	sys 0.042s
W20260709 13:02:35.502753  8381 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.023s	sys 0.042s
I20260709 13:02:35.507472  9294 raft_consensus.cc:2393] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 11: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
W20260709 13:02:35.427323 12241 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
W20260709 13:02:35.524883  8378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.003s	sys 0.034s
W20260709 13:02:35.525537  8378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.003s	sys 0.034s
W20260709 13:02:35.432957 12133 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.274s	user 0.007s	sys 0.021s
I20260709 13:02:35.527803  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:35.384218 11672 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:35.528662  8459 raft_consensus.cc:2393] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 9: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:35.529464  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:35.529510  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2837) took 1677 ms. Trace:
I20260709 13:02:35.531041  8386 rpcz_store.cc:276] 0709 13:02:33.852470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.058261 (+1205791us) service_pool.cc:224] Handling call
0709 13:02:35.058600 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.058789 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:35.223377 (+164588us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.529061 (+305684us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.529144 (+    83us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:35.529216 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.529302 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.529441 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":416601,"thread_start_us":469083,"threads_started":2}
I20260709 13:02:35.432126 11953 raft_consensus.cc:697] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:35.414198 12136 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:35.409619 11957 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:35.409174 12199 raft_consensus.cc:697] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:35.532963  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:35.412566 12234 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 13:02:35.534016  9288 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:35.534446  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:35.567317  8384 raft_consensus.cc:2410] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:02:35.569267  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.531167  9287 raft_consensus.cc:2955] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 2 to 7, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:35.473987 11940 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:35.510442 12063 raft_consensus.cc:697] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:02:35.543977 12243 log.cc:927] Time spent T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.436s	user 0.000s	sys 0.001s
I20260709 13:02:35.510742 12093 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.437542 12210 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:35.496979  8283 catalog_manager.cc:5697] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 2 to 4, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 4 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
W20260709 13:02:35.539446 12133 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.381s	user 0.007s	sys 0.022s
I20260709 13:02:35.566308  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:35.587147  8459 raft_consensus.cc:2393] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:35.413832 12219 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:35.508836  8527 rpcz_store.cc:276] 0709 13:02:32.577555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.402125 (+2824570us) service_pool.cc:224] Handling call
0709 13:02:35.402503 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.447100 (+ 44597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.447370 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.606122  8527 raft_consensus.cc:1240] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:35.606920  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 778) took 2753 ms. Trace:
I20260709 13:02:35.607300  8527 rpcz_store.cc:276] 0709 13:02:32.853681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.605510 (+2751829us) service_pool.cc:224] Handling call
0709 13:02:35.605899 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.606624 (+   725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.606855 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:35.556715 12130 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.727s	user 0.027s	sys 0.054s
I20260709 13:02:35.465359 12229 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:35.577867  8530 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:35.627919  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:35.392946 12189 consensus_queue.cc:237] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:35.509723 12186 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:02:35.580344  9261 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:35.545845 12136 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:35.583777  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:35.645344  8379 raft_consensus.cc:2393] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 9: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:35.584609  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:35.650368  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 70088.5us
I20260709 13:02:35.533601 11930 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:35.584242  8283 catalog_manager.cc:5697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 7 to 8, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 8 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
W20260709 13:02:35.592481  8349 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.000s	sys 0.008s
W20260709 13:02:35.660667  8349 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.000s	sys 0.008s
W20260709 13:02:35.661257  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 681563us
W20260709 13:02:35.592842  8424 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.005s	sys 0.003s
W20260709 13:02:35.594449  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.603976  8426 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:35.604341  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.608927  8527 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:35.667461  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 779) took 2807 ms. Trace:
I20260709 13:02:35.667918  8527 rpcz_store.cc:276] 0709 13:02:32.860368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.608160 (+2747792us) service_pool.cc:224] Handling call
0709 13:02:35.608497 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.667099 (+ 58602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.667386 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.573177 11940 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.624687 11672 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:35.623464  9288 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:35.628659  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2253) took 2783 ms. Trace:
I20260709 13:02:35.513985 12179 consensus_queue.cc:1059] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:02:35.581427 12093 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:35.604596 12092 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.007s	sys 0.001s
I20260709 13:02:35.638342  8459 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:35.583662 12131 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:35.621383 12130 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.799s	user 0.028s	sys 0.055s
W20260709 13:02:35.665372  8424 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.005s	sys 0.003s
W20260709 13:02:35.685315  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 704288us
I20260709 13:02:35.686782  8424 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:35.669678  8527 raft_consensus.cc:2955] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 2 to 7, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:02:35.672528  8382 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.010s	sys 0.037s
I20260709 13:02:35.662724  8283 catalog_manager.cc:5697] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 5 to 8, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 8 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:35.676895  8530 rpcz_store.cc:276] 0709 13:02:32.845281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.557536 (+2712255us) service_pool.cc:224] Handling call
0709 13:02:35.577610 (+ 20074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:35.628321 (+ 50711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.628586 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:35.677443  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 73601.6us
I20260709 13:02:35.685758 11957 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:35.681346 12091 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.708164 12091 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:35.713150 12091 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:35.715202  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2258) took 2829 ms. Trace:
I20260709 13:02:35.715842  8530 rpcz_store.cc:276] 0709 13:02:32.885794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.714191 (+2828397us) service_pool.cc:224] Handling call
0709 13:02:35.714581 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.714804 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.714827 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.714863 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:35.714892 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.715045 (+   153us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.715153 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:35.707252  8426 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:35.718739  8426 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:35.719748 11672 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:35.720398 11672 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:35.720714 11672 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:35.708714  8283 catalog_manager.cc:5697] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
W20260709 13:02:35.683564 12092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.007s	sys 0.001s
I20260709 13:02:35.709986 11957 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:35.721064 11672 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:35.721428 11957 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:35.721879 11957 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:35.725440  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2835) took 1873 ms. Trace:
W20260709 13:02:35.710062  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.573212 12224 consensus_queue.cc:260] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:35.702471 11801 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.676172 11940 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:35.710740  8382 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.011s	sys 0.038s
I20260709 13:02:35.730486  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:35.682734 12232 consensus_meta.cc:287] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.664s	user 0.011s	sys 0.000s
I20260709 13:02:35.736456 11672 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:35.733992 12092 raft_consensus.cc:697] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:35.762470  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.685544 12130 raft_consensus.cc:697] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:35.726027  8381 rpcz_store.cc:276] 0709 13:02:33.851951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.974258 (+1122307us) service_pool.cc:224] Handling call
0709 13:02:34.974579 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.974766 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:35.509129 (+534363us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.724393 (+215264us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.725003 (+   610us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.725061 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:35.725145 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.725227 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.725372 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":428998,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":2395,"raft.queue_time_us":1116,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":147,"thread_start_us":742469,"threads_started":2}
W20260709 13:02:35.748582 12149 consensus_meta.cc:287] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.718s	user 0.011s	sys 0.000s
I20260709 13:02:35.811798  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 773) took 3292 ms. Trace:
W20260709 13:02:35.816867  8427 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.002s	sys 0.006s
W20260709 13:02:35.817705  8427 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.003s	sys 0.006s
I20260709 13:02:35.814303  8531 rpcz_store.cc:276] 0709 13:02:32.519356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.210772 (+2691416us) service_pool.cc:224] Handling call
0709 13:02:35.211040 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.213651 (+  2611us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:35.559400 (+345749us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.811417 (+252017us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.811471 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:35.811525 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.811591 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.811721 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":474,"prepare.queue_time_us":530408,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":2201,"thread_start_us":480936,"threads_started":2}
W20260709 13:02:35.822096  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 375611us
W20260709 13:02:35.824033  8500 leader_election.cc:336] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.649s (SENT)
W20260709 13:02:35.824632  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.825001  8500 leader_election.cc:336] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.706s (SENT)
I20260709 13:02:35.827342  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:35.738763 12178 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:35.665321 12227 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.745170  8386 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:35.746675  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2343) took 3255 ms. Trace:
I20260709 13:02:35.749356 11801 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:35.745124  9292 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.002s	sys 0.016s
I20260709 13:02:35.722018  8283 catalog_manager.cc:5697] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 7 to 10, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 10 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:02:35.847261  8283 catalog_manager.cc:5697] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 5 to 7, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 7 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
W20260709 13:02:35.756426 12127 consensus_meta.cc:287] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.606s	user 0.007s	sys 0.003s
W20260709 13:02:35.856235  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 145641us
I20260709 13:02:35.758327  8385 raft_consensus.cc:2410] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:35.662909 12187 consensus_queue.cc:1059] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:02:35.677523 11953 consensus_queue.cc:237] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:35.828761  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:35.863865  8381 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:35.837486  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.864246  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2257) took 2986 ms. Trace:
I20260709 13:02:35.727684 12063 consensus_queue.cc:237] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:35.845463  9292 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.003s	sys 0.016s
I20260709 13:02:35.852751  8283 catalog_manager.cc:5697] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:02:35.857035  8424 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:35.857311  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 114163us
I20260709 13:02:35.861706  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:35.875190  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:35.875250  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 204181us
I20260709 13:02:35.875953  8379 raft_consensus.cc:2393] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 9: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:35.864693  8527 rpcz_store.cc:276] 0709 13:02:32.877669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.668890 (+2791221us) service_pool.cc:224] Handling call
0709 13:02:35.669298 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.669543 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:35.737228 (+ 67685us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.863923 (+126695us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.863971 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:35.864011 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.864074 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.864194 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":126279,"threads_started":1}
W20260709 13:02:35.827875 12236 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.003s	sys 0.024s
I20260709 13:02:35.845214  8532 rpcz_store.cc:276] 0709 13:02:32.491631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.141192 (+2649561us) service_pool.cc:224] Handling call
0709 13:02:35.141550 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.141835 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:35.536409 (+394574us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.746221 (+209812us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.746287 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:35.746364 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.746447 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.746606 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":560684,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":11197,"raft.queue_time_us":11132,"raft.run_wall_time_us":30784,"spinlock_wait_cycles":30251264,"thread_start_us":570469,"threads_started":2}
I20260709 13:02:35.867137  8453 raft_consensus.cc:1240] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:35.873521  8283 catalog_manager.cc:5697] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 6 to 8, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 8 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.868081  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:35.868883  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:35.731547 12199 consensus_queue.cc:237] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:35.875636  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 70455.6us
I20260709 13:02:35.787456 12091 consensus_queue.cc:1059] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:02:35.884308  8349 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:35.882236  8283 catalog_manager.cc:5697] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 8 to 9, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 9 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:02:35.881909  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:35.891451  8424 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:35.892455  8452 raft_consensus.cc:1240] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:35.898588  8283 catalog_manager.cc:5697] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 7 to 8, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 8 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:02:35.900748  8283 catalog_manager.cc:5697] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 6 to 9, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 9 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
W20260709 13:02:35.904170  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 193448us
I20260709 13:02:35.907912  8379 raft_consensus.cc:2393] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:35.908852  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:35.927520  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:35.927775  8500 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:35.889981 12236 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.004s	sys 0.024s
I20260709 13:02:35.939705  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:35.932024  8381 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:35.941247  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:35.941955  8381 raft_consensus.cc:2393] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 9: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:35.913899  8283 catalog_manager.cc:5697] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 5 to 7, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 7 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:02:35.829902 12097 consensus_queue.cc:1059] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:02:35.947535  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:35.948465  8384 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
W20260709 13:02:35.955794  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.880779 12185 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:35.960721  8501 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:35.961972  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2246) took 3260 ms. Trace:
I20260709 13:02:35.962636  8501 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:35.962726  8526 rpcz_store.cc:276] 0709 13:02:32.701068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.501940 (+2800872us) service_pool.cc:224] Handling call
0709 13:02:35.502300 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.502499 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:35.745022 (+242523us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.961373 (+216351us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.961456 (+    83us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:35.961552 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.961677 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.961883 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":316191,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"thread_start_us":440880,"threads_started":2}
I20260709 13:02:35.966220  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:35.865309 12186 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:02:35.829965 12260 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 13:02:35.869490 12133 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:02:35.890426 12118 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:35.864336 12127 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:35.974684  8501 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:35.864497 12227 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:35.988309  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:35.997836  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 178834us
I20260709 13:02:35.950292 12264 raft_consensus.cc:3055] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:35.953097 11760 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:35.958292 12179 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.966516 12098 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:36.001148  8379 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:02:35.951155 12210 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:35.934063 12065 consensus_queue.cc:1059] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:02:36.000020 12151 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:36.020336  8427 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:36.001262  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:36.004379  8501 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:35.901954 12092 consensus_queue.cc:237] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:35.989233 12234 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:36.003916  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 119691us
I20260709 13:02:36.028636  8349 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:36.000424 12219 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:36.031296  8526 raft_consensus.cc:2393] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 11: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:35.910820 12130 consensus_queue.cc:237] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:36.032564  8501 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:36.036839  8349 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:36.031961  9287 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:36.039484  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:36.041273  8379 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:02:36.002262 12264 raft_consensus.cc:740] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:36.014912 12117 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:36.048585  8501 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:36.039484 12249 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.336s	user 0.001s	sys 0.001s
I20260709 13:02:36.061014 12287 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:36.061339 12277 log.cc:927] Time spent T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:02:36.061554 12151 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:02:36.062175 12256 log.cc:927] Time spent T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:02:36.040616 12252 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:36.053097 12234 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:36.064970 12234 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.065388 12234 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:36.053974  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.026299 11760 raft_consensus.cc:697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 9 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:36.018805 12179 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:36.059372  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:36.059841 12268 log.cc:927] Time spent T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:02:36.041456 12098 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:36.060320 12248 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:36.060628 12269 log.cc:927] Time spent T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:02:35.985862 11957 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:36.061942  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2827) took 2212 ms. Trace:
I20260709 13:02:36.091679  8378 rpcz_store.cc:276] 0709 13:02:33.850002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.957857 (+1107855us) service_pool.cc:224] Handling call
0709 13:02:34.958170 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.958485 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.958512 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:34.959006 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.526078 (+567072us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:35.526138 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.526254 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.061692 (+535438us) raft_consensus.cc:1685] finished
0709 13:02:36.061711 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.061871 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11049,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":566592,"threads_started":1,"wal-append.queue_time_us":628077}
I20260709 13:02:36.005760 12286 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:36.029786 12097 consensus_queue.cc:1059] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:02:36.041214 11672 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:36.068298 12086 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:36.043746 12136 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:36.094580 12258 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 13:02:36.061563 12287 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:36.070712  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 179344us
I20260709 13:02:36.079053  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:36.087460  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:36.055536 12117 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:36.097889  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 207196us
I20260709 13:02:36.074100 12091 raft_consensus.cc:3055] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:36.112211  8424 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:36.056838  8349 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:36.125959  8526 raft_consensus.cc:2393] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 6: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:36.142383  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:36.144613  8526 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 7 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:02:36.080204 12248 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:02:36.149974  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.194941  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2370) took 2075 ms. Trace:
W20260709 13:02:36.157546  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 100775us
I20260709 13:02:36.096020 12098 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:36.167557  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.096400 12260 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:36.186512  8530 raft_consensus.cc:1240] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:36.187004  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 57546.4us
I20260709 13:02:36.126313 12210 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:36.187363  8533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.000s	sys 0.028s
I20260709 13:02:36.151157 12091 raft_consensus.cc:740] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:36.211985  8533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.000s	sys 0.031s
I20260709 13:02:36.174839 12118 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.198899  8349 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:36.223203  8349 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:36.224462  8349 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:36.225667 12283 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:36.148545 12117 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:36.100271 12133 consensus_queue.cc:1059] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
W20260709 13:02:36.187454  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 75351.9us
I20260709 13:02:36.125762 12287 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:36.195415  8526 rpcz_store.cc:276] 0709 13:02:34.119682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.143751 (+2024069us) service_pool.cc:224] Handling call
0709 13:02:36.144206 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:36.189168 (+ 44962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.194876 (+  5708us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.172750 12086 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:36.227368 12086 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.227751 12086 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:36.227866  8424 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:36.218813  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2847) took 1264 ms. Trace:
W20260709 13:02:36.220412  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.183517 12097 raft_consensus.cc:3055] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:36.229463  8380 rpcz_store.cc:276] 0709 13:02:34.954343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.373799 (+419456us) service_pool.cc:224] Handling call
0709 13:02:35.374190 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:35.381450 (+  7260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.381497 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:35.407615 (+ 26118us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.700098 (+292483us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:35.700139 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.700216 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.218562 (+518346us) raft_consensus.cc:1685] finished
0709 13:02:36.218583 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.218741 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10784,"raft.queue_time_us":7219,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":16337,"thread_start_us":198519,"threads_started":1,"wal-append.queue_time_us":383388}
I20260709 13:02:36.180863 11930 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:36.241159  8526 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:36.241732 12133 raft_consensus.cc:3055] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:36.242167 12133 raft_consensus.cc:740] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:36.242235  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2371) took 2122 ms. Trace:
I20260709 13:02:36.242776  8526 rpcz_store.cc:276] 0709 13:02:34.120000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.240579 (+2120579us) service_pool.cc:224] Handling call
0709 13:02:36.240956 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.241929 (+   973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.242180 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.243016 12133 consensus_queue.cc:260] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:36.244323 12253 log.cc:927] Time spent T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:02:36.244445  8526 raft_consensus.cc:1240] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:02:36.245496 12288 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:02:36.245867  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2374) took 2125 ms. Trace:
W20260709 13:02:36.246572 12279 log.cc:927] Time spent T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:36.247202 12091 consensus_queue.cc:260] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:36.196380 11672 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:36.248078  8526 rpcz_store.cc:276] 0709 13:02:34.120959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.243776 (+2122817us) service_pool.cc:224] Handling call
0709 13:02:36.244211 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:36.245006 (+   795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.245808 (+   802us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.201402 12248 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:36.249614  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2843) took 2273 ms. Trace:
I20260709 13:02:36.249459  8424 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:36.249794  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2375) took 2118 ms. Trace:
I20260709 13:02:36.263232  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:36.262548  8382 rpcz_store.cc:276] 0709 13:02:33.976403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.135473 (+1159070us) service_pool.cc:224] Handling call
0709 13:02:35.135752 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:35.136112 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.136144 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:35.136623 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.745042 (+608419us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:35.745102 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.745170 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.249425 (+504255us) raft_consensus.cc:1685] finished
0709 13:02:36.249442 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.249557 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":100,"thread_start_us":608120,"threads_started":1,"wal-append.queue_time_us":957801}
I20260709 13:02:36.266610  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:36.268790  9260 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:36.263769  8526 rpcz_store.cc:276] 0709 13:02:34.131800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.249055 (+2117255us) service_pool.cc:224] Handling call
0709 13:02:36.249339 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.249503 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.249526 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:36.249565 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:36.249597 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.249648 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.249749 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.275697  8526 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:36.260407  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 774) took 3740 ms. Trace:
I20260709 13:02:36.276672  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2376) took 2125 ms. Trace:
I20260709 13:02:36.277333  8526 rpcz_store.cc:276] 0709 13:02:34.151283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.275085 (+2123802us) service_pool.cc:224] Handling call
0709 13:02:36.275474 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.276345 (+   871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.276600 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.282754  8526 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:02:36.276360  8533 rpcz_store.cc:276] 0709 13:02:32.519652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.380264 (+2860612us) service_pool.cc:224] Handling call
0709 13:02:35.412923 (+ 32659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.413174 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:35.657903 (+244729us) log.cc:844] Serialized 14 byte log entry
0709 13:02:36.260012 (+602109us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:36.260073 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:36.260134 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.260208 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.260338 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":393660,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"thread_start_us":816288,"threads_started":3}
W20260709 13:02:36.236235 11714 consensus_meta.cc:287] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.839s	user 0.011s	sys 0.000s
I20260709 13:02:36.284566  8526 pending_rounds.cc:85] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 6
I20260709 13:02:36.284904  8526 pending_rounds.cc:107] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:02:36.285261  8526 raft_consensus.cc:2889] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:36.286012  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2263) took 1157 ms. Trace:
I20260709 13:02:36.235505 12232 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:36.287770  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:36.244521 12133 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:36.240409 12097 raft_consensus.cc:740] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:36.233349 11801 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:36.248139 12149 raft_consensus.cc:3055] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:02:36.305050  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 277570us
I20260709 13:02:36.196942 12286 consensus_queue.cc:1059] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:02:36.286499  8526 rpcz_store.cc:276] 0709 13:02:35.128516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.278582 (+1150066us) service_pool.cc:224] Handling call
0709 13:02:36.278907 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.285750 (+  6843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.285959 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.347553  8533 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:36.353237  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 787) took 1129 ms. Trace:
I20260709 13:02:36.353621  8533 rpcz_store.cc:276] 0709 13:02:35.224161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.285789 (+1061628us) service_pool.cc:224] Handling call
0709 13:02:36.347360 (+ 61571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.352937 (+  5577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.353183 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.263819 11930 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:36.288832 12119 consensus_meta.cc:287] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.893s	user 0.009s	sys 0.003s
I20260709 13:02:36.326686 11672 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:36.209962 12098 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:36.235177 12118 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:36.346974 12149 raft_consensus.cc:740] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:36.326685 12127 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:36.197909 11760 consensus_queue.cc:237] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:36.326284 12283 raft_consensus.cc:697] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:36.325760 12232 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:36.373826  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 147761us
I20260709 13:02:36.248973 12299 consensus_queue.cc:1059] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.124s
I20260709 13:02:36.282191 12186 consensus_queue.cc:1059] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:02:36.202625 12264 consensus_queue.cc:260] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:36.250177 12210 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:36.479972 12210 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:36.481315 12312 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:36.482630 12186 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:36.483309 12186 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:36.485935 12280 raft_consensus.cc:3055] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:36.486474 12280 raft_consensus.cc:740] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:36.487514 12280 consensus_queue.cc:260] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:36.441752 12292 consensus_queue.cc:1059] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
W20260709 13:02:36.360726  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 92022.4us
I20260709 13:02:36.352357 12091 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:36.378765  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:36.356410 11801 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:36.391821 11672 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:36.325923 11714 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:36.456467  8349 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:36.466918  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:36.373266 12119 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:36.471046 12299 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:36.546093  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:36.547132  8382 raft_consensus.cc:2393] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 8: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:36.547438  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2368) took 2428 ms. Trace:
I20260709 13:02:36.484730 12293 raft_consensus.cc:3055] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:36.492291  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2354) took 3998 ms. Trace:
I20260709 13:02:36.557678  8534 rpcz_store.cc:276] 0709 13:02:32.494233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.163468 (+2669235us) service_pool.cc:224] Handling call
0709 13:02:35.163768 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:35.164112 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.164138 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:35.504253 (+340115us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b2c0003cae8. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2
0709 13:02:35.511327 (+  7074us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.854140 (+342813us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:35.982354 (+128214us) log.cc:844] Serialized 14 byte log entry
0709 13:02:36.000767 (+ 18413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.000853 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.489883 (+489030us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b180042bda0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:02:36.492088 (+  2205us) raft_consensus.cc:1685] finished
0709 13:02:36.492109 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.492233 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":132153,"prepare.queue_time_us":118466,"prepare.run_cpu_time_us":6723,"prepare.run_wall_time_us":14995,"raft.queue_time_us":26565,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":13359,"spinlock_wait_cycles":127133184,"thread_start_us":287535,"threads_started":1,"wal-append.queue_time_us":465576}
I20260709 13:02:36.493448  8380 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:36.483314  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2356) took 3988 ms. Trace:
I20260709 13:02:36.561700  8529 rpcz_store.cc:276] 0709 13:02:32.494943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.189921 (+2694978us) service_pool.cc:224] Handling call
0709 13:02:35.190217 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:35.190552 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.190579 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:35.191040 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.758622 (+567582us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:35.759228 (+   606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.759325 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.483069 (+723744us) raft_consensus.cc:1685] finished
0709 13:02:36.483090 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.483252 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":382,"raft.queue_time_us":10561,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":18501,"thread_start_us":401101,"threads_started":1,"wal-append.queue_time_us":1259954}
I20260709 13:02:36.524464  9295 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:36.469587 12274 log.cc:927] Time spent T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
W20260709 13:02:36.537364  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 80967.6us
W20260709 13:02:36.538848  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 67022.9us
W20260709 13:02:36.542616  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 185831us
I20260709 13:02:36.456696 12232 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:36.576756  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 789) took 1352 ms. Trace:
I20260709 13:02:36.455451 12179 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:36.480834 12210 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:36.619015  8386 raft_consensus.cc:2368] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12.
W20260709 13:02:36.551599  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.548643  8532 rpcz_store.cc:276] 0709 13:02:34.119013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.880308 (+1761295us) service_pool.cc:224] Handling call
0709 13:02:35.880573 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.880786 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:35.968455 (+ 87669us) log.cc:844] Serialized 14 byte log entry
0709 13:02:36.545205 (+576750us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:36.546105 (+   900us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:36.546318 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.546736 (+   418us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.547253 (+   517us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49739,"prepare.queue_time_us":101608,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":178743,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":21819,"thread_start_us":570631,"threads_started":2,"wal-append.queue_time_us":473013}
I20260709 13:02:36.568001  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:36.570092  8349 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:36.573688  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 56695.1us
W20260709 13:02:36.622115  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.546075 11672 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:36.626999  9293 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.023s	sys 0.030s
W20260709 13:02:36.627426  9293 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.023s	sys 0.031s
I20260709 13:02:36.489073 12280 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:36.594594  8526 rpcz_store.cc:276] 0709 13:02:35.224725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.353195 (+1128470us) service_pool.cc:224] Handling call
0709 13:02:36.354283 (+  1088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.576240 (+221957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.576289 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:36.576355 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:36.576412 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.576507 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.576674 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2977,"thread_start_us":218388,"threads_started":1}
I20260709 13:02:36.596900  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:36.588286  8427 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:02:36.635203  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 47348.1us
I20260709 13:02:36.491601 12178 raft_consensus.cc:3055] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:36.625021  8382 raft_consensus.cc:2410] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:36.625204  8380 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:02:36.625169  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 55152.6us
I20260709 13:02:36.490649 12098 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:36.629703  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.552551 12307 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.633071  8534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38890
I20260709 13:02:36.564625 12293 raft_consensus.cc:740] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:36.538209 12292 consensus_queue.cc:1059] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:02:36.641644  8349 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:36.623864 12065 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.642268  8534 raft_consensus.cc:606] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 13:02:36.645133  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:36.640609  8382 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:36.617187 11957 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:36.636723 12093 consensus_meta.cc:287] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.934s	user 0.012s	sys 0.000s
I20260709 13:02:36.736866  8534 raft_consensus.cc:614] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:36.739862  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 97921.5us
I20260709 13:02:36.643370 12236 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.745338 12319 raft_consensus.cc:3055] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:36.492393 12149 consensus_queue.cc:260] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:36.644589 12260 raft_consensus.cc:697] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:36.638839 12178 raft_consensus.cc:740] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:02:36.646615 12291 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.421s	user 0.000s	sys 0.001s
I20260709 13:02:36.523160 12097 consensus_queue.cc:260] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:36.623159 11953 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
W20260709 13:02:36.820101  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.640606 12298 raft_consensus.cc:3055] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:36.789251 12130 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.797843 12149 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:36.798228 12300 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.388s	user 0.001s	sys 0.000s
W20260709 13:02:36.755362 12289 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.482s	user 0.001s	sys 0.001s
W20260709 13:02:36.780697 12062 consensus_meta.cc:287] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.609s	user 0.006s	sys 0.008s
I20260709 13:02:36.648356 12136 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:36.808686 12316 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:36.846771 12301 log.cc:927] Time spent T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:02:36.779253 12319 raft_consensus.cc:740] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:36.807637 12274 log.cc:927] Time spent T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:02:36.808516 12117 consensus_meta.cc:287] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.001s
I20260709 13:02:36.754931 12312 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:02:36.804566 12127 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:36.748149 12065 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:37.026986 11760 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:37.028573 11760 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:36.653546  8349 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:36.964476  8424 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.004s	sys 0.006s
W20260709 13:02:37.043818  8424 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.005s	sys 0.006s
I20260709 13:02:36.967484  8455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 2080) took 1503 ms. Trace:
W20260709 13:02:36.686779  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.971907  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:37.050212  8455 rpcz_store.cc:276] 0709 13:02:35.463729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.463908 (+   179us) service_pool.cc:224] Handling call
0709 13:02:35.464346 (+   438us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:35.464816 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.464857 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:35.501959 (+ 37102us) log.cc:844] Serialized 52 byte log entry
0709 13:02:35.848459 (+346500us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:35.905663 (+ 57204us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.982343 (+ 76680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.982757 (+   414us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.966508 (+983751us) raft_consensus.cc:1685] finished
0709 13:02:36.966612 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.967100 (+   488us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37954,"prepare.queue_time_us":58516,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":13469,"raft.queue_time_us":160320,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":42995,"thread_start_us":318719,"threads_started":2,"wal-append.queue_time_us":493886}
I20260709 13:02:37.052594  8382 raft_consensus.cc:2393] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 8: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:36.789026  8531 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:36.779934  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38890 (request call id 80) took 5702 ms. Trace:
I20260709 13:02:37.054557  8534 rpcz_store.cc:276] 0709 13:02:31.063401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.590664 (+5527263us) service_pool.cc:224] Handling call
0709 13:02:36.765354 (+174690us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:36.976205  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 296657us
I20260709 13:02:36.977207  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2364) took 4315 ms. Trace:
I20260709 13:02:37.056371  8535 rpcz_store.cc:276] 0709 13:02:32.661496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.416871 (+2755375us) service_pool.cc:224] Handling call
0709 13:02:35.417379 (+   508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:35.417885 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.417925 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:35.428382 (+ 10457us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.737721 (+309339us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:35.737778 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.737855 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.976436 (+1238581us) raft_consensus.cc:1685] finished
0709 13:02:36.976477 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.976808 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14509,"raft.queue_time_us":4980,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":4238,"thread_start_us":308919,"threads_started":1,"wal-append.queue_time_us":1488569}
I20260709 13:02:37.064180  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:02:37.011137  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.060869  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.024060 11714 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:36.816111 11801 raft_consensus.cc:697] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:36.862046 12062 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:36.962241  8273 maintenance_manager.cc:419] P 3a492d68031a44b1b0b286d8ce68436c: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033403
I20260709 13:02:37.080286 12062 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:37.083336 12119 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:37.089448 11714 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:37.100349  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:37.101879  9290 raft_consensus.cc:2393] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 8: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:37.103662 12063 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.105594 12096 raft_consensus.cc:3055] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:37.106148 12096 raft_consensus.cc:740] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:37.107999 12096 consensus_queue.cc:260] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:37.112936 12131 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:37.066512  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:36.807402 12093 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:37.088748  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 782) took 2989 ms. Trace:
I20260709 13:02:37.158313 12093 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:36.891155 12117 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.162583 12117 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:37.153870  8377 raft_consensus.cc:1240] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:02:37.163542 12117 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.847169 12130 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:36.887329 12136 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:37.166525 12136 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:37.156261 12131 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:37.168118 12062 consensus_queue.cc:1059] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:02:36.997040  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.065271 12066 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:37.119140  8527 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 8 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:37.119411  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2148) took 1438 ms. Trace:
I20260709 13:02:37.170795  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2367) took 3052 ms. Trace:
I20260709 13:02:37.170456  8379 rpcz_store.cc:276] 0709 13:02:35.681232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.018097 (+336865us) service_pool.cc:224] Handling call
0709 13:02:36.023944 (+  5847us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:36.050932 (+ 26988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.118770 (+1067838us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b54002f94d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:37.119220 (+   450us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26931072}
I20260709 13:02:37.171402  8527 rpcz_store.cc:276] 0709 13:02:34.118660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.876559 (+1757899us) service_pool.cc:224] Handling call
0709 13:02:35.876831 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.118716 (+1241885us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b540009e0a0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c83fcdc0 00007f36c84871c0 00007f36c8488231 00007f36c8484d8f 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c
0709 13:02:37.170429 (+ 51713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.170737 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56125184}
I20260709 13:02:37.173424 12066 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.121299 11801 consensus_queue.cc:237] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:37.150365  8461 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:37.146720 11953 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:37.120718  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 786) took 3020 ms. Trace:
I20260709 13:02:37.100697  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48484 (request call id 630) took 1640 ms. Trace:
I20260709 13:02:37.130607  9292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 573) took 2964 ms. Trace:
I20260709 13:02:37.152496 12118 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:37.188208 12062 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.188473  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:37.190174  8382 raft_consensus.cc:2393] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 9: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:37.189476 12062 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:37.142562  8386 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 2135) took 1675 ms (client timeout 1910 ms). Trace:
I20260709 13:02:37.158208  8530 rpcz_store.cc:276] 0709 13:02:34.099308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.716875 (+1617567us) service_pool.cc:224] Handling call
0709 13:02:35.717262 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.204188 (+486926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.088073 (+883885us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54002b8754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:37.088485 (+   412us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1049798400}
I20260709 13:02:37.159684  8383 raft_consensus.cc:2368] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12.
I20260709 13:02:36.832297 12098 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:37.169714 12127 raft_consensus.cc:3055] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:37.188604  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 2075) took 1970 ms. Trace:
I20260709 13:02:37.193281 12127 raft_consensus.cc:740] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:02:37.193748  8383 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 2137) took 1726 ms (client timeout 1513 ms). Trace:
I20260709 13:02:37.193672  8461 rpcz_store.cc:276] 0709 13:02:35.218425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.219669 (+  1244us) service_pool.cc:224] Handling call
0709 13:02:35.219973 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.187572 (+1967599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.188298 (+   726us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54003c7654. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:37.188533 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4293179776}
W20260709 13:02:37.194252  8383 rpcz_store.cc:269] 0709 13:02:35.467514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.482166 (+ 14652us) service_pool.cc:224] Handling call
0709 13:02:37.193458 (+1711292us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54002cbd54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:37.193670 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3854264704}
W20260709 13:02:37.191350  8386 rpcz_store.cc:269] 0709 13:02:35.467009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.845014 (+378005us) service_pool.cc:224] Handling call
0709 13:02:37.141940 (+1296926us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b54002f9ed4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:37.142309 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1694187392}
I20260709 13:02:37.058756  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2365) took 4396 ms. Trace:
I20260709 13:02:37.183480  8531 rpcz_store.cc:276] 0709 13:02:34.100680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.862910 (+1762230us) service_pool.cc:224] Handling call
0709 13:02:35.893514 (+ 30604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.054377 (+1160863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.120175 (+ 65798us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54002add54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:37.120509 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2058734464}
I20260709 13:02:37.195971  8528 rpcz_store.cc:276] 0709 13:02:32.661772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.498393 (+2836621us) service_pool.cc:224] Handling call
0709 13:02:35.498831 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.499103 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:35.827327 (+328224us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.054586 (+1227259us) spinlock_profiling.cc:243] Waited 6.72 ms on lock 0x7b18001b7900. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c5312c0a 00007f36cea52219 00007f36c539aa40 00007f36c53954e4 00007f36c5395455 00007f36cbe7d3c7 00007f36c848f9a7 00007f36c849f0bf 00007f36c849f038
0709 13:02:37.057388 (+  2802us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.057785 (+   397us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.057894 (+   109us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:37.058042 (+   148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.058219 (+   177us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.058517 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49150,"prepare.queue_time_us":315957,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":61,"raft.queue_time_us":163252,"raft.run_cpu_time_us":461,"raft.run_wall_time_us":12352,"spinlock_wait_cycles":15467392,"thread_start_us":426585,"threads_started":2,"wal-append.queue_time_us":191364}
I20260709 13:02:37.164311 12117 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.183943  8385 rpcz_store.cc:276] 0709 13:02:35.460121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.460256 (+   135us) service_pool.cc:224] Handling call
0709 13:02:37.100044 (+1639788us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54002c8154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:37.100425 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524020096}
W20260709 13:02:37.103894  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.174713  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2845) took 3031 ms. Trace:
I20260709 13:02:37.210942  8377 rpcz_store.cc:276] 0709 13:02:34.143630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.185860 (+1042230us) service_pool.cc:224] Handling call
0709 13:02:35.212613 (+ 26753us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.163630 (+1951017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.174270 (+ 10640us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54003b6854. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:37.174641 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4295725312}
I20260709 13:02:37.191684 11953 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.195014 12127 consensus_queue.cc:260] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:36.906829 12271 log.cc:927] Time spent T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:02:36.883325 12178 consensus_queue.cc:260] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.242779 12211 raft_consensus.cc:2764] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:36.796249 12236 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.243839 12178 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:36.808794 12186 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:37.245833 12186 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:36.915854 12260 consensus_queue.cc:237] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:36.630185 12210 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:37.246770 12272 log.cc:927] Time spent T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 1.203s	user 0.004s	sys 0.005s
W20260709 13:02:36.908500 12228 consensus_meta.cc:287] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 1.446s	user 0.012s	sys 0.000s
I20260709 13:02:36.743033 12283 consensus_queue.cc:237] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:36.848611 12294 log.cc:927] Time spent T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.492s	user 0.000s	sys 0.002s
W20260709 13:02:36.926908 12287 consensus_meta.cc:287] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.700s	user 0.009s	sys 0.003s
I20260709 13:02:37.339143 12287 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.339946 12227 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:36.804415 12293 consensus_queue.cc:260] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:37.341049 12320 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.410s	user 0.000s	sys 0.001s
I20260709 13:02:36.831278 12298 raft_consensus.cc:740] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:37.342039 12065 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:37.343935 12275 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 1.132s	user 0.001s	sys 0.000s
I20260709 13:02:37.343381 12298 consensus_queue.cc:260] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:36.646179 12307 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:36.798652 12304 consensus_queue.cc:1175] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "446d9310dce14ff4afff2dc2d64f68d8" responder_term: 10 status { last_received { term: 7 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: [9.9-9.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:36.891821 12305 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.346362 12305 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:37.346851 12276 raft_consensus.cc:3055] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:37.347353 12276 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:37.347412 12307 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:36.909621 12325 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:37.349584 12325 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:37.350231 12325 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:37.350495 12287 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:36.922047 12336 raft_consensus.cc:3055] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:02:37.398481 12144 consensus_meta.cc:287] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.841s	user 0.013s	sys 0.004s
I20260709 13:02:37.398974 12336 raft_consensus.cc:740] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:37.399048 12144 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.184327  9292 rpcz_store.cc:276] 0709 13:02:34.166354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.960801 (+794447us) service_pool.cc:224] Handling call
0709 13:02:34.961043 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.982255 (+ 21212us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:35.871357 (+889102us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.129426 (+1258069us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b1800439ea0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c802d4bc 00007f36c537b48b 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c802523a
0709 13:02:37.129840 (+   414us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.129922 (+    82us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:37.130036 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.130175 (+   139us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.130413 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":885355,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"spinlock_wait_cycles":47671040,"thread_start_us":930625,"threads_started":2,"wal-append.queue_time_us":325279}
I20260709 13:02:37.283851 12066 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:37.313666  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.313897  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 103625us
I20260709 13:02:37.304080 12096 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:37.304185 12127 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:36.919203 12292 consensus_queue.cc:1059] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.384s
I20260709 13:02:37.246819 12186 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.329820 12224 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.335595 12062 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:37.241901 12179 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:37.313050 12264 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:37.325806  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 638788us
I20260709 13:02:37.315868 11953 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:37.363723 12131 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:37.364050 11760 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:37.330440 12236 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:37.295166 12063 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:37.368593 12248 consensus_meta.cc:287] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 1.080s	user 0.007s	sys 0.007s
I20260709 13:02:37.371062 12136 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:37.373654 12228 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.348968 12305 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:37.378176  9293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 569) took 1314 ms. Trace:
W20260709 13:02:37.365437  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 1.11595e+06us
I20260709 13:02:37.385340 12298 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.385787 12210 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:37.386518  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.388290  9295 consensus_meta.cc:287] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.820s	user 0.014s	sys 0.031s
I20260709 13:02:37.353803 12227 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:37.388643 12130 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:37.328094 12312 consensus_queue.cc:1175] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d653e71832b7402b9a03b46249d3b885" responder_term: 10 status { last_received { term: 9 index: 8 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:37.438133  8527 raft_consensus.cc:1240] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:37.438658  8424 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:02:37.392028 12328 log.cc:927] Time spent T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.481s	user 0.002s	sys 0.000s
W20260709 13:02:37.392448  8427 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.005s	sys 0.014s
W20260709 13:02:37.393254  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.348794 12276 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:37.395879 12299 consensus_meta.cc:287] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.826s	user 0.007s	sys 0.005s
I20260709 13:02:37.397272 12098 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:37.398164 11930 consensus_meta.cc:287] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.023s	user 0.009s	sys 0.013s
I20260709 13:02:37.402046  8381 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 10. Current term is 12. Ops: []
I20260709 13:02:37.400408 12336 consensus_queue.cc:260] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:37.457437  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.458357  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.458588 12336 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.461473  8461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:37.462364  8461 raft_consensus.cc:606] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:37.462795  8461 raft_consensus.cc:614] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:37.462849 12287 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:37.409863  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 105746us
I20260709 13:02:37.465026 12341 consensus_queue.cc:1059] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:37.409149  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:37.465909  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:37.414577 12179 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.415328  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:37.418694 12186 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:37.419963 12062 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:37.421406 12340 log.cc:927] Time spent T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.095s	user 0.002s	sys 0.000s
I20260709 13:02:37.398602 12117 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:37.434998  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:37.468698  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:37.471071  8531 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
W20260709 13:02:37.471590 12234 consensus_meta.cc:287] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 1.394s	user 0.007s	sys 0.008s
I20260709 13:02:37.395308 12319 consensus_queue.cc:260] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.472152 12228 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:37.472278  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:37.473049 12299 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:37.473182 12319 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:37.475441  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:37.479064 12304 consensus_queue.cc:1059] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:37.431504  9293 rpcz_store.cc:276] 0709 13:02:36.063884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.064031 (+   147us) service_pool.cc:224] Handling call
0709 13:02:36.064384 (+   353us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:36.064783 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.064810 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:36.065362 (+   552us) log.cc:844] Serialized 52 byte log entry
0709 13:02:36.627870 (+562508us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:36.627922 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.628001 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.340117 (+712116us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:37.352625 (+ 12508us) raft_consensus.cc:1685] finished
0709 13:02:37.352646 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.377980 (+ 25334us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1177,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":9299,"spinlock_wait_cycles":900474624,"thread_start_us":562067,"threads_started":1,"wal-append.queue_time_us":864532}
I20260709 13:02:37.455417  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:37.455641 11930 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.455446  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:37.456604  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.466373 12341 consensus_queue.cc:1048] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:37.466725  8459 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:37.480409 12304 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:37.479518  9261 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:37.437673  9295 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:37.438792 12227 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:37.451640  8427 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.006s	sys 0.015s
I20260709 13:02:37.482563  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:37.433506 12248 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:37.489809  8527 raft_consensus.cc:2410] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:37.489912  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:37.490726  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:37.496749 12086 consensus_meta.cc:287] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.268s	user 0.030s	sys 0.009s
W20260709 13:02:37.450482 12133 consensus_meta.cc:287] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.973s	user 0.029s	sys 0.007s
I20260709 13:02:37.467568 12092 raft_consensus.cc:3055] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:02:37.499972  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 75019.7us
I20260709 13:02:37.492692 11930 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:37.495337  8531 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:37.525446  8452 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:37.432689 12118 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:37.487169 12144 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:37.530375  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:37.533344 11940 consensus_meta.cc:287] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.733s	user 0.020s	sys 0.038s
I20260709 13:02:37.533946 11940 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:37.536604 11940 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:37.536394 12118 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:37.537511  8384 raft_consensus.cc:1240] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:02:37.538371 12312 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:37.538916 12312 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.539439  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:37.540145  8459 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:37.540642  8384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2139) took 2072 ms. Trace:
I20260709 13:02:37.541672  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:37.472113 12234 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:37.544591  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.544735 12234 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:37.528240 12086 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.546316  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 632) took 2085 ms. Trace:
I20260709 13:02:37.546717  8381 rpcz_store.cc:276] 0709 13:02:35.460919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.945399 (+484480us) service_pool.cc:224] Handling call
0709 13:02:35.945676 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.457102 (+1511426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.546036 (+ 88934us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540013ced4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:37.546257 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3348375296}
I20260709 13:02:37.547706 12086 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:37.548193  8378 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:02:37.538911 12118 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:37.548841 12312 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:37.549361  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:37.550251  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:37.550704 12179 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:37.551074  8461 raft_consensus.cc:2410] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:37.553895  8535 raft_consensus.cc:1240] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:37.554502 12297 log.cc:927] Time spent T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.627s	user 0.002s	sys 0.000s
I20260709 13:02:37.555310  8530 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:02:37.555986 12091 consensus_meta.cc:287] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 1.020s	user 0.012s	sys 0.012s
I20260709 13:02:37.557066  9294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 566) took 1727 ms. Trace:
I20260709 13:02:37.557619  9294 rpcz_store.cc:276] 0709 13:02:35.829804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.829941 (+   137us) service_pool.cc:224] Handling call
0709 13:02:35.830307 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:35.830658 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.830695 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:35.831251 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:02:36.165372 (+334121us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:36.165433 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.165530 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.553647 (+1388117us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:37.556616 (+  2969us) raft_consensus.cc:1685] finished
0709 13:02:37.556637 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.556896 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13903,"raft.queue_time_us":36615,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":22876,"spinlock_wait_cycles":1005652864,"thread_start_us":254902,"threads_started":1,"wal-append.queue_time_us":1051524}
I20260709 13:02:37.559386  8501 leader_election.cc:400] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12.
I20260709 13:02:37.559737  8501 leader_election.cc:403] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:37.560075 12063 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:37.560701 12063 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:37.517431 11957 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.003s	sys 0.010s
I20260709 13:02:37.569880  9295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55720 (request call id 584) took 1153 ms. Trace:
I20260709 13:02:37.567414  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:37.570314  8528 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:02:37.570274  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 90902.4us
W20260709 13:02:37.573441  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.561064  8501 leader_election.cc:400] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12.
I20260709 13:02:37.579613  8501 leader_election.cc:403] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:02:37.580631  8454 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:37.557121  9291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 915) took 1290 ms. Trace:
I20260709 13:02:37.572588  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:37.575446  9295 rpcz_store.cc:276] 0709 13:02:36.378248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.378421 (+   173us) service_pool.cc:224] Handling call
0709 13:02:37.526403 (+1147982us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:37.541014  8384 rpcz_store.cc:276] 0709 13:02:35.468060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.956502 (+488442us) service_pool.cc:224] Handling call
0709 13:02:35.956931 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.537963 (+1581032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.540320 (+  2357us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b540013d3d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:37.540578 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3633940224}
W20260709 13:02:37.573716  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 937698us
I20260709 13:02:37.515532 12092 raft_consensus.cc:740] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:37.571789  9258 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.522s (SENT) [suppressed 36 similar messages]
W20260709 13:02:37.608114  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.561929  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:37.612305  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 51367.4us
I20260709 13:02:37.560989  9260 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:37.614830  8461 raft_consensus.cc:1240] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:02:37.565613 12276 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:37.570833 12157 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:02:37.570520 12097 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.618957  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:37.618973  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 89601.5us
I20260709 13:02:37.569209 12227 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:37.643807  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:37.570495 12312 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:37.563457 12307 consensus_queue.cc:1059] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:02:37.505151 12325 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.627556  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 790) took 1982 ms. Trace:
I20260709 13:02:37.634078  8427 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:37.640112  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:37.699954  9292 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
W20260709 13:02:37.642865  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 81975.7us
I20260709 13:02:37.566985 12248 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:37.659592  9288 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:37.561271 12063 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.662343  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:37.662163  8456 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:37.702158  9294 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.639931  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:37.640193  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:37.635324  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:37.669869  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:37.671578  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:02:37.643502 12330 log.cc:927] Time spent T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.712s	user 0.000s	sys 0.003s
I20260709 13:02:37.643183 12333 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:37.569332 12098 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:37.638339  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:37.713157  9293 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 13: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:37.673907  8452 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
W20260709 13:02:37.675849 12324 log.cc:927] Time spent T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.744s	user 0.001s	sys 0.001s
I20260709 13:02:37.561331 12117 consensus_queue.cc:1059] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.116s
I20260709 13:02:37.677321 12348 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:37.715108  8500 leader_election.cc:336] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.711s (SENT)
I20260709 13:02:37.715879  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:37.715744 12348 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.715196  9289 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
W20260709 13:02:37.717324  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 83399.8us
I20260709 13:02:37.717016  9287 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:37.719516 11801 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.720172 11801 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.721168 12262 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:37.721375  9295 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:37.721966 12262 consensus_queue.cc:1059] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:37.722425 11801 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:37.641595 12118 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:37.703380  9290 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:37.587445  9291 rpcz_store.cc:276] 0709 13:02:36.266119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.267796 (+  1677us) service_pool.cc:224] Handling call
0709 13:02:36.268176 (+   380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:36.343140 (+ 74964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.343182 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:36.357509 (+ 14327us) log.cc:844] Serialized 52 byte log entry
0709 13:02:36.594916 (+237407us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:36.997749 (+402833us) log.cc:844] Serialized 14 byte log entry
0709 13:02:36.998401 (+   652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.998577 (+   176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.371663 (+373086us) spinlock_profiling.cc:243] Waited 7.77 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:37.556676 (+185013us) raft_consensus.cc:1685] finished
0709 13:02:37.556786 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.556913 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26669,"prepare.queue_time_us":328228,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":266636,"raft.run_cpu_time_us":552,"raft.run_wall_time_us":59285,"spinlock_wait_cycles":17867520,"thread_start_us":414803,"threads_started":3,"wal-append.queue_time_us":472175}
I20260709 13:02:37.702281  8456 raft_consensus.cc:606] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:37.714671  8459 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:37.698107  8533 rpcz_store.cc:276] 0709 13:02:35.444063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.354407 (+910344us) service_pool.cc:224] Handling call
0709 13:02:36.381193 (+ 26786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.381407 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:37.055455 (+674048us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.352350 (+296895us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.360176 (+  7826us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.366628 (+  6452us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:37.406300 (+ 39672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.409547 (+  3247us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.426624 (+ 17077us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":714874,"prepare.queue_time_us":862928,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":2018,"raft.queue_time_us":5394,"raft.run_cpu_time_us":454,"raft.run_wall_time_us":7920,"thread_start_us":245269,"threads_started":1,"wal-append.queue_time_us":471887}
W20260709 13:02:37.733424  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.738219  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.737387 12341 raft_consensus.cc:3055] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:37.767642  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:37.769263  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:37.770349  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:37.771559 12227 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:37.771914  8454 raft_consensus.cc:1240] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:37.772249 12227 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:37.774636 12227 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:37.775223 12234 raft_consensus.cc:3055] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:37.775707 12234 raft_consensus.cc:740] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:37.776136  8452 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:37.776522 12229 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:37.776597 12234 consensus_queue.cc:260] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:37.777590 12280 consensus_meta.cc:287] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 1.137s	user 0.011s	sys 0.005s
I20260709 13:02:37.779373  8454 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:37.780951  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 65931us
W20260709 13:02:37.782074  8500 leader_election.cc:336] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.732s (SENT)
I20260709 13:02:37.783437  9260 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:37.790128  9295 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:02:37.737504 12307 consensus_queue.cc:1243] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer d653e71832b7402b9a03b46249d3b885 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:02:37.762778 12287 raft_consensus.cc:697] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:37.778228 12234 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:37.765739 12339 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.641s	user 0.000s	sys 0.002s
I20260709 13:02:37.795681  9287 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:02:37.639727 12092 consensus_queue.cc:260] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:37.732517 12098 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.767668 12341 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:37.794107 12344 log.cc:927] Time spent T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:02:37.812618  9288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 571) took 1045 ms. Trace:
I20260709 13:02:37.803742 12228 consensus_queue.cc:1059] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:02:37.817790  8351 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:37.823941  9294 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:37.820139  9288 rpcz_store.cc:276] 0709 13:02:36.763784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.066038 (+302254us) service_pool.cc:224] Handling call
0709 13:02:37.808738 (+742700us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b5400533c54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:37.808850 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":671084416}
I20260709 13:02:37.825019  8458 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:37.793785 12117 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:37.828264  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:37.801530 12280 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.835178  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:37.829384  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:37.839320  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 635) took 1972 ms. Trace:
I20260709 13:02:37.806389 12229 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:37.848174  8528 raft_consensus.cc:2393] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 16: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:37.839867  8378 rpcz_store.cc:276] 0709 13:02:35.866538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.109521 (+242983us) service_pool.cc:224] Handling call
0709 13:02:36.173036 (+ 63515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.548764 (+1375728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.810040 (+261276us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400350a54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:37.839229 (+ 29189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3143579008}
I20260709 13:02:37.861718 12260 consensus_queue.cc:1059] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:02:37.863341 12133 raft_consensus.cc:3055] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:37.863808 12133 raft_consensus.cc:740] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:37.864691 12133 consensus_queue.cc:260] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:37.866365 12133 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:37.868093 12232 consensus_meta.cc:287] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.245s	user 0.003s	sys 0.011s
I20260709 13:02:37.868599 12232 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:37.871902 12098 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:37.874223 12341 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:37.875813 12341 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.876472 12227 raft_consensus.cc:3055] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:37.876950 12227 raft_consensus.cc:740] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:37.878293 12227 consensus_queue.cc:260] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:37.880582 12318 log.cc:927] Time spent T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.948s	user 0.002s	sys 0.006s
W20260709 13:02:37.882226 12303 log.cc:927] Time spent T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.952s	user 0.000s	sys 0.005s
I20260709 13:02:37.882833  9296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 914) took 1617 ms. Trace:
I20260709 13:02:37.883284  9296 rpcz_store.cc:276] 0709 13:02:36.265779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.265890 (+   111us) service_pool.cc:224] Handling call
0709 13:02:36.266251 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:36.269454 (+  3203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.269490 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:36.288488 (+ 18998us) log.cc:844] Serialized 26 byte log entry
0709 13:02:36.495920 (+207432us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:36.495958 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.496035 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.879494 (+1383459us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:37.882326 (+  2832us) raft_consensus.cc:1685] finished
0709 13:02:37.882349 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.882653 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2811,"raft.queue_time_us":90096,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":33857,"spinlock_wait_cycles":819467136,"thread_start_us":123146,"threads_started":1,"wal-append.queue_time_us":538495}
I20260709 13:02:37.886596 12227 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:37.811228 12091 consensus_queue.cc:1059] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:02:37.853863  8535 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:37.886482 12293 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:37.890588 12333 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.897517  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:37.844764 12315 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.911304 12315 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:37.912006  8456 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:37.913776 12315 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:37.898896  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 155646us
W20260709 13:02:37.897580  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 133449us
I20260709 13:02:37.904443 12333 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.920274  8533 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:37.920454 12086 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:37.921000  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 156030us
I20260709 13:02:37.921336 11930 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:37.922449  9260 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:37.925593 12063 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:37.928514  8459 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
W20260709 13:02:37.932435  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.936811  9296 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:37.930882  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 359089us
I20260709 13:02:37.934077  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:37.940404  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.940877  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.944386  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.945065  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.945395  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.948206 12149 consensus_meta.cc:287] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 1.098s	user 0.004s	sys 0.008s
I20260709 13:02:37.948496  9260 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:37.949173 12325 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:37.949469  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:37.950713 12224 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.948243 12063 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:37.951998 12264 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:02:37.952301  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.952250 12063 consensus_queue.cc:1059] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:37.948534 12280 consensus_queue.cc:1059] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:02:37.902534 12229 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:37.951340 12312 consensus_queue.cc:1059] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:02:37.953903 12262 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.954460 12262 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.954869 12280 raft_consensus.cc:3055] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:37.955309 12280 raft_consensus.cc:740] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:37.955680 12229 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:37.958530  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:37.956331 12280 consensus_queue.cc:260] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:37.973664  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:37.936556 11930 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.956773 12086 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:37.977887  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:37.979882  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 236798us
I20260709 13:02:37.978767  9296 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:02:37.972086 12315 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:37.980731 12232 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:37.981503 11930 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:38.003944 12096 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:38.015631 12229 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:38.016331 12280 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:38.015730 12311 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
W20260709 13:02:38.021020 11672 consensus_meta.cc:287] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 1.288s	user 0.016s	sys 0.008s
I20260709 13:02:38.054251 12348 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:38.054095 11672 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:38.056252 11672 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:38.057286 12333 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:38.059041  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:38.060298  8378 raft_consensus.cc:2393] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 11: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:38.062146  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:38.063271  8377 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:38.064909  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:38.066013  8383 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:38.066879  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:38.068589  9258 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:38.075349  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.076318  8458 raft_consensus.cc:2393] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:38.077425 12117 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:38.078269 12298 consensus_meta.cc:287] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.632s	user 0.007s	sys 0.003s
I20260709 13:02:38.021360  8455 raft_consensus.cc:2410] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:02:38.049950  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.006692 12315 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.022809 12086 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:37.999539 12264 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.023267  9295 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:38.087471  8386 raft_consensus.cc:1275] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:38.023003  9261 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:38.028292  8351 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:38.031302  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:38.088784  9296 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:02:38.038532  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:38.089699  9289 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:38.044979  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 214206us
I20260709 13:02:38.048694 12092 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:38.040766 12229 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:38.049885  8453 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:02:38.076049 12260 consensus_queue.cc:1059] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:02:38.022007 12127 consensus_meta.cc:287] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.611s	user 0.012s	sys 0.000s
I20260709 13:02:38.071367 12262 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:38.082298  8384 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:38.085157  8461 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
W20260709 13:02:38.090667  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 62445.8us
I20260709 13:02:38.096755  8461 pending_rounds.cc:85] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12: Aborting all ops after (but not including) 6
W20260709 13:02:38.091355  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 68457.4us
I20260709 13:02:38.093997  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:38.086578 12315 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:38.093945 12348 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:38.100181  8351 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:38.091400 12333 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:38.094431 12086 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:38.097115  8461 pending_rounds.cc:107] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:02:38.101765  8461 raft_consensus.cc:2889] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:38.101838 12260 raft_consensus.cc:3055] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:38.102385 12260 raft_consensus.cc:740] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:38.103407 12260 consensus_queue.cc:260] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:38.104691 12260 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:38.106812 12224 raft_consensus.cc:3055] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:38.107276 12224 raft_consensus.cc:740] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:38.108309 12224 consensus_queue.cc:260] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:38.110363 12311 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.112505  8530 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:38.113329  8531 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:38.113229  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:38.113788  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.112556  9296 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60"
dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:54044
I20260709 13:02:38.122367  9289 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:02:38.122766  9296 raft_consensus.cc:606] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:38.121048 12157 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12.
I20260709 13:02:38.113132 12228 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.115674  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:38.090698 12264 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:38.118481  8385 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:38.123149  9296 raft_consensus.cc:614] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:38.114421  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:38.124379  8527 raft_consensus.cc:2393] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 9: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:38.124728  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:38.126356  8461 raft_consensus.cc:1240] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:38.115456 12229 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:38.126514  8534 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:02:38.132292  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:38.086272 12117 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:38.126567  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.149667  9288 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:38.094803 12096 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:38.147712  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 79285.2us
I20260709 13:02:38.088025 12287 consensus_queue.cc:237] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:38.162868  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.153115  8461 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:38.170297 12096 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:38.170953 12348 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:38.174220 12333 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.174811 12333 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:38.175639  8461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67513665d04b44c292143601e7f66ac8"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:38.176473  8461 raft_consensus.cc:606] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:38.176862  8461 raft_consensus.cc:614] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:38.177404  8383 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:38.183866  9258 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:38.184919  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.188272  8526 raft_consensus.cc:2410] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:38.124097 12311 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:38.185665  8534 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:38.183068  8458 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:02:38.197230  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:38.156837 12224 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:38.204882  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.201996  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:38.195899  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 98467.3us
I20260709 13:02:38.208033  8461 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:38.213788  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:38.177048 12333 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:38.206593  8534 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:38.203274  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.248014  9260 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:38.142836 12228 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:38.250806  8461 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:02:38.182235 12336 consensus_meta.cc:287] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.723s	user 0.014s	sys 0.000s
I20260709 13:02:38.256119  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.256779  8453 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:38.203698 12312 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:38.203817 12086 raft_consensus.cc:697] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 12 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:38.270556  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:38.265130  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.196096 12210 raft_consensus.cc:3055] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:38.207412 12096 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:38.203693 12229 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.270556  8386 raft_consensus.cc:1275] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:38.279100  8457 raft_consensus.cc:2410] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:38.279597  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:38.280087  9295 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:38.282915  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:38.283824  8426 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:38.284574  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.262612 12333 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:38.288304  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.289223  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:38.262470 12157 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.295418  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:38.296267  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:38.301373  9288 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:38.294267  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.273934 12210 raft_consensus.cc:740] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:38.303015  8534 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:38.312044  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:38.301364  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:38.313520  8386 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:38.249040 12360 consensus_queue.cc:1059] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:02:38.290396 12333 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.288806 12096 raft_consensus.cc:697] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:02:38.315372  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 136759us
I20260709 13:02:38.325831  8383 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:02:38.301999 12336 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:38.330307  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.318187  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:38.299537 12348 consensus_queue.cc:1059] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:02:38.340461  8458 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:02:38.342312  8455 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 7: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:38.323573 12333 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:38.298764 12229 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:38.356468  9258 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:38.359004  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:02:38.361209 12352 log.cc:927] Time spent T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c: Append to log took a long time: real 0.268s	user 0.003s	sys 0.000s
I20260709 13:02:38.332199 12336 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.364461  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.365670  8458 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 13: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
W20260709 13:02:38.352221 12234 consensus_meta.cc:287] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.545s	user 0.006s	sys 0.004s
I20260709 13:02:38.370579  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.370868  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:38.326025 12312 consensus_queue.cc:1059] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:02:38.391649  8455 raft_consensus.cc:2410] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:38.369776 12144 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:38.398232  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.376456  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:38.377494 12228 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:38.379380 12118 consensus_meta.cc:287] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.001s
I20260709 13:02:38.351938 12127 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:38.354637 12086 consensus_queue.cc:237] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:38.362723 12157 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:38.381860 12311 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:38.382259 12210 consensus_queue.cc:260] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:38.410018 12341 consensus_meta.cc:287] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.534s	user 0.013s	sys 0.000s
I20260709 13:02:38.389605  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.367168 12336 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:38.409049  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.415735  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.426107  8531 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:38.412827  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.418285  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:38.428318  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.429654  8528 raft_consensus.cc:2410] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:38.425428  8527 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:38.416666  8427 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:38.353792 12063 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:02:38.419690  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:38.417339 12118 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12.
I20260709 13:02:38.433037  8530 raft_consensus.cc:2376] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11. Re-sending same reply.
W20260709 13:02:38.389717 12362 log.cc:927] Time spent T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:02:38.400444 12098 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:38.418460  8351 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:38.362296 12096 consensus_queue.cc:237] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:38.431109  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:38.412520 12312 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:38.439476  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.440546  8461 raft_consensus.cc:2393] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:38.431618  8455 raft_consensus.cc:2368] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12.
I20260709 13:02:38.434185  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.414822 12117 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:38.415583 12144 raft_consensus.cc:697] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:38.411949 12133 consensus_queue.cc:1059] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:02:38.443759  8527 raft_consensus.cc:2393] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:38.444386  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.449839  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:38.450997  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:38.451526  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.451526  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.462942  8530 raft_consensus.cc:2410] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:02:38.451144  8527 raft_consensus.cc:2393] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:38.453028  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:38.465864  8461 raft_consensus.cc:2393] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:38.443219 12312 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.473980  8351 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:38.451822 12210 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:38.474717 12229 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:38.475878 12157 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:38.476121 12232 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:38.476579 12232 raft_consensus.cc:697] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 12 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:38.426327 12091 consensus_queue.cc:1048] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:02:38.477195  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.477834  8532 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:38.477448 12232 consensus_queue.cc:237] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:38.480269 12179 raft_consensus.cc:3055] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:38.480707 12179 raft_consensus.cc:740] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:38.481565 12127 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:38.481956  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.482468  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.482729  8529 raft_consensus.cc:2393] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 7: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:38.439239 12098 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:38.487917  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:38.472361  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.502566  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.504127  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:38.445895 12149 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:38.507974  8427 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:38.505756  8527 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:38.511164  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:38.512542  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.536530  8383 raft_consensus.cc:1240] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:38.515411  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.512076  8461 raft_consensus.cc:2376] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8. Re-sending same reply.
I20260709 13:02:38.544147  8530 raft_consensus.cc:2393] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 11: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:38.452720 12341 consensus_queue.cc:1048] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:02:38.569921  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.501590 12098 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:38.484050 12312 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:38.483551 12066 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:38.570921  8461 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:02:38.603014  8381 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:02:38.603572  8381 pending_rounds.cc:85] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 3
I20260709 13:02:38.603863  8381 pending_rounds.cc:107] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:02:38.604143  8381 raft_consensus.cc:2889] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:38.611935  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.621692 12311 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:38.625675  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.606050 12133 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:38.634114  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.640563  8458 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:02:38.641153  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:38.642544  8527 raft_consensus.cc:1275] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:38.643944  8530 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:38.481590 12179 consensus_queue.cc:260] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:38.617638 12149 raft_consensus.cc:697] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:38.627442 12311 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:38.652593 12293 consensus_meta.cc:287] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.725s	user 0.008s	sys 0.008s
I20260709 13:02:38.657987  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:38.658138  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.667428  8458 raft_consensus.cc:2410] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:38.645293 12299 consensus_queue.cc:1059] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:02:38.692279  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:38.656097  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 299559us
W20260709 13:02:38.657790  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.511024 12144 consensus_queue.cc:237] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:38.665117  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:38.714882  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.714936  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.717911  8453 raft_consensus.cc:2410] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:38.718688  8461 raft_consensus.cc:2393] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 11: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:38.718809  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:38.656829 12133 raft_consensus.cc:697] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:38.719686  8458 raft_consensus.cc:2368] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12.
I20260709 13:02:38.725865  8500 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:38.724189  8460 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:02:38.730698  8460 pending_rounds.cc:85] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12: Aborting all ops after (but not including) 9
W20260709 13:02:38.730974  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.731056  8460 pending_rounds.cc:107] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:02:38.731626  8460 raft_consensus.cc:2889] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:38.737205  9294 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:02:38.737486  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.700933 12179 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:38.744324  8500 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:38.746320  8526 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:02:38.753218  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:38.755795 12366 log.cc:927] Time spent T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:02:38.759220 12348 raft_consensus.cc:3055] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:38.760452  8453 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:38.759824 12066 raft_consensus.cc:697] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 12 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:38.775166  8453 raft_consensus.cc:606] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:38.750787  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:38.748816 12227 consensus_meta.cc:287] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.861s	user 0.017s	sys 0.000s
I20260709 13:02:38.761682  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.739082 12229 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:38.773334  8530 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:02:38.777575  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.781057  8458 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:02:38.786607  8531 raft_consensus.cc:2410] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:02:38.763432 12117 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:38.776784 11930 consensus_meta.cc:287] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.694s	user 0.016s	sys 0.000s
I20260709 13:02:38.794003  8529 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:38.797066  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.797159  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.797935  8526 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:38.773909 12348 raft_consensus.cc:740] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:02:38.801945  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 328042us
W20260709 13:02:38.807682  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 196356us
I20260709 13:02:38.812674  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.813429  8529 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:38.816161  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.816977  8458 raft_consensus.cc:1240] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:38.827116  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 82917.8us
I20260709 13:02:38.796977 12227 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:38.849527  8453 raft_consensus.cc:1275] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:02:38.850023  8453 pending_rounds.cc:85] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12: Aborting all ops after (but not including) 4
I20260709 13:02:38.850320  8453 pending_rounds.cc:107] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:02:38.850600  8453 raft_consensus.cc:2889] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:38.797232 12127 raft_consensus.cc:697] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:38.859499  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.860146  8500 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:38.866652  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:38.867094 12370 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:02:38.800153 11930 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:38.801463 12373 consensus_queue.cc:1059] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:02:38.873667  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.819550 12117 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:38.878652  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 74814.6us
I20260709 13:02:38.879374  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.882975  8533 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:38.879410  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.880107  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.884864  8530 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:38.885512 12286 raft_consensus.cc:993] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:02:38.885581 12248 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:38.886127 12248 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:38.886487 12248 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:38.886746 12383 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.886890 11940 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.887357 11940 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:38.889200 12264 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:38.889354 12378 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:02:38.889525 12367 log.cc:927] Time spent T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:02:38.890664 12280 raft_consensus.cc:3055] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:38.890775  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.886149 12379 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.891136 12280 raft_consensus.cc:740] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:38.891391  8533 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:38.889504  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.891598 12379 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:38.892460  8459 raft_consensus.cc:2410] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:38.893261  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.893662 12379 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:38.894217  8459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:38.894917  8459 raft_consensus.cc:606] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:02:38.896409  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:38.898217  8453 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:38.898850  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:38.899487  8453 raft_consensus.cc:1240] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:38.902024 11940 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:38.903306  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:38.905055 11940 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:38.905165  8380 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:38.907368  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:38.908358  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.784973 12149 consensus_queue.cc:237] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:38.909598  9288 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:38.887288 12383 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:38.911933  8531 raft_consensus.cc:1240] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:02:38.912068  8534 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:02:38.913035  8455 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6.
I20260709 13:02:38.907827  9260 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:38.921456  9258 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:38.929227  9258 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:38.931149  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:38.933336 12372 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:38.933826 12372 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.934182 12372 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:38.935065 12336 consensus_meta.cc:287] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.507s	user 0.005s	sys 0.008s
I20260709 13:02:38.935484 12336 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:38.938238  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:38.943341  8529 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:38.943639  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.945106  8527 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:38.948190  8457 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 11: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:38.948457  9258 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:38.948577  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.949542  8530 raft_consensus.cc:2410] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:38.952625  8386 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:38.955015  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:38.960497  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:38.960498  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:38.914918 11940 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.963904  8531 raft_consensus.cc:1275] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:38.963413  8461 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 7: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:38.964025  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.943687 12299 raft_consensus.cc:1081] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:02:39.002184  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:39.002750  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 72555.7us
I20260709 13:02:38.985273  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:38.971257  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:38.987474  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:38.993644  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 133542us
W20260709 13:02:39.002166  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 53778.3us
I20260709 13:02:38.927249 12286 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.009510  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:38.960144 12373 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:38.954511 12224 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:38.877954 12133 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.015061  8382 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:39.013255  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:38.963443 11940 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:39.041436  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:39.042402  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:39.042605  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:39.044873  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:38.909008 12348 consensus_queue.cc:260] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.056320  8529 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:39.063329  8527 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:02:39.076860  8386 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:39.078231  8382 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 7: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
W20260709 13:02:39.078649  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 93212.5us
I20260709 13:02:39.019243 12311 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:39.080659  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:39.081480  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.006247 12286 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:39.031351 12224 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:39.084180  8349 leader_election.cc:336] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.518s (SENT)
I20260709 13:02:39.063160  8460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 706) took 1515 ms. Trace:
I20260709 13:02:39.031021 12373 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:39.091455  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:39.110230  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:39.094444  8349 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:39.093254  8460 rpcz_store.cc:276] 0709 13:02:37.547373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.557258 (+  9885us) service_pool.cc:224] Handling call
0709 13:02:37.557656 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:38.742685 (+1185029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.062865 (+320180us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540040d3d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:39.063087 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2560041856}
W20260709 13:02:39.052286 12333 consensus_meta.cc:287] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.685s	user 0.009s	sys 0.006s
I20260709 13:02:38.939234 12066 consensus_queue.cc:237] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.001886 11957 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:02:39.082505 12229 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:39.047802 12374 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:39.093036 12348 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:39.038836 12097 consensus_queue.cc:1059] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:02:39.111709 12224 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:39.145483  8386 raft_consensus.cc:1240] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:39.107985 12391 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.115862 12373 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:39.092758 12311 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:39.155733  8529 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:02:39.053529  8270 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 56cc480ba6f642e08bb2e547a0ef50a1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 105d6581548546b98eddd4ee7083bb12 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:39.030019 12127 consensus_queue.cc:237] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.132768 12374 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.153959 11672 raft_consensus.cc:3055] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:39.147253 12336 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:39.181876  8385 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 12 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:39.060622 12280 consensus_queue.cc:260] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.125026 12333 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:39.192569  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 186814us
I20260709 13:02:39.210536  8500 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:39.201601  8270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 148392us
I20260709 13:02:39.203903 12227 raft_consensus.cc:697] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 9 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:02:39.200927 12092 consensus_meta.cc:287] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 1.101s	user 0.007s	sys 0.007s
I20260709 13:02:39.218503  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:39.177053 12395 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:39.225072  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 140925us
I20260709 13:02:39.234598  8458 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
W20260709 13:02:39.233258  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.190546 11672 raft_consensus.cc:740] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:39.193049 12374 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:39.202167 12260 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.245559  8349 leader_election.cc:336] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.567s (SENT)
I20260709 13:02:39.208108 12262 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.253226  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.254338  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:39.189844 12311 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.259582  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:39.223285 11930 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:39.271265  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.177387 12391 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:39.284271  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:39.285073  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 112732us
I20260709 13:02:39.285276  8381 raft_consensus.cc:2393] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:02:39.286768  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.212414 12227 consensus_queue.cc:237] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.223973 12248 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.273885 12117 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:39.276189 12383 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:39.288318 12394 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:39.302860  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:39.269881 12262 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:39.306380  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 60880.1us
W20260709 13:02:39.309212  8349 leader_election.cc:336] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.579s (SENT)
I20260709 13:02:39.259204 12260 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:39.298661 12280 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:39.298419 11672 consensus_queue.cc:260] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.314893 12286 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:39.315302 12361 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.306159 12394 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.315557 11672 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:39.333457 12400 consensus_queue.cc:1059] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 13:02:39.348606  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:39.351344  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:39.351824  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.354188  8528 raft_consensus.cc:1275] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:02:39.354730  8528 pending_rounds.cc:85] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 3
I20260709 13:02:39.354993  8528 pending_rounds.cc:107] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:02:39.355278  8528 raft_consensus.cc:2889] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:39.376269 12393 log.cc:927] Time spent T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.181s	user 0.001s	sys 0.001s
W20260709 13:02:39.374342  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 163841us
I20260709 13:02:39.379406  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:39.380460  8500 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:39.337270 12394 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:39.363013  8381 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
W20260709 13:02:39.377589 12315 consensus_meta.cc:287] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.244s	user 0.016s	sys 0.016s
I20260709 13:02:39.400218  8377 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:39.405369 12368 log.cc:927] Time spent T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.622s	user 0.003s	sys 0.001s
I20260709 13:02:39.408428  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2290) took 1042 ms. Trace:
I20260709 13:02:39.408869  8534 rpcz_store.cc:276] 0709 13:02:38.366462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.366607 (+   145us) service_pool.cc:224] Handling call
0709 13:02:39.408240 (+1041633us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x7b54002baa54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:39.408346 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75429120}
I20260709 13:02:39.413633  8528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38894
W20260709 13:02:39.414023 12408 log.cc:927] Time spent T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:02:39.414729 12234 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:39.416527 12360 raft_consensus.cc:3055] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:39.416952 12360 raft_consensus.cc:740] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:39.417757 12360 consensus_queue.cc:260] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.418817 12360 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:39.421883 12311 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:39.422385 12262 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:39.423774 12228 raft_consensus.cc:3055] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:39.424242 12228 raft_consensus.cc:740] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:39.425047 12228 consensus_queue.cc:260] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.435460  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:39.426141 12371 log.cc:927] Time spent T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.557s	user 0.002s	sys 0.000s
W20260709 13:02:39.477530  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:39.420846 12098 consensus_meta.cc:287] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.792s	user 0.008s	sys 0.004s
W20260709 13:02:39.502388  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 50583.9us
I20260709 13:02:39.502166  8456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 717) took 1446 ms. Trace:
I20260709 13:02:39.331194 12361 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:39.521010  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:39.397882 12333 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:39.524058  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.525794  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:39.527630  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 218433us
I20260709 13:02:39.511427  8456 rpcz_store.cc:276] 0709 13:02:38.055527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.055681 (+   154us) service_pool.cc:224] Handling call
0709 13:02:38.056027 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:38.085815 (+ 29788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:38.085861 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:38.090283 (+  4422us) log.cc:844] Serialized 26 byte log entry
0709 13:02:38.574215 (+483932us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:38.574278 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.574377 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:39.404485 (+830108us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:39.450416 (+ 45931us) raft_consensus.cc:1685] finished
0709 13:02:39.450436 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:39.502063 (+ 51627us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23511,"raft.queue_time_us":31825,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":2095,"spinlock_wait_cycles":12874624,"thread_start_us":427644,"threads_started":1,"wal-append.queue_time_us":644239}
I20260709 13:02:39.566664 12228 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:39.570415  8349 leader_election.cc:336] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.645s (SENT)
I20260709 13:02:39.510264 12234 raft_consensus.cc:697] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:39.573707  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:39.401513 12315 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.535729 11940 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.580359  8349 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:39.459617 12262 consensus_queue.cc:1059] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.108s
I20260709 13:02:39.580083  8385 raft_consensus.cc:2393] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:39.570348 12187 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:39.529827 12248 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:39.598308  8528 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:39.601240  8528 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:39.601423  8379 raft_consensus.cc:2410] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:39.517418 12224 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.602888  8378 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 11: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:02:39.600874 12210 consensus_meta.cc:287] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 1.125s	user 0.013s	sys 0.001s
I20260709 13:02:39.604811 12260 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:39.605176 11940 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:39.605731 12382 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:39.606190 12411 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:02:39.522689 12098 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.613924  8535 raft_consensus.cc:2410] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:02:39.614732  8386 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:39.598519 12157 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.615715 12157 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:39.618119 12157 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:39.619429  8424 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:39.620535 12229 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.621213 12229 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:39.621855  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2870) took 1112 ms. Trace:
I20260709 13:02:39.622259  8377 rpcz_store.cc:276] 0709 13:02:38.512330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.513204 (+   874us) service_pool.cc:224] Handling call
0709 13:02:38.513474 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:39.450137 (+936663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.621587 (+171450us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54003dd1d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:39.621793 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2024468864}
W20260709 13:02:39.600735 12179 consensus_meta.cc:287] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.827s	user 0.011s	sys 0.000s
I20260709 13:02:39.623500 12229 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:39.624332  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:39.624970  8527 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:39.608842 12187 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.622268 12418 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
W20260709 13:02:39.624850 12372 consensus_meta.cc:287] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.000s
I20260709 13:02:39.629925 12372 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:39.633412  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 104995us
I20260709 13:02:39.633491  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:39.634172  8349 leader_election.cc:336] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.687s (SENT)
I20260709 13:02:39.634434 12355 raft_consensus.cc:3055] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:39.634810  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:39.634889 12355 raft_consensus.cc:740] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:39.635424  8526 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:39.635933  8531 raft_consensus.cc:1240] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:39.636421  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:39.637485  8526 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:39.641350  9258 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:39.643539  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.644733 12348 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:39.637565  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:39.658046  8527 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
W20260709 13:02:39.664407  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:39.666625  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 52456.4us
I20260709 13:02:39.581434 12417 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:39.658502  8528 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:39.678318 12417 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.681450  9258 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:39.682204  8531 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
W20260709 13:02:39.683555  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:39.636504 12409 log.cc:927] Time spent T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.333s	user 0.002s	sys 0.000s
I20260709 13:02:39.690308  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:39.690495  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 71139.5us
I20260709 13:02:39.691890  8424 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:39.692808  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:39.693912  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:39.694859  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.691011  8456 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:39.676331 12373 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.696841  8379 raft_consensus.cc:2368] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:02:39.698051  8380 raft_consensus.cc:2393] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 7: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:39.694763  8382 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:39.719316  9260 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
W20260709 13:02:39.696897 12312 consensus_meta.cc:287] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 1.079s	user 0.009s	sys 0.004s
I20260709 13:02:39.724181  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:39.725142  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:39.769591  8456 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
W20260709 13:02:39.740703  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.718881  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:39.723505  8500 connection.cc:256] RPC call timeout handler was delayed by -1.7900383599999827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2717s for a response
I20260709 13:02:39.691443 12391 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:39.692027 12341 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:39.811810  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:39.812721  8384 raft_consensus.cc:2393] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 9: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:39.812649 12401 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:39.810997  8460 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:39.804251 12312 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.816715 12312 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:39.768937  8424 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:39.832072  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 131051us
I20260709 13:02:39.832988  8424 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:39.833988 12315 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:39.834229  8424 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:39.835170 12287 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:39.835556  8424 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:39.836084 12287 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:39.836467 12276 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:39.817268  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 46419.8us
I20260709 13:02:39.817517  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2872) took 1003 ms. Trace:
I20260709 13:02:39.836908 12287 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:39.837528 12361 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:39.837335  8383 rpcz_store.cc:276] 0709 13:02:38.814244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.814494 (+   250us) service_pool.cc:224] Handling call
0709 13:02:38.834680 (+ 20186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:38.991731 (+157051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:38.991762 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:39.025436 (+ 33674us) log.cc:844] Serialized 26 byte log entry
0709 13:02:39.191202 (+165766us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:39.191251 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.191339 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:39.636242 (+444903us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b240013dac8. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c521e9c4 00007f36c521cacb 00007f36c53d7dc9 00007f36c53d7a55 00007f36c53d709d 00007f36c800910e 00007f36c802088c 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221
0709 13:02:39.817218 (+180976us) raft_consensus.cc:1685] finished
0709 13:02:39.817240 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:39.817459 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12061,"raft.queue_time_us":41345,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"spinlock_wait_cycles":5758592,"thread_start_us":203093,"threads_started":2,"wal-append.queue_time_us":180648}
W20260709 13:02:39.819272 12280 consensus_meta.cc:287] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.001s
I20260709 13:02:39.691939 12179 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.821580  9260 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:39.822593  8460 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:39.726828 12063 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:39.825659  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:39.863481  8382 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:39.825731 12098 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:39.828205  8528 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:39.866436  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:39.828461 12373 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:39.829965 12401 raft_consensus.cc:697] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:39.865767  8424 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:39.867069  8382 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:02:39.867178  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:39.868662  9261 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.012s	sys 0.011s
I20260709 13:02:39.869374  8384 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:02:39.807880 12144 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.880625  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:39.881309  8383 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:39.805589 12325 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:39.839886 12179 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:39.872757  9261 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.012s	sys 0.011s
W20260709 13:02:39.869208 12149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.002s	sys 0.021s
I20260709 13:02:39.869766 12312 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.884634  8500 leader_election.cc:336] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.590s (SENT)
I20260709 13:02:39.884945  8381 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:39.887820  8424 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:39.888976  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.723896 12319 consensus_queue.cc:1048] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.148s
I20260709 13:02:39.862995 12063 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:39.894143  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 558318us
I20260709 13:02:39.892287  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:39.900954  8379 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:39.872915 12280 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:39.903074  8427 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:39.871316  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 236268us
I20260709 13:02:39.841812 12234 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.886945 11672 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:39.913517 12063 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:39.917682 12373 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.917891  8535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2291) took 1532 ms (client timeout 1687 ms). Trace:
I20260709 13:02:39.918220 12373 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.918722  8532 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:02:39.919124  8532 pending_rounds.cc:85] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 9
I20260709 13:02:39.919373  8532 pending_rounds.cc:107] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:02:39.919623  8532 raft_consensus.cc:2889] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:39.920574 12423 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:39.921206 12423 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.922011 12394 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.922762  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2306) took 1461 ms. Trace:
I20260709 13:02:39.923414 12423 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:39.923513  8535 rpcz_store.cc:269] 0709 13:02:38.385448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.397759 (+ 12311us) service_pool.cc:224] Handling call
0709 13:02:39.917657 (+1519898us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54000f69d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:39.917816 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2718043904}
I20260709 13:02:39.924002  8534 raft_consensus.cc:1240] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:39.883867 12117 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:39.900538  8500 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:39.908253  8380 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:39.871510 12418 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.895578  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:39.916006  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:39.923116  8532 rpcz_store.cc:276] 0709 13:02:38.461968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.478574 (+ 16606us) service_pool.cc:224] Handling call
0709 13:02:39.918366 (+1439792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:39.920050 (+  1684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.922560 (+  2510us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54000f69d0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:39.922711 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3310464256}
I20260709 13:02:39.931850  8379 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
W20260709 13:02:39.906067 12149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.003s	sys 0.022s
I20260709 13:02:39.935336  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:39.924062 12423 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.938561  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 50853.3us
I20260709 13:02:39.933130 12418 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.913193 12280 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:39.958652  8424 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:39.959342  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:39.962993  8382 raft_consensus.cc:2393] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:39.961205  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:39.943933  8349 leader_election.cc:336] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.993s (SENT)
I20260709 13:02:39.963605  8460 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:39.933173 12311 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.968406  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:39.967952 12311 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.969187  8456 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:39.970696 12179 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:39.895205 12144 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.936936 12117 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:39.950069 12187 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:39.973738 12144 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:39.967887  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:39.974716 12117 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:39.932094 12325 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:39.975453  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:39.975658 12325 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.976262 12325 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:39.908435 12361 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:02:39.955215  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:39.980865  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:39.993091  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 64744.8us
I20260709 13:02:39.957546  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:39.982335  9260 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:39.997249  9260 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:39.998006  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:39.999055  8385 raft_consensus.cc:2368] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:02:39.985967  8349 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:39.915453 12312 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:40.007701  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:40.008597  8460 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:40.005522  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:40.008656  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:40.010890  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 136233us
I20260709 13:02:39.965000 12280 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:39.947940 12418 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:40.010177  8456 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:40.013721  8383 raft_consensus.cc:2393] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 12: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:40.023545  8427 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:40.013473  9260 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:39.942446 12360 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:40.020794  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:39.941969 12428 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:40.025118  8427 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:40.026683  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.027792  8500 connection.cc:256] RPC call timeout handler was delayed by -1.7184445670000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 13:02:40.033833  8500 connection.cc:256] RPC call timeout handler was delayed by -1.702844468999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
I20260709 13:02:40.006862 12179 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:40.006630 12187 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:40.030330  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:40.017619 11672 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:40.007318 12264 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.002491 12417 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:40.007236 12224 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:40.029222  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:40.025071 12432 log.cc:927] Time spent T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:02:40.030572  8382 raft_consensus.cc:2393] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:40.038309 12410 consensus_queue.cc:1059] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:02:40.039789 12311 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:39.982631 12097 consensus_queue.cc:1048] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:02:40.017351 12333 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.040795 12063 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:40.042933  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:40.043573  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:40.045485  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:40.046074 12373 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:40.046155  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:40.046277  8460 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:39.961410 12423 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:40.051055  8500 connection.cc:256] RPC call timeout handler was delayed by -1.6115438239999662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
W20260709 13:02:40.202961  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.203387  8500 connection.cc:256] RPC call timeout handler was delayed by -1.475038359999985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30670000000000003s for a response
W20260709 13:02:40.203719  8500 connection.cc:256] RPC call timeout handler was delayed by -1.1991961830000264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1865s for a response
I20260709 13:02:40.203864  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:40.204562  8460 raft_consensus.cc:2376] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 6. Re-sending same reply.
I20260709 13:02:40.022200 12144 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:40.058194  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:40.208235  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:40.141018  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.116847  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.037933 12418 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:40.036135 12341 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:40.038630 12179 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:40.079150  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.113121  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:40.211411 12418 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.221992 12418 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:40.222935  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2878) took 1026 ms. Trace:
I20260709 13:02:40.223392  8386 rpcz_store.cc:276] 0709 13:02:39.196670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.200810 (+  4140us) service_pool.cc:224] Handling call
0709 13:02:39.218335 (+ 17525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:39.615210 (+396875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.222677 (+607467us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b5400189554. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:40.222875 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900884352}
W20260709 13:02:40.161123  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 217192us
W20260709 13:02:40.162029  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 107670us
I20260709 13:02:40.163172  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:40.056874  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:40.228516  8382 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:02:40.229326  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:40.229859  8526 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:40.229964  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:39.991150 12401 consensus_queue.cc:237] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:40.224910 12372 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:40.234789  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2388) took 1033 ms. Trace:
I20260709 13:02:40.234874  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:40.236107  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:40.235301  8529 rpcz_store.cc:276] 0709 13:02:39.201096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.201340 (+   244us) service_pool.cc:224] Handling call
0709 13:02:39.217514 (+ 16174us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:39.701119 (+483605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:39.806018 (+104899us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:39.823236 (+ 17218us) log.cc:844] Serialized 26 byte log entry
0709 13:02:40.174230 (+350994us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:40.174283 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.174352 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:40.234572 (+ 60220us) raft_consensus.cc:1685] finished
0709 13:02:40.234590 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:40.234733 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12430,"raft.queue_time_us":75764,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":9356,"thread_start_us":808572,"threads_started":2,"wal-append.queue_time_us":403669}
I20260709 13:02:40.236999  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:40.237243  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:40.237701  8528 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:40.240478 12373 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.200965 12333 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:40.241044 12373 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:40.243124 12333 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:40.243188 12373 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:40.244001  8378 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:02:40.167065  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:40.051501 11672 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.047394 12187 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:40.060555 12149 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:40.253937  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:40.169942 12382 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.191668  8452 raft_consensus.cc:2393] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:40.056414 12264 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:40.198836  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:40.204063  8500 connection.cc:256] RPC call timeout handler was delayed by -1.087701509999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3186s for a response
I20260709 13:02:40.051738  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:40.262502  9296 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:40.206740  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.208668  8454 raft_consensus.cc:2368] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8.
I20260709 13:02:40.058307  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:40.263652  8532 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:40.212322  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:40.213268  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 169779us
I20260709 13:02:40.213732 12096 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:40.230744  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:40.265578  8460 raft_consensus.cc:2393] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 12: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:40.265733  8533 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:40.231254  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:40.269836  8526 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:02:40.232054  8459 raft_consensus.cc:2410] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:40.233639  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:40.233822  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:40.244994  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:40.249429  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:40.248984  9258 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:40.271101  8382 raft_consensus.cc:2393] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 9: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:40.255101  9288 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:40.159430  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:40.257186  9290 raft_consensus.cc:2410] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:40.217407 12179 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:40.217144 12341 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.262846  8383 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:40.248283 12348 consensus_meta.cc:287] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.567s	user 0.010s	sys 0.000s
W20260709 13:02:40.296022  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 282647us
I20260709 13:02:40.296276  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:40.298462  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.256752 12429 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:02:40.255683 11672 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:40.257153 12187 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:40.285225  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:40.285311  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:40.287253  9287 raft_consensus.cc:1240] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:40.315029  8456 raft_consensus.cc:2393] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 12: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
W20260709 13:02:40.288687  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.245360 12234 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.279811  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:40.321017  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:40.321820  8532 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:40.302734  8349 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:40.322444  9294 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:40.305148  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:40.323208  9288 raft_consensus.cc:2393] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:40.283739  8351 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:40.297475  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:40.256651 12149 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.256978 12144 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:02:40.324517  9291 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:40.295828 12341 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:40.298663 12413 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:40.313277  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.298178 12096 raft_consensus.cc:697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:40.286412 12260 consensus_queue.cc:1059] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:02:40.443310  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:40.219694 12355 consensus_queue.cc:260] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:40.311161 12348 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:40.388188  8383 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:02:40.466799  8384 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:40.459563  9295 raft_consensus.cc:2393] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 12: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:40.281164 12382 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:40.304554 12404 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.142s
I20260709 13:02:40.325389 12361 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.298406 12098 consensus_queue.cc:1059] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:02:40.331424 12149 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:40.263011 12097 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.482779  9294 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:40.360864 12312 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:40.447184 12413 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.445554 12391 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:40.312358 12315 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.150s
I20260709 13:02:40.497275 12382 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:40.498150  8382 raft_consensus.cc:1275] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:40.460955 12319 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:40.520553  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 237743us
W20260709 13:02:40.487380 12374 consensus_meta.cc:287] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 1.214s	user 0.010s	sys 0.003s
I20260709 13:02:40.327416 12234 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:40.513965 12413 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:40.594702  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 311033us
I20260709 13:02:40.544328 12382 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:40.596199  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:02:40.599215  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 71510.6us
W20260709 13:02:40.566509 12445 log.cc:927] Time spent T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:02:40.493788 12361 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:40.544931 12348 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.515632 12097 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:40.549786 12394 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:40.606386  8349 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:40.543690 12319 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:40.545508 12374 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:40.719884  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 197526us
W20260709 13:02:40.722373  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 54297.6us
W20260709 13:02:40.726830  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.754956  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.843088  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.617798 12423 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:40.613682 12260 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:02:40.856274  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 249934us
I20260709 13:02:40.873139  9292 raft_consensus.cc:2368] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13.
I20260709 13:02:40.883869  8349 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:02:40.897890  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.833725 12315 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:40.866864 12451 raft_consensus.cc:3055] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:40.616796 12348 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:40.904989  8332 auto_rebalancer.cc:893] Removing replace marker failed: Replica b8eb0ad4490645598004d862412f4e31 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:02:40.912552 12443 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.391s	user 0.001s	sys 0.000s
W20260709 13:02:40.912902  8332 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:02:40.913342  8332 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:02:40.913573 12382 raft_consensus.cc:3055] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:40.913990 12382 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:02:40.896924 12445 log.cc:927] Time spent T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:02:40.620852 12096 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:40.949283  8533 consensus_meta.cc:287] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.664s	user 0.006s	sys 0.003s
I20260709 13:02:41.033403  8533 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:40.912545  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2884) took 1143 ms. Trace:
W20260709 13:02:40.959985  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 92557.1us
I20260709 13:02:41.034162  8381 rpcz_store.cc:276] 0709 13:02:39.769515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.770353 (+   838us) service_pool.cc:224] Handling call
0709 13:02:39.884764 (+114411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:39.900809 (+ 16045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.912339 (+1011530us) spinlock_profiling.cc:243] Waited 71 ms on lock 0x7b540026a050. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:40.912491 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163379584}
I20260709 13:02:41.034695  8500 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:41.068509  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 462899us
I20260709 13:02:41.070519  8455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 728) took 1353 ms. Trace:
I20260709 13:02:41.071880  8455 rpcz_store.cc:276] 0709 13:02:39.717634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.723805 (+  6171us) service_pool.cc:224] Handling call
0709 13:02:39.814066 (+ 90261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:39.814425 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:39.814454 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:40.335388 (+520934us) spinlock_profiling.cc:243] Waited 52.3 ms on lock 0x7b2c0007a8e8. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2
0709 13:02:40.365158 (+ 29770us) log.cc:844] Serialized 26 byte log entry
0709 13:02:40.603784 (+238626us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:40.603836 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.603930 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:41.045195 (+441265us) raft_consensus.cc:1685] finished
0709 13:02:41.045227 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.070445 (+ 25218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2310,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":120379136,"thread_start_us":116876,"threads_started":1,"wal-append.queue_time_us":511055}
W20260709 13:02:40.917004 12280 consensus_meta.cc:287] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.883s	user 0.001s	sys 0.007s
I20260709 13:02:40.972703 12448 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:40.967330 12348 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:40.952029 12319 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:40.906430 12264 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:40.944118 12325 consensus_meta.cc:287] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.967s	user 0.008s	sys 0.002s
I20260709 13:02:41.045902 12454 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:40.955736 12361 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:40.938414 12097 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:40.953446 12374 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:41.106139  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:41.078145 12341 consensus_meta.cc:287] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.001s
I20260709 13:02:41.106804  8383 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:40.926448 12234 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:40.990803 12287 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.000082 12462 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:40.886868 12260 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:40.971730 12459 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:41.099978  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:41.100658  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:41.103871  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 220079us
I20260709 13:02:41.104710  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:41.117029  8382 raft_consensus.cc:2393] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 11: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:40.910099 12451 raft_consensus.cc:740] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:41.109825  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:41.110124  8460 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:41.129694  8461 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:41.110553  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:41.113734  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:41.130537  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.038779 12144 consensus_queue.cc:1059] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:02:41.112020  8459 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:41.135667  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:41.118031  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:41.136318  8452 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:41.138960  8452 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:02:41.115921  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 81298.1us
I20260709 13:02:41.119390  8349 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:02:41.171980  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 52677.2us
I20260709 13:02:41.173024  8349 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:41.125463  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:41.173763  9290 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:41.174041  8386 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.127545  8501 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:41.085546 12448 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:41.132994  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:41.133234  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:41.183219  8454 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 11: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:41.140892  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:41.139565 12228 consensus_meta.cc:287] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 1.560s	user 0.012s	sys 0.001s
I20260709 13:02:41.146075  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:41.189811  8458 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.150909  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:41.117440 12459 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:41.095359 12280 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:41.145653 12264 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.145133 12348 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.163153  9295 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:02:41.195998  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.090693 12453 consensus_queue.cc:1048] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:02:41.100193 12325 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:41.170377  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:41.140053 12097 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.117049 12287 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:41.135996 12454 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 13:02:41.175175  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 47711.4us
I20260709 13:02:41.115077 12341 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:41.144106 12456 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.190729  8459 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:41.215253 12456 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:41.216416 12287 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:41.189818  8500 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:41.181561 12234 raft_consensus.cc:2764] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:41.144300 12461 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:41.164324 12179 consensus_meta.cc:287] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.853s	user 0.011s	sys 0.000s
I20260709 13:02:41.161490  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:41.228279  8378 raft_consensus.cc:2393] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 10: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:41.200678  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2404) took 1151 ms. Trace:
W20260709 13:02:41.181855 12418 consensus_meta.cc:287] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.959s	user 0.010s	sys 0.002s
I20260709 13:02:41.198290  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:41.201188 12417 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.193774 12459 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:41.191737  8383 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:02:41.193222 12448 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.225553  9288 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:41.233213  9290 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:41.228850  8535 rpcz_store.cc:276] 0709 13:02:40.049003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.049197 (+   194us) service_pool.cc:224] Handling call
0709 13:02:40.054303 (+  5106us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:40.114077 (+ 59774us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:40.177612 (+ 63535us) log.cc:844] Serialized 14 byte log entry
0709 13:02:40.476503 (+298891us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:40.500985 (+ 24482us) log.cc:844] Serialized 26 byte log entry
0709 13:02:40.501218 (+   233us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:40.577053 (+ 75835us) log.cc:844] Serialized 14 byte log entry
0709 13:02:40.577434 (+   381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.577509 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:41.200374 (+622865us) raft_consensus.cc:1685] finished
0709 13:02:41.200401 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.200586 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11113,"prepare.queue_time_us":99742,"prepare.run_cpu_time_us":146,"prepare.run_wall_time_us":5524,"raft.queue_time_us":126403,"raft.run_cpu_time_us":422,"raft.run_wall_time_us":26054,"spinlock_wait_cycles":1750272,"thread_start_us":359470,"threads_started":2,"wal-append.queue_time_us":301034}
I20260709 13:02:41.235256  8461 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:41.246789  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:41.129148 12462 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:41.235103  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:41.244655  8501 leader_election.cc:400] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:02:41.250588  8501 leader_election.cc:403] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:02:41.251755  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:41.253288  8458 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:41.208948 12264 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:41.258221  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:41.258845  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:41.260023  8460 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:02:41.261763  9293 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:41.262884  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:41.263914  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:41.267165  9295 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 11: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:41.208473 12348 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:41.237506 12287 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:41.303678  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:41.270267  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:41.272583  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:41.273279 12450 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.306162 12456 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:41.305974 12450 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:41.309032 12450 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:41.235631 12179 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:41.311468 12179 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:41.217860 12097 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:41.312815  8459 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:41.314242 12097 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:41.315599 12097 consensus_queue.cc:1059] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:41.235711 12228 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:41.318449  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 128737us
I20260709 13:02:41.278395 12280 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:41.285655  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:41.287448  8386 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:41.305321  8378 raft_consensus.cc:2376] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12. Re-sending same reply.
I20260709 13:02:41.320080  9290 raft_consensus.cc:2393] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:41.305234  8458 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:41.202431 12451 consensus_queue.cc:260] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:41.352170  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:41.357601  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:41.358204 12413 consensus_meta.cc:287] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.758s	user 0.009s	sys 0.000s
I20260709 13:02:41.358304  8386 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:41.358830 12413 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:41.359298  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:41.361908  8386 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
W20260709 13:02:41.302245 12149 consensus_meta.cc:287] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.796s	user 0.011s	sys 0.000s
I20260709 13:02:41.362766 12413 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:41.362668 12149 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:41.293206 12234 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:41.352551  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:41.244376 12418 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:41.675269 12418 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:41.370645 12149 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:41.355614  8500 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:41.248423 12417 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:41.718423  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 390298us
I20260709 13:02:41.720112  8500 leader_election.cc:400] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12.
I20260709 13:02:41.720963  8500 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:41.721764 12417 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:41.247738 12461 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:41.722286 12117 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:41.722998 12117 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:41.723906 12461 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:41.393600 12451 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:41.351974 12450 raft_consensus.cc:3055] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:41.725240 12450 raft_consensus.cc:740] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:41.726081 12450 consensus_queue.cc:260] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:41.727305 12450 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:41.383303 12453 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:41.729290 12453 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:41.729753 12453 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.730721 12117 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:41.327688 12456 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:02:41.322296 12287 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:41.416281 12462 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:41.426759 12187 consensus_meta.cc:287] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 1.090s	user 0.005s	sys 0.006s
W20260709 13:02:41.396869 12457 consensus_queue.cc:1175] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "446d9310dce14ff4afff2dc2d64f68d8" responder_term: 10 status { last_received { term: 8 index: 8 } last_committed_idx: 8 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:41.434957 12341 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:41.439071 12264 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:41.437812 11672 consensus_meta.cc:287] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 1.117s	user 0.006s	sys 0.007s
I20260709 13:02:41.732563 12187 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:41.440668 12348 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:41.441222 12325 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:41.442400 12260 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:41.445835 12234 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:02:41.436781 12470 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:41.450162 12448 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:41.733289 11672 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:41.739487  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2406) took 1491 ms. Trace:
I20260709 13:02:41.739670 11672 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:41.740891 12391 raft_consensus.cc:3055] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:41.739898  8529 rpcz_store.cc:276] 0709 13:02:40.248064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.248185 (+   121us) service_pool.cc:224] Handling call
0709 13:02:40.261863 (+ 13678us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:40.262248 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:40.262277 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:40.988618 (+726341us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b1800347680. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53662a6 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a
0709 13:02:40.990141 (+  1523us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b2c0003cae8. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2
0709 13:02:40.990605 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:02:41.322115 (+331510us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:41.322165 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.322305 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:41.739281 (+416976us) raft_consensus.cc:1685] finished
0709 13:02:41.739299 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.739426 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":355,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":21238,"spinlock_wait_cycles":15778560,"thread_start_us":331175,"threads_started":1,"wal-append.queue_time_us":409912}
I20260709 13:02:41.741314 12391 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:41.742138 12391 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:41.743435 12391 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:41.744040  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.744834  8457 raft_consensus.cc:2368] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10.
I20260709 13:02:41.737013 12448 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:41.748660 12063 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:41.748873 12187 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:41.748873  8500 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:41.752424 12382 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:41.753765 12382 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:41.754407 12287 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:41.756788 12417 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:41.533744  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:41.973790  8378 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:41.975154  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:41.976125  8378 raft_consensus.cc:2393] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 11: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:41.603780  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:41.663794  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 387375us
I20260709 13:02:41.674496  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:41.978816  8383 raft_consensus.cc:2393] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 11: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:02:41.701952  8349 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.017s	sys 0.021s
W20260709 13:02:41.979710  8349 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.017s	sys 0.021s
W20260709 13:02:41.980356  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 807367us
I20260709 13:02:41.981050  8349 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:41.982260  8349 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:41.983323  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:41.984772  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:41.985460 12448 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.986034  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:41.991400  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:41.992693  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:41.993666  8386 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:41.996168  8349 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:41.997511  8349 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:41.998661  8349 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:41.537456 12276 raft_consensus.cc:993] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
W20260709 13:02:41.567528 12422 log.cc:927] Time spent T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 1.063s	user 0.006s	sys 0.016s
I20260709 13:02:41.700580 12315 raft_consensus.cc:3055] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:42.158998 12315 raft_consensus.cc:740] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:42.159997 12315 consensus_queue.cc:260] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:41.452718 12459 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:41.775583  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.783957  8460 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:42.190198  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:42.190945  8535 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:42.194043  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:42.194770  8535 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:42.196282 12459 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:42.196746  8460 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:02:41.791785  9258 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:42.197615  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 405868us
I20260709 13:02:42.198369  9258 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:42.199573 12264 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:42.200173 12264 raft_consensus.cc:697] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:42.201119 12264 consensus_queue.cc:237] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:42.202557  8535 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:02:41.834775 12228 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.904428  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:42.203079 12063 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:42.203392  8381 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:42.203274 12228 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:42.203991  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:42.204495  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:42.204655  8533 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:42.205049  8381 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:42.206642 12228 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:41.911176  8426 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.008s	sys 0.012s
W20260709 13:02:42.208300  8426 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.008s	sys 0.013s
I20260709 13:02:42.208132  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:42.208588  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 934171us
I20260709 13:02:42.208724  8533 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:41.915937  9292 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 582) took 1662 ms (client timeout 2096 ms). Trace:
W20260709 13:02:42.209641  9292 rpcz_store.cc:269] 0709 13:02:40.254375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.261436 (+  7061us) service_pool.cc:224] Handling call
0709 13:02:41.915578 (+1654142us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b5400735854. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:41.915843 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316240640}
I20260709 13:02:41.919195  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:42.212488  8527 raft_consensus.cc:2410] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:02:42.213413  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:42.213933  8527 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:42.214852  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:42.215586  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48484 (request call id 659) took 1103 ms. Trace:
I20260709 13:02:42.215898  8383 rpcz_store.cc:276] 0709 13:02:41.111834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.979335 (+867501us) service_pool.cc:224] Handling call
0709 13:02:42.214701 (+235366us) spinlock_profiling.cc:243] Waited 9.75 ms on lock 0x7b5800151e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd44b0a0 00007f36cd44a984 00007f36c69c56d4 00007f36c69c5662
0709 13:02:42.215529 (+   828us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22433024}
I20260709 13:02:41.919464  9296 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:41.920552  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:42.219027  9295 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:02:41.921460  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:42.012892  8349 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:02:42.381278  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 368455us
I20260709 13:02:41.761970  8500 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:02:42.382700  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 620772us
I20260709 13:02:42.384011  8500 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:42.001183 12448 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:42.385588 12228 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:42.386283 12228 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:42.004956  8501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.009s	sys 0.021s
W20260709 13:02:42.387138  8501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.119s	user 0.010s	sys 0.021s
W20260709 13:02:42.387451  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 1.14287e+06us
I20260709 13:02:42.388068  8501 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:42.009733 12355 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:42.019696  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:42.393436  8531 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:42.394496  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:42.395224  8531 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:42.396157  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:42.396682  8531 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:42.039762  9291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 580) took 1788 ms. Trace:
I20260709 13:02:42.397305  9291 rpcz_store.cc:276] 0709 13:02:40.251000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.251109 (+   109us) service_pool.cc:224] Handling call
0709 13:02:40.266849 (+ 15740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:40.450366 (+183517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.039367 (+1589001us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b54004b8cd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:42.039671 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104892800}
I20260709 13:02:42.041523 12460 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:42.047071  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:42.050915 12133 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:42.398968 12133 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:42.399328  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:42.399892  8530 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:42.400686  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:42.057983 12484 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:42.074173  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 182252us
I20260709 13:02:42.401678  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:42.402231  8530 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.056964 12453 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:42.406531 12453 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:42.407713 12348 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.408273 12348 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:42.409487  8530 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:42.410293 12348 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:42.410378  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:42.410928 12348 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:42.411101  8530 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:42.411438 12348 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:42.411976  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:42.412519  8530 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:42.413259 12264 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:42.077649 12391 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:42.414850 12391 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:42.415283 12391 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.084380  9293 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:42.093019  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2405) took 1845 ms. Trace:
I20260709 13:02:42.100476  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:42.417718  8526 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 11: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:42.417368  8528 rpcz_store.cc:276] 0709 13:02:40.247778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.258919 (+ 11141us) service_pool.cc:224] Handling call
0709 13:02:40.304026 (+ 45107us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:40.321958 (+ 17932us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:40.321988 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:40.328401 (+  6413us) log.cc:844] Serialized 26 byte log entry
0709 13:02:41.806666 (+1478265us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b180028d320. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c80250d1 00007f36c8440a0f
0709 13:02:42.057517 (+250851us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:42.057565 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.057652 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.092643 (+ 34991us) raft_consensus.cc:1685] finished
0709 13:02:42.092676 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.092949 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7829,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":122250,"spinlock_wait_cycles":10552192,"thread_start_us":250647,"threads_started":1,"wal-append.queue_time_us":1631950}
I20260709 13:02:42.112898 12470 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:42.419450 12470 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:42.419826 12470 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:42.419929  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:42.417565  9293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 609) took 1090 ms. Trace:
I20260709 13:02:42.421486  9293 rpcz_store.cc:276] 0709 13:02:41.327440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.327572 (+   132us) service_pool.cc:224] Handling call
0709 13:02:42.084200 (+756628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.417308 (+333108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.417513 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:42.126834  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:42.421633  8528 raft_consensus.cc:1240] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:02:42.422742  8534 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.425015  8528 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:42.161072 12315 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:42.426659  8501 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:41.839248  8272 maintenance_manager.cc:643] P 3a492d68031a44b1b0b286d8ce68436c: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 4.760s	user 0.142s	sys 0.068s Metrics: {"bytes_written":30238,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":14475,"dirs.run_cpu_time_us":488,"dirs.run_wall_time_us":7795,"drs_written":1,"lbm_read_time_us":414,"lbm_reads_lt_1ms":4,"lbm_write_time_us":40477,"lbm_writes_10-100_ms":2,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":10692,"threads_started":2,"update_count":18,"wal-append.queue_time_us":1569}
W20260709 13:02:42.077426  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:42.615506  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.622967  8273 maintenance_manager.cc:419] P 3a492d68031a44b1b0b286d8ce68436c: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10807 bytes on disk
I20260709 13:02:42.413301  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:42.632334 12348 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:41.924559  8351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.014s	sys 0.045s
W20260709 13:02:42.636042  8351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.490s	user 0.016s	sys 0.047s
I20260709 13:02:42.077646  8378 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:41.961705  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:42.708123  8379 raft_consensus.cc:2393] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:42.708642  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 2193) took 1593 ms. Trace:
I20260709 13:02:42.708985  8379 rpcz_store.cc:276] 0709 13:02:41.114915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.961411 (+846496us) service_pool.cc:224] Handling call
0709 13:02:42.708572 (+747161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:42.710057  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:42.710700  8379 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.818279  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:42.716933  8382 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
I20260709 13:02:42.717582  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48484 (request call id 673) took 1595 ms. Trace:
I20260709 13:02:42.717923  8382 rpcz_store.cc:276] 0709 13:02:41.122258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.818015 (+695757us) service_pool.cc:224] Handling call
0709 13:02:42.717522 (+899507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:42.719053  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:42.719902  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48484 (request call id 665) took 1606 ms. Trace:
I20260709 13:02:42.720263  8382 rpcz_store.cc:276] 0709 13:02:41.113284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.718751 (+1605467us) service_pool.cc:224] Handling call
0709 13:02:42.719841 (+  1090us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:42.176882  8384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2892) took 1885 ms. Trace:
I20260709 13:02:42.722913  8384 rpcz_store.cc:276] 0709 13:02:40.291473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.291604 (+   131us) service_pool.cc:224] Handling call
0709 13:02:40.466558 (+174954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:40.475257 (+  8699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.176647 (+1701390us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54003b6350. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:42.176814 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348162816}
I20260709 13:02:42.724493  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:42.083166  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:42.726986  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:42.728305  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:42.001402  8386 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:42.730418  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:41.786585  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:42.732115  8377 raft_consensus.cc:2393] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 7: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:02:42.732573  8377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48484 (request call id 672) took 1610 ms (client timeout 2144 ms). Trace:
W20260709 13:02:42.732985  8377 rpcz_store.cc:269] 0709 13:02:41.121983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.786270 (+664287us) service_pool.cc:224] Handling call
0709 13:02:42.732509 (+946239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:42.734489  8377 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:42.735139  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2894) took 1473 ms. Trace:
I20260709 13:02:42.735481  8377 rpcz_store.cc:276] 0709 13:02:41.261823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.733761 (+1471938us) service_pool.cc:224] Handling call
0709 13:02:42.734138 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.734886 (+   748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.735085 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:41.926942  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:42.138247  8454 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.011s	sys 0.009s
W20260709 13:02:42.740499  8454 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.525s	user 0.013s	sys 0.010s
W20260709 13:02:42.115958  8457 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36448 (request call id 2139) took 2074 ms (client timeout 1985 ms). Trace:
I20260709 13:02:42.339643  8381 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
W20260709 13:02:42.742156  8457 rpcz_store.cc:269] 0709 13:02:40.041464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.045910 (+  4446us) service_pool.cc:224] Handling call
0709 13:02:42.115657 (+2069747us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b540019d2d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:42.115835 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3562899712}
I20260709 13:02:42.350684  8426 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:41.816462  8529 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:42.220259  8532 raft_consensus.cc:2410] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:42.225785  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:42.230651  8527 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
W20260709 13:02:42.234073  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.199538  9258 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:42.772197  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 572677us
I20260709 13:02:42.772437 12264 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:42.772910 12264 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.418814  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:42.790475  8526 raft_consensus.cc:2393] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 11: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:42.294724  9288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 585) took 2035 ms. Trace:
W20260709 13:02:42.435547  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 53487.9us
I20260709 13:02:42.164510 12144 consensus_queue.cc:1048] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:42.400995 12133 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:42.353144 12382 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:42.818399 12382 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:42.418083 12428 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:42.434414 12459 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:42.823835 12459 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:42.824335 12459 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:42.827355  8379 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:42.807291 12470 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:42.111182 12469 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:42.236573  8533 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:42.449069  8531 raft_consensus.cc:1275] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:02:42.486506  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 59901.1us
I20260709 13:02:42.860481  8501 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:42.861404  8501 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:42.862689 12469 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:42.863627  8380 raft_consensus.cc:2410] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:42.216997  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:42.864836 12428 raft_consensus.cc:2764] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:42.523036  8500 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:42.865923  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 2192) took 1751 ms. Trace:
I20260709 13:02:42.866362  8380 rpcz_store.cc:276] 0709 13:02:41.114696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.926637 (+811941us) service_pool.cc:224] Handling call
0709 13:02:42.865569 (+938932us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54002c7254. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:42.865847 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289286016}
I20260709 13:02:42.530814 12315 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:42.866374  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 343391us
I20260709 13:02:42.867455 12315 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:42.868182  8500 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:42.869668 12315 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:42.538230  8534 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:42.872893 12474 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:42.873293 12260 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:42.555608  9261 leader_election.cc:336] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.694s (SENT)
I20260709 13:02:42.873817 12260 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:42.874512  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 318911us
W20260709 13:02:42.874882  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 524254us
W20260709 13:02:42.875138  9261 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.791s (SENT) [suppressed 37 similar messages]
W20260709 13:02:42.582165  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.875954 12260 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:42.876214  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.876659 12260 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:42.638207  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 1.49174e+06us
I20260709 13:02:42.879528  8351 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:42.641278  8272 maintenance_manager.cc:643] P 3a492d68031a44b1b0b286d8ce68436c: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":371,"lbm_reads_lt_1ms":4}
W20260709 13:02:42.642694  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.881314 12355 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:42.644248  8530 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:42.648205 12391 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:42.881876 12355 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:42.883941 12391 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:42.649065  8453 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:02:42.746073 12417 raft_consensus.cc:2764] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:02:42.884541 12355 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:42.885111 12228 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:42.885730 12293 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.885876 12417 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:42.748375  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 2898) took 1442 ms. Trace:
I20260709 13:02:42.886395 12464 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:42.886255 12293 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:42.886605  8385 rpcz_store.cc:276] 0709 13:02:41.287121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.728038 (+1440917us) service_pool.cc:224] Handling call
0709 13:02:42.729027 (+   989us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:42.887120 12464 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:42.749703  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:42.889410  8382 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:42.751056 11957 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.890066  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:42.890314  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:42.755496 12276 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.890517 11957 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:42.891100 12260 raft_consensus.cc:697] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:42.891404 12276 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:42.892072 12260 consensus_queue.cc:237] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:42.659021  8427 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:42.894747  8377 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:42.895108  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 236142us
W20260709 13:02:42.770678  9317 debug-util.cc:398] Leaking SignalData structure 0x7b08002f5fa0 after lost signal to thread 7274
I20260709 13:02:42.771204 12063 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.897521 12063 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:42.898564 12325 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:42.898995 12325 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.899340 12325 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:42.900624 12063 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:42.773417 12264 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.901316  8386 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:42.902165 12276 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:42.891050  8460 raft_consensus.cc:2393] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 10: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:42.785326 12287 consensus_queue.cc:1059] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:42.904333 12287 raft_consensus.cc:3055] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:42.904680 12287 raft_consensus.cc:740] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:42.779508 12292 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.904728  8351 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:42.905556 12292 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:42.905968 12287 consensus_queue.cc:260] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:42.792729  8378 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:42.907330  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2900) took 1619 ms. Trace:
I20260709 13:02:42.907817 12292 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:42.785499  9258 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:42.799193 12096 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:42.797729  9288 rpcz_store.cc:276] 0709 13:02:40.259837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.326502 (+ 66665us) service_pool.cc:224] Handling call
0709 13:02:40.326787 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:41.244644 (+917857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.294408 (+1049764us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b54003a20d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:42.294652 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2066318592}
I20260709 13:02:42.800982  8284 catalog_manager.cc:5697] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 5 to 6, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 6 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:42.802937 12319 raft_consensus.cc:1081] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:02:42.909386 12096 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:42.820794 12382 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:42.909920 12096 raft_consensus.cc:697] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:42.910180 12144 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.908980 12460 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:02:42.910728 12144 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:42.910902 12096 consensus_queue.cc:237] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:42.907676  8378 rpcz_store.cc:276] 0709 13:02:41.287740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.792245 (+1504505us) service_pool.cc:224] Handling call
0709 13:02:42.792557 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.907092 (+114535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.907273 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:42.801717 12463 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.912843 12144 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:42.913652 12428 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:42.873523 12474 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:42.749050  8384 raft_consensus.cc:2393] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:42.893347 12448 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:42.914958  8384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 2196) took 1799 ms. Trace:
I20260709 13:02:42.839056 12470 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:42.898029  9317 debug-util.cc:398] Leaking SignalData structure 0x7b08002f68e0 after lost signal to thread 8318
I20260709 13:02:42.913532  8457 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:42.902758  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48484 (request call id 671) took 1781 ms. Trace:
I20260709 13:02:42.843886 12459 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:42.922845  8381 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:42.923110 12474 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:42.925069 12459 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:42.926355  8382 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:42.926954  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2896) took 1661 ms. Trace:
I20260709 13:02:42.927460  8381 rpcz_store.cc:276] 0709 13:02:41.265924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.742553 (+1476629us) service_pool.cc:224] Handling call
0709 13:02:42.742868 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.923305 (+180437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.926659 (+  3354us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54003dc7d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:42.926884 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413516160}
I20260709 13:02:42.929032  8378 raft_consensus.cc:1240] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:42.909763  8453 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36448 (request call id 2149) took 2865 ms (client timeout 1825 ms). Trace:
W20260709 13:02:42.912819  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 127405us
I20260709 13:02:42.913414 12463 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:42.930322  8453 rpcz_store.cc:269] 0709 13:02:40.044222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.198562 (+154340us) service_pool.cc:224] Handling call
0709 13:02:42.909565 (+2711003us) spinlock_profiling.cc:243] Waited 2.39 s on lock 0x7b540019e1d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:42.909669 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5489621376}
I20260709 13:02:42.930756  9258 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:42.914309 12428 raft_consensus.cc:697] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:42.894093 12453 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:42.915347  8384 rpcz_store.cc:276] 0709 13:02:41.115610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.724207 (+1608597us) service_pool.cc:224] Handling call
0709 13:02:42.914890 (+190683us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:42.916373  8386 rpcz_store.cc:276] 0709 13:02:41.121691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.730142 (+1608451us) service_pool.cc:224] Handling call
0709 13:02:42.902535 (+172393us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b540013e2d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:42.902679 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391286016}
I20260709 13:02:42.798471  8349 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:02:42.916893  9317 debug-util.cc:398] Leaking SignalData structure 0x7b0800108540 after lost signal to thread 8410
W20260709 13:02:42.960112  9317 debug-util.cc:398] Leaking SignalData structure 0x7b0800361a00 after lost signal to thread 8485
I20260709 13:02:42.908085 12484 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:42.888669 12293 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:42.875950  9261 leader_election.cc:336] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.803s (SENT)
W20260709 13:02:42.961790  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 83522.9us
I20260709 13:02:42.961921  9261 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:42.962224 12491 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:42.962585  9260 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
W20260709 13:02:42.962956  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 87033.7us
I20260709 13:02:42.918164  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2895) took 1654 ms. Trace:
I20260709 13:02:42.964569  8377 rpcz_store.cc:276] 0709 13:02:41.263503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.736253 (+1472750us) service_pool.cc:224] Handling call
0709 13:02:42.736568 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.895168 (+158600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.917935 (+ 22767us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54001a77d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:42.918119 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363362560}
W20260709 13:02:42.918967  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.932592  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:42.966600  8453 raft_consensus.cc:2410] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:02:42.934005  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:42.906164  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:42.935842  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2901) took 1647 ms. Trace:
I20260709 13:02:42.968212  8427 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:42.952334 12487 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:42.962738 12491 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.932473  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:42.974328  8460 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.974800  8380 raft_consensus.cc:1240] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:42.968312  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 169934us
I20260709 13:02:42.975373  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:42.976032  8452 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:42.969301  9260 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:42.968598  8379 rpcz_store.cc:276] 0709 13:02:41.288015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.915721 (+1627706us) service_pool.cc:224] Handling call
0709 13:02:42.935195 (+ 19474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.935424 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.935463 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:42.935519 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:42.935564 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.935636 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.935769 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:42.950448  8454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 2125) took 1806 ms. Trace:
W20260709 13:02:42.967981  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 61916.9us
I20260709 13:02:42.979965  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:42.970177  9317 debug-util.cc:398] Leaking SignalData structure 0x7b080040c640 after lost signal to thread 8559
W20260709 13:02:42.982112  9317 debug-util.cc:398] Leaking SignalData structure 0x7b080036d920 after lost signal to thread 9320
W20260709 13:02:42.982402  9317 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3c20 after lost signal to thread 9321
I20260709 13:02:42.892954 11957 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:42.931638 12355 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.933238 12228 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.991925  8459 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:02:42.984983  8460 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:42.985737  8427 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:42.997895  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:42.976672  8424 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:43.003089  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:42.961355 12484 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.008148  8501 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:43.003065  8427 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:43.033535  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 56929.4us
I20260709 13:02:42.977366  8454 rpcz_store.cc:276] 0709 13:02:41.144211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.197306 (+ 53095us) service_pool.cc:224] Handling call
0709 13:02:41.197716 (+   410us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:41.207794 (+ 10078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:41.207827 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:41.208365 (+   538us) log.cc:844] Serialized 52 byte log entry
0709 13:02:42.741003 (+1532638us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:42.839472 (+ 98469us) log.cc:844] Serialized 14 byte log entry
0709 13:02:42.949940 (+110468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.950069 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.950137 (+    68us) raft_consensus.cc:1685] finished
0709 13:02:42.950157 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.950359 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96187,"prepare.queue_time_us":92587,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":115165,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":13865,"thread_start_us":1631140,"threads_started":3,"wal-append.queue_time_us":226477,"wal-append.run_cpu_time_us":3365,"wal-append.run_wall_time_us":1008062}
I20260709 13:02:42.988880  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:43.020749  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.031642  8452 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:43.036621  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:43.034725  8427 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:42.975385 12448 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:42.972962 12469 raft_consensus.cc:2764] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:42.967279 12496 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:42.972520 12417 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.975482 12464 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:42.978864 12292 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:43.050621  8424 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:43.053620 12462 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:43.050654 12348 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:43.055441 12348 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.055917 12348 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:43.056336  8384 raft_consensus.cc:1240] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:43.056538 12287 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:43.058359  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:43.059284 12492 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:43.059753 12492 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:43.060169 12492 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.060609  8384 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:43.041679  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:43.062304  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:43.062526  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:43.063001  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:43.063220  8384 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:02:43.063663  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:43.064170  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:43.064234  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:43.042721 12489 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:43.042872  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:43.043218  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:43.013266  8284 catalog_manager.cc:5697] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:43.032852 11957 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:42.967916 12319 consensus_queue.cc:1059] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:02:43.050844  8427 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:42.977591 12491 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:43.065028  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:43.079888  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:43.082193  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 214078us
I20260709 13:02:43.083071  8500 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:43.066567  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:43.039996 12484 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:43.040540 12298 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:43.037474  8452 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:43.093582  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:43.093698  8460 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:43.095458  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:43.071581  8377 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:43.066181  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:43.051710  8453 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:43.096522  8384 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:02:43.094918  8424 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:43.102535  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:43.043738 12361 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:43.104816  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:43.109879  8284 catalog_manager.cc:5697] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:43.111641 12487 raft_consensus.cc:697] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:43.103132  8382 raft_consensus.cc:2376] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12. Re-sending same reply.
I20260709 13:02:43.120882  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:43.121604  9295 raft_consensus.cc:2393] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 13: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:43.010196 12293 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 13:02:43.042809 12144 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:43.107321  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:43.112207  8284 catalog_manager.cc:5697] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:43.113355  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 144166us
I20260709 13:02:43.114662 12503 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:43.104761  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 174077us
W20260709 13:02:43.118813  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 68046.9us
I20260709 13:02:43.117902  8500 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:43.120523  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:43.121632  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:43.122172  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:43.122956  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:43.032959 12228 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:43.051990 12463 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:43.083987 12460 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.033412 12355 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:43.051256 12448 raft_consensus.cc:697] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:43.216998  9260 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:43.128777  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:43.217864  8386 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 7: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:43.092180 12292 raft_consensus.cc:697] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:43.218060  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:43.140247  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:43.218416  9294 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:43.129136  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:43.218930  8382 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:43.219250  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:43.220120  8427 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:43.220206  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:43.221312 12149 raft_consensus.cc:3055] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:43.101660 11957 raft_consensus.cc:697] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:43.223500  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:43.106431 12467 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:43.225399  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 118176us
I20260709 13:02:43.101892 12298 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.219489  9258 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:43.095889 12459 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.251979  9260 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
W20260709 13:02:43.226687  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 131847us
W20260709 13:02:43.257515  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.287999  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:43.330911  8381 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 11: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:43.339196  9293 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:43.340528  9290 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:43.331864  8424 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
W20260709 13:02:43.364565  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 324618us
I20260709 13:02:43.330792  8377 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:43.331804  8351 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:43.366338  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 114434us
I20260709 13:02:43.366724  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:02:43.367381  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 147965us
I20260709 13:02:43.343889  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:43.368463  9258 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:43.085645 12417 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:43.376807  9260 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
W20260709 13:02:43.350509  9261 leader_election.cc:336] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.534s (SENT)
I20260709 13:02:43.109266 12361 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:43.354607  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:43.356670  8456 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.361102  8426 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:43.361958  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:43.361824  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 141782us
I20260709 13:02:43.330195 12149 raft_consensus.cc:740] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:43.372359  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.379009  9261 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:43.343405 12298 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:43.122195 12315 consensus_queue.cc:1059] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.237s
I20260709 13:02:43.353137 12462 raft_consensus.cc:697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:43.253634  8284 catalog_manager.cc:5697] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 9 to 11, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 11 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:43.383250  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:02:43.398984  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 67180.6us
I20260709 13:02:43.226511 12410 consensus_queue.cc:1059] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.153s
W20260709 13:02:43.397578  8349 connection.cc:256] RPC call timeout handler was delayed by -2.3748167989999729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 13:02:43.217124 12144 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:43.332253 12467 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:43.355856 12501 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:43.231206 12460 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:43.416852  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:43.129024 12097 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.271s
I20260709 13:02:43.407833  8457 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:43.365859 12319 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:43.329439 12473 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:43.430949  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.403139 12464 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:43.382694  9292 raft_consensus.cc:2393] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 9: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
W20260709 13:02:43.445627  8482 debug-util.cc:398] Leaking SignalData structure 0x7b08000fac00 after lost signal to thread 7274
I20260709 13:02:43.396534 12469 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:43.381394 12502 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:43.384490 12456 raft_consensus.cc:2804] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:43.378090 12489 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:43.457530  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 89119.1us
I20260709 13:02:43.457903 12507 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:43.460572  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 53136.4us
I20260709 13:02:43.461194  9293 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:43.384045 12503 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:43.401715 12453 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:43.384374 12361 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.352818 12459 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:43.452432  8284 catalog_manager.cc:5697] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 2 to 7, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:02:43.420930  8349 connection.cc:256] RPC call timeout handler was delayed by -2.0364167989999942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
I20260709 13:02:43.403538 12495 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:43.446135 12467 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:43.497114  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 136063us
W20260709 13:02:43.498907  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 115246us
I20260709 13:02:43.446588 11672 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:43.106649 12428 consensus_queue.cc:237] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:43.432435 12133 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:43.576365  8349 connection.cc:256] RPC call timeout handler was delayed by -1.6857052329999647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2504s for a response
W20260709 13:02:43.534842  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.403255 12391 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 13:02:43.578373  8351 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:43.578996 12063 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:43.583437  8482 debug-util.cc:398] Leaking SignalData structure 0x7b08001d4ea0 after lost signal to thread 8318
W20260709 13:02:43.584525  8482 debug-util.cc:398] Leaking SignalData structure 0x7b0800374c20 after lost signal to thread 8410
W20260709 13:02:43.584834  8482 debug-util.cc:398] Leaking SignalData structure 0x7b08000b6dc0 after lost signal to thread 8411
I20260709 13:02:43.585325  8424 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:02:43.586146  8482 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5240 after lost signal to thread 8485
I20260709 13:02:43.416386 12492 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:43.509727  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 159258us
W20260709 13:02:43.624261  9261 leader_election.cc:336] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.652s (SENT)
I20260709 13:02:43.459760 12260 consensus_queue.cc:1059] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 13:02:43.607915  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:43.584064  9258 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:43.618916  8527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38894
I20260709 13:02:43.629630  8527 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:43.630170  8527 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.598834  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:43.621114  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:43.626812 12063 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:43.498991 12228 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:43.632532  8534 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
W20260709 13:02:43.633533  8482 debug-util.cc:398] Leaking SignalData structure 0x7b0800347be0 after lost signal to thread 8559
I20260709 13:02:43.472414 12451 consensus_queue.cc:1059] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.117s
I20260709 13:02:43.472795 12384 consensus_queue.cc:1059] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.117s
I20260709 13:02:43.616106  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:43.635304  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:43.651862  8526 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
W20260709 13:02:43.637529  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 53536.7us
I20260709 13:02:43.588210 12456 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.638727  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:43.625169  9261 leader_election.cc:336] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.770s (SENT)
I20260709 13:02:43.515612 12315 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:43.494076 12319 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:43.625173 12502 raft_consensus.cc:697] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:43.638438  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:43.636078  8482 debug-util.cc:398] Leaking SignalData structure 0x7b08000eea20 after lost signal to thread 9320
W20260709 13:02:43.694988  8482 debug-util.cc:398] Leaking SignalData structure 0x7b08003f7be0 after lost signal to thread 9321
W20260709 13:02:43.695254  8482 debug-util.cc:398] Leaking SignalData structure 0x7b08003b7460 after lost signal to thread 11672
W20260709 13:02:43.695677  8482 debug-util.cc:398] Leaking SignalData structure 0x7b08002bb840 after lost signal to thread 12287
W20260709 13:02:43.695988  8482 debug-util.cc:398] Leaking SignalData structure 0x7b080034c060 after lost signal to thread 12341
W20260709 13:02:43.696223  8482 debug-util.cc:398] Leaking SignalData structure 0x7b080005c620 after lost signal to thread 12360
I20260709 13:02:43.586411 12495 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.587102 12469 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.587961 12507 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.586073 12133 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:43.502242 12457 consensus_queue.cc:1059] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.137s
I20260709 13:02:43.668987  8535 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:43.669557  9291 raft_consensus.cc:2393] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 9: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:43.605455 12496 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:43.669492  8530 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:02:43.502852 12464 raft_consensus.cc:697] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:43.710631 12464 consensus_queue.cc:237] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:43.672202  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 47061.8us
I20260709 13:02:43.623035 12473 raft_consensus.cc:2764] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:02:43.495047 12450 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.146s
I20260709 13:02:43.473194 11957 consensus_queue.cc:237] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:43.431862 12487 consensus_queue.cc:237] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:43.672097  8424 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:43.649211  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:43.634040 12096 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:43.692315  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:43.720191  8534 raft_consensus.cc:2410] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:43.648819 12228 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:43.698706  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 580836us
W20260709 13:02:43.699801  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 121856us
I20260709 13:02:43.696520  8527 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:43.728982  8500 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:43.495230 12448 consensus_queue.cc:237] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:43.694439  8531 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
W20260709 13:02:43.696661  8482 debug-util.cc:398] Leaking SignalData structure 0x7b08000300e0 after lost signal to thread 12456
W20260709 13:02:43.732722  8482 debug-util.cc:398] Leaking SignalData structure 0x7b08003b86a0 after lost signal to thread 12457
W20260709 13:02:43.733166  8482 debug-util.cc:398] Leaking SignalData structure 0x7b0800334fa0 after lost signal to thread 12461
I20260709 13:02:43.606196 12465 consensus_queue.cc:1059] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:02:43.667411 12456 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.709694 12496 raft_consensus.cc:697] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:43.715144  8456 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:43.690269 12451 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.716912  8532 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:02:43.741626  8457 raft_consensus.cc:606] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:02:43.724934 12501 raft_consensus.cc:697] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:43.742211  8457 raft_consensus.cc:614] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:43.743088 12501 consensus_queue.cc:237] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:43.725436 12521 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:43.733574  8482 debug-util.cc:398] Leaking SignalData structure 0x7b08003f6780 after lost signal to thread 12465
W20260709 13:02:43.746592  8482 debug-util.cc:398] Leaking SignalData structure 0x7b08003f67a0 after lost signal to thread 12467
W20260709 13:02:43.746939  8482 debug-util.cc:398] Leaking SignalData structure 0x7b08003f6720 after lost signal to thread 12473
W20260709 13:02:43.747157  8482 debug-util.cc:398] Leaking SignalData structure 0x7b08003f66c0 after lost signal to thread 12474
I20260709 13:02:43.747709  8527 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:43.748039  8530 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:43.708292 12469 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.706549 12315 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:43.588263 12292 consensus_queue.cc:237] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:43.735606  8380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.018s	sys 0.015s
I20260709 13:02:43.764930  8500 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:43.714432 12133 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:43.704208 12495 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.630450 12462 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:43.748987  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:43.772442  8534 raft_consensus.cc:2410] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:43.706835 12507 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:43.765340  8380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.018s	sys 0.015s
I20260709 13:02:43.738662 12503 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:43.774451 12063 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:43.714090 12391 consensus_queue.cc:1059] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:02:43.735091 12473 raft_consensus.cc:3055] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:43.738750 12355 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:43.773854  8500 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:43.765122 12315 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:43.771267 12325 consensus_meta.cc:287] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.871s	user 0.010s	sys 0.001s
I20260709 13:02:43.784850  8500 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:43.735342 12228 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:43.774448 12503 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:43.770236 12460 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:43.779526 12465 raft_consensus.cc:3055] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:43.764714 12451 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:43.779187 12417 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:43.781961 12473 raft_consensus.cc:740] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:43.844048  8379 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.001s	sys 0.022s
I20260709 13:02:43.794399 12315 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:43.838446  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 176581us
I20260709 13:02:43.794312 12355 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:43.831202 12264 consensus_meta.cc:287] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.930s	user 0.005s	sys 0.005s
W20260709 13:02:43.845647  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 468874us
W20260709 13:02:43.845194  8379 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.002s	sys 0.022s
I20260709 13:02:43.859936  8424 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:43.778748 12505 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:02:43.777567 12467 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:43.839308 12465 raft_consensus.cc:740] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:43.846045 12460 raft_consensus.cc:3055] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:43.845978 12492 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:43.853454 12417 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:43.850108 12355 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.857542 12508 raft_consensus.cc:3055] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:43.828359 12325 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:43.865298 12494 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
W20260709 13:02:43.901707 12348 consensus_meta.cc:287] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.845s	user 0.007s	sys 0.005s
I20260709 13:02:43.902256 12348 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:43.902735 12149 consensus_queue.cc:260] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:43.906226  9288 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 14: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:43.854985 12384 consensus_queue.cc:1059] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:02:43.878211 12355 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:43.905520 12506 log.cc:927] Time spent T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
W20260709 13:02:43.901727 12517 log.cc:927] Time spent T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:02:43.873737 12460 raft_consensus.cc:740] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:43.867856 12509 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:02:43.878790 12508 raft_consensus.cc:740] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:43.858388 12264 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:43.898481 12144 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:43.906914 12492 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:43.934688 12515 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:02:43.939456 12460 consensus_queue.cc:260] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:43.789940 12502 consensus_queue.cc:237] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:43.940449 12527 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:43.927640 12319 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:43.943073 12467 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:43.950455 12451 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:43.921307  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 61455us
I20260709 13:02:44.008481  8424 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:43.993249 12492 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:44.002667 12264 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:43.859225 12496 consensus_queue.cc:237] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:44.014226 12500 log.cc:927] Time spent T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.901s	user 0.002s	sys 0.004s
I20260709 13:02:44.014250 12492 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:44.003660 12523 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:44.004209  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:44.019549 12523 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.019719  8530 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:44.020005 12523 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:44.004463  8533 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:44.009791  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2914) took 2022 ms. Trace:
I20260709 13:02:44.021739  8385 rpcz_store.cc:276] 0709 13:02:41.987742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.931591 (+943849us) service_pool.cc:224] Handling call
0709 13:02:42.931892 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:42.951347 (+ 19455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.951393 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:42.952094 (+   701us) log.cc:844] Serialized 26 byte log entry
0709 13:02:43.102124 (+150030us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:43.102166 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.102244 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:44.009570 (+907326us) raft_consensus.cc:1685] finished
0709 13:02:44.009603 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.009736 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18934,"raft.queue_time_us":26445,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":4217,"thread_start_us":149151,"threads_started":1,"wal-append.queue_time_us":464841}
I20260709 13:02:44.023972  9260 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:44.029274  8424 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:43.996024 12348 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:44.041399  8530 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
W20260709 13:02:44.043232  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 329715us
I20260709 13:02:44.048974 12315 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:44.049906 12484 consensus_meta.cc:287] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.944s	user 0.011s	sys 0.000s
I20260709 13:02:44.050410 12484 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:44.052697 12484 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:44.053268 12522 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:44.053166 12508 consensus_queue.cc:260] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:44.053946 12522 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:44.054518 12508 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:44.025065 12491 consensus_meta.cc:287] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.952s	user 0.009s	sys 0.003s
W20260709 13:02:44.057861  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.060659  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:44.060858  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:44.061678  8526 raft_consensus.cc:2410] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:44.061738  8529 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:02:43.970002 12503 raft_consensus.cc:697] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 6 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:44.063299  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:44.106781  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:44.107156  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:44.116963  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:44.117272  8453 raft_consensus.cc:2376] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13. Re-sending same reply.
I20260709 13:02:44.106990  8535 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:44.108811  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 324009us
I20260709 13:02:44.109722  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:44.119057  8500 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:44.109879  9261 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:43.910337 12473 consensus_queue.cc:260] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:44.028859 12460 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.110217  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:44.081306 12467 raft_consensus.cc:3055] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:02:44.162662 12287 consensus_meta.cc:287] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 1.106s	user 0.014s	sys 0.011s
W20260709 13:02:44.112450  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 346453us
I20260709 13:02:44.116343  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:44.166138  8458 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:44.166838  8427 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:44.030972 12492 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:44.120767  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:44.168013  8454 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:02:44.166527  9293 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:44.119361  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:44.105631 12262 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:44.169823  8528 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:44.158921  8500 leader_election.cc:400] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8.
I20260709 13:02:44.170622  9291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55734 (request call id 936) took 1064 ms. Trace:
I20260709 13:02:44.170964  8500 leader_election.cc:403] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:02:44.171146  9291 rpcz_store.cc:276] 0709 13:02:43.106556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.106684 (+   128us) service_pool.cc:224] Handling call
0709 13:02:44.162601 (+1055917us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b5400047754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:44.170556 (+  7955us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":774523648}
I20260709 13:02:44.175406  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:44.177168  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:44.177983  8378 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:02:44.176364  8385 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:44.178841  8535 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:44.180665  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:44.181622  9289 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:02:44.166095 12467 raft_consensus.cc:740] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:44.183969 12467 consensus_queue.cc:260] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:44.185065 12467 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:44.185426 12262 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.185948 12262 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.186400  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2197) took 1133 ms. Trace:
I20260709 13:02:44.186795  8379 rpcz_store.cc:276] 0709 13:02:43.052630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.052760 (+   130us) service_pool.cc:224] Handling call
0709 13:02:43.055177 (+  2417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.080285 (+ 25108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:43.080321 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:43.080830 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:02:43.854004 (+773174us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:43.854070 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.854178 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:44.186165 (+331987us) raft_consensus.cc:1685] finished
0709 13:02:44.186188 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.186343 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35357,"raft.queue_time_us":25713,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":86,"spinlock_wait_cycles":1280,"thread_start_us":772649,"threads_started":1,"wal-append.queue_time_us":975109}
W20260709 13:02:44.159533  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 49736.4us
I20260709 13:02:44.086223 12325 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:43.966835 12465 consensus_queue.cc:260] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:44.109624 12484 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.197973  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:44.118680  9260 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:44.054512 12522 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:44.207001  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:44.191574  9261 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:44.194054  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:44.195282  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:44.208869  8500 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:44.207844 12492 raft_consensus.cc:697] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:44.219218 12492 consensus_queue.cc:237] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:44.220299 12462 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.201638 12287 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:44.225840  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:44.228048  8383 raft_consensus.cc:2393] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 7: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:44.063957 12495 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:44.221755 12528 log.cc:927] Time spent T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:02:44.193439 12489 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8.
I20260709 13:02:44.086609 12491 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:44.170038 12315 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:44.229912  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 111311us
I20260709 13:02:44.196969 12527 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:44.234133  9261 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:44.250124  8500 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:44.232508 12530 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:44.207283 12228 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:44.246717 12536 log.cc:927] Time spent T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:02:44.281524  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:44.242650 12348 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:44.234813 12507 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:44.256646 12491 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:44.278728 12495 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:44.213937 12484 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:44.208973 12264 raft_consensus.cc:2764] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:02:44.280393 12526 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:44.226979 12501 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.350688 12484 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:44.244716  9260 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:44.256745  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:44.279285 12503 consensus_queue.cc:237] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:44.351526  8535 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:44.341006 12497 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:44.353865 12497 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.227864 12287 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:44.354204 12497 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:44.354432 12287 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:44.334851 12510 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.331271 12489 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:44.356150 12319 raft_consensus.cc:3055] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:44.356683 12319 raft_consensus.cc:740] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:44.357554 12319 consensus_queue.cc:260] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:44.358641  8535 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:02:44.358819 12319 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:44.369884  8456 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53010 (request call id 744) took 1412 ms (client timeout 1759 ms). Trace:
W20260709 13:02:44.370421  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 125747us
I20260709 13:02:44.220854 12462 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:44.329936  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 95904us
W20260709 13:02:44.330492  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 80420.7us
I20260709 13:02:44.403105  8500 leader_election.cc:400] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10.
I20260709 13:02:44.403537  8500 leader_election.cc:403] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:44.322336  8458 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:02:44.322928 12144 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.335448  8534 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:44.341933  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.350164 12501 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:44.408079  9260 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:44.415656  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:44.229504 12531 log.cc:927] Time spent T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.100s	user 0.000s	sys 0.004s
I20260709 13:02:44.373473  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:44.374116  8453 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:44.424918  8459 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:44.425853  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:44.374138  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:44.426980  8460 raft_consensus.cc:2376] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9. Re-sending same reply.
I20260709 13:02:44.428262  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:44.370198 12526 raft_consensus.cc:697] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:44.377182 12495 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:44.380241 12298 consensus_meta.cc:287] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.963s	user 0.008s	sys 0.000s
I20260709 13:02:44.475860  9296 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:44.476608  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:44.385396 12529 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:44.370473  8456 rpcz_store.cc:269] 0709 13:02:42.957820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.958064 (+   244us) service_pool.cc:224] Handling call
0709 13:02:44.369631 (+1411567us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b54000d5f54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:44.369797 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":737883904}
I20260709 13:02:44.481258  9293 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:44.386073 12534 consensus_queue.cc:1059] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:02:44.387811 12456 consensus_meta.cc:287] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.623s	user 0.008s	sys 0.000s
I20260709 13:02:44.356118 12510 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:44.389950 12469 consensus_meta.cc:287] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.000s
W20260709 13:02:44.391471 12521 consensus_meta.cc:287] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.645s	user 0.011s	sys 0.000s
I20260709 13:02:44.391556 12355 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:44.393362 12096 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:44.392920 12262 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:44.363005 12287 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:44.412161  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:44.407516  8426 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:44.423921  8500 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:44.435446  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:44.449965  8534 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
W20260709 13:02:44.384908 12133 consensus_meta.cc:287] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.000s
I20260709 13:02:44.469638  9294 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:02:44.480150  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:44.482173  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:44.423931 12361 consensus_meta.cc:287] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.824s	user 0.008s	sys 0.004s
I20260709 13:02:44.485471  8453 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:44.531109  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 123642us
I20260709 13:02:44.550493  8426 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:44.489878  9261 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:44.463686 12495 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.462998 12063 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:44.518419 12521 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:44.488950  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.583019  8284 catalog_manager.cc:5697] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 8 to 11, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 11 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.552214  8456 raft_consensus.cc:2393] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 7: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:44.594090  8284 catalog_manager.cc:5697] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 5 to 8, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 8 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:44.559283  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:44.586229  8453 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:44.595818  9293 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:44.484819 12417 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10.
I20260709 13:02:44.573568  8426 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:44.480319 12228 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:02:44.461802 12144 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:44.572741  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 148907us
W20260709 13:02:44.557762 12523 consensus_meta.cc:287] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.537s	user 0.006s	sys 0.005s
W20260709 13:02:44.581656  9288 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55734 (request call id 934) took 1477 ms (client timeout 1854 ms). Trace:
I20260709 13:02:44.583276  8534 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:44.528489  8459 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:02:44.556794 12410 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:44.484131 12298 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:44.589700  8454 raft_consensus.cc:1240] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:02:44.591152  9258 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:44.552799  9289 raft_consensus.cc:2393] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 9: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:44.601845  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:44.487602 12529 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:44.573575 12495 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:44.608064  9260 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
W20260709 13:02:44.608291  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.610872  8383 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:44.613029  8378 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:44.615365  8385 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:44.577617 12520 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:44.620535  8380 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:44.623512  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:44.624451  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:44.624775  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:44.624292  9288 rpcz_store.cc:269] 0709 13:02:43.104278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.104454 (+   176us) service_pool.cc:224] Handling call
0709 13:02:44.581432 (+1476978us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b54007378d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:44.581585 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1829172096}
I20260709 13:02:44.625509  8529 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:44.625845  8528 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:44.626441  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:44.626874  8459 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:02:44.597959 12463 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.021s	user 0.010s	sys 0.023s
W20260709 13:02:44.735846 12463 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.235s	user 0.011s	sys 0.024s
I20260709 13:02:44.737900 12507 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:44.739012 12462 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:44.578912 12497 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:44.742334 12510 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:44.743040 12149 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:44.744402 12508 consensus_meta.cc:287] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.689s	user 0.010s	sys 0.000s
I20260709 13:02:44.593742 12063 raft_consensus.cc:697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:44.745393 12470 raft_consensus.cc:3055] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:44.746310 12470 raft_consensus.cc:740] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:44.746044 12063 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:44.747126 12470 consensus_queue.cc:260] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:44.748217 12470 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:44.623637 12526 consensus_queue.cc:237] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:44.752082 12355 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:44.518746 12469 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:44.634846  9258 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:44.635756  8381 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:44.510865 12456 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:44.636186  8377 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:44.594475 12457 raft_consensus.cc:3055] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:44.583997 12487 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:44.557128 12361 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:44.711952  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:44.770474  8526 raft_consensus.cc:2376] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12. Re-sending same reply.
I20260709 13:02:44.771586  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:44.712472  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:44.772328  8529 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:44.712695  8533 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
W20260709 13:02:44.774189  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 284352us
I20260709 13:02:44.774941  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:44.775203  9261 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:44.775729  8533 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.713073  8527 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:44.714496  8459 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:44.715389  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:44.705672  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:44.560123 12133 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:44.720844 12144 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:44.721184 12521 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:44.721841 12298 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:44.722268 12460 consensus_meta.cc:287] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.000s
I20260709 13:02:44.723080 12262 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:44.728427  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.729103  8457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43296 (request call id 47) took 1094 ms. Trace:
I20260709 13:02:44.729560 12529 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:44.731719 12527 raft_consensus.cc:3055] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:44.732012  8531 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
W20260709 13:02:44.733390 12545 log.cc:927] Time spent T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:02:44.579197 12532 raft_consensus.cc:2764] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:44.720755  8455 raft_consensus.cc:1240] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:02:44.754601  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 119866us
W20260709 13:02:44.755338  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 147335us
I20260709 13:02:44.849478  9258 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:44.759891  8535 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:44.849913  8529 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:44.850808  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:44.851073  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:44.851526  8535 raft_consensus.cc:2393] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 11: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:44.851613  8529 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:44.768842  9293 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:44.622761 12276 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.852396  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:44.631747 12410 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.637961 12533 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:44.723125 12467 consensus_meta.cc:287] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.001s
W20260709 13:02:44.935933  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 317648us
I20260709 13:02:44.826722  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:44.807240  8532 raft_consensus.cc:2393] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:44.631321 12509 consensus_queue.cc:1059] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.161s
I20260709 13:02:44.833056  8383 raft_consensus.cc:1275] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:44.834889  8452 raft_consensus.cc:2393] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 9: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:44.836076  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:44.834617  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:44.836947  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 61844.7us
I20260709 13:02:44.834815  8457 rpcz_store.cc:276] 0709 13:02:43.635030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.635185 (+   155us) service_pool.cc:224] Handling call
0709 13:02:44.728877 (+1093692us) spinlock_profiling.cc:243] Waited 89.6 ms on lock 0x7b54000d5f54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c847f853 00007f36cd44d60a 00007f36c69d37d4 00007f36c69d3762 00007f36c69d3691 00007f36c69d360c 00007f36c69d28c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:44.728996 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206098176}
W20260709 13:02:44.844267  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.970495  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:44.845269  8531 pending_rounds.cc:85] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 9
W20260709 13:02:44.970870  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.971186  8531 pending_rounds.cc:107] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:02:44.971511  8531 raft_consensus.cc:2889] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:44.845914  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:44.769737 12502 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:44.847455  8379 raft_consensus.cc:2410] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:44.847747 12487 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:44.972574  8528 raft_consensus.cc:2376] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12. Re-sending same reply.
I20260709 13:02:44.978854  9261 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:44.979882  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:44.787684 12496 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:44.771312 12497 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:45.043058  8526 raft_consensus.cc:2376] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12. Re-sending same reply.
I20260709 13:02:44.637403 12523 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:44.825651 12522 consensus_meta.cc:287] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.000s
I20260709 13:02:44.855237  8456 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:44.911985  8533 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:45.046072  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:44.844985 12527 raft_consensus.cc:740] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:44.954041  9296 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:45.052407  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 76209.8us
W20260709 13:02:45.054008  8349 leader_election.cc:336] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.728s (SENT)
W20260709 13:02:45.055455  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.958069 12133 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:44.975497  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:44.992373  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:44.806224 12355 consensus_queue.cc:1059] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.167s
I20260709 13:02:44.788483 12360 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.146s
I20260709 13:02:44.805863 12341 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.146s
W20260709 13:02:45.042348  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.762059 12457 raft_consensus.cc:740] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:44.846598 12521 raft_consensus.cc:697] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:45.046672  8532 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:45.046564  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:45.122462  8533 raft_consensus.cc:2393] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:44.913434  8529 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:45.126920  8527 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:45.128535  8527 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:44.934147 12410 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:45.085727  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.973399 12287 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:44.977425 12492 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:45.093292  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:45.095633  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:44.982817 12487 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.106309  8457 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:45.109120  8351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.000s	sys 0.013s
W20260709 13:02:45.167121  8351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.000s	sys 0.014s
W20260709 13:02:45.167471  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 765617us
I20260709 13:02:44.975216 12533 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:45.047482 12467 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.139642  8533 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:02:45.089941 12144 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:45.155893  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 183236us
W20260709 13:02:45.136852  8349 leader_election.cc:336] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.899s (SENT)
I20260709 13:02:45.178300  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:45.178977  8457 raft_consensus.cc:606] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:02:45.179347  8457 raft_consensus.cc:614] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:45.180115  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:45.173722  8533 pending_rounds.cc:85] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 7
I20260709 13:02:45.181149  8383 raft_consensus.cc:2410] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:02:45.181329  8533 pending_rounds.cc:107] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:02:45.105508 12497 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:45.182871  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:45.136116 12556 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:45.186892  8385 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:45.181269  8528 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:02:45.182086  8533 raft_consensus.cc:2889] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:45.140655 12502 raft_consensus.cc:697] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:45.132623  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:45.100088 12315 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:45.162228  8529 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:45.207727  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:45.195482  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 58648.5us
I20260709 13:02:45.198570  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:45.058459 12522 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:45.167234 12382 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.212255  8386 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:45.210562  8385 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:45.205516  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:45.170792 12487 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:45.184731  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:45.214735  8383 raft_consensus.cc:2393] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 11: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:02:45.217032  8349 leader_election.cc:336] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 2.018s (SENT)
I20260709 13:02:45.211627  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:45.202134 12554 log.cc:927] Time spent T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:02:45.213366  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:45.172246 12492 raft_consensus.cc:697] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:45.221532  8381 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:02:45.226475  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:45.227226  8381 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:45.219592  8384 raft_consensus.cc:2376] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10. Re-sending same reply.
I20260709 13:02:45.208830  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:45.230377  8529 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 5.
I20260709 13:02:45.230923  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:45.233933  8386 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:45.234526  8349 leader_election.cc:336] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.519s (SENT)
I20260709 13:02:45.230568  8461 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:45.237761  8383 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:45.240217  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:45.245702  8529 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:45.243213  8457 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:45.180716 12467 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:45.257457  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:45.183215 12510 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:02:45.266206  8385 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:45.249447  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:45.183732 12144 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:45.269658  8529 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:45.271008  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:45.271464 12144 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:45.272753  8529 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:02:45.274331 12552 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
W20260709 13:02:45.275049 12348 consensus_meta.cc:287] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.935s	user 0.010s	sys 0.000s
W20260709 13:02:45.275667 12550 log.cc:927] Time spent T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.300s	user 0.000s	sys 0.000s
I20260709 13:02:45.220153 12315 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:45.277225 12561 log.cc:927] Time spent T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:02:45.278358 12565 log.cc:927] Time spent T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:02:45.214551 12457 consensus_queue.cc:260] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:45.281765 12457 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:45.283828 12533 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:45.284722 12456 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:45.258132 12361 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:45.286289 12522 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:45.286732 12544 log.cc:927] Time spent T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.449s	user 0.000s	sys 0.001s
I20260709 13:02:45.286846 12502 consensus_queue.cc:237] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:45.223899 12521 consensus_queue.cc:237] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:45.292016 12555 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:02:45.172936 12527 consensus_queue.cc:260] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:45.297349 12492 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:45.275604 12348 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:45.306838  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:45.307875  8529 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:45.309242  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:45.258653 12489 consensus_meta.cc:287] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.894s	user 0.013s	sys 0.003s
I20260709 13:02:45.218616 12382 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:45.313555  8386 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:45.326411  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67513665d04b44c292143601e7f66ac8"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:45.330262  8457 raft_consensus.cc:606] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:45.330724  8457 raft_consensus.cc:614] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:45.280977 12558 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:02:45.327615  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.257491 12469 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:45.346164  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:45.358417  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 222883us
I20260709 13:02:45.333559 12489 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:45.339148 12470 consensus_meta.cc:287] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.000s
W20260709 13:02:45.388701  8500 connection.cc:256] RPC call timeout handler was delayed by -4.0080710540000268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
W20260709 13:02:45.389211  8500 connection.cc:256] RPC call timeout handler was delayed by -3.1692710540000348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3028s for a response
W20260709 13:02:45.389524  8500 connection.cc:256] RPC call timeout handler was delayed by -2.936171053999999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3287s for a response
W20260709 13:02:45.389940  8500 connection.cc:256] RPC call timeout handler was delayed by -2.5023710539999797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3769s for a response
W20260709 13:02:45.390225  8500 connection.cc:256] RPC call timeout handler was delayed by -1.9749710539999796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.43550000000000005s for a response
I20260709 13:02:45.390838  8500 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:45.361222  8457 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 13. Current term is 14. Ops: [13.14-13.14]
I20260709 13:02:45.406687  8531 raft_consensus.cc:1240] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:45.402851  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.398553  8381 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
W20260709 13:02:45.399089  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.410672  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2441) took 1351 ms. Trace:
I20260709 13:02:45.411108  8530 rpcz_store.cc:276] 0709 13:02:44.059030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.110557 (+ 51527us) service_pool.cc:224] Handling call
0709 13:02:44.119460 (+  8903us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.119866 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.119904 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:44.120337 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:02:44.636853 (+516516us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b1800439de0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c80250d1 00007f36c8440a0f
0709 13:02:44.848479 (+211626us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:44.848542 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.848667 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:45.399698 (+551031us) raft_consensus.cc:1685] finished
0709 13:02:45.399726 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.410601 (+ 10875us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1072,"raft.run_cpu_time_us":2241,"raft.run_wall_time_us":67926,"spinlock_wait_cycles":5437952,"thread_start_us":211282,"threads_started":1,"wal-append.queue_time_us":1037068}
I20260709 13:02:45.410125  8381 pending_rounds.cc:85] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 8
I20260709 13:02:45.396073 12522 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.381141 12496 raft_consensus.cc:697] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:45.392218 12559 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.399089  8500 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:45.410898 12556 consensus_queue.cc:1059] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:02:45.417824  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:45.442638  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:45.418362  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:45.444927  8500 leader_election.cc:400] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13.
I20260709 13:02:45.445262  8500 leader_election.cc:403] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:45.415509 12315 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:45.446698 12428 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:45.446825 12315 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.447113 12144 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:45.447450 12428 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:45.447607 12144 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:45.448935  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:45.449456 12532 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:45.450142  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:45.450706  8530 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.451001 12465 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:45.417141 12496 consensus_queue.cc:237] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:45.417425 12559 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:45.397897 12228 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:45.419116  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.420946  8455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 2126) took 2441 ms. Trace:
I20260709 13:02:45.414758  8381 pending_rounds.cc:107] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:02:45.458199  8455 rpcz_store.cc:276] 0709 13:02:42.979483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.982380 (+  2897us) service_pool.cc:224] Handling call
0709 13:02:43.038060 (+ 55680us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.849127 (+1811067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.420665 (+571538us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54000d2ad4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:45.420861 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3869211520}
I20260709 13:02:45.458952  8381 raft_consensus.cc:2889] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:45.406347 12530 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:45.466362  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:45.432008  8453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36446 (request call id 2147) took 1015 ms. Trace:
I20260709 13:02:45.430740  8349 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:45.467285  8385 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 8: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:02:45.434854  8379 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 2924) took 1244 ms (client timeout 1572 ms). Trace:
I20260709 13:02:45.460188  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:45.467594  8453 rpcz_store.cc:276] 0709 13:02:44.416489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.425572 (+  9083us) service_pool.cc:224] Handling call
0709 13:02:45.431851 (+1006279us) spinlock_profiling.cc:243] Waited 58.8 ms on lock 0x7b54000d2fd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:45.431950 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135330560}
W20260709 13:02:45.468096  8379 rpcz_store.cc:269] 0709 13:02:44.190638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.197619 (+  6981us) service_pool.cc:224] Handling call
0709 13:02:45.434651 (+1237032us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b54003dd1d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:45.434795 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1470243584}
I20260709 13:02:45.435474  8452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53010 (request call id 751) took 1355 ms. Trace:
I20260709 13:02:45.468879  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:45.440445  8351 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:02:45.460537  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 479909us
I20260709 13:02:45.470510  9261 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:45.509477  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.501643  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:45.515475  8378 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.469447  8452 rpcz_store.cc:276] 0709 13:02:44.080485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.106484 (+ 25999us) service_pool.cc:224] Handling call
0709 13:02:45.435316 (+1328832us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b54003c7154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:45.435422 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1650161408}
I20260709 13:02:45.501334  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:45.432734 12473 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:45.426559 12489 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:45.424996 12501 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:45.539084  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:45.521489  8454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 758) took 1277 ms. Trace:
I20260709 13:02:45.539753  8454 rpcz_store.cc:276] 0709 13:02:44.244401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.244554 (+   153us) service_pool.cc:224] Handling call
0709 13:02:44.244964 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.637325 (+392361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.521162 (+883837us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b540041b754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:45.521414 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":752263936}
I20260709 13:02:45.521486  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:45.499336 12572 log.cc:927] Time spent T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:02:45.500890  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:45.453653 12522 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:45.484133  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.527884  8532 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:45.433893 12382 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:45.557263  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.531286  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:45.537711  8378 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:02:45.521286  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:45.557950  8455 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 8: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:45.558393  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:45.558950  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:45.528048  8530 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:02:45.472190  8351 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:45.559994  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:45.560436  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:45.560678  8455 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 8: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:45.561100  9295 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:45.561151  8530 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 8: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:45.554284  8534 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:45.563458  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:45.564180  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:45.564711  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.540385  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:45.561393  9260 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:45.565977  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:45.566144  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:45.566280 12574 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:45.567024  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:45.567373  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:45.427444 12556 raft_consensus.cc:3055] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:45.557116  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:45.569474  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:45.569741  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:45.570154  8532 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 11: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:45.571115  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:45.436108 12529 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 13:02:45.559144  9288 raft_consensus.cc:2368] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:02:45.432183 12467 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:45.567788  8458 raft_consensus.cc:2368] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12.
I20260709 13:02:45.499413 12096 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:45.568113  8385 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:45.573717  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:45.574363  8458 raft_consensus.cc:2368] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 12.
I20260709 13:02:45.574457 12556 raft_consensus.cc:740] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:45.575197  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:45.575852  8458 raft_consensus.cc:2368] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:02:45.575402 12556 consensus_queue.cc:260] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:45.576417 12556 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.576541  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:45.577492  8458 raft_consensus.cc:2393] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 9: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:45.578694  9295 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:45.579420  8458 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:45.580767  9288 raft_consensus.cc:1240] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:45.580737  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:45.582010  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:45.582149 12348 consensus_queue.cc:1059] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:45.582480  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:45.582621  9294 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:02:45.582192  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:45.583263 12348 consensus_queue.cc:1059] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:45.583945  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:45.584354 12507 raft_consensus.cc:3055] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:45.584739  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:45.574380  8532 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:45.586052  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:45.586629  8532 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:45.586839  8530 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:45.584754 12507 raft_consensus.cc:740] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:45.588027  8530 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:45.587934 12507 consensus_queue.cc:260] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:45.589237 12507 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:45.584019  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:45.593765  9291 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 8: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:45.595312  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:45.595762  8534 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:45.596606  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:45.584373  8458 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:45.541743  9258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.008s	sys 0.012s
W20260709 13:02:45.598495  9258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.008s	sys 0.012s
W20260709 13:02:45.600173  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.601118 12497 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:45.601794  8424 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:45.602682 12467 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:45.603163 12467 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:45.603617 12467 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:45.604161  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:45.604861  8530 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 8: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:45.605278  8532 raft_consensus.cc:3055] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:45.605674  8532 raft_consensus.cc:740] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:45.606809  8532 consensus_queue.cc:260] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:45.343109  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:45.608125  8529 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:02:45.609313  8529 raft_consensus.cc:3055] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:45.609671  8529 raft_consensus.cc:740] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:45.610634  8529 consensus_queue.cc:260] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:45.611830  8529 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:45.501631 12469 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:45.614020  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:45.415808 12526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.015s	sys 0.001s
I20260709 13:02:45.614814  8385 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:45.616055  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 753) took 1508 ms. Trace:
I20260709 13:02:45.616420  8461 rpcz_store.cc:276] 0709 13:02:44.107982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.108123 (+   141us) service_pool.cc:224] Handling call
0709 13:02:44.157455 (+ 49332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.235501 (+1078046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.615870 (+380369us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540040d3d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:45.616004 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2467411200}
I20260709 13:02:45.617659  8534 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:45.618377  8532 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:45.419554 12449 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 13:02:45.429263 12510 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 13:02:45.436931 12456 consensus_queue.cc:1048] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.117s
I20260709 13:02:45.498852 12571 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:45.624794  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:45.626617  8385 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:45.655113  8452 raft_consensus.cc:2368] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
W20260709 13:02:45.655207 12149 consensus_meta.cc:287] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.912s	user 0.008s	sys 0.004s
I20260709 13:02:45.655584  9288 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:45.656159 12382 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:45.656659 12382 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:45.657002 12382 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:45.642683  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.603336  9258 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:45.648527  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:45.658557  9294 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
W20260709 13:02:45.658625  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 55375.3us
I20260709 13:02:45.651737  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:45.659507  8378 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:45.652837  9293 raft_consensus.cc:2410] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:02:45.655210  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 183077us
I20260709 13:02:45.663066  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:45.471001 12228 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:45.653641  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.653703  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:45.675297  8458 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:02:45.675765  8381 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:45.656097  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:45.429394 12448 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.128s
I20260709 13:02:45.447409 12315 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:45.659798  9258 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:45.648428 12497 consensus_queue.cc:1059] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:02:45.666975  9295 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
W20260709 13:02:45.614079 12276 consensus_meta.cc:287] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.680s	user 0.007s	sys 0.004s
W20260709 13:02:45.624413 12526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.016s	sys 0.001s
I20260709 13:02:45.680689  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2329) took 1011 ms. Trace:
I20260709 13:02:45.715997  8531 rpcz_store.cc:276] 0709 13:02:44.669413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.165181 (+495768us) service_pool.cc:224] Handling call
0709 13:02:45.165556 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.410000 (+244444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.680437 (+270437us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b5400096354. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:45.680626 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":539224320}
I20260709 13:02:45.681226  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:45.650167 12559 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:45.431468 12463 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.216s
I20260709 13:02:45.430994 12512 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.215s
I20260709 13:02:45.676584  8284 catalog_manager.cc:5697] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 8 to 9, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 9 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:45.432832 12487 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:45.742233  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:45.682755  8424 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:45.701866  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:45.703886 12456 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:45.707336  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:45.748566  8378 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:02:45.749795  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:45.750720  8378 raft_consensus.cc:2393] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 11: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:45.522202 12457 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.131s
I20260709 13:02:45.647243 12063 raft_consensus.cc:3055] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:02:45.667234 12495 consensus_meta.cc:287] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.904s	user 0.005s	sys 0.006s
I20260709 13:02:45.681334  8455 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:02:45.726643  8532 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:45.719936 12276 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:45.732738 12144 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:45.735491  8452 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:02:45.807236  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:45.736634  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:45.808729  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:45.809406  8380 raft_consensus.cc:2393] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 11: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:45.809921  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:45.810837  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:45.811334  8380 raft_consensus.cc:2410] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:45.811823  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:45.812559  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.812500  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:45.813011  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.813469  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:45.737183  8529 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:45.740077  8453 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:45.638221 12467 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:45.680209 12571 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:45.700651 12507 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:45.741562  8501 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:45.751796  8456 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36446 (request call id 2149) took 1265 ms (client timeout 1657 ms). Trace:
W20260709 13:02:45.752161  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 69485.5us
I20260709 13:02:45.753796  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:45.826917  8424 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:45.760514  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:45.827920  8378 raft_consensus.cc:2393] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 11: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:45.762315  8531 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:45.753870  8427 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:45.733372  8377 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:45.720170 12489 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.735067  8381 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
W20260709 13:02:45.768679  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.846876  8452 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:45.764883  9290 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:02:45.848476  8452 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:02:45.819841  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.823031  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:45.760208 12149 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:45.719332 12096 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.081s
W20260709 13:02:45.845839  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 399641us
I20260709 13:02:45.856353  8378 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:45.818135  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:45.851289  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:45.857887  8380 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 8: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:02:45.833745  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.759752 12063 raft_consensus.cc:740] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:45.752096 12459 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:45.861110  8452 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:02:45.763645 12292 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.740731 12530 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:02:45.862219  8529 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:45.826529  8456 rpcz_store.cc:269] 0709 13:02:44.486599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.601601 (+115002us) service_pool.cc:224] Handling call
0709 13:02:45.751643 (+1150042us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b540015b8d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:45.751748 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509580544}
I20260709 13:02:45.864830  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:45.864629  8424 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:45.765964 12551 consensus_queue.cc:1059] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.098s
I20260709 13:02:45.759851 12460 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.128s
W20260709 13:02:45.900746  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 146955us
I20260709 13:02:45.799782 12521 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:02:45.903486  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:45.800068 12495 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:45.905431  8427 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:45.920166  8427 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:45.904645  8424 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:45.757632 12456 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:45.862043 12149 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:45.913810  8457 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:45.878307 12360 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:45.863060 12571 raft_consensus.cc:697] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:45.893538 12292 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:45.924369  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:45.900499 12529 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.969398 12529 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:45.877584 12526 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:02:45.916098 12449 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:45.971580 12507 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:45.947877  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:45.972745 12529 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:45.973263  9288 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 16.
I20260709 13:02:45.878072 12497 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:02:45.974249 12467 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:45.975244 12571 consensus_queue.cc:237] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:45.978334 12495 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:45.979311 12522 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:45.943526 12496 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:02:45.928194 12457 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:45.981861 12457 raft_consensus.cc:697] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:45.982985 12457 consensus_queue.cc:237] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:45.911448 12276 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:45.985895 12276 raft_consensus.cc:697] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:45.986361 12382 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:45.986994 12276 consensus_queue.cc:237] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:45.988572 12382 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:45.990327 12589 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:45.990914 12589 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.991329 12589 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.993173 12533 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.950974 12063 consensus_queue.cc:260] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:45.952688 12315 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:45.953464 12530 consensus_queue.cc:1059] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:45.993997 12533 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:45.994958 12530 raft_consensus.cc:3055] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:45.995345 12530 raft_consensus.cc:740] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:02:45.995837 12579 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
I20260709 13:02:45.996206 12530 consensus_queue.cc:260] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:45.952726 12228 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:45.954833 12456 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:45.925902 12360 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:45.926734 12514 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:45.925623 12384 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:45.925915 12512 raft_consensus.cc:3055] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:45.927284 12149 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:45.963140  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.006851  9288 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:02:45.965937 12428 consensus_meta.cc:287] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.518s	user 0.007s	sys 0.003s
I20260709 13:02:45.864148 12489 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:45.993247  9292 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
W20260709 13:02:45.951601 12577 log.cc:927] Time spent T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
I20260709 13:02:46.000373 12360 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:46.001909 12530 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:46.045269  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:02:46.034838  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.003422 12384 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.048363 12384 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:46.046041 12470 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.052712 12470 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:46.053648  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 847) took 1196 ms. Trace:
I20260709 13:02:46.003535 12512 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:46.004197 12514 raft_consensus.cc:697] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:46.054108  8533 rpcz_store.cc:276] 0709 13:02:44.857046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.209710 (+352664us) service_pool.cc:224] Handling call
0709 13:02:45.209943 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.210124 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:45.460127 (+250003us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.053256 (+593129us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.053314 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:46.053355 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.053420 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.053576 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":412836,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":82746,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":831022,"threads_started":3}
I20260709 13:02:46.059518  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:46.062456  9288 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:46.007829 12469 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:46.018601 12428 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13.
W20260709 13:02:46.061564  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 137574us
W20260709 13:02:46.068075  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 326569us
W20260709 13:02:46.061807 12465 consensus_meta.cc:287] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.004s
W20260709 13:02:46.076220  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.085860  8500 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:46.087059  8500 leader_election.cc:400] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:02:46.087348  8500 leader_election.cc:403] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:02:46.092206  9261 leader_election.cc:336] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.168s (SENT)
I20260709 13:02:46.083693  8427 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:46.071388 12487 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:46.076895 12410 consensus_meta.cc:287] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.916s	user 0.010s	sys 0.002s
W20260709 13:02:46.097846  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 193257us
I20260709 13:02:46.133373  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2332) took 1369 ms. Trace:
W20260709 13:02:46.172374  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.179177  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 95595.6us
I20260709 13:02:46.143428  9288 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:46.179240  9261 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:46.157704  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.215185  8424 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:46.138974 12149 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:46.198105  8527 rpcz_store.cc:276] 0709 13:02:44.763971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.167266 (+403295us) service_pool.cc:224] Handling call
0709 13:02:45.182949 (+ 15683us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:45.183303 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:45.183330 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:45.207472 (+ 24142us) log.cc:844] Serialized 26 byte log entry
0709 13:02:45.383220 (+175748us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:45.383265 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.383349 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.107474 (+724125us) raft_consensus.cc:1685] finished
0709 13:02:46.133152 (+ 25678us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.133305 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13180,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":4194,"thread_start_us":141995,"threads_started":1,"wal-append.queue_time_us":327753}
I20260709 13:02:46.214915  8427 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:46.134124 12592 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 13:02:46.137107 12590 log.cc:927] Time spent T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:02:46.135936 12360 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:46.075465 11957 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.222208 11957 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:46.213919 12260 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:46.223325 12260 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.223721 12260 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:46.100648 12512 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:46.099803 12470 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:46.243261  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.237067  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 144876us
I20260709 13:02:46.238853  8424 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:46.239380  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 483144us
I20260709 13:02:46.240197  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 848) took 1382 ms. Trace:
I20260709 13:02:46.141161 12489 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:46.138991 12228 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:02:46.247051  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:46.286676  8535 rpcz_store.cc:276] 0709 13:02:44.857414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.216726 (+359312us) service_pool.cc:224] Handling call
0709 13:02:45.229652 (+ 12926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.229952 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:45.388686 (+158734us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.239331 (+850645us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.239564 (+   233us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:46.239700 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.239851 (+   151us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.240142 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":472879,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":247650,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":991662,"threads_started":3,"wal-append.queue_time_us":563182}
I20260709 13:02:46.138777 12600 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:46.256000  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.256892  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 168740us
I20260709 13:02:46.283600  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:46.255497  9261 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:46.287966  8380 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:46.247697  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:46.217535 12523 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:46.290051  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.308645  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.218093 12532 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:02:46.329613  8500 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:46.292659  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 53914.3us
I20260709 13:02:46.328579  8351 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:46.215834 12410 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:46.331552  8424 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:46.245187 12509 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:46.242863 12467 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.254494 12456 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:46.335424  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:46.283452 12543 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.370972  8460 raft_consensus.cc:2393] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 12: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:46.250639 12529 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:46.339155  8500 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:46.355469  8424 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:46.323016 12276 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:46.377789  8424 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:46.365221  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:46.380333  8500 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:46.117650 12514 consensus_queue.cc:237] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:46.321017 12096 consensus_queue.cc:1059] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:02:46.368435 12509 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:46.298938 12526 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:02:46.375279  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:46.344532 12600 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:46.368151 12262 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:46.369390 12460 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:46.395069  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:46.386286  8424 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:46.348352 12467 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:46.390203 12228 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:46.387598 12522 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:46.407346  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 74954.4us
I20260709 13:02:46.392810 12457 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:46.410136  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:46.389725 12598 raft_consensus.cc:2764] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:02:46.398334 12460 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:46.383806 12543 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:46.392263 12382 consensus_queue.cc:1059] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:02:46.403894 12096 raft_consensus.cc:3055] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:46.414371 12456 raft_consensus.cc:697] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:46.421239 12606 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.412600 12276 raft_consensus.cc:2804] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:46.425529  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:46.426365 12593 log.cc:927] Time spent T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
W20260709 13:02:46.427518 12604 log.cc:927] Time spent T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:02:46.427767 12467 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:46.428156 12602 log.cc:927] Time spent T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:02:46.408715 12228 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.409848 12262 raft_consensus.cc:697] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:46.407634 12260 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:46.418597 12460 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:46.424655 12096 raft_consensus.cc:740] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:46.433243 12276 raft_consensus.cc:697] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:46.430548 12606 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:46.415424 12470 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:46.410261 12601 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 13:02:46.469067  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 213637us
I20260709 13:02:46.458410 12469 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:46.459013 12598 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.468918 12228 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:46.476230  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:46.471714  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 57374us
I20260709 13:02:46.479744  9296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 620) took 2002 ms. Trace:
I20260709 13:02:46.479696  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:46.480515  8454 raft_consensus.cc:2376] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8. Re-sending same reply.
I20260709 13:02:46.480327  9296 rpcz_store.cc:276] 0709 13:02:44.476906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.484717 (+  7811us) service_pool.cc:224] Handling call
0709 13:02:44.581595 (+ 96878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.051342 (+469747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.455971 (+404629us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b54007378d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:46.479578 (+1023607us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b54007378d0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:46.479695 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":991629440}
I20260709 13:02:46.481491  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:46.482070  8454 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:46.482719  9261 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:46.482836  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:46.486303  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.486161  8500 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:46.486783  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.487391  8500 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:46.474931 12595 log.cc:927] Time spent T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.238s	user 0.000s	sys 0.003s
I20260709 13:02:46.493526  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2939) took 1033 ms. Trace:
I20260709 13:02:46.482548 12526 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:02:46.473871 12470 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:46.501533  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:46.473354 12149 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:46.499138  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:46.499827  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:46.502405  8454 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:46.502862  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:46.503543  8385 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:46.500541 12530 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:46.494650  8382 rpcz_store.cc:276] 0709 13:02:45.460405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.461563 (+  1158us) service_pool.cc:224] Handling call
0709 13:02:45.461937 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:45.462331 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:45.462370 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:45.468024 (+  5654us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.005417 (+537393us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:46.005458 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.005544 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.493338 (+487794us) raft_consensus.cc:1685] finished
0709 13:02:46.493357 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.493472 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4722,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":30092,"thread_start_us":390732,"threads_started":1,"wal-append.queue_time_us":579514}
I20260709 13:02:46.506948  9293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6"
dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:54044
I20260709 13:02:46.536556  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:46.536630  9293 raft_consensus.cc:606] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:46.538637  9293 raft_consensus.cc:614] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:46.540913  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:46.541769  8453 raft_consensus.cc:2410] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:02:46.476442 12469 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:46.487772 12556 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:46.544171  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:46.542697  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:46.570643  8453 raft_consensus.cc:1240] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:46.572008  8453 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:46.572108  8385 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:02:46.574918 12606 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:46.575543 12606 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:46.578688  8454 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:02:46.500767 12410 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:46.581012  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 93680.4us
I20260709 13:02:46.497869 12292 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:46.492671 12457 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 13:02:46.505905 12470 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:46.592409  8500 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:46.592588  8461 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:46.596962  8500 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:46.544171 12149 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.477567 12598 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:46.605742  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.580487 12530 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.505033 12497 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.085s
W20260709 13:02:46.581624 12595 log.cc:927] Time spent T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:02:46.581472 12384 consensus_meta.cc:287] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.002s
I20260709 13:02:46.642494 12527 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:46.643471  8500 leader_election.cc:400] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12.
I20260709 13:02:46.653177  8500 leader_election.cc:400] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 12.
I20260709 13:02:46.540583 12484 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.088s
W20260709 13:02:46.656339 12613 log.cc:927] Time spent T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:02:46.501142 12456 consensus_queue.cc:237] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:46.659020  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:46.685019  8386 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:02:46.659226  8500 leader_election.cc:400] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:02:46.685894  8500 leader_election.cc:403] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:02:46.641523  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 135859us
I20260709 13:02:46.687218  8500 leader_election.cc:400] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:02:46.659504 12615 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.152s
W20260709 13:02:46.660027 12607 log.cc:927] Time spent T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
W20260709 13:02:46.660280 12614 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:02:46.660511 12605 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:02:46.664418 11957 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:46.665767 12527 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:46.667527 12574 consensus_meta.cc:287] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 1.101s	user 0.012s	sys 0.000s
I20260709 13:02:46.547791 12096 consensus_queue.cc:260] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:46.674199  8460 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36446 (request call id 2145) took 2258 ms (client timeout 2465 ms). Trace:
W20260709 13:02:46.675712 12589 consensus_meta.cc:287] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.000s
I20260709 13:02:46.667440  8427 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:46.678057  8459 raft_consensus.cc:1240] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:46.702312  8500 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:46.631781 12606 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:46.687635  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.690220  8386 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:46.652679 12543 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:46.670094  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:46.710515  8380 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:46.711947  8380 raft_consensus.cc:1240] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:46.683082 12264 raft_consensus.cc:3055] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:02:46.697948  8460 rpcz_store.cc:269] 0709 13:02:44.415889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.435117 (+ 19228us) service_pool.cc:224] Handling call
0709 13:02:46.673993 (+2238876us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b54001f9d54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:46.674137 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4175264512}
I20260709 13:02:46.543702 12262 consensus_queue.cc:237] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:46.668154  8528 raft_consensus.cc:2410] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:02:46.704972  8500 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:46.707484  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:46.728185  9292 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:46.708122  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:46.639542 12149 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:46.654023 12530 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:46.715564  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:46.715937  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:46.716410  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:46.716730  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:46.719652  8534 raft_consensus.cc:1275] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:46.715289  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:46.678085 12384 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:46.735260  9293 raft_consensus.cc:1240] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:02:46.739187  8527 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:46.733141  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:46.699393 12574 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:46.748781  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:46.734117  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:46.733237  8526 raft_consensus.cc:2410] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:46.749861  8532 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:46.751065  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:46.736727  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:46.729504  8351 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:46.731045  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2945) took 1189 ms. Trace:
I20260709 13:02:46.735598  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:46.740937  8427 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:46.754189  8534 raft_consensus.cc:2410] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:46.754375  8427 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:46.755307  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:46.748530  9288 raft_consensus.cc:2393] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:46.755986  8534 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:46.735952  8529 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:02:46.733059  8533 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:02:46.752477  8379 rpcz_store.cc:276] 0709 13:02:45.541386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.541800 (+   414us) service_pool.cc:224] Handling call
0709 13:02:45.554070 (+ 12270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:45.613704 (+ 59634us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:45.659494 (+ 45790us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.013513 (+354019us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:46.056942 (+ 43429us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.057174 (+   232us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:46.057250 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.057346 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.730865 (+673519us) raft_consensus.cc:1685] finished
0709 13:02:46.730881 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.730992 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6266,"prepare.queue_time_us":59856,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":65816,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":32392,"thread_start_us":270093,"threads_started":1,"wal-append.queue_time_us":387731}
I20260709 13:02:46.765493  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:46.766100  8531 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:46.766497  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:46.724304 12465 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:46.724642 12264 raft_consensus.cc:740] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:46.767592  8531 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:46.768585  8532 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:46.767072  8386 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:46.632546 12276 consensus_queue.cc:237] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:46.732568 12527 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:46.783797  9289 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:46.736799 12608 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.737403 12606 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:46.730186 12617 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:02:46.802166  8532 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:46.713609 12589 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:46.808976  8384 raft_consensus.cc:1240] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12. Ops: [10.9-11.10]
I20260709 13:02:46.784579  8453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 2159) took 1039 ms. Trace:
I20260709 13:02:46.768265 12448 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:46.772490 12260 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:46.768131 12473 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:46.817433  8535 raft_consensus.cc:2410] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:46.812155  8534 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:02:46.767980 12601 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:46.824987 12601 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.825491 12601 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:46.806150  8379 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:46.810668  8453 rpcz_store.cc:276] 0709 13:02:45.745047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.572911 (+827864us) service_pool.cc:224] Handling call
0709 13:02:46.573145 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.573347 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:46.584124 (+ 10777us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.783703 (+199579us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.784269 (+   566us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.784313 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:46.784354 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.784417 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.784525 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10980,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":13327,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":4072,"spinlock_wait_cycles":18411136,"thread_start_us":197624,"threads_started":1}
I20260709 13:02:46.772969 12465 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:46.834780  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 129892us
I20260709 13:02:46.810213 12448 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:46.857146  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.858984  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.812057 12616 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:46.846463 12465 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:46.877373  8379 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:46.854327 12448 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:46.808305 12606 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:46.876677  8386 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:02:46.883329 12534 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.875293 12473 raft_consensus.cc:697] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:46.887787 12617 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:46.902571  8527 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:46.809502 12608 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:46.905017 12530 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:46.900295 12594 log.cc:927] Time spent T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.523s	user 0.001s	sys 0.006s
W20260709 13:02:46.949462  8528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2347) took 1765 ms (client timeout 1625 ms). Trace:
W20260709 13:02:46.949967  8528 rpcz_store.cc:269] 0709 13:02:45.183841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.205185 (+ 21344us) service_pool.cc:224] Handling call
0709 13:02:46.949208 (+1744023us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54002b8754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:46.949382 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3345462016}
I20260709 13:02:46.952553  9290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 951) took 1371 ms. Trace:
W20260709 13:02:46.952569  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 1.47772e+06us
I20260709 13:02:46.901165 12598 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:46.953025  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:46.963847  8527 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:46.953018  9290 rpcz_store.cc:276] 0709 13:02:45.581530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.583344 (+  1814us) service_pool.cc:224] Handling call
0709 13:02:45.583620 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:45.862004 (+278384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.952306 (+1090302us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b540008d9d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:46.952492 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416164096}
W20260709 13:02:46.955771 12622 log.cc:927] Time spent T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:02:46.956164 12634 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:02:46.924995 12527 raft_consensus.cc:697] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:46.877351 12616 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:46.983421 12616 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:46.984019  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.965186 12617 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.985255 12617 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:46.985904 12063 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:46.987632 12617 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:46.988652  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 853) took 1385 ms. Trace:
I20260709 13:02:46.952841 12637 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:46.980970 12360 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:46.989100  8530 rpcz_store.cc:276] 0709 13:02:45.602861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.611931 (+  9070us) service_pool.cc:224] Handling call
0709 13:02:45.612187 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.096937 (+484750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.096968 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.097013 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:46.097046 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.988370 (+891324us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54000f73d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:46.988423 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.988579 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7652,"raft.queue_time_us":155468,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":46434,"spinlock_wait_cycles":1109153024}
I20260709 13:02:46.969798 12460 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:46.991293  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2936) took 1531 ms. Trace:
I20260709 13:02:46.990909 12527 consensus_queue.cc:237] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:46.991689  8377 rpcz_store.cc:276] 0709 13:02:45.459593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.459690 (+    97us) service_pool.cc:224] Handling call
0709 13:02:45.459898 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.862004 (+402106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.991035 (+1129031us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54003b6354. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:46.991233 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":628513536}
I20260709 13:02:46.992370 12460 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:46.979301 12589 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:46.974965 12149 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:46.975099 12489 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.994062 12489 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:46.989532 12637 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:46.892063 12264 consensus_queue.cc:260] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:46.901173 12534 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:47.012214  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:47.012888  9290 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:47.015290  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2947) took 1393 ms. Trace:
I20260709 13:02:47.015817  8383 rpcz_store.cc:276] 0709 13:02:45.622293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.624580 (+  2287us) service_pool.cc:224] Handling call
0709 13:02:45.624951 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:45.657258 (+ 32307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:45.657286 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:45.657712 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.018476 (+360764us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:46.018513 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.682810 (+664297us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b540013e7d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:46.682877 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.745052 (+ 62175us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:47.015034 (+269982us) raft_consensus.cc:1685] finished
0709 13:02:47.015059 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:47.015222 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8107,"raft.queue_time_us":17091,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":35677,"spinlock_wait_cycles":62767232,"thread_start_us":360407,"threads_started":1,"wal-append.queue_time_us":633267}
I20260709 13:02:47.014391  8500 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:46.968294 12530 consensus_queue.cc:1059] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:02:47.004719 12473 consensus_queue.cc:237] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:47.014856 12384 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:47.018853 12264 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:47.046871  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:47.049348  8377 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:47.025678 12589 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:47.005853 12460 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:02:47.053668  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:47.054224  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 99271.2us
I20260709 13:02:47.054340  8381 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:47.055292  8349 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:47.057749  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 97657.4us
I20260709 13:02:47.058449  8427 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:47.065526 12569 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:47.063253  8501 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:47.068408  8501 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:47.055327 12589 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:47.062536 12228 consensus_meta.cc:287] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.569s	user 0.003s	sys 0.007s
I20260709 13:02:47.062857  8349 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:47.074534  8427 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:47.080482 12606 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:47.070364 12571 consensus_queue.cc:1059] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
W20260709 13:02:47.117442  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:47.159247  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 84812.2us
I20260709 13:02:47.076361 12609 raft_consensus.cc:3055] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:47.165597 12574 raft_consensus.cc:3055] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:47.076565 12598 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:47.166045 12574 raft_consensus.cc:740] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:47.166417 12598 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:47.076786 12616 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:47.167140 12574 consensus_queue.cc:260] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:47.167443 12616 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:47.093309 12617 consensus_queue.cc:1059] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:02:47.050339 12601 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:47.097473 12645 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:47.068813 12496 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:02:47.168833 12598 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:47.071226 12262 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:47.158874 12589 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:47.073557 12556 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:02:47.153972 12489 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:47.085266 12534 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:47.174644  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:47.192464  8378 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:47.086040 12636 raft_consensus.cc:3055] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:02:47.145638 12470 consensus_meta.cc:287] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.000s
I20260709 13:02:47.179543  8377 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:47.164395 12606 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:47.084154 12637 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:47.181401  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:47.180284 12510 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.025s	sys 0.016s
W20260709 13:02:47.181788  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 119011us
I20260709 13:02:47.182463  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:47.183962  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:47.165143 12609 raft_consensus.cc:740] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:47.173370 12529 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:47.193611  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:47.195798  8427 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:47.196805  8501 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:47.197129  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:47.082945 12620 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.118s
I20260709 13:02:47.198526  8381 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:47.181660  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 114928us
I20260709 13:02:47.226754  9258 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:47.148124 12228 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:47.204049  8349 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:47.209354  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:47.229197  8377 raft_consensus.cc:2393] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 8: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:47.190176 12598 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:47.203758 12510 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.026s	sys 0.016s
I20260709 13:02:47.232177  8349 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:47.199316 12489 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.196921 12645 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:47.199682 12262 raft_consensus.cc:697] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:47.194800 12636 raft_consensus.cc:740] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:02:47.243340  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.230165 12637 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:47.207237 12529 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.222261 12656 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:47.235890 12456 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:47.205636 12526 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:02:47.206321 12606 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:47.233855 12571 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:02:47.289397 12655 log.cc:927] Time spent T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:02:47.290303 12619 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:02:47.265265 12637 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.291016 12616 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:47.295445 12650 log.cc:927] Time spent T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:02:47.295713 12456 raft_consensus.cc:697] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:47.277127 12656 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:47.301764 12659 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:47.201695 12470 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:47.330750  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 264509us
I20260709 13:02:47.262706 12529 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:47.247097 12598 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:47.251434 12489 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:47.398715 12656 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:47.408577 12651 log.cc:927] Time spent T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.226s	user 0.003s	sys 0.004s
W20260709 13:02:47.403657 12448 consensus_meta.cc:287] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.001s
I20260709 13:02:47.378676 12637 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:47.409540 12649 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:47.410187  8386 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:47.415783  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.424913  8381 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:02:47.418020 12601 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:47.438421 12671 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.261143 12645 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:47.414227 12659 raft_consensus.cc:697] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:47.461401 12663 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:47.461977 12652 log.cc:927] Time spent T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:02:47.464160  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:47.467947 12470 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:47.473664 12653 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:02:47.283494 12609 consensus_queue.cc:260] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:47.476255 12662 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:47.477324 12662 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:47.479456 12662 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:47.426343 12448 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:47.484935  8378 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:47.466085 12456 consensus_queue.cc:237] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:47.494894 12448 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:47.495711 12063 consensus_meta.cc:287] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.003s
I20260709 13:02:47.495784 12609 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:47.496537  9288 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:02:47.420953 12262 consensus_queue.cc:237] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:47.505213 12654 log.cc:927] Time spent T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:02:47.505234 12228 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:47.463762 12671 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:47.502377 12465 consensus_meta.cc:287] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.609s	user 0.012s	sys 0.000s
I20260709 13:02:47.511106 12465 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:47.516597 12611 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.942s	user 0.005s	sys 0.016s
I20260709 13:02:47.472453 12636 consensus_queue.cc:260] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:47.520839 12489 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:47.521409 12637 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:47.522539 12469 consensus_meta.cc:287] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.942s	user 0.006s	sys 0.007s
I20260709 13:02:47.522938 12469 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:47.535391  8383 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:47.526046  8529 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:47.534056  8452 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:02:47.533702  8455 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36448 (request call id 2152) took 2006 ms (client timeout 2114 ms). Trace:
W20260709 13:02:47.540736  8455 rpcz_store.cc:269] 0709 13:02:45.526857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.567163 (+ 40306us) service_pool.cc:224] Handling call
0709 13:02:47.533457 (+1966294us) spinlock_profiling.cc:243] Waited 87.7 ms on lock 0x7b5400341054. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:47.533624 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201673984}
I20260709 13:02:47.541949 12465 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:47.548313 12063 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:02:47.549036 12489 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.559312 12489 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:47.540126 12527 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.561815 12527 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:47.564313 12527 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:47.567348 12589 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:47.568100  9289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 594) took 1987 ms. Trace:
I20260709 13:02:47.538671 12637 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:47.598311 12589 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:47.536788 12469 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:47.604610 12529 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:47.608399 12529 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:47.568665  9289 rpcz_store.cc:276] 0709 13:02:45.580723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.581640 (+   917us) service_pool.cc:224] Handling call
0709 13:02:47.567869 (+1986229us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540067e654. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:47.568022 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2760083840}
I20260709 13:02:47.512874 12659 consensus_queue.cc:237] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:47.551682 12606 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:47.628299 12671 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:47.637115 12533 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:47.638289  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.638695 12512 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:47.642146 12489 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:47.646133 12507 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:47.646868 12507 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:47.647249 12656 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:47.649155 12507 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:47.651310 12656 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:47.669519 12666 log.cc:927] Time spent T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.200s	user 0.000s	sys 0.005s
I20260709 13:02:47.677253 12598 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:47.681520 12667 log.cc:927] Time spent T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.239s	user 0.001s	sys 0.004s
I20260709 13:02:47.688066 12608 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:47.696569 12574 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:47.699059 12645 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:47.700469 12636 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:47.708200 12676 log.cc:927] Time spent T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.235s	user 0.004s	sys 0.000s
I20260709 13:02:47.710017 12096 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:47.758780  8284 catalog_manager.cc:5697] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 8 to 9, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 9 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:47.763934  8283 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53494 (request call id 327) took 21757 ms (client timeout 15000 ms). Trace:
W20260709 13:02:47.764710  8283 rpcz_store.cc:269] 0709 13:02:26.006518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.024101 (+ 17583us) service_pool.cc:224] Handling call
0709 13:02:47.763532 (+21739431us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:36.814557 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:36.914418 (+ 99861us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:36.914452 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:02:36.914467 (+    15us) tablet.cc:662] Decoding operations
0709 13:02:36.916050 (+  1583us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:36.916111 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:36.916138 (+    27us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:02:36.930609 (+ 14471us) tablet.cc:701] Row locks acquired
0709 13:02:36.930632 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:02:36.930803 (+   171us) write_op.cc:270] Start()
0709 13:02:36.930919 (+   116us) write_op.cc:276] Timestamp: P: 1783602156930757 usec, L: 0
0709 13:02:36.930955 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:02:37.367915 (+436960us) log.cc:844] Serialized 7112 byte log entry
0709 13:02:38.796014 (+1428099us) op_driver.cc:464] REPLICATION: finished
0709 13:02:39.307243 (+511229us) write_op.cc:301] APPLY: starting
0709 13:02:39.326240 (+ 18997us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:39.334104 (+  7864us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:39.345613 (+ 11509us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:39.646177 (+300564us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:39.719217 (+ 73040us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=36
0709 13:02:39.724585 (+  5368us) write_op.cc:312] APPLY: finished
0709 13:02:39.816157 (+ 91572us) log.cc:844] Serialized 125 byte log entry
0709 13:02:40.166769 (+350612us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:40.189747 (+ 22978us) write_op.cc:454] Released schema lock
0709 13:02:40.207928 (+ 18181us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:40.222481 (+ 14553us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:40.222527 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":351704,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":478785,"apply.run_cpu_time_us":50648,"apply.run_wall_time_us":924409,"num_ops":18,"prepare.queue_time_us":563952,"prepare.run_cpu_time_us":163767,"prepare.run_wall_time_us":998786,"raft.queue_time_us":376732,"raft.run_cpu_time_us":35374,"raft.run_wall_time_us":349736,"replication_time_us":1836656,"thread_start_us":1177173,"threads_started":5,"wal-append.queue_time_us":1006781,"wal-append.run_cpu_time_us":30245,"wal-append.run_wall_time_us":2707041}]]}
I20260709 13:02:47.763141  8284 catalog_manager.cc:5697] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 5 to 7, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 7 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:47.770767  8284 catalog_manager.cc:5697] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 6 to 8, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 8 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:47.772867  8284 catalog_manager.cc:5697] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:47.781554  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.785264  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:47.785931  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:47.786988  8384 raft_consensus.cc:2410] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 12 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:02:47.860567  8378 raft_consensus.cc:2393] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 6: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:02:47.861657  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.866262  8385 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 14. (term mismatch)
I20260709 13:02:47.886781  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:47.888056  8379 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:47.879860  8385 pending_rounds.cc:85] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 13
I20260709 13:02:47.903136  8385 pending_rounds.cc:107] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 13.14
I20260709 13:02:47.922333  8385 raft_consensus.cc:2889] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:47.947528 12612 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.948597 12612 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:47.971560  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38894 (request call id 2473) took 1250 ms. Trace:
I20260709 13:02:47.972095  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:47.972177  8527 rpcz_store.cc:276] 0709 13:02:46.720636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.739973 (+ 19337us) service_pool.cc:224] Handling call
0709 13:02:47.971014 (+1231041us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54000abc54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:47.971265 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351995264}
I20260709 13:02:47.953516  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:48.000419  8384 raft_consensus.cc:2393] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 13: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:48.002056  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:48.003083  8384 raft_consensus.cc:2393] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 11: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:48.004235  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:48.005219  8384 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:02:48.008805  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:48.010322  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:48.012794  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:48.018332  8386 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:48.026805  9288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 597) took 1113 ms. Trace:
I20260709 13:02:48.027331  9288 rpcz_store.cc:276] 0709 13:02:46.913171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.913568 (+   397us) service_pool.cc:224] Handling call
0709 13:02:48.026301 (+1112733us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b540009b0d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:48.026546 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1217966848}
I20260709 13:02:48.029106 12574 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.030331 12574 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:48.035411 12574 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:48.037122  8452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36448 (request call id 2165) took 2429 ms. Trace:
I20260709 13:02:48.037918  8459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 763) took 2904 ms. Trace:
I20260709 13:02:48.019603  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:48.048385  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 84820us
I20260709 13:02:48.051555  8501 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:48.056720  8526 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:02:48.057343  8378 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:48.042964  8459 rpcz_store.cc:276] 0709 13:02:45.133237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.135679 (+  2442us) service_pool.cc:224] Handling call
0709 13:02:46.677898 (+1542219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.701070 (+ 23172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.029750 (+1328680us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54001f9d50. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:48.037694 (+  7944us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3546061568}
I20260709 13:02:48.062197  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 704) took 1648 ms. Trace:
I20260709 13:02:48.062880  8385 rpcz_store.cc:276] 0709 13:02:46.414076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.572803 (+158727us) service_pool.cc:224] Handling call
0709 13:02:46.573057 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.945489 (+1372432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.061856 (+116367us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400269654. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:48.062109 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2968228224}
I20260709 13:02:48.065775  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2212) took 1652 ms. Trace:
I20260709 13:02:48.066314  8382 rpcz_store.cc:276] 0709 13:02:46.413510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.545231 (+131721us) service_pool.cc:224] Handling call
0709 13:02:46.996701 (+451470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:46.997131 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.997174 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:46.997724 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:02:47.043620 (+ 45896us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:47.043675 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.043908 (+   233us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:47.456487 (+412579us) raft_consensus.cc:1685] finished
0709 13:02:47.456518 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.065252 (+608734us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54003b6350. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:48.065578 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29491,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":1037520768,"thread_start_us":45556,"threads_started":1,"wal-append.queue_time_us":73779}
I20260709 13:02:48.042480  8452 rpcz_store.cc:276] 0709 13:02:45.601312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.863355 (+262043us) service_pool.cc:224] Handling call
0709 13:02:47.533625 (+1670270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.537425 (+  3800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.030653 (+493228us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b5400341050. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:48.030919 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3840571136}
I20260709 13:02:48.071764  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:48.073035  8526 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:48.081863  8379 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:02:48.080621 12645 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:48.084472 12645 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:48.088762  8384 raft_consensus.cc:2410] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:48.099785 12612 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:48.134349 12228 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:48.135288 12228 raft_consensus.cc:697] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:02:48.139137  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 88037.5us
I20260709 13:02:48.136837 12228 consensus_queue.cc:237] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:48.088901 12645 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:48.148593  9258 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:48.150147 12574 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:48.150905 12574 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:48.151618 12574 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:48.158679  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:48.165531  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 70047.8us
I20260709 13:02:48.168095  8426 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:48.175616 12384 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.181097 12384 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:48.181968  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:48.182070  8456 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:48.183132  8456 raft_consensus.cc:606] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:02:48.183527  8456 raft_consensus.cc:614] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:48.183934 12384 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:48.177331  8459 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:48.178539 12360 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.188119 12360 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:48.189954 12260 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:48.191277 12360 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:48.190902 12260 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:48.178911 12543 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.193142 12543 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:48.194993  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:48.195685  8456 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:48.196040 12260 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:48.196249  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:48.197147  8459 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:02:48.197280  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:48.198884 12543 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:48.179847  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:48.202756  8452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:48.203573  8452 raft_consensus.cc:606] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:48.205628  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:48.211925  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:48.257813  8378 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:48.259311 12645 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:48.260290 12645 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:48.287374  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:48.301796 12484 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.110s	user 0.034s	sys 0.025s
I20260709 13:02:48.263806  8526 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
W20260709 13:02:48.322314  8533 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.012s	sys 0.007s
W20260709 13:02:48.326045  8533 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.012s	sys 0.007s
W20260709 13:02:48.320415 12484 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.130s	user 0.034s	sys 0.025s
I20260709 13:02:48.326998  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:48.321097 12384 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:48.327791  8377 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.902s	user 0.040s	sys 0.032s
W20260709 13:02:48.332468 12560 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.009s	sys 0.004s
W20260709 13:02:48.332700  8349 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.069s	user 0.023s	sys 0.042s
I20260709 13:02:48.333174 12636 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:48.333308 12646 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:48.333827  8500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.208s	user 0.028s	sys 0.048s
W20260709 13:02:48.334332  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.334247  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:48.338924 12617 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:48.339679  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:48.340899  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 173018us
I20260709 13:02:48.344143  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:48.345093  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.345237 12530 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.336869  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:02:48.357625  8377 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.040s	sys 0.033s
W20260709 13:02:48.363927  8349 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.023s	sys 0.043s
I20260709 13:02:48.366041  8455 raft_consensus.cc:2393] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 9: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
W20260709 13:02:48.366220  8352 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.021s	user 0.000s	sys 0.065s
W20260709 13:02:48.366668  8352 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.076s	user 0.000s	sys 0.065s
W20260709 13:02:48.367269  8500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.028s	sys 0.048s
I20260709 13:02:48.345072  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:48.346150 12384 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:48.372166  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:48.371652  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:48.377285  8424 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:48.377910  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:48.378737  8461 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:48.379709 12449 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:48.380177  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:48.380535 12449 consensus_queue.cc:1048] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:02:48.382416 12672 log.cc:927] Time spent T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:02:48.383482  9261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.014s	sys 0.022s
W20260709 13:02:48.383942  9261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.015s	sys 0.022s
W20260709 13:02:48.371076 12560 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.010s	sys 0.004s
I20260709 13:02:48.385443  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:48.386183  8459 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:02:48.386741 12384 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:48.386943  9288 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:02:48.388754  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:48.393167  8452 raft_consensus.cc:2393] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 11: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:48.393945  9290 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:48.360118 12574 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:48.411782  8380 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.902s	user 0.055s	sys 0.082s
W20260709 13:02:48.415028  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 48991.3us
W20260709 13:02:48.423454  8380 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.055s	sys 0.083s
W20260709 13:02:48.425004  8530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.020s	sys 0.038s
I20260709 13:02:48.412547 12096 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:48.422861 12571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.026s	sys 0.022s
W20260709 13:02:48.430311  8427 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.020s	sys 0.025s
W20260709 13:02:48.429131  8534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.014s	sys 0.006s
I20260709 13:02:48.393992 12646 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:48.432875  9296 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.021s	sys 0.016s
I20260709 13:02:48.392102 12617 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:48.439352  8427 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.021s	sys 0.025s
W20260709 13:02:48.439767  8530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.020s	sys 0.039s
W20260709 13:02:48.441619  8534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.015s	sys 0.006s
W20260709 13:02:48.444274  9296 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.022s	sys 0.016s
I20260709 13:02:48.411175 12636 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:48.433063 12096 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.422755 12360 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
W20260709 13:02:48.443992 12571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.026s	sys 0.022s
W20260709 13:02:48.449134  8284 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.000s	sys 0.027s
W20260709 13:02:48.455189  8284 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.000s	sys 0.027s
I20260709 13:02:48.459493  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:48.460290  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:48.461480 12682 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:48.461716  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:48.462272 12646 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:48.462168 12682 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:48.462862  9294 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 14: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:48.464349  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:48.465539 12680 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.466303 12680 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:48.460966  9291 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:48.470155 12645 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:48.450173 12096 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:48.468868 12680 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:48.473372 12680 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.474108  9295 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:48.474049 12680 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:48.475724  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 1.24353e+06us
I20260709 13:02:48.476661 12680 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:48.454461  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 45741us
I20260709 13:02:48.422475 12608 consensus_queue.cc:1059] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:02:48.427974 12530 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:48.489926 12456 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.012s	sys 0.022s
I20260709 13:02:48.490005 12682 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:48.495563  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:48.496909 12456 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.012s	sys 0.023s
I20260709 13:02:48.495550  8424 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:48.498487  8424 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:48.501266 12599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.965s	user 0.023s	sys 0.026s
I20260709 13:02:48.501364 12456 raft_consensus.cc:2764] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:02:48.501909 12599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.023s	sys 0.026s
I20260709 13:02:48.502218 12456 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:48.500943  8424 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
W20260709 13:02:48.503439  8535 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.008s	sys 0.015s
W20260709 13:02:48.503896  8535 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.008s	sys 0.015s
I20260709 13:02:48.505259 12681 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:48.505761 12681 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:48.506289 12681 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:48.506922  8424 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:48.509337 12456 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:48.510793  8379 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:48.510936  8384 raft_consensus.cc:1275] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:48.512055  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:48.512758  8382 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:48.513159 12523 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.006s	sys 0.012s
W20260709 13:02:48.513664  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 177034us
I20260709 13:02:48.513567  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:48.522825  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 45970.9us
W20260709 13:02:48.513628 12523 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.007s	sys 0.012s
I20260709 13:02:48.527312  9291 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:48.531616  8526 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
W20260709 13:02:48.534698  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.532588  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 866) took 1001 ms. Trace:
I20260709 13:02:48.489919 12571 raft_consensus.cc:697] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:48.530510  8426 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:48.546666  8385 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:48.552479  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.535969  8530 rpcz_store.cc:276] 0709 13:02:47.524678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.527372 (+  2694us) service_pool.cc:224] Handling call
0709 13:02:47.527721 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:47.528078 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:47.528115 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:47.528668 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:02:48.490139 (+961471us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:48.490208 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.517415 (+ 27207us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:48.525351 (+  7936us) raft_consensus.cc:1685] finished
0709 13:02:48.525377 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.525561 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":196,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":7868,"thread_start_us":911432,"threads_started":1,"wal-append.queue_time_us":973362}
W20260709 13:02:48.550552 12660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.975s	user 0.006s	sys 0.013s
I20260709 13:02:48.534219 12560 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.564507  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:48.557156  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:48.562321  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:48.556962  9290 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
W20260709 13:02:48.582720  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 47290.9us
W20260709 13:02:48.582325  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 65076us
W20260709 13:02:48.573275  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 66478.7us
W20260709 13:02:48.606542  9260 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.017s	sys 0.024s
I20260709 13:02:48.581542 12574 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:48.569160 12665 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.964s	user 0.021s	sys 0.000s
W20260709 13:02:48.607620 12665 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.137s	user 0.021s	sys 0.000s
I20260709 13:02:48.608124 12665 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:48.608826 12665 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:48.609333  8526 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:48.611114 12665 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:48.611773  9260 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.018s	sys 0.025s
W20260709 13:02:48.612124  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 746682us
I20260709 13:02:48.573988  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:48.582655 12636 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:48.613535  8534 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:48.614648  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:48.615209  8534 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:48.612879 12617 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:48.617413  8382 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
W20260709 13:02:48.575708 12660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.006s	sys 0.014s
I20260709 13:02:48.557337  8349 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:48.619375  8381 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:48.623068  8530 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:02:48.557188 12457 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.013s	sys 0.017s
W20260709 13:02:48.573222 12659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.885s	user 0.012s	sys 0.014s
I20260709 13:02:48.559206 12645 raft_consensus.cc:3055] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:48.632067  8526 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:02:48.574716 12530 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:48.557457 12096 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:48.635799  8424 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:48.639246  8501 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:48.641271  8382 raft_consensus.cc:1240] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:48.638298 12457 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.013s	sys 0.018s
I20260709 13:02:48.637943 12679 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.649211  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.636875 12645 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:02:48.640977 12659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.013s	sys 0.014s
I20260709 13:02:48.653690  8385 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:48.581486 12560 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:48.640632 12360 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:48.679088 12449 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:48.680445 12681 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:48.557303 12678 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 13:02:48.577775 12571 consensus_queue.cc:237] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:48.898089  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.703227  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:48.898916  8526 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:48.899318  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 263639us
W20260709 13:02:48.797869  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.758337  8530 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:48.686954  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:48.897287  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 419518us
W20260709 13:02:48.903571  8527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.041s	sys 0.119s
W20260709 13:02:48.904021  8527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.041s	sys 0.119s
I20260709 13:02:48.905332  8385 raft_consensus.cc:2393] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 10: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:48.645589 12484 raft_consensus.cc:2764] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:48.907299  8534 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
W20260709 13:02:48.867116  8500 connection.cc:256] RPC call timeout handler was delayed by -1.2304811590000213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
W20260709 13:02:48.718070  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 164773us
W20260709 13:02:48.849924  8532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.010s	sys 0.022s
W20260709 13:02:48.913242  8532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.020s	sys 0.022s
W20260709 13:02:48.871992  8529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.014s	sys 0.043s
W20260709 13:02:48.914126  8529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.017s	sys 0.046s
W20260709 13:02:48.681433 12262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.120s	user 0.030s	sys 0.022s
I20260709 13:02:48.920754  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:48.923204  8534 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:02:48.646606 12599 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.927394  8381 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:48.719126 12560 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:48.757439 12608 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.722527 12096 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:48.850102 12646 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.703632 12673 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.933889  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:48.721879 12636 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.206s
W20260709 13:02:48.929731 12262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.404s	user 0.039s	sys 0.029s
I20260709 13:02:48.935443 12449 consensus_queue.cc:1059] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:02:48.937939  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:48.822798 12384 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:48.708276 12612 consensus_queue.cc:1059] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.225s
I20260709 13:02:48.943619  8534 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 7.
I20260709 13:02:48.710589 12668 consensus_queue.cc:1059] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.267s
I20260709 13:02:48.947788  8426 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:48.952147  8530 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:48.754659 12645 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:48.704196 12679 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:48.961385  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:48.961550  8349 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:48.948892 12360 raft_consensus.cc:3055] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:48.937136 12560 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.944438 12646 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:48.983716  8386 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:48.940359 12673 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:48.965899 12457 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:48.980360  8424 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:48.945142 12608 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:48.988574  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 53703.5us
W20260709 13:02:48.989385  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.953213 12599 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:48.965745 12360 raft_consensus.cc:740] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:48.989787 12228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.019s	sys 0.031s
I20260709 13:02:48.988389 12683 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:49.011835  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 70623.6us
I20260709 13:02:49.002197  8427 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:49.020641 12686 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.021504 12686 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:49.022704  8454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 2160) took 3272 ms. Trace:
I20260709 13:02:49.022432 12276 consensus_queue.cc:1059] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:02:49.023762 12276 raft_consensus.cc:3055] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:49.024466 12276 raft_consensus.cc:740] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:49.023165  8454 rpcz_store.cc:276] 0709 13:02:45.750741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.579489 (+828748us) service_pool.cc:224] Handling call
0709 13:02:46.579822 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:46.580175 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.580203 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:46.589743 (+  9540us) log.cc:844] Serialized 52 byte log entry
0709 13:02:48.008120 (+1418377us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b180037ef40. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c80250d1 00007f36c8440a0f
0709 13:02:48.495913 (+487793us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:48.495950 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.496036 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:49.022203 (+526167us) raft_consensus.cc:1685] finished
0709 13:02:49.022227 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.022521 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2843,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":3538,"spinlock_wait_cycles":5387008,"thread_start_us":470044,"threads_started":1,"wal-append.queue_time_us":2419727}
W20260709 13:02:49.005210  8533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.028s	sys 0.027s
W20260709 13:02:49.026535  8533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.028s	sys 0.027s
I20260709 13:02:49.003994 12262 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:49.029053  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 47081.2us
W20260709 13:02:49.029408  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:49.030303  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.985401 12560 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:49.008941 12636 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:49.017786 12228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.020s	sys 0.031s
I20260709 13:02:49.008003 12683 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:49.069125  8383 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.000s	sys 0.012s
W20260709 13:02:49.069633  8378 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.000s	sys 0.009s
W20260709 13:02:49.076730  8384 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.001s	sys 0.001s
I20260709 13:02:49.093456  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 871) took 1483 ms. Trace:
W20260709 13:02:49.115422  8383 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.000s	sys 0.013s
I20260709 13:02:49.094514  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 874) took 1080 ms. Trace:
W20260709 13:02:49.115561  8384 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.002s	sys 0.001s
W20260709 13:02:49.118808  8378 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.001s	sys 0.009s
W20260709 13:02:49.120829  9296 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.005s	sys 0.007s
W20260709 13:02:49.121233  9296 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.005s	sys 0.007s
W20260709 13:02:49.123935  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 418062us
I20260709 13:02:49.029168 12384 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:49.115577  8427 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:49.114199  8379 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.011s	sys 0.000s
W20260709 13:02:49.115489  8377 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.016s	sys 0.016s
I20260709 13:02:49.027523 12686 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:49.045145 12675 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:49.128154  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 151837us
W20260709 13:02:49.128314  8377 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.016s	sys 0.016s
W20260709 13:02:49.128001  8379 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.011s	sys 0.000s
I20260709 13:02:49.116941  8532 rpcz_store.cc:276] 0709 13:02:48.014363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.020343 (+  5980us) service_pool.cc:224] Handling call
0709 13:02:48.020980 (+   637us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:48.073398 (+ 52418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:48.073442 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:48.074279 (+   837us) log.cc:844] Serialized 26 byte log entry
0709 13:02:48.913677 (+839398us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:48.913733 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.913816 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:49.094258 (+180442us) raft_consensus.cc:1685] finished
0709 13:02:49.094312 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.094455 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51456,"raft.queue_time_us":111706,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":198,"thread_start_us":838836,"threads_started":1,"wal-append.queue_time_us":1013447}
W20260709 13:02:49.130009  9288 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.008s	sys 0.008s
W20260709 13:02:49.137002  9288 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.008s	sys 0.008s
W20260709 13:02:49.131922 12523 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.009s	sys 0.009s
I20260709 13:02:49.047219 12681 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:49.025472 12360 consensus_queue.cc:260] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:49.128460  8531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.020s	sys 0.054s
W20260709 13:02:49.144032  8531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.020s	sys 0.054s
I20260709 13:02:49.124393  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 711) took 1712 ms. Trace:
I20260709 13:02:49.115805  8529 rpcz_store.cc:276] 0709 13:02:47.609977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.610180 (+   203us) service_pool.cc:224] Handling call
0709 13:02:47.610577 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:47.611025 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:47.611064 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:47.616633 (+  5569us) log.cc:844] Serialized 26 byte log entry
0709 13:02:48.937514 (+1320881us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:48.940619 (+  3105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.949519 (+  8900us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:49.093147 (+143628us) raft_consensus.cc:1685] finished
0709 13:02:49.093169 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.093369 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":103,"thread_start_us":1052418,"threads_started":1,"wal-append.queue_time_us":1224176}
W20260709 13:02:49.137638 12523 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.009s	sys 0.009s
W20260709 13:02:49.142155  8535 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.008s	sys 0.010s
I20260709 13:02:49.125922 12457 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:49.148955  8535 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.008s	sys 0.010s
I20260709 13:02:49.147148  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 875) took 1132 ms. Trace:
W20260709 13:02:49.146279  9261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.011s	sys 0.041s
W20260709 13:02:49.151177  9261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.012s	sys 0.041s
W20260709 13:02:49.151690  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 692153us
I20260709 13:02:49.153162  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 865) took 1628 ms. Trace:
I20260709 13:02:49.147939 12530 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:49.065771 12260 consensus_queue.cc:1048] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:02:49.131721 12262 raft_consensus.cc:697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:49.142580 12686 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.145049  8380 rpcz_store.cc:276] 0709 13:02:47.412019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.412175 (+   156us) service_pool.cc:224] Handling call
0709 13:02:47.412502 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:48.448367 (+1035865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:48.452585 (+  4218us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:48.529679 (+ 77094us) log.cc:844] Serialized 26 byte log entry
0709 13:02:49.074100 (+544421us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:49.074152 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.074292 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:49.075949 (+  1657us) raft_consensus.cc:1685] finished
0709 13:02:49.075979 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.124309 (+ 48330us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26042,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":93,"thread_start_us":1505925,"threads_started":2,"wal-append.queue_time_us":534569}
I20260709 13:02:49.127640 12449 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 13:02:49.161629  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 150029us
I20260709 13:02:49.164263  8530 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:49.150663  8531 rpcz_store.cc:276] 0709 13:02:48.014762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.021858 (+  7096us) service_pool.cc:224] Handling call
0709 13:02:48.022391 (+   533us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:48.079236 (+ 56845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:48.079266 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:48.080146 (+   880us) log.cc:844] Serialized 52 byte log entry
0709 13:02:49.144407 (+1064261us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:49.144445 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.144522 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:49.144579 (+    57us) raft_consensus.cc:1685] finished
0709 13:02:49.144595 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.147085 (+  2490us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52053,"raft.queue_time_us":110948,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":104,"thread_start_us":1063739,"threads_started":1,"wal-append.queue_time_us":1010665}
I20260709 13:02:49.147131 12228 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:49.147794 12574 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.001s	sys 0.016s
I20260709 13:02:49.164862  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38894 (request call id 2483) took 1091 ms. Trace:
I20260709 13:02:49.140923 12636 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:49.181255  8528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.070s	user 0.049s	sys 0.101s
I20260709 13:02:49.181819  8530 rpcz_store.cc:276] 0709 13:02:48.078458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.918649 (+840191us) service_pool.cc:224] Handling call
0709 13:02:49.164800 (+246151us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:49.162223  9260 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 3.060s (SENT) [suppressed 30 similar messages]
W20260709 13:02:49.184051  8528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.145s	user 0.049s	sys 0.101s
I20260709 13:02:49.154821  8533 rpcz_store.cc:276] 0709 13:02:47.524348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.526560 (+  2212us) service_pool.cc:224] Handling call
0709 13:02:47.526900 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.527140 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:48.327749 (+800609us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.108947 (+781198us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.126809 (+ 17862us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:49.131255 (+  4446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.143853 (+ 12598us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.153101 (+  9248us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":926739,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"thread_start_us":1439220,"threads_started":2,"wal-append.queue_time_us":725293}
I20260709 13:02:49.185256  8526 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
W20260709 13:02:49.186172  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 45601us
I20260709 13:02:49.186975  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2480) took 1111 ms. Trace:
I20260709 13:02:49.187348  8529 rpcz_store.cc:276] 0709 13:02:48.071942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.145755 (+1073813us) service_pool.cc:224] Handling call
0709 13:02:49.150754 (+  4999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.183128 (+ 32374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:49.183180 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.183259 (+    79us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:49.183294 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.183356 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.183474 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:49.189211 12599 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:49.190598  8424 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:49.189271 12360 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:49.158458 12384 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:49.160267 12457 raft_consensus.cc:697] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:49.195700 12646 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:49.196693 12646 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:49.197274 12646 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:49.199628 12646 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:49.185634 12574 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.001s	sys 0.016s
I20260709 13:02:49.195003  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 868) took 1664 ms. Trace:
I20260709 13:02:49.202386  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 869) took 1671 ms. Trace:
W20260709 13:02:49.207190  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 141106us
I20260709 13:02:49.207578 12710 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:49.208770 12695 log.cc:927] Time spent T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:02:49.208283 12710 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:49.223732  8426 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:49.181453 12686 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:49.244452  9258 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:49.157981 12675 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:49.204850  8528 rpcz_store.cc:276] 0709 13:02:47.530653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.531280 (+   627us) service_pool.cc:224] Handling call
0709 13:02:47.976279 (+444999us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b5800003698. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd45efc0 00007f36cd449929 00007f36cd4493d2 00007f36c69c0bd4
0709 13:02:47.976782 (+   503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:48.038195 (+ 61413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:48.038225 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:48.038941 (+   716us) log.cc:844] Serialized 26 byte log entry
0709 13:02:49.184504 (+1145563us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:49.184553 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.184622 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:49.184669 (+    47us) raft_consensus.cc:1685] finished
0709 13:02:49.184678 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.202319 (+ 17641us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2343168,"thread_start_us":1145043,"threads_started":1,"wal-append.queue_time_us":1041160}
I20260709 13:02:49.247714  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:49.248600 12457 consensus_queue.cc:237] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:49.252615  8534 raft_consensus.cc:2393] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 12: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:49.205119  8535 rpcz_store.cc:276] 0709 13:02:47.530271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.531190 (+   919us) service_pool.cc:224] Handling call
0709 13:02:47.546833 (+ 15643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.547063 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:48.504397 (+957334us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.159265 (+654868us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.163431 (+  4166us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:49.174005 (+ 10574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.174991 (+   986us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.194941 (+ 19950us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1005597,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":46029,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":1601541,"threads_started":2,"wal-append.queue_time_us":655555}
I20260709 13:02:49.253563 12675 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:49.186740 12228 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:49.214972 12599 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:49.257443 12599 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.257855 12599 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:49.258028 12228 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:49.210047 12679 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:49.262499 12709 log.cc:927] Time spent T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:02:49.223896 12384 raft_consensus.cc:697] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:49.265945 12668 consensus_queue.cc:1059] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:49.266198 12384 consensus_queue.cc:237] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:49.268143 12636 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:49.181739 12276 consensus_queue.cc:260] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:49.245414  8424 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:49.269505 12276 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:49.272315 12560 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:49.244315  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 872) took 1305 ms. Trace:
I20260709 13:02:49.283461  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2484) took 1137 ms. Trace:
I20260709 13:02:49.285311  8531 rpcz_store.cc:276] 0709 13:02:48.146345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.174741 (+1028396us) service_pool.cc:224] Handling call
0709 13:02:49.216082 (+ 41341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.279036 (+ 62954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:49.279077 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.283038 (+  3961us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:49.283114 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.283211 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.283385 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:49.284960  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 76956.4us
W20260709 13:02:49.286376  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:49.287006  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 92675.9us
I20260709 13:02:49.255404 12686 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:49.289513 12523 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:49.291136 12726 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:49.291788 12726 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:49.294108 12726 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:49.287271 12260 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:02:49.294797  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.280583 12679 raft_consensus.cc:3055] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:49.296304 12679 raft_consensus.cc:740] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:49.297529 12679 consensus_queue.cc:260] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:49.277288  8527 rpcz_store.cc:276] 0709 13:02:48.013294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.013491 (+   197us) service_pool.cc:224] Handling call
0709 13:02:48.014119 (+   628us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:48.037958 (+ 23839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:48.038009 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:48.038943 (+   934us) log.cc:844] Serialized 52 byte log entry
0709 13:02:48.908169 (+869226us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:48.936104 (+ 27935us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.243912 (+307808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.244002 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:49.244054 (+    52us) raft_consensus.cc:1685] finished
0709 13:02:49.244073 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.244231 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79125,"prepare.queue_time_us":28722,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":324553,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":362,"thread_start_us":1172479,"threads_started":2,"wal-append.queue_time_us":1043957}
I20260709 13:02:49.302171  8349 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:49.288631 12675 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:49.303011 12686 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:49.299428 12260 raft_consensus.cc:697] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:49.295110 12608 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:49.300632 12683 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:49.310834 12710 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:49.295408 12673 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:49.301820 12360 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:49.318169  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 105882us
I20260709 13:02:49.307119 12484 raft_consensus.cc:3055] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:49.307860 12686 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.321669  8349 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:49.284934 12262 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:49.324581  8349 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:49.325289 12560 raft_consensus.cc:2764] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:02:49.319046 12710 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.323453 12686 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:49.320899 12484 raft_consensus.cc:740] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:49.346876  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:49.345397  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:49.348042  8459 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:49.319898 12675 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:49.346925  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:49.349198  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:49.349838  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:49.350108  8452 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:49.350651  8454 raft_consensus.cc:2393] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 15: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:49.329627 12710 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:49.321031 12360 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:49.395049  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.401921  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:49.403450  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:49.403855  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:49.404462  8456 raft_consensus.cc:2393] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 13: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:49.406682  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:49.407851  8454 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 8: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:49.408835  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:49.403178  8461 raft_consensus.cc:2393] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 9: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
W20260709 13:02:49.464962  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 399465us
W20260709 13:02:49.470952  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:49.491139  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 188121us
W20260709 13:02:49.490700  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 303072us
I20260709 13:02:49.531455  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2981) took 1020 ms. Trace:
I20260709 13:02:49.533921  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 2976) took 1024 ms. Trace:
I20260709 13:02:49.534399  8378 rpcz_store.cc:276] 0709 13:02:48.509552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.512537 (+  2985us) service_pool.cc:224] Handling call
0709 13:02:48.512846 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.513135 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:49.123764 (+610629us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.533534 (+409770us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.533592 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:49.533649 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.533725 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.533857 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30806,"prepare.queue_time_us":555182,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"thread_start_us":941724,"threads_started":2}
I20260709 13:02:49.542903  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:49.548018 12674 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:49.517490 12659 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:49.548694 12674 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:49.550201  8427 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:49.551807 12384 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:49.552407 12384 raft_consensus.cc:697] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:49.567868  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:49.559015  9296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 965) took 3043 ms. Trace:
I20260709 13:02:49.558441  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47306 (request call id 877) took 1066 ms. Trace:
I20260709 13:02:49.543748  8535 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:49.572613 12348 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:49.573365 12348 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:49.574105 12456 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:49.535648 12673 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:49.570034  8534 rpcz_store.cc:276] 0709 13:02:48.492198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.951856 (+459658us) service_pool.cc:224] Handling call
0709 13:02:49.558167 (+606311us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54002aeed4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:49.558360 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":665756928}
I20260709 13:02:49.581637  8426 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:49.596437 12746 consensus_queue.cc:1059] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:02:49.600070  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:02:49.622031  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.568204 12096 raft_consensus.cc:3055] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:49.534190  8383 rpcz_store.cc:276] 0709 13:02:48.511199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.511751 (+   552us) service_pool.cc:224] Handling call
0709 13:02:48.512068 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.512395 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:49.126320 (+613925us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.520468 (+394148us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.520548 (+    80us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:49.520598 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.520681 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.531383 (+ 10702us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1564,"prepare.queue_time_us":555635,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":30517,"spinlock_wait_cycles":15744,"thread_start_us":940439,"threads_started":2}
I20260709 13:02:49.531930 12530 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:49.607522 12384 consensus_queue.cc:237] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:49.599736 12728 log.cc:927] Time spent T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 13:02:49.569743  9296 rpcz_store.cc:276] 0709 13:02:46.499109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.499247 (+   138us) service_pool.cc:224] Handling call
0709 13:02:46.542632 (+ 43385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:46.690703 (+148071us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.690742 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:47.607496 (+916754us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b2c00047b98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2
0709 13:02:47.608274 (+   778us) log.cc:844] Serialized 52 byte log entry
0709 13:02:48.530952 (+922678us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:48.566220 (+ 35268us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b54001908a0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c83fadbe 00007f36c8405930 00007f36c84058d8 00007f36c8405858 00007f36c8405813 00007f36c8404a9c 00007f36ce2f0626 00007f36ce2eadd8 00007f36c84417cb 00007f36c84442c0
0709 13:02:49.121602 (+555382us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.523320 (+401718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.535308 (+ 11988us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:49.535351 (+    43us) raft_consensus.cc:1685] finished
0709 13:02:49.535363 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.542304 (+  6941us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":539703,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":205514,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":284,"spinlock_wait_cycles":67758720,"thread_start_us":1924922,"threads_started":4,"wal-append.queue_time_us":887867}
I20260709 13:02:49.463420 12260 consensus_queue.cc:237] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:49.608662 12228 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.589185  8459 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:02:49.599931 12727 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:49.706526  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 189000us
I20260709 13:02:49.651224 12096 raft_consensus.cc:740] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:02:49.720993  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 178347us
I20260709 13:02:49.660149 12530 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:49.721498 12723 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:49.722793 12228 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:49.758147 12096 consensus_queue.cc:260] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:49.768611 12228 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:49.769465  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 115850us
I20260709 13:02:49.737914 12262 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:49.781711  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.787283  9258 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:49.810286  9261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.006s	sys 0.013s
W20260709 13:02:49.811473  9261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.006s	sys 0.013s
W20260709 13:02:49.810606  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 257833us
I20260709 13:02:49.567209 12484 consensus_queue.cc:260] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:49.827165 12484 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:49.827503  8534 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:02:49.822649  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:49.823417 12228 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:49.824169  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:49.824915  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:49.825876  8529 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:49.825984  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:49.826257  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 271448us
I20260709 13:02:49.778038 12096 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:49.834456  8535 raft_consensus.cc:2410] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:49.835832  9288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 635) took 1428 ms. Trace:
W20260709 13:02:49.838842  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 59243.1us
I20260709 13:02:49.801623 12360 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:49.843971  8527 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:49.845283  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:49.845479 12571 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:49.845877  8528 raft_consensus.cc:2393] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 10: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:49.846093 12571 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:49.846544  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:49.814409 12727 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:49.848333 12571 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:49.795253 12675 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:49.849112  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:49.845139 12262 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:02:49.829324 12751 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:49.884474  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:49.887470  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:49.937005  9289 raft_consensus.cc:1240] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:02:49.889245  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 49297.7us
I20260709 13:02:49.953557  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:49.945931  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.837473  9288 rpcz_store.cc:276] 0709 13:02:48.408315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.412777 (+  4462us) service_pool.cc:224] Handling call
0709 13:02:48.422809 (+ 10032us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.452198 (+ 29389us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:49.138683 (+686485us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.822447 (+683764us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.829749 (+  7302us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.829808 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:49.835541 (+  5733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.835619 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.835752 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24440,"prepare.queue_time_us":669076,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":156,"raft.queue_time_us":301289,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":1060410,"threads_started":3,"wal-append.queue_time_us":682797}
W20260709 13:02:49.975288  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 414788us
I20260709 13:02:49.979123  8426 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:49.980182 12360 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:49.888988  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:49.918964  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:02:49.925673  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 91358us
I20260709 13:02:49.983137  9294 raft_consensus.cc:2393] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 11: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:49.976250  9287 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
W20260709 13:02:49.952137 12599 consensus_meta.cc:287] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.694s	user 0.009s	sys 0.002s
I20260709 13:02:49.988529  9292 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:02:49.966427  9293 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:49.936630 12678 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:49.955178 12686 consensus_meta.cc:287] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.000s
I20260709 13:02:50.002988  8535 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:49.836205 12680 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:02:50.006108  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.975492 12727 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:49.941751 12724 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:02:50.006726 12686 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:50.007261  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 712) took 2592 ms. Trace:
I20260709 13:02:50.003044 12599 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:49.993353 12096 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:49.918974 12710 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:50.017253  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:50.039768  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.001587  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:49.889927 12571 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:50.050889  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 69761.4us
W20260709 13:02:50.048347  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 168182us
I20260709 13:02:49.891542 12228 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:50.061761  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.047987 12682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.039s	sys 0.072s
I20260709 13:02:49.947752 12530 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:50.064332  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:50.073796  8459 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
W20260709 13:02:50.074532  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 610332us
W20260709 13:02:50.075937  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.076594  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:50.077253  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:50.078274  9296 raft_consensus.cc:2368] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14.
I20260709 13:02:50.019665 12751 raft_consensus.cc:697] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:50.018013  8377 rpcz_store.cc:276] 0709 13:02:47.415338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.415498 (+   160us) service_pool.cc:224] Handling call
0709 13:02:47.415962 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:48.414366 (+998404us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:49.137933 (+723567us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.539711 (+401778us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:49.841373 (+301662us) log.cc:844] Serialized 26 byte log entry
0709 13:02:49.841567 (+   194us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:49.841615 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.919996 (+ 78381us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:50.007030 (+ 87034us) raft_consensus.cc:1685] finished
0709 13:02:50.007049 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.007180 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22889,"prepare.queue_time_us":644687,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":47,"raft.queue_time_us":48057,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":248,"spinlock_wait_cycles":11275776,"thread_start_us":2003579,"threads_started":3,"wal-append.queue_time_us":501069}
I20260709 13:02:50.079674  8530 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:50.084203  8459 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:50.082861  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:50.082959 12449 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.086675 12449 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:50.089030  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:50.089982  8529 raft_consensus.cc:2410] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:50.090478 12530 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:50.090924 12645 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:50.077309 12574 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.092653 12574 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:50.093502  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:50.095027  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.116185  8531 raft_consensus.cc:2410] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:02:50.073676 12682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.039s	sys 0.072s
I20260709 13:02:50.122699  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:50.126281  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.126706  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.128978  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 81144.2us
W20260709 13:02:50.129357  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 45617.3us
W20260709 13:02:50.129455  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 73328.3us
I20260709 13:02:50.047071 12680 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:50.082559 12456 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:50.149355  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:50.161868  8529 raft_consensus.cc:2410] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:50.150084 12755 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
W20260709 13:02:50.166754  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.167712 12449 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:50.173395 12456 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:50.176085 12456 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:50.181641 12574 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:50.186442 12228 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:50.189675  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 48046.9us
W20260709 13:02:50.196905  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 44441.3us
I20260709 13:02:50.206063 12686 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:50.207351 12751 consensus_queue.cc:237] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:50.215739  8526 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:50.216468  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:50.196607 12484 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.078063 12096 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:50.220763  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:50.231949  9293 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:50.234395  8530 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
W20260709 13:02:50.226176  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 56798.6us
I20260709 13:02:50.238947  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:50.239275  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:50.239003  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:50.240434  8526 raft_consensus.cc:2410] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:50.240788  8529 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:50.241408  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:50.241719 12668 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.242213 12668 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:50.242765  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:50.244256 12668 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:50.248543  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2479) took 2177 ms. Trace:
I20260709 13:02:50.248692  9290 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:50.250013  8532 rpcz_store.cc:276] 0709 13:02:48.071496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.136352 (+1064856us) service_pool.cc:224] Handling call
0709 13:02:49.136780 (+   428us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:49.611863 (+475083us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:49.680427 (+ 68564us) log.cc:844] Serialized 14 byte log entry
0709 13:02:50.062864 (+382437us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:50.116178 (+ 53314us) log.cc:844] Serialized 52 byte log entry
0709 13:02:50.116354 (+   176us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:50.116394 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.116482 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:50.248282 (+131800us) raft_consensus.cc:1685] finished
0709 13:02:50.248308 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.248484 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49372,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":15711,"raft.queue_time_us":63872,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":5548,"thread_start_us":792120,"threads_started":2,"wal-append.queue_time_us":524806}
W20260709 13:02:50.258988  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 95390.7us
I20260709 13:02:50.204654 12599 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:50.260152  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:50.264989  9289 raft_consensus.cc:2410] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:02:50.266970  9292 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.268172 12096 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:50.282023  8526 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:50.302304  8459 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:50.313862  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:50.314780  9295 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:50.141831 12571 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:50.290200 12745 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:02:50.341189  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 76482.2us
I20260709 13:02:50.289758 12260 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.352258  9289 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:02:50.365974  9289 pending_rounds.cc:85] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting all ops after (but not including) 9
I20260709 13:02:50.366334  9289 pending_rounds.cc:107] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:02:50.366637  9289 raft_consensus.cc:2889] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:50.372102  8459 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:50.290504 12659 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:50.374490  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 45754.5us
I20260709 13:02:50.395812  8459 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:50.401497  8457 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:50.415035  9287 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:50.381419 12659 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:50.413378  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:50.422863  9294 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:02:50.423017 12750 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.434027  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:50.325345 12484 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:50.445127  9295 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:50.459645  9293 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:50.423712 12750 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:50.466552  9292 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:50.466565  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:50.474774  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.470036  9294 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
W20260709 13:02:50.475842  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.452618 12745 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:02:50.482515  9290 raft_consensus.cc:2410] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:02:50.483382  8457 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:02:50.381187 12260 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:50.488893  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.490648  8461 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:50.496628  8351 connection.cc:256] RPC call timeout handler was delayed by -1.1833823640000105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 13:02:50.498030  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 110725us
W20260709 13:02:50.500808  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.501792  8424 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:50.506264  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:50.508728  8457 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:02:50.514324  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:50.515318  8461 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 8: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:50.518181 12457 raft_consensus.cc:3055] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:50.518687 12457 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:50.520123 12758 log.cc:927] Time spent T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:02:50.521130 12760 log.cc:927] Time spent T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:02:50.501410 12384 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.528177  8500 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:50.533697  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:50.535490  9258 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:50.503726 12612 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:50.550853  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:50.549768  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:50.553817  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:50.501693 12681 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:02:50.550087  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:50.577356  8457 raft_consensus.cc:2393] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 11: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:50.543737  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:50.503536 12449 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:02:50.570119  8452 raft_consensus.cc:2410] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:02:50.552044  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:50.503400 12262 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:02:50.552693 12571 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:50.540398 12748 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:50.589794  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.554492  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:50.537777 12276 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:50.555097  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:50.539568  8424 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:50.593798  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 54309us
I20260709 13:02:50.544807 12673 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:50.591629  8460 raft_consensus.cc:2410] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:50.541121 12683 consensus_queue.cc:1059] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:02:50.543673 12710 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:02:50.583827 12734 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:50.607547  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:50.609290  8456 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.543334 12763 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:02:50.589672 12748 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.611575  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:50.570436 12612 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:50.603000 12673 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:50.603251 12360 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:50.570202 12384 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:50.625393  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:50.593921 12262 consensus_queue.cc:1243] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer b8eb0ad4490645598004d862412f4e31 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:50.593243 12574 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
W20260709 13:02:50.633616  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 121659us
I20260709 13:02:50.644289  8455 raft_consensus.cc:2376] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13. Re-sending same reply.
W20260709 13:02:50.653241  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.616640 12748 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:50.660192  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:50.639936 12750 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:50.664521  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:50.644373 12360 raft_consensus.cc:697] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:50.694512  8500 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:50.700352  8500 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:50.701762  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:50.681238 12228 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:50.706832  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 103938us
I20260709 13:02:50.697201 12260 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:50.704188 12484 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:50.719856  8351 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:50.706022 12228 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:50.726287 12668 consensus_queue.cc:1059] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.005s
W20260709 13:02:50.732662 12759 log.cc:927] Time spent T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:02:50.734313 12680 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:50.729691 12682 consensus_queue.cc:1059] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
W20260709 13:02:50.734984 12770 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:02:50.735479 12682 raft_consensus.cc:3055] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:50.735587 12720 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:50.735903 12682 raft_consensus.cc:740] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:50.710291 12096 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:02:50.724059 12645 consensus_meta.cc:287] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.003s
I20260709 13:02:50.722754 12763 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.721392 12710 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:02:50.729053 12228 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:50.734261 12774 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:50.745494  8456 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:02:50.743196 12724 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.747061 12724 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:50.749413 12384 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:50.750165 12771 log.cc:927] Time spent T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:02:50.750998 12679 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:50.753660 12773 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:02:50.754745  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.740937 12360 consensus_queue.cc:237] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:50.745124 12763 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:50.757921 12772 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:02:50.766669  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.767441  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.767871  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.743741 12720 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:50.783401  8351 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:50.783661  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:50.784269  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:50.785714  8535 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:50.785977  8527 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:50.787508  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:50.788954  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:50.790182  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:50.795209  8377 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:50.796422  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:50.797302  8386 raft_consensus.cc:2410] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:02:50.798117  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 69520.4us
I20260709 13:02:50.745594 12774 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:50.774739 12645 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:50.811513  8534 raft_consensus.cc:1275] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:02:50.812361  8531 raft_consensus.cc:1275] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:50.798779  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:50.813555  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 113286us
I20260709 13:02:50.813161  8533 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:50.775662 12763 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:50.817853  8500 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:50.781912 12484 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:50.789812 12096 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.820233  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:50.791549 12734 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:50.824075  8528 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:50.811299 12774 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:50.851126  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:50.854413  8531 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
W20260709 13:02:50.859678  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 113287us
I20260709 13:02:50.868582  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:50.871368  8527 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:02:50.883711  8424 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:50.886596  8424 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:50.887617  8424 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:50.893996  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:50.894668  8529 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:02:50.899296  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 81518us
I20260709 13:02:50.858144 12727 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:50.810055 12682 consensus_queue.cc:260] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:50.903649  8377 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:02:50.892510 12763 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.013s
W20260709 13:02:50.907624 12782 log.cc:927] Time spent T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:02:50.831844 12096 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:50.869627 12612 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:50.906858 12787 log.cc:927] Time spent T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:02:50.911168  8500 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:50.929432  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.856477 12484 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:50.880277 12720 raft_consensus.cc:697] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:50.853557 12734 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:50.903069 12645 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.897370 12750 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:50.897490 12681 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:50.897229 12456 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:50.939548  8384 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:50.892004 12260 consensus_queue.cc:1048] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 13:02:50.947438  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 87040.9us
I20260709 13:02:50.948309  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:50.948926  8383 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:02:50.942377 12750 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.944041 12456 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.944187 12681 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:50.946903 12784 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:50.972582  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 72299.9us
I20260709 13:02:50.975518  8500 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:50.981532 12783 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:50.983547 12783 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:50.972116  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:50.968689 12750 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.945255 12645 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:50.930559 12659 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:50.953446 12682 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:50.946444 12788 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:50.972067  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:50.970705 12456 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:51.024326  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:51.024925  8377 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:50.973932 12681 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:51.041257  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 69295.2us
I20260709 13:02:51.043987 12788 raft_consensus.cc:697] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 17 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:51.054536 12788 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:51.070910 12764 raft_consensus.cc:3055] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:51.071483 12764 raft_consensus.cc:740] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:51.073691  8385 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:51.072381 12764 consensus_queue.cc:260] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:51.075502  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.108361  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:51.093390  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.074949  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:51.091292  9260 leader_election.cc:336] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.618s (SENT)
I20260709 13:02:51.142455  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.143384  8385 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:51.140625  8529 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:02:51.144356  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.145936  8385 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:51.137629  8384 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:02:51.075004  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:51.155385  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.139559  9260 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:51.175570  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:51.120918 12757 log.cc:927] Time spent T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
I20260709 13:02:51.176271  9292 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:51.177641  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.178826  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.183269  8384 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:51.185814  8455 raft_consensus.cc:1240] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:51.085347 12665 raft_consensus.cc:3055] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:51.106678 12645 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:51.090277 12096 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:51.084259 12348 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:51.114319 12484 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:51.108083 12674 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:51.198395  8385 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
W20260709 13:02:51.199636  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 224259us
I20260709 13:02:51.130805 12734 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:51.101507 12523 raft_consensus.cc:3055] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:51.174175 12612 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:51.152088 12384 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:02:51.107596 12673 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:51.210297  8530 raft_consensus.cc:2393] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 13: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:02:51.211385  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.239327  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 329360us
I20260709 13:02:51.211927  9258 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:51.214550  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.176262 12764 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:51.226961 12732 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.041455 12720 consensus_queue.cc:237] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:51.233424  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:51.243887  8461 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:51.238204  8500 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:51.209030  8455 raft_consensus.cc:1240] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:51.190774 12665 raft_consensus.cc:740] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:51.208110 12710 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:51.077147 12457 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:51.262470  8349 leader_election.cc:336] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.640s (SENT)
W20260709 13:02:51.263438  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 172180us
I20260709 13:02:51.263615  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.267067  8384 raft_consensus.cc:2410] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:51.276356  8349 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:51.278344  8455 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:51.237567 12523 raft_consensus.cc:740] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:51.260015 12683 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:51.258402 12724 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:51.292874  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 78733.9us
W20260709 13:02:51.296383  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 157427us
W20260709 13:02:51.300864  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.309863  8531 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:51.311314  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.313026 12802 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:51.313441  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 72517.8us
W20260709 13:02:51.314540  8349 leader_election.cc:336] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.655s (SENT)
I20260709 13:02:51.315017  8349 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:51.317395 12645 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:51.318437 12665 consensus_queue.cc:260] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:51.319550 12665 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:51.323396  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.324395  8385 raft_consensus.cc:2410] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:02:51.325480 12799 log.cc:927] Time spent T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:02:51.332722 12727 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:51.335363  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:51.336735 12795 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:02:51.379370  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:51.415156  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.421399 12683 raft_consensus.cc:697] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:51.261624 12732 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:51.502727  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:51.494005  8426 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:51.426529  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.608295  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.540040  8461 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:51.471989  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:51.611518  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 299676us
W20260709 13:02:51.600631  8535 consensus_meta.cc:287] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.800s	user 0.008s	sys 0.007s
I20260709 13:02:51.660588  8535 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
W20260709 13:02:51.629796  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.652139  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 158226us
W20260709 13:02:51.423992  8349 leader_election.cc:336] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.816s (SENT)
I20260709 13:02:51.661566  8349 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:51.661787  8426 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:51.552289  8500 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:51.624944  8533 raft_consensus.cc:1240] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:51.601189  8531 raft_consensus.cc:1275] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:51.532192  8378 raft_consensus.cc:1240] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:51.557468  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.663498  8426 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:51.641728  8460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 797) took 1061 ms. Trace:
I20260709 13:02:51.625442  8530 raft_consensus.cc:1217] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Deduplicated request from leader. Original: 9.6->[10.7-11.8]   Dedup: 10.7->[11.8-11.8]
W20260709 13:02:51.664077  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.666457  8530 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: [10.7-11.8]
I20260709 13:02:51.624224  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:51.425511 12800 log.cc:927] Time spent T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:02:51.360826 12457 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:51.621203 12808 log.cc:927] Time spent T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:02:51.669273  8427 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:51.422930 12802 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:51.539773 12659 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:51.613430 12673 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:51.665067 12260 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:51.664381  8460 rpcz_store.cc:276] 0709 13:02:50.563734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.642824 (+ 79090us) service_pool.cc:224] Handling call
0709 13:02:50.689369 (+ 46545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.702609 (+ 13240us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:50.950575 (+247966us) log.cc:844] Serialized 14 byte log entry
0709 13:02:51.594273 (+643698us) log.cc:844] Serialized 14 byte log entry
0709 13:02:51.609984 (+ 15711us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:51.610055 (+    71us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:51.610128 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.614062 (+  3934us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:51.614200 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":194400,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":72,"raft.queue_time_us":428,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":22574,"spinlock_wait_cycles":14573824,"thread_start_us":800170,"threads_started":3,"wal-append.queue_time_us":689947}
I20260709 13:02:51.689666  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.426429 12763 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.256s
W20260709 13:02:51.699257  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 147059us
I20260709 13:02:51.426080 12750 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:51.681471 12674 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:51.707182  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:51.709384  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 287158us
I20260709 13:02:51.686499 12783 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:51.714309  8426 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
W20260709 13:02:51.720444 12681 consensus_meta.cc:287] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.623s	user 0.008s	sys 0.000s
I20260709 13:02:51.727649  8500 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:51.424283 12523 consensus_queue.cc:260] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:51.745991  8453 raft_consensus.cc:1240] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:51.750768 12784 consensus_meta.cc:287] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.730s	user 0.010s	sys 0.001s
I20260709 13:02:51.751385 12784 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:51.753048  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.758304  8378 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 12: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:51.738945 12810 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:51.750176 12748 consensus_meta.cc:287] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 1.049s	user 0.006s	sys 0.009s
I20260709 13:02:51.763104  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.763379 12816 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:02:51.763754 12449 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:02:51.764849 12812 log.cc:927] Time spent T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:02:51.765720 12807 log.cc:927] Time spent T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:02:51.767189 12612 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:51.768898  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.772897  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 45338us
I20260709 13:02:51.762836 12814 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:51.776789  8386 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 13: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:51.745990 12780 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:51.795085  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.782361  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.752990 12724 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:51.745952 12809 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:51.792320  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 67820.5us
W20260709 13:02:51.754158 12774 consensus_meta.cc:287] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.876s	user 0.012s	sys 0.000s
W20260709 13:02:51.801029  8377 consensus_meta.cc:287] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.760s	user 0.002s	sys 0.006s
I20260709 13:02:51.744633 12683 consensus_queue.cc:237] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:51.778473 12523 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:51.807040  8377 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
W20260709 13:02:51.808131  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.807754  8500 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:51.793236 12612 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:51.810984  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.814390  8386 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:02:51.785935 12810 raft_consensus.cc:697] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:51.746294 12681 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:51.806839 12228 consensus_meta.cc:287] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 1.040s	user 0.004s	sys 0.008s
I20260709 13:02:51.781589 12748 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:51.812386 12682 consensus_meta.cc:287] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.791s	user 0.013s	sys 0.000s
I20260709 13:02:51.821563  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.821910  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.822247 12724 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:51.823112  8426 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:51.831899  8380 raft_consensus.cc:2393] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 11: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:51.831034  8378 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:02:51.834903  8452 raft_consensus.cc:1240] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:51.807775 12774 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:51.829550 12809 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:02:51.843667  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:51.854708  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.857641  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:51.858819  8500 connection.cc:256] RPC call timeout handler was delayed by -3.2163721669999745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
W20260709 13:02:51.859262  8500 connection.cc:256] RPC call timeout handler was delayed by -3.1310703240000066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
I20260709 13:02:51.859586  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:51.855845  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.861310  8380 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:02:51.862133  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.862700  8380 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:02:51.863632  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:51.864138  8380 raft_consensus.cc:2376] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10. Re-sending same reply.
W20260709 13:02:51.865476 12813 log.cc:927] Time spent T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:02:51.867377  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:51.869231  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.871662 12764 consensus_meta.cc:287] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.000s
I20260709 13:02:51.873797 12810 consensus_queue.cc:237] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:51.848373 12816 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:51.841003 12724 raft_consensus.cc:697] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 10 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:51.878211  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:51.892328 12816 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.898003  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.908790 12816 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:51.909693  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.910337  8384 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:02:51.910485 12681 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:51.826859 12228 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:51.878927  8527 raft_consensus.cc:1240] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:51.869249  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.918421  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.864888  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.885200  8457 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:51.860136  8458 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:02:51.891126  8381 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:02:51.898448  8453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 792) took 1346 ms. Trace:
I20260709 13:02:51.899799  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.922194  8380 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:02:51.923319  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:51.892529 12811 log.cc:927] Time spent T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:02:51.924006  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.924307  8385 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:02:51.891048 12682 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.902554 12748 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:51.878449 12774 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:51.926103  8380 raft_consensus.cc:2393] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 9: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:51.922104  8453 rpcz_store.cc:276] 0709 13:02:50.551794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.609403 (+ 57609us) service_pool.cc:224] Handling call
0709 13:02:51.065273 (+455870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:51.750528 (+685255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.897351 (+146823us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b54001e69d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:51.898204 (+   853us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54001e69d0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:51.898353 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2593540224}
I20260709 13:02:51.931115  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:51.931407 12665 consensus_meta.cc:287] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.611s	user 0.006s	sys 0.007s
I20260709 13:02:51.931770  8383 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:02:51.905799 12724 consensus_queue.cc:237] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:51.933064 12228 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:51.898728 12750 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:51.944932  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.948525  8383 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 13: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:02:51.955160  8501 leader_election.cc:336] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.508s (SENT)
W20260709 13:02:51.943284 12645 consensus_meta.cc:287] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.000s
W20260709 13:02:51.965042  8500 connection.cc:256] RPC call timeout handler was delayed by -2.0156515879999688s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260709 13:02:51.966670  8500 connection.cc:256] RPC call timeout handler was delayed by -2.0100489560000483s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3224s for a response
W20260709 13:02:51.968263  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 239640us
W20260709 13:02:51.967314  8500 connection.cc:256] RPC call timeout handler was delayed by -1.8626515880000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
W20260709 13:02:51.979689  8500 connection.cc:256] RPC call timeout handler was delayed by -1.74745158799999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
I20260709 13:02:51.970613  8427 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
W20260709 13:02:51.981578  8500 connection.cc:256] RPC call timeout handler was delayed by -1.7033515879999754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
I20260709 13:02:51.930630 12682 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:51.982775  8500 connection.cc:256] RPC call timeout handler was delayed by -1.5620515879999743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
W20260709 13:02:51.984342  8500 connection.cc:256] RPC call timeout handler was delayed by -1.4387515880000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
W20260709 13:02:51.985469  8500 connection.cc:256] RPC call timeout handler was delayed by -1.436051587999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
W20260709 13:02:51.986537  8500 connection.cc:256] RPC call timeout handler was delayed by -1.3118515879999677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2315s for a response
I20260709 13:02:51.989260 12763 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:51.989436  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:51.989897 12763 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.990381 12763 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:51.992081  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:51.992725  8528 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:51.982473  8427 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:51.981948 12645 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:51.995471  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:51.996284  8528 raft_consensus.cc:2368] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 10. Current term is 11.
I20260709 13:02:51.997398 12750 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:51.997982  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:51.998459 12681 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:51.999270  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:51.999125 12681 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:52.000849  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:52.001551 12681 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:52.001596  8535 raft_consensus.cc:2368] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 8. Current term is 9.
I20260709 13:02:52.002640 12682 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:51.997944 12750 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.003401 12750 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:52.005700  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:52.006085  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:52.006865  8380 raft_consensus.cc:2393] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 11: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:52.008317  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:52.008637  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:52.008805  8427 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:52.009239  8380 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:02:52.010795 12449 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:52.011305 12449 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.011739 12449 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:51.977283  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:51.998760  8528 raft_consensus.cc:2368] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 10. Current term is 11.
W20260709 13:02:52.005817 12456 consensus_meta.cc:287] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.961s	user 0.011s	sys 0.000s
I20260709 13:02:52.031004  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:52.027112  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:52.031661  8455 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:52.059533  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:52.063959  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:52.073498  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.031275 12456 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:52.064111 12523 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.068149 12384 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.115895  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:52.117467  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.120450  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:52.121490  8528 raft_consensus.cc:2376] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8. Re-sending same reply.
I20260709 13:02:52.130091  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:52.132627  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:52.134572  9287 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:52.146597  9294 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:52.179317  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:52.096046 12612 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:52.191759  8385 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 17 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:52.147452 12682 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.194974  9296 raft_consensus.cc:1240] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:52.163079  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:52.155052  8501 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:52.190241  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:52.202857  9261 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:52.163667  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:52.206151  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 51209.9us
W20260709 13:02:52.174834  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.183353  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:52.154832  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.208081  8501 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:52.208926  9289 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:52.217648  9261 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:52.188313 12764 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:52.226617  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:52.224404  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:52.184141 12674 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.120651 12384 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:52.235456  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:52.241120  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.211755 12682 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:52.119118 12523 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:52.218815 12645 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:52.252686  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48484 (request call id 716) took 1175 ms. Trace:
I20260709 13:02:52.232708 12228 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:52.247852  8377 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:52.222659 12665 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:52.250679  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 94139us
I20260709 13:02:52.246081  9260 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:52.244351  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:52.257345  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:52.257666  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.235100 12788 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:52.253114  8381 rpcz_store.cc:276] 0709 13:02:51.072125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.075266 (+  3141us) service_pool.cc:224] Handling call
0709 13:02:52.247149 (+1171883us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b540013ced4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:52.247314 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1734610304}
I20260709 13:02:52.255334  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:52.233774 12764 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:52.232214 12748 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:52.265844  8535 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:02:52.267727  8380 raft_consensus.cc:1240] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:52.269243  8383 raft_consensus.cc:1275] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:52.270594  8528 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:02:52.276314  9287 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:52.278083  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:52.278703  9292 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:52.283367  8382 raft_consensus.cc:3055] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:52.283522  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:52.283968  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:52.283046  8349 leader_election.cc:336] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.963s (SENT)
I20260709 13:02:52.284849  8349 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:52.289716  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:52.290562  8455 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:02:52.291604  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:52.292268  8455 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:02:52.295320  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:52.296037 12732 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:52.296496  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:52.298430  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:52.298610  8452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 2185) took 1086 ms. Trace:
I20260709 13:02:52.299553  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:52.252332 12645 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:52.283800  8382 raft_consensus.cc:740] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:52.256388 12228 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.239053 12674 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:52.300398  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:52.299098  8452 rpcz_store.cc:276] 0709 13:02:51.212701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.213495 (+   794us) service_pool.cc:224] Handling call
0709 13:02:51.227871 (+ 14376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:51.835373 (+607502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.298340 (+462967us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b540019cdd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:52.298545 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1393029504}
I20260709 13:02:52.494836  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:52.351243  8379 raft_consensus.cc:1275] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:52.302560  9295 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:02:52.505429  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:52.325141  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.365873  8383 raft_consensus.cc:1275] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:52.505446  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:02:52.382092  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 146757us
I20260709 13:02:52.417655  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:52.504758  9288 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:02:52.441138  8535 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:02:52.307250  9289 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:52.395468  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:52.509814  8454 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
W20260709 13:02:52.406189  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 170780us
I20260709 13:02:52.303232  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:52.365161  8380 raft_consensus.cc:3055] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:02:52.485664  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 239660us
I20260709 13:02:52.321549  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:52.511816  8380 raft_consensus.cc:740] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:52.330567  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:52.339452  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:52.514688  8455 raft_consensus.cc:2393] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:52.512769  9294 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:02:52.514696  9260 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:52.516422  9260 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:52.273002 12764 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:52.516316  9258 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:52.522233  9260 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:52.518615  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:52.519462  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:52.523962  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.526612  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:02:52.453889 12831 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:02:52.546119  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:52.522253  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:52.528626  8454 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:02:52.514183 12228 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:52.363580 12449 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:52.533733 12837 log.cc:927] Time spent T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.254s	user 0.000s	sys 0.000s
I20260709 13:02:52.533638  8382 consensus_queue.cc:260] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:52.534668  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:52.594614  8460 raft_consensus.cc:2393] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 12: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:52.535691  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:52.538386  8531 raft_consensus.cc:1275] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:52.539535  8533 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:52.540908  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:52.372449 12732 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:52.511583 12645 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:52.493335 12788 raft_consensus.cc:697] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:52.612252 12788 consensus_queue.cc:237] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:52.395740 12384 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:52.553535  8424 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:52.618968  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 65533.2us
I20260709 13:02:52.559415  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:52.560788  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:52.562444  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:52.562799  8381 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:52.514869 12360 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.592823  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:52.518476 12612 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:52.562273 12845 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:52.521180 12724 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:52.549686 12827 log.cc:927] Time spent T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
W20260709 13:02:52.550108 12763 consensus_meta.cc:287] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.559s	user 0.013s	sys 0.000s
I20260709 13:02:52.646078 12763 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:52.648223 12763 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:52.605899  8534 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
I20260709 13:02:52.606799  8382 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:52.649449  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:52.650704  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:52.651291  8534 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:02:52.652114  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:52.653331 12724 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:52.654271  8459 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:02:52.655756 12724 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:52.655946  8382 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:52.607465  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:52.622851  8454 raft_consensus.cc:2393] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 14: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:52.624491  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:52.631538 12384 consensus_queue.cc:1048] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:02:52.657526  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:52.631605  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:52.658874  8457 raft_consensus.cc:2393] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 8: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:52.633527  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:52.634195  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:52.637406 12612 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:52.640654 12348 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:52.630081 12851 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:52.632606 12360 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:52.627243 12262 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:52.657603  8531 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:52.658757  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:52.675740  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:52.560879  9293 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:02:52.659621  8528 raft_consensus.cc:1275] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:52.605113 12682 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:52.652931  8534 raft_consensus.cc:2410] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
W20260709 13:02:52.663625 12750 consensus_meta.cc:287] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.660s	user 0.011s	sys 0.000s
I20260709 13:02:52.634490 12845 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:52.678823  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.682422  8382 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:52.634099 12850 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:52.688028  8529 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:52.690610  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:52.714644  8534 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:02:52.627743  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:52.620261 12809 consensus_queue.cc:1059] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:02:52.717182  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:52.692749  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 176399us
I20260709 13:02:52.693557  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:52.718961  8531 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:52.695118  8530 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:52.631412 12683 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:52.722065  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:52.723030  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:52.723591  8534 raft_consensus.cc:2410] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:52.723570  8533 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:52.666996 12523 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:52.725327  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 176704us
I20260709 13:02:52.747998  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:52.749815  8500 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:52.686944 12599 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.685787 12612 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.751444  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:52.756029  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:52.761613  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 250907us
I20260709 13:02:52.762882  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:52.763510  8386 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:52.766404  8535 raft_consensus.cc:2410] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:02:52.771831  8534 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:02:52.773308  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:52.694917 12845 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:52.779832  8351 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:52.752072 12384 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:52.783507  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 91491.5us
W20260709 13:02:52.792985  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 529205us
I20260709 13:02:52.696600 12750 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:52.859831  8349 leader_election.cc:336] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 2.061s (SENT)
I20260709 13:02:52.860266  8349 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:52.860962 12750 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:52.820220 12674 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:52.861599  8349 leader_election.cc:336] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 2.109s (SENT)
I20260709 13:02:52.862428 12674 consensus_queue.cc:1059] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:52.863405 12674 consensus_queue.cc:1243] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer 105d6581548546b98eddd4ee7083bb12 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:02:52.863979 12674 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:52.864378 12674 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.822075 12850 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
W20260709 13:02:52.837738  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:52.866707  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.768513 12724 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:52.867465 12724 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:52.867973 12724 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:52.869208  8534 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:52.840258  8531 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:02:52.873960  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:52.875599  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.845395  8386 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
W20260709 13:02:52.846014  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 51190.1us
I20260709 13:02:52.853905  8533 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:52.856302  8500 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:52.864801 12674 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:52.768932 12599 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:52.776641 12612 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:52.853863 12816 consensus_meta.cc:287] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.945s	user 0.006s	sys 0.006s
I20260709 13:02:52.888878  8530 raft_consensus.cc:2410] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:02:52.917851  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 894) took 2035 ms. Trace:
I20260709 13:02:52.918418  8527 rpcz_store.cc:276] 0709 13:02:50.882258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.884006 (+  1748us) service_pool.cc:224] Handling call
0709 13:02:50.902737 (+ 18731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:51.921900 (+1019163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.917528 (+995628us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b54002b9154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:52.917772 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2244570880}
W20260709 13:02:52.855639 12844 log.cc:927] Time spent T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:02:52.907894 12853 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:52.961097  8535 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 13:02:52.908942  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 85647.1us
I20260709 13:02:52.912843 12849 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.950842 12802 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:52.960374  8530 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:02:52.962580  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 414469us
W20260709 13:02:52.960391  8349 leader_election.cc:336] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 2.148s (SENT)
I20260709 13:02:52.963254  8458 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
W20260709 13:02:52.973100  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.973323  8349 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:52.973443  8458 raft_consensus.cc:606] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:52.968362  9260 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:52.975272  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:52.977218  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:52.797478 12384 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:52.828078 12228 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:52.964716 12665 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.021s	sys 0.008s
I20260709 13:02:52.988343  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:52.992319  8535 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:52.983925  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:53.006286  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:53.009701  8454 raft_consensus.cc:2393] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:53.015110  8529 raft_consensus.cc:2393] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 8: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:53.015897  8452 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
W20260709 13:02:52.998281 12665 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.021s	sys 0.009s
I20260709 13:02:52.985962 12449 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:52.900396 12858 consensus_queue.cc:1059] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.121s
I20260709 13:02:53.013463  9260 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:52.991978 12851 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:53.036113  9260 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:53.084158  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 48119.3us
W20260709 13:02:53.049111  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.055816  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 799) took 1216 ms. Trace:
W20260709 13:02:53.066190 12852 log.cc:927] Time spent T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.257s	user 0.006s	sys 0.000s
I20260709 13:02:53.073596 12682 consensus_queue.cc:1059] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:53.077447 12732 consensus_queue.cc:1059] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:53.014618 12262 raft_consensus.cc:697] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:53.002512 12360 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:53.089164  8456 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:52.977295 12260 consensus_queue.cc:1059] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:02:53.081728  8380 consensus_queue.cc:260] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:53.012158 12783 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:52.962752 12816 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:53.000967 12850 consensus_queue.cc:1059] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
W20260709 13:02:53.109508  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 483185us
I20260709 13:02:53.132424  8380 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:53.091497 12855 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:52.970855 12853 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:53.111871  8533 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:53.099115  9260 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:53.139052  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 258374us
I20260709 13:02:53.112427  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:53.086236  8461 rpcz_store.cc:276] 0709 13:02:51.839188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.839335 (+   147us) service_pool.cc:224] Handling call
0709 13:02:51.857216 (+ 17881us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:51.898259 (+ 41043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:51.898297 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:51.898798 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:02:52.100051 (+201253us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:52.183743 (+ 83692us) log.cc:844] Serialized 14 byte log entry
0709 13:02:53.055168 (+871425us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b5400082da0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8400733 00007f36c8485dbf 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c
0709 13:02:53.055246 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.055361 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:53.055422 (+    61us) raft_consensus.cc:1685] finished
0709 13:02:53.055555 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:53.055740 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7658,"prepare.queue_time_us":290559,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2136,"raft.queue_time_us":17472,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":4816,"spinlock_wait_cycles":4563200,"thread_start_us":264741,"threads_started":2,"wal-append.queue_time_us":200874}
W20260709 13:02:53.147123  8349 leader_election.cc:336] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 2.183s (SENT)
W20260709 13:02:53.120504  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 253597us
I20260709 13:02:53.095010 12751 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:53.147814  8349 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:53.000777 12857 consensus_queue.cc:1059] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 13:02:53.081336 12851 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:52.978395 12849 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:53.149060  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:53.141692  9260 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
W20260709 13:02:53.170325  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:53.171155  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.177268 12809 consensus_queue.cc:1048] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:53.178473 12872 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.178969 12872 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:53.181394 12873 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:53.182442 12866 raft_consensus.cc:3055] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:53.182837 12866 raft_consensus.cc:740] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:53.183562 12866 consensus_queue.cc:260] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:53.184711  8532 consensus_meta.cc:287] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.633s	user 0.006s	sys 0.000s
I20260709 13:02:53.184747 12866 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.187239 12816 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:53.173848  8501 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:53.189988  8501 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:53.190758 12384 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:53.190867 12872 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:53.193696  8457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36446 (request call id 2192) took 1142 ms. Trace:
I20260709 13:02:53.108393 12788 consensus_queue.cc:1059] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:02:53.194197  8457 rpcz_store.cc:276] 0709 13:02:52.026623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.026799 (+   176us) service_pool.cc:224] Handling call
0709 13:02:53.168316 (+1141517us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b54003c6254. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:53.168499 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1440318208}
I20260709 13:02:53.196920  8532 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:53.106249 12863 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:53.207123 12599 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:53.155944 12262 consensus_queue.cc:237] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:53.209331 12612 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:53.210611 12449 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:53.199030 12857 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:53.227448 12857 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:53.227875 12857 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:53.153990 12851 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.213239 12872 consensus_queue.cc:1048] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:53.187263 12853 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:53.200503 12764 consensus_meta.cc:287] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.595s	user 0.007s	sys 0.003s
I20260709 13:02:53.214057 12751 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:53.208932 12748 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:02:53.215584 12681 raft_consensus.cc:3055] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:53.216312 12228 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:53.216133 12674 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:53.218492 12456 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:53.222159  8528 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:53.222579 12849 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:53.222494 12860 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:53.156193 12861 consensus_queue.cc:1048] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:02:53.229112  8380 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:02:53.193109 12858 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:53.157234 12260 consensus_queue.cc:1048] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:02:53.210184 12783 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:53.244959  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 103382us
W20260709 13:02:53.271615  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:53.274269  8349 connection.cc:256] RPC call timeout handler was delayed by -1.43242730999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 13:02:53.274825  8349 connection.cc:256] RPC call timeout handler was delayed by -1.4162273099999538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
I20260709 13:02:53.245723 12826 raft_consensus.cc:3055] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:53.301090  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:53.316712  8531 raft_consensus.cc:2393] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 8: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:53.244575 12681 raft_consensus.cc:740] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:53.338478  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.264452 12860 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.281723 12863 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:53.379546  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:53.327028 12856 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:02:53.299506 12783 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.252218 12763 consensus_queue.cc:1048] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:02:53.245599 12764 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:53.250236 12449 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.091s
W20260709 13:02:53.414098  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 562985us
I20260709 13:02:53.325955 12228 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:53.314059 12826 raft_consensus.cc:740] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:53.417395  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:53.428946  8530 raft_consensus.cc:2410] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:02:53.429313  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:53.430050  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:53.430768  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:53.431166  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.432726  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:53.421631  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:53.433702  8530 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:53.422818  8349 leader_election.cc:336] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.501s (SENT)
I20260709 13:02:53.434192  8500 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:53.434428  8349 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:53.362453 12860 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:53.421180 12783 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:53.403273 12824 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.014s	sys 0.011s
I20260709 13:02:53.433758  8535 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:53.437665 12826 consensus_queue.cc:260] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:53.438984 12724 consensus_meta.cc:287] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.570s	user 0.007s	sys 0.005s
W20260709 13:02:53.452195  8349 leader_election.cc:336] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.641s (SENT)
I20260709 13:02:53.464910  8349 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:53.465525  8500 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:53.448877 12824 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.014s	sys 0.011s
W20260709 13:02:53.470520  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 372442us
W20260709 13:02:53.457870 12845 consensus_meta.cc:287] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.003s
I20260709 13:02:53.445328 12877 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:53.489390  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 299446us
I20260709 13:02:53.492452  8500 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:53.504958  8527 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.008s	sys 0.008s
W20260709 13:02:53.505465  8527 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.008s	sys 0.008s
W20260709 13:02:53.507929  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 493401us
I20260709 13:02:53.508106  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:53.511564 12871 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:53.512351 12871 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:53.515240 12871 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:53.516294  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:53.518366  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:53.471724 12674 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:53.533979  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 62533.6us
I20260709 13:02:53.534688  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:53.535408  8380 raft_consensus.cc:2368] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:02:53.479168 12880 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:53.539216  8530 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:02:53.505645 12802 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.417387 12863 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:53.469172 12724 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:53.670312  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:53.522686 12858 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:02:53.678414  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 226240us
I20260709 13:02:53.678604  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:53.679095  8349 leader_election.cc:336] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.728s (SENT)
I20260709 13:02:53.679219  8382 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:53.679551  8349 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:53.509030  8427 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:53.666543  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6427ce7790bd4629985d340936d6f356"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:53.670589  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:53.672353  9260 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.017s	sys 0.002s
I20260709 13:02:53.680709  8457 raft_consensus.cc:606] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
W20260709 13:02:53.681005  9260 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.017s	sys 0.002s
W20260709 13:02:53.681331  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 514947us
I20260709 13:02:53.682829  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:53.682091  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:53.707231  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:53.708105  8456 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:53.683418  8459 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:02:53.715826  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:53.719137  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:53.722086  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:53.542079 12456 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.471112 12681 consensus_queue.cc:260] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:53.728821  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 49753.2us
I20260709 13:02:53.491611 12845 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:53.729857  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:53.542340 12883 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:53.670941 12674 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:53.736945  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 195603us
W20260709 13:02:53.739847  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 230916us
I20260709 13:02:53.748796  8528 raft_consensus.cc:1240] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:53.748791  9261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.020s	sys 0.031s
W20260709 13:02:53.750950  9261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.020s	sys 0.031s
I20260709 13:02:53.753844  8384 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:53.733029 12780 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.747751 12858 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:53.783619  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 291386us
I20260709 13:02:53.752357 12523 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:53.788133  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:53.801565  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:53.803299  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:53.803954  9294 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:02:53.804917  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:53.822228  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:53.822484  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 330076us
I20260709 13:02:53.823153  9292 raft_consensus.cc:2393] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 12: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:53.823807  9293 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:53.824016  8500 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:53.830349  9287 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:53.835135  8456 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
W20260709 13:02:53.837714  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 89835.2us
W20260709 13:02:53.840677  8532 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.011s	sys 0.021s
W20260709 13:02:53.841176  8532 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.012s	sys 0.021s
I20260709 13:02:53.671200 12802 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:53.890132  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.894778  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:53.895645  9292 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:53.633548 12880 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:53.897136  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:53.897697  8501 leader_election.cc:400] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:02:53.897995  8501 leader_election.cc:403] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:53.898200  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:53.756692 12893 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:53.898782  9291 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:53.898941  8459 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:53.739923 12456 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:53.916203  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 77715.9us
I20260709 13:02:53.755937 12674 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:53.900266  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 191983us
I20260709 13:02:53.897501  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:53.897418  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:53.775941 12748 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.136s
I20260709 13:02:53.936721  8381 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
W20260709 13:02:53.906878 12870 log.cc:927] Time spent T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.475s	user 0.001s	sys 0.000s
I20260709 13:02:54.029168 12763 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:02:54.029994 12851 consensus_meta.cc:287] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.801s	user 0.009s	sys 0.000s
I20260709 13:02:54.029172 12874 consensus_queue.cc:1059] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:54.030432 12851 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:53.956393  8427 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:53.905180 12764 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:53.938092 12857 consensus_meta.cc:287] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.710s	user 0.008s	sys 0.003s
I20260709 13:02:54.110911  8456 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:54.086319  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:54.066248  9291 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:54.115178  9289 raft_consensus.cc:2410] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:54.097146  9260 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
W20260709 13:02:54.046782  8499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.027s	sys 0.084s
W20260709 13:02:54.116500  8499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.030s	sys 0.088s
I20260709 13:02:53.757526 12883 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:54.120862  9292 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
W20260709 13:02:54.142690  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 45635.6us
W20260709 13:02:54.144487  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 188162us
W20260709 13:02:54.124009  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 300180us
I20260709 13:02:54.145869  8500 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:02:53.957037 12865 log.cc:927] Time spent T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.802s	user 0.006s	sys 0.001s
I20260709 13:02:54.025518 12893 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:54.147588  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2372) took 1684 ms. Trace:
W20260709 13:02:54.148842  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 216732us
I20260709 13:02:54.102046  9287 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:54.145953  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:54.098533  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:54.131834  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:54.132835  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 418020us
I20260709 13:02:54.164013  9294 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:02:54.134371  8378 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
W20260709 13:02:54.135363  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 345902us
W20260709 13:02:54.092348 12885 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.415s	user 0.000s	sys 0.001s
I20260709 13:02:54.147966  8526 rpcz_store.cc:276] 0709 13:02:52.462877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.463047 (+   170us) service_pool.cc:224] Handling call
0709 13:02:52.505506 (+ 42459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:52.531607 (+ 26101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:52.531645 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:52.562710 (+ 31065us) log.cc:844] Serialized 26 byte log entry
0709 13:02:52.881777 (+319067us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:53.304196 (+422419us) log.cc:844] Serialized 14 byte log entry
0709 13:02:53.313166 (+  8970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.313246 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:53.542481 (+229235us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:54.147255 (+604774us) raft_consensus.cc:1685] finished
0709 13:02:54.147365 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.147427 (+    62us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b18004a7c40. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:02:54.147514 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12459,"prepare.queue_time_us":585602,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":205103,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":24615,"spinlock_wait_cycles":34613248,"thread_start_us":602006,"threads_started":2,"wal-append.queue_time_us":487624}
I20260709 13:02:54.186821  8535 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:54.088892 12899 log.cc:927] Time spent T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
W20260709 13:02:54.090685 12878 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.620s	user 0.000s	sys 0.001s
W20260709 13:02:54.171008  9261 leader_election.cc:336] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.533s (SENT)
I20260709 13:02:54.178993  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:54.208545  8384 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:53.831377 12780 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:54.196138  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.033377 12880 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:54.215301  8459 raft_consensus.cc:1240] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:02:54.217469  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 71680.5us
W20260709 13:02:54.208990  9261 leader_election.cc:336] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.590s (SENT)
I20260709 13:02:54.229156  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:54.230124  8378 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:02:53.941097 12872 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.251s
I20260709 13:02:54.231513  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:54.239491  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:54.248255  8382 raft_consensus.cc:2376] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9. Re-sending same reply.
I20260709 13:02:54.248421  8453 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:54.241549  8424 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:54.241804  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:54.243513  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:54.187403 12870 log.cc:927] Time spent T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 13:02:54.246981  9261 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.747s (SENT) [suppressed 40 similar messages]
I20260709 13:02:54.256577  8460 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:02:54.258330  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.257936  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:02:54.277238  9261 leader_election.cc:336] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.853s (SENT)
I20260709 13:02:54.277801  9261 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:54.281049  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:54.282096  8535 raft_consensus.cc:2393] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 13: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:02:54.314790  9261 leader_election.cc:336] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.879s (SENT)
I20260709 13:02:54.315361  9261 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:54.317464  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 59590.2us
W20260709 13:02:54.320207  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 55935.1us
I20260709 13:02:54.318598  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:54.206972 12228 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:54.325735  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 56224.1us
I20260709 13:02:54.328224  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:54.329067  8377 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:54.355473  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 914) took 1130 ms. Trace:
I20260709 13:02:54.357254  8532 rpcz_store.cc:276] 0709 13:02:53.225061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.237749 (+ 12688us) service_pool.cc:224] Handling call
0709 13:02:53.238180 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.238434 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:53.843220 (+604786us) log.cc:844] Serialized 14 byte log entry
0709 13:02:54.355025 (+511805us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:54.355086 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:54.355143 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.355236 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.355402 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16831,"prepare.queue_time_us":286005,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"thread_start_us":1086843,"threads_started":3}
I20260709 13:02:54.335807  8500 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:54.146333 12857 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:54.263919 12724 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:54.365873  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:54.334162 12885 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 13:02:54.370765  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 44166us
I20260709 13:02:54.313570 12888 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:54.263876 12877 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:54.195920 12861 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.159s
W20260709 13:02:54.334568 12866 consensus_meta.cc:287] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.149s	user 0.000s	sys 0.010s
I20260709 13:02:54.320080 12665 raft_consensus.cc:3055] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:54.327443 12348 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:54.367345 12865 log.cc:927] Time spent T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:02:54.374758 12880 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:54.414325  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 78606us
I20260709 13:02:54.476359  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:54.360553 12599 consensus_queue.cc:1059] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:02:54.489152  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:54.637771  8378 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 6.
I20260709 13:02:54.511410  9287 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:02:54.574052 12883 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:54.492792 12913 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:54.493176 12228 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:54.569643 12674 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:54.576864 12914 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.391338 12888 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.561373 12894 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:54.590848  8454 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:02:54.570789 12456 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:54.482765 12877 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:54.562399 12886 consensus_queue.cc:1059] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.167s
I20260709 13:02:54.477927 12665 raft_consensus.cc:740] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:54.571676 12891 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:54.561919 12911 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:54.618680  8381 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 12: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:54.616816  8500 leader_election.cc:400] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14.
I20260709 13:02:54.636565  8377 raft_consensus.cc:2410] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:02:54.453253 12845 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:54.354821 12849 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.244s
I20260709 13:02:54.513021 12724 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:54.520289 12880 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:54.696985  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:54.859052  8527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.073s	user 0.004s	sys 0.005s
W20260709 13:02:55.307410  8527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.524s	user 0.018s	sys 0.012s
I20260709 13:02:55.307825  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 3035) took 1128 ms. Trace:
I20260709 13:02:55.308161  8500 leader_election.cc:403] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:55.252027  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 2198) took 1735 ms. Trace:
W20260709 13:02:54.933554  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 355987us
W20260709 13:02:54.890583  9261 leader_election.cc:336] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.190s (SENT)
I20260709 13:02:54.993402  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2536) took 1739 ms. Trace:
W20260709 13:02:54.733348  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 414829us
I20260709 13:02:54.743335  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:54.725526  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:54.857618  9290 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.004s	sys 0.006s
W20260709 13:02:55.055953  8384 consensus_meta.cc:287] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.813s	user 0.009s	sys 0.000s
I20260709 13:02:55.308260  8377 rpcz_store.cc:276] 0709 13:02:54.178913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.250455 (+ 71542us) service_pool.cc:224] Handling call
0709 13:02:55.307763 (+1057308us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:54.974901 12645 consensus_meta.cc:287] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 2.343s	user 0.013s	sys 0.002s
I20260709 13:02:55.308969  8461 rpcz_store.cc:276] 0709 13:02:53.516613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.524819 (+  8206us) service_pool.cc:224] Handling call
0709 13:02:53.525247 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:53.525533 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:53.525569 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:53.526116 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:02:53.900963 (+374847us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:53.901051 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.901172 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.251681 (+1350509us) raft_consensus.cc:1685] finished
0709 13:02:55.251725 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.251941 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":218962,"threads_started":1,"wal-append.queue_time_us":1620966}
I20260709 13:02:55.311223  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48484 (request call id 745) took 1054 ms. Trace:
W20260709 13:02:55.192515  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.321252  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.320564  8379 rpcz_store.cc:276] 0709 13:02:54.256873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.588576 (+331703us) service_pool.cc:224] Handling call
0709 13:02:55.311103 (+722527us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.313416  8378 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:55.310429  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48484 (request call id 746) took 1053 ms. Trace:
W20260709 13:02:55.188449 12751 consensus_meta.cc:287] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 1.940s	user 0.011s	sys 0.001s
W20260709 13:02:55.315024  9290 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.382s	user 0.012s	sys 0.018s
I20260709 13:02:55.315397  8384 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
W20260709 13:02:54.888553 12889 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.376s	user 0.000s	sys 0.000s
I20260709 13:02:55.324585  8381 rpcz_store.cc:276] 0709 13:02:54.257168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.476041 (+218873us) service_pool.cc:224] Handling call
0709 13:02:55.310366 (+834325us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.311410  9261 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:54.994415 12780 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:55.327198 12645 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.352877 12788 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.353592 12788 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:55.354532 12645 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:55.254521 12857 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:54.728516 12913 raft_consensus.cc:697] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:54.889139 12934 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:54.857239 12907 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:55.367609  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 912) took 2282 ms. Trace:
I20260709 13:02:55.368427  8385 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:55.370184  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3039) took 1135 ms. Trace:
I20260709 13:02:55.359238  8381 raft_consensus.cc:1240] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:55.370674  8385 rpcz_store.cc:276] 0709 13:02:54.235589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.367817 (+1132228us) service_pool.cc:224] Handling call
0709 13:02:55.368182 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.368978 (+   796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.370129 (+  1151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.311556  8534 rpcz_store.cc:276] 0709 13:02:53.253928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.254101 (+   173us) service_pool.cc:224] Handling call
0709 13:02:53.254512 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:53.254916 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:53.254952 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:53.263984 (+  9032us) log.cc:844] Serialized 26 byte log entry
0709 13:02:53.712232 (+448248us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:53.712391 (+   159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.712483 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.993109 (+1280626us) raft_consensus.cc:1685] finished
0709 13:02:54.993137 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.993336 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":215856,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":9390,"thread_start_us":349958,"threads_started":1,"wal-append.queue_time_us":1657329}
W20260709 13:02:54.887528 12910 log.cc:927] Time spent T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.468s	user 0.000s	sys 0.001s
I20260709 13:02:55.313066  8351 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:54.888775 12887 log.cc:927] Time spent T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.500s	user 0.000s	sys 0.001s
W20260709 13:02:54.993840 12922 log.cc:927] Time spent T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.316s	user 0.000s	sys 0.000s
I20260709 13:02:55.328722  8384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 3034) took 1150 ms. Trace:
I20260709 13:02:55.323557  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:55.325009 12894 raft_consensus.cc:697] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:55.391208  8377 raft_consensus.cc:2393] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 10: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:55.329591 12751 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:55.390080  8384 rpcz_store.cc:276] 0709 13:02:54.178638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.178748 (+   110us) service_pool.cc:224] Handling call
0709 13:02:55.328652 (+1149904us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.356904 12877 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:55.330642 12228 raft_consensus.cc:697] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 9 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:55.356786 12788 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:55.396136 12228 consensus_queue.cc:237] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.398948 12936 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:55.399693 12936 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.401690 12913 consensus_queue.cc:237] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.403849 12936 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:55.405746  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2266) took 1869 ms. Trace:
I20260709 13:02:55.359946 12867 raft_consensus.cc:3055] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:55.367640 12907 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:55.406867 12867 raft_consensus.cc:740] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:55.407153  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2379) took 2864 ms. Trace:
I20260709 13:02:55.407860 12867 consensus_queue.cc:260] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.408588 12907 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:55.407562  8527 rpcz_store.cc:276] 0709 13:02:52.542782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.961947 (+419165us) service_pool.cc:224] Handling call
0709 13:02:52.987211 (+ 25264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:53.505875 (+518664us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:53.505905 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:53.639383 (+133478us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.307863 (+1668480us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:55.307902 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.307970 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.406947 (+ 98977us) raft_consensus.cc:1685] finished
0709 13:02:55.406967 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.407099 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":214876,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"thread_start_us":2035523,"threads_started":2,"wal-append.queue_time_us":1647855}
I20260709 13:02:55.408980  9296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 985) took 1648 ms. Trace:
I20260709 13:02:55.409789  8527 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:55.410030  9290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 986) took 1624 ms. Trace:
W20260709 13:02:54.899034 12860 consensus_meta.cc:287] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 1.459s	user 0.012s	sys 0.000s
I20260709 13:02:55.406152  8380 rpcz_store.cc:276] 0709 13:02:53.536336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.536448 (+   112us) service_pool.cc:224] Handling call
0709 13:02:53.536766 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:53.536991 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:53.537030 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:53.537480 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:02:53.933613 (+396133us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:53.933657 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.933730 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.405514 (+1471784us) raft_consensus.cc:1685] finished
0709 13:02:55.405537 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.405683 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":200694,"threads_started":1,"wal-append.queue_time_us":1733699}
I20260709 13:02:55.412729  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3045) took 1003 ms. Trace:
I20260709 13:02:55.413507  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2556) took 1132 ms. Trace:
I20260709 13:02:55.063768 12748 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.331837 12919 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:55.410426  9290 rpcz_store.cc:276] 0709 13:02:53.787411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.787553 (+   142us) service_pool.cc:224] Handling call
0709 13:02:53.787887 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:53.798559 (+ 10672us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:53.798592 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:53.799121 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.328420 (+1529299us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:55.328569 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.328914 (+   345us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.409854 (+ 80940us) raft_consensus.cc:1685] finished
0709 13:02:55.409875 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.409981 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10246,"raft.queue_time_us":248350,"raft.run_cpu_time_us":453,"raft.run_wall_time_us":59577,"thread_start_us":1394905,"threads_started":1,"wal-append.queue_time_us":1507684}
W20260709 13:02:55.343495 12859 log.cc:927] Time spent T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 2.518s	user 0.025s	sys 0.014s
I20260709 13:02:55.348160 12863 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:55.349685  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:55.443156  8379 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:55.443854  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 3040) took 1129 ms. Trace:
I20260709 13:02:55.444250  8379 rpcz_store.cc:276] 0709 13:02:54.314915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.332510 (+1017595us) service_pool.cc:224] Handling call
0709 13:02:55.443778 (+111268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.313223 12888 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:55.351174 12861 raft_consensus.cc:3055] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:02:55.371749  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 481167us
I20260709 13:02:55.368261  8529 rpcz_store.cc:276] 0709 13:02:53.085101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.085231 (+   130us) service_pool.cc:224] Handling call
0709 13:02:53.085703 (+   472us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:53.094019 (+  8316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:53.094066 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:53.094847 (+   781us) log.cc:844] Serialized 52 byte log entry
0709 13:02:53.482642 (+387795us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:53.482696 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.482796 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.367214 (+1884418us) raft_consensus.cc:1685] finished
0709 13:02:55.367249 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.367485 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123903,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":47,"thread_start_us":342383,"threads_started":1,"wal-append.queue_time_us":1192339}
I20260709 13:02:55.373363  8534 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:55.037467 12783 consensus_meta.cc:287] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 1.595s	user 0.013s	sys 0.000s
I20260709 13:02:54.586134 12348 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:55.376271  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 63271.7us
I20260709 13:02:55.379112  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 744) took 1122 ms. Trace:
W20260709 13:02:55.379743 12876 log.cc:927] Time spent T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 1.953s	user 0.003s	sys 0.018s
I20260709 13:02:54.728807 12914 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.373664 12682 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:55.382213 12857 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.381245 12665 consensus_queue.cc:260] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.385594 12853 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:55.312971 12880 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:55.312512 12911 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.392167  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3038) took 1180 ms. Trace:
I20260709 13:02:55.635319  8381 rpcz_store.cc:276] 0709 13:02:54.212300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.336004 (+1123704us) service_pool.cc:224] Handling call
0709 13:02:55.336340 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.391751 (+ 55411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.392093 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:55.636251  8349 leader_election.cc:336] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.554s (SENT)
I20260709 13:02:55.367929 12934 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:54.699543 12866 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:55.394929  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 3037) took 1215 ms. Trace:
I20260709 13:02:55.637903  8377 rpcz_store.cc:276] 0709 13:02:54.179372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.322912 (+1143540us) service_pool.cc:224] Handling call
0709 13:02:55.394869 (+ 71957us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.410720  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 918) took 1128 ms. Trace:
I20260709 13:02:55.638903  8527 rpcz_store.cc:276] 0709 13:02:54.282161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.409281 (+1127120us) service_pool.cc:224] Handling call
0709 13:02:55.409617 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.410236 (+   619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.410667 (+   431us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.413591  8380 rpcz_store.cc:276] 0709 13:02:54.408958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.411900 (+1002942us) service_pool.cc:224] Handling call
0709 13:02:55.412221 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.412429 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.412454 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.412492 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:55.412522 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.412576 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.412671 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.414143  8532 rpcz_store.cc:276] 0709 13:02:54.280693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.396295 (+115602us) service_pool.cc:224] Handling call
0709 13:02:54.488593 (+ 92298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.623253 (+134660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.623285 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.665650 (+ 42365us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.136404 (+470754us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:55.136460 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.136563 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.413242 (+276679us) raft_consensus.cc:1685] finished
0709 13:02:55.413269 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.413437 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89623,"thread_start_us":203214,"threads_started":1,"wal-append.queue_time_us":600897}
I20260709 13:02:55.416610  8378 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:55.636739  8349 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:55.640602  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 3042) took 1306 ms. Trace:
I20260709 13:02:55.640992  8378 rpcz_store.cc:276] 0709 13:02:54.334644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.638451 (+303807us) service_pool.cc:224] Handling call
0709 13:02:55.640549 (+1002098us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.409407  9296 rpcz_store.cc:276] 0709 13:02:53.785269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.820954 (+ 35685us) service_pool.cc:224] Handling call
0709 13:02:53.908568 (+ 87614us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:53.909004 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:53.909042 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:53.933399 (+ 24357us) log.cc:844] Serialized 52 byte log entry
0709 13:02:54.367681 (+434282us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:54.367733 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.367816 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.408777 (+1040961us) raft_consensus.cc:1685] finished
0709 13:02:55.408796 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.408929 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":186293,"spinlock_wait_cycles":32909056,"thread_start_us":225471,"threads_started":1,"wal-append.queue_time_us":1351930}
I20260709 13:02:55.644675 12866 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.419487  9295 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:55.423736 12748 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.411227 12860 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.441147 12720 raft_consensus.cc:3055] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:55.452587  8455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36448 (request call id 2202) took 3087 ms. Trace:
I20260709 13:02:55.514322  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 917) took 1232 ms. Trace:
I20260709 13:02:55.519037  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:55.570976  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 919) took 1288 ms. Trace:
I20260709 13:02:55.572337  8385 rpcz_store.cc:276] 0709 13:02:54.256536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.372678 (+1116142us) service_pool.cc:224] Handling call
0709 13:02:55.377990 (+  5312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.378331 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.378398 (+    67us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.378503 (+   105us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:55.378577 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.378700 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.378933 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.572458  8351 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:55.576937  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 57262.8us
I20260709 13:02:55.604084 12894 consensus_queue.cc:237] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:55.623385  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3046) took 1110 ms. Trace:
I20260709 13:02:55.650903  8534 rpcz_store.cc:276] 0709 13:02:54.281874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.372733 (+1090859us) service_pool.cc:224] Handling call
0709 13:02:55.373020 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.513882 (+140862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.514222 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.651120  8529 rpcz_store.cc:276] 0709 13:02:54.282472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.569805 (+1287333us) service_pool.cc:224] Handling call
0709 13:02:55.570273 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.570525 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.570565 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.570626 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:55.570665 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.570719 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.570891 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.651675  8379 rpcz_store.cc:276] 0709 13:02:54.512657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.511376 (+998719us) service_pool.cc:224] Handling call
0709 13:02:55.622638 (+111262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.622896 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.622937 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.622999 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:55.623048 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.623127 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.623303 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:55.481352 12867 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:55.498936 12861 raft_consensus.cc:740] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:55.649715  8455 rpcz_store.cc:276] 0709 13:02:52.365542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.632802 (+267260us) service_pool.cc:224] Handling call
0709 13:02:52.642657 (+  9855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:52.905230 (+262573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:52.905274 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:53.004693 (+ 99419us) log.cc:844] Serialized 26 byte log entry
0709 13:02:53.488276 (+483583us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:53.488328 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.488420 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.452219 (+1963799us) raft_consensus.cc:1685] finished
0709 13:02:55.452258 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.452498 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43539,"raft.queue_time_us":31966,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":13387,"thread_start_us":610055,"threads_started":2,"wal-append.queue_time_us":757031}
W20260709 13:02:55.657609  8349 leader_election.cc:336] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.751s (SENT)
I20260709 13:02:55.633298  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3043) took 1275 ms. Trace:
W20260709 13:02:55.619742 12910 log.cc:927] Time spent T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260709 13:02:55.645164 12866 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:55.653825  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 81444.7us
I20260709 13:02:55.640002 12665 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:55.658181  8349 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:55.658466  8382 rpcz_store.cc:276] 0709 13:02:54.357577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.383417 (+1025840us) service_pool.cc:224] Handling call
0709 13:02:55.383729 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.383924 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:55.384214 (+   290us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.632846 (+248632us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.632917 (+    71us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:55.632977 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.633060 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.633225 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":182,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":2874,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":14431,"thread_start_us":248224,"threads_started":1}
I20260709 13:02:55.574112 12783 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.638381 12911 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.664592  9290 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:55.639544 12853 raft_consensus.cc:697] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:55.669095  9288 raft_consensus.cc:2393] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 10: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
W20260709 13:02:55.669651  8350 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.036s	sys 0.046s
W20260709 13:02:55.670373  8350 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.036s	sys 0.046s
I20260709 13:02:55.652878 12720 raft_consensus.cc:740] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:55.656695 12858 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:55.676393 12858 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.631162 12857 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:55.660238 12863 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:55.679396  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3024) took 3295 ms. Trace:
I20260709 13:02:55.624114 12953 consensus_queue.cc:1059] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.096s
I20260709 13:02:55.666668 12950 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.676854 12858 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.688172 12863 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:55.688630  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:55.688884  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:55.690301  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:55.690791  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:55.691061  8455 raft_consensus.cc:2393] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:55.691370  9296 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:02:55.691905  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:55.670564 12924 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:02:55.693557  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:55.702344 12914 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:55.702987  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:55.703878 12720 consensus_queue.cc:260] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.704339  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:55.705327 12720 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.705287  8455 raft_consensus.cc:1240] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:55.708588 12957 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:55.703161  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2539) took 2383 ms. Trace:
I20260709 13:02:55.709226 12957 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.709619 12855 raft_consensus.cc:3055] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:55.710112 12855 raft_consensus.cc:740] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:55.679844  8383 rpcz_store.cc:276] 0709 13:02:52.383847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.630237 (+246390us) service_pool.cc:224] Handling call
0709 13:02:52.630707 (+   470us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:52.853839 (+223132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:52.853873 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:52.854482 (+   609us) log.cc:844] Serialized 52 byte log entry
0709 13:02:53.233415 (+378933us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:53.233455 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.233526 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.378843 (+2145317us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:55.672807 (+293964us) raft_consensus.cc:1685] finished
0709 13:02:55.672843 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.679315 (+  6472us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":231036,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"spinlock_wait_cycles":4638080,"thread_start_us":594471,"threads_started":2,"wal-append.queue_time_us":567007}
I20260709 13:02:55.711024 12855 consensus_queue.cc:260] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.711653 12957 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:55.708724 12826 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.712249 12855 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:55.713985 12851 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:55.717288 12956 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.717864 12956 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:55.720094 12956 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:55.709558  8530 rpcz_store.cc:276] 0709 13:02:53.320169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.544857 (+224688us) service_pool.cc:224] Handling call
0709 13:02:53.545267 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:54.211680 (+666413us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:54.313049 (+101369us) log.cc:844] Serialized 14 byte log entry
0709 13:02:54.860828 (+547779us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:54.860902 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:54.860958 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.702936 (+841978us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b54002ad5d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:55.702984 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.703106 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141399,"prepare.queue_time_us":122555,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"spinlock_wait_cycles":1542075392,"thread_start_us":405907,"threads_started":1,"wal-append.queue_time_us":1154898}
I20260709 13:02:55.720602 12956 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:55.721311 12875 log.cc:927] Time spent T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 2.011s	user 0.014s	sys 0.016s
I20260709 13:02:55.722519 12783 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:55.717886 12802 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:55.681658 12892 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.723845 12956 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.724550 12892 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.727159 12892 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:55.731875 12950 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:55.738075 12956 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:55.739096 12802 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.739774 12957 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:55.740017 12934 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:55.677502 12682 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:55.742187  8454 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53010 (request call id 816) took 1596 ms (client timeout 1817 ms). Trace:
W20260709 13:02:55.670899  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.744241  9288 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55734 (request call id 994) took 1941 ms (client timeout 1598 ms). Trace:
W20260709 13:02:55.754714  8454 rpcz_store.cc:269] 0709 13:02:54.145445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.145632 (+   187us) service_pool.cc:224] Handling call
0709 13:02:55.742014 (+1596382us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540041a354. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:55.742118 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":369769216}
I20260709 13:02:55.742733 12860 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:55.757406  8349 leader_election.cc:336] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.862s (SENT)
I20260709 13:02:55.753618  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:55.753907  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:55.744474  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:02:55.755196  9288 rpcz_store.cc:269] 0709 13:02:53.802957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.803074 (+   117us) service_pool.cc:224] Handling call
0709 13:02:55.744046 (+1940972us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54007044d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:55.744173 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3981693824}
I20260709 13:02:55.758735  9296 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:55.758746  8383 raft_consensus.cc:2393] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 8: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:55.747218  9287 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:02:55.760610  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.769186  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:55.771152  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:55.771778  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.764860  8349 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:55.744395 12748 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:55.778347  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:55.781334  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:55.782545  9291 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:02:55.783072  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:55.781430  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:55.783483  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:55.784031  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:55.817477  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:55.818354  8385 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:55.814463  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:55.820343  8452 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:02:55.816406  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:55.823975  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 66634.9us
W20260709 13:02:55.824874  8349 leader_election.cc:336] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.892s (SENT)
I20260709 13:02:55.825402  8349 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:55.826442 12906 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:55.826642  8349 leader_election.cc:336] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.962s (SENT)
I20260709 13:02:55.827025 12906 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:55.827904  8349 leader_election.cc:336] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 2.031s (SENT)
I20260709 13:02:55.828307  8349 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:55.828612  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 916) took 1547 ms. Trace:
I20260709 13:02:55.829231 12847 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.829011  8526 rpcz_store.cc:276] 0709 13:02:54.281590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.642023 (+360433us) service_pool.cc:224] Handling call
0709 13:02:54.666457 (+ 24434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.317007 (+650550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.317042 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:55.322110 (+  5068us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.694551 (+372441us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:55.694584 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.694667 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.828418 (+133751us) raft_consensus.cc:1685] finished
0709 13:02:55.828435 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.828554 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":193734,"thread_start_us":507734,"threads_started":2,"wal-append.queue_time_us":433916}
I20260709 13:02:55.829927 12847 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:55.830200  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 46265.6us
I20260709 13:02:55.832237 12847 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:55.833122 12674 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:55.832933  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.833796  9261 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:55.832906 12847 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:55.834679 12855 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:55.835055  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:55.836063 12855 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:55.836503 12855 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:55.836885 12855 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:55.838797 12732 raft_consensus.cc:3055] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:55.839206 12732 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:55.840065 12732 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.841629 12955 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:55.842518 12857 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:55.845507 12855 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.852200 12848 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.854092 12950 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:55.854928  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:55.846733  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:55.849452  8377 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:55.857666 12855 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:55.858326  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3048) took 1131 ms. Trace:
I20260709 13:02:55.859130 12348 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:55.859846 12853 consensus_queue.cc:237] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:55.860688  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.861378  9296 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:55.861721  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:55.862741  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:55.863533  8386 raft_consensus.cc:2393] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 9: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:55.858209  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:55.865477  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.866336  8426 connection.cc:256] RPC call timeout handler was delayed by -1.3593711879999546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 13:02:55.866844  8426 connection.cc:256] RPC call timeout handler was delayed by -1.3575711879999517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
I20260709 13:02:55.858770  8377 rpcz_store.cc:276] 0709 13:02:54.729410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.647584 (+918174us) service_pool.cc:224] Handling call
0709 13:02:55.660695 (+ 13111us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.857466 (+196771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.858078 (+   612us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54002c8154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:55.858230 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433266048}
I20260709 13:02:55.776036 12913 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.870213  9260 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:55.870270  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:55.785212 12933 log.cc:927] Time spent T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.165s	user 0.004s	sys 0.003s
W20260709 13:02:55.890671  8426 connection.cc:256] RPC call timeout handler was delayed by -1.0650711879999335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2049s for a response
W20260709 13:02:55.885655  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 57762.7us
I20260709 13:02:55.890277  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:55.782892 12788 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:55.777042 12877 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.766150 12682 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.905776  9296 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:02:55.896685  8383 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:55.779026 12924 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.112s
W20260709 13:02:55.909301  8349 leader_election.cc:336] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 2.126s (SENT)
W20260709 13:02:55.918622  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 54644.3us
I20260709 13:02:55.918780  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:55.919378  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:55.767156 12802 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:55.890017 12897 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:55.891412 12873 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:55.922642  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:55.920022  8351 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:55.758092 12957 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:55.885002 12845 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:55.852792 12848 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.687614 12861 consensus_queue.cc:260] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:55.890410 12824 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:55.884539 12958 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:55.933832  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:55.907986 12895 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.966739  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:55.930189  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:55.953617  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2552) took 1674 ms. Trace:
I20260709 13:02:55.941486  8382 raft_consensus.cc:2410] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:02:55.946362  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 1.32959e+06us
I20260709 13:02:55.923821  8349 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:55.958899  8457 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:55.946084  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3050) took 1011 ms. Trace:
I20260709 13:02:55.962409  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:55.969651  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:55.969981  8530 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:02:55.902616 12788 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.902486 12855 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:55.910694 12906 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:55.968775  8378 rpcz_store.cc:276] 0709 13:02:54.935070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.641745 (+706675us) service_pool.cc:224] Handling call
0709 13:02:55.642106 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.642464 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.642490 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:55.642982 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.764479 (+121497us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:55.789559 (+ 25080us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.830726 (+ 41167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.830797 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.945825 (+115028us) raft_consensus.cc:1685] finished
0709 13:02:55.945850 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.946013 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61447,"prepare.queue_time_us":24831,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":81901,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":11075,"thread_start_us":121086,"threads_started":1,"wal-append.queue_time_us":259807}
I20260709 13:02:55.933406  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:55.974146  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:55.929239 12960 log.cc:927] Time spent T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:02:55.946686 12645 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14.
I20260709 13:02:55.883493 12888 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:55.972317  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:55.944962 12930 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:55.968170  8528 rpcz_store.cc:276] 0709 13:02:54.279447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.279589 (+   142us) service_pool.cc:224] Handling call
0709 13:02:54.279957 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.395687 (+115730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.395733 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.487698 (+ 91965us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.414101 (+926403us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:55.423972 (+  9871us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.953280 (+529308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.953375 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.953424 (+    49us) raft_consensus.cc:1685] finished
0709 13:02:55.953440 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.953563 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":574450,"prepare.queue_time_us":6244,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":2189584,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":209,"thread_start_us":177161,"threads_started":2,"wal-append.queue_time_us":981699}
I20260709 13:02:56.001776  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:55.935317 12682 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:55.999055  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:55.986532  8426 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:55.938953 12802 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:55.931697 12724 consensus_meta.cc:287] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.001s
I20260709 13:02:55.918735 12894 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:55.940713 12921 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:55.952138 12850 consensus_queue.cc:1059] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:02:55.914628 12877 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:55.971961 12924 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:56.076442 12924 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:56.076958 12924 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:56.071291 12880 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:56.068259 12911 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:56.081647  9289 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:56.026959  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.985400 12895 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:56.084153 12895 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:56.084991  8530 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:02:55.988561 12845 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:56.086222  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 186458us
I20260709 13:02:56.086627 12911 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:56.074232 12858 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:56.062142  9295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55734 (request call id 992) took 2259 ms (client timeout 2985 ms). Trace:
I20260709 13:02:55.971408 12824 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.994156  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:56.104331  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.994889  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:55.945461 12927 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.950372 12898 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.925364 12683 raft_consensus.cc:3055] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:55.922582 12826 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:55.939664 12896 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:56.122701 12896 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:56.125445  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:55.949954 12937 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:55.949563 12941 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:55.999234  8500 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
W20260709 13:02:56.188364  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 189221us
I20260709 13:02:56.189591  8500 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:56.191743  8500 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:56.001343  8526 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:02:55.986681  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:55.922400 12674 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:02:55.952531 12748 consensus_queue.cc:1059] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:02:55.917946 12913 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:56.062745 12888 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:56.064918 12866 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.995054  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:56.096086  8457 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:55.994567 12856 consensus_queue.cc:1059] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.202s
I20260709 13:02:56.100566  8527 raft_consensus.cc:2410] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
W20260709 13:02:56.101467  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 115029us
I20260709 13:02:56.219687  8426 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:56.105548  8349 leader_election.cc:336] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.563s (SENT)
W20260709 13:02:56.090319  9295 rpcz_store.cc:269] 0709 13:02:53.802333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.802472 (+   139us) service_pool.cc:224] Handling call
0709 13:02:56.061941 (+2259469us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400047754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:56.062047 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3362283904}
I20260709 13:02:56.109687  9258 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:56.220697  8349 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:56.221388  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 111797us
I20260709 13:02:55.984338 12788 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:56.217175 12863 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.026s	sys 0.096s
I20260709 13:02:56.117048 12927 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:56.117959 12858 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:56.118687 12880 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:56.119102 12898 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:56.202996 12802 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:56.120931  9294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 999) took 1628 ms. Trace:
I20260709 13:02:56.210649 12645 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:56.284190  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:56.066427 12848 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:56.156687  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.193761  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 207172us
W20260709 13:02:56.293502  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.067694 12681 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:56.000295 12855 raft_consensus.cc:697] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:56.196851  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:56.299942  8459 raft_consensus.cc:2410] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:02:56.067435 12918 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:56.112687 12260 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:56.127558 12724 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:02:55.971602 12873 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:56.311447 12913 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:56.312798 12873 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:56.313411 12873 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.313966 12874 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:56.112370 12683 raft_consensus.cc:740] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:56.315763 12683 consensus_queue.cc:260] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:56.216296  8534 raft_consensus.cc:2393] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 11: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:56.228541  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:56.199892 12937 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:56.313927 12873 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:55.989835 12897 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:56.239851  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:02:56.037957  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.231928 12863 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.026s	sys 0.096s
I20260709 13:02:56.198375 12893 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:56.102358 12894 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:56.254256  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 148728us
W20260709 13:02:56.337430  8349 leader_election.cc:336] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.581s (SENT)
W20260709 13:02:56.338433  8349 leader_election.cc:336] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 2.371s (SENT)
W20260709 13:02:56.338447  8500 connection.cc:256] RPC call timeout handler was delayed by -2.911511508999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
W20260709 13:02:56.339287  8500 connection.cc:256] RPC call timeout handler was delayed by -2.7603115089999619s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
W20260709 13:02:56.341550  8500 connection.cc:256] RPC call timeout handler was delayed by -2.7297115090000261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
W20260709 13:02:56.256203  8380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.030s	sys 0.079s
I20260709 13:02:56.202741 12921 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:56.203815 12883 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:56.120186 12957 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:56.057614 12930 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:56.260164  9258 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:56.121915 12824 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:56.404423  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:56.263548  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:56.406466  8527 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:56.287417  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:02:56.253168 12909 log.cc:927] Time spent T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:02:56.296799  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:56.412122  8454 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:02:56.187137 12826 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:56.262269  9294 rpcz_store.cc:276] 0709 13:02:54.492124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.497236 (+  5112us) service_pool.cc:224] Handling call
0709 13:02:54.497579 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.630617 (+1133038us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:55.776324 (+145707us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.113023 (+336699us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.119994 (+  6971us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:56.120053 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:56.120107 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.120706 (+   599us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540067e654. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:56.120750 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.120874 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16231,"prepare.queue_time_us":304818,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":102,"raft.queue_time_us":21952,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":163,"spinlock_wait_cycles":2605009792,"thread_start_us":444325,"threads_started":2}
I20260709 13:02:56.305697  8351 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:56.258086 12665 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:56.301771 12645 raft_consensus.cc:697] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:56.204567 12941 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:56.232017 12896 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:56.257400 12958 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:56.257866 12888 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:56.432475  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:56.332751  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:56.333513  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.335491  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:56.342031  8500 connection.cc:256] RPC call timeout handler was delayed by -2.7234115090000159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
I20260709 13:02:56.298787 12802 raft_consensus.cc:697] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:56.308024 12260 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.319841 12861 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:56.320374 12918 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:56.400383  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 140297us
W20260709 13:02:56.412312  8349 leader_election.cc:336] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 2.552s (SENT)
I20260709 13:02:56.340688 12928 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.343217 12921 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.419096 12665 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:56.470193  8533 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.011s	sys 0.011s
W20260709 13:02:56.470628  8533 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.011s	sys 0.011s
I20260709 13:02:56.471451  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2551) took 3046 ms. Trace:
I20260709 13:02:56.342967 12883 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:56.316778 12924 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:56.433156  8382 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:56.434790  8500 connection.cc:256] RPC call timeout handler was delayed by -2.7009115089999796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
W20260709 13:02:56.511152  8500 connection.cc:256] RPC call timeout handler was delayed by -2.6505115090000118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.191s for a response
W20260709 13:02:56.511600  8500 connection.cc:256] RPC call timeout handler was delayed by -2.6289115089999768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
W20260709 13:02:56.435454  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 129869us
W20260709 13:02:56.445842 12965 log.cc:927] Time spent T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:02:56.342445  8380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.030s	sys 0.079s
I20260709 13:02:56.518169  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3049) took 1679 ms. Trace:
I20260709 13:02:56.464838  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:56.460861  9295 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
W20260709 13:02:56.416517 12853 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.006s	sys 0.014s
W20260709 13:02:56.530566  8455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.021s	sys 0.039s
W20260709 13:02:56.530967  8455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.022s	sys 0.039s
I20260709 13:02:56.412258 12848 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:56.448385 12260 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:56.518585  8380 rpcz_store.cc:276] 0709 13:02:54.838718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.646743 (+808025us) service_pool.cc:224] Handling call
0709 13:02:55.647150 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.656577 (+  9427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.656608 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:55.665182 (+  8574us) log.cc:844] Serialized 26 byte log entry
0709 13:02:56.517821 (+852639us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:56.517861 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.517927 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:56.517967 (+    40us) raft_consensus.cc:1685] finished
0709 13:02:56.517978 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.518113 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5815,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":5896,"thread_start_us":834172,"threads_started":1,"wal-append.queue_time_us":642902}
I20260709 13:02:56.537691  8351 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:56.512164  8500 connection.cc:256] RPC call timeout handler was delayed by -2.6019115090000469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260709 13:02:56.539448  8500 connection.cc:256] RPC call timeout handler was delayed by -2.5182115090000252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
W20260709 13:02:56.539971  8500 connection.cc:256] RPC call timeout handler was delayed by -2.5047115090000034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
W20260709 13:02:56.540373  8500 connection.cc:256] RPC call timeout handler was delayed by -1.9566115090000267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2681s for a response
I20260709 13:02:56.450300 12826 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:56.447194 12941 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:56.518729  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2555) took 2238 ms. Trace:
I20260709 13:02:56.479009 12665 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:56.535010  8452 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.014s	sys 0.018s
I20260709 13:02:56.462498 12674 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:56.512137 12883 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:56.523075  8531 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.010s	sys 0.018s
I20260709 13:02:56.472839 12921 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:56.549712  8535 rpcz_store.cc:276] 0709 13:02:54.280385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.282855 (+  2470us) service_pool.cc:224] Handling call
0709 13:02:54.283229 (+   374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:54.443926 (+160697us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:54.698085 (+254159us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.720041 (+1021956us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b1800463ea0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c802523a 00007f36c848fa2a
0709 13:02:55.978964 (+258923us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:55.979622 (+   658us) log.cc:844] Serialized 52 byte log entry
0709 13:02:55.979815 (+   193us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:56.467436 (+487621us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.479720 (+ 12284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.480899 (+  1179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:56.518450 (+ 37551us) raft_consensus.cc:1685] finished
0709 13:02:56.518482 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.518663 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":221628,"prepare.queue_time_us":285833,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":62,"raft.queue_time_us":1783523,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":14678,"spinlock_wait_cycles":11544832,"thread_start_us":753730,"threads_started":3,"wal-append.queue_time_us":1425802}
W20260709 13:02:56.564195  8531 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.010s	sys 0.018s
W20260709 13:02:56.529767 12853 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.006s	sys 0.014s
W20260709 13:02:56.570129  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 157832us
W20260709 13:02:56.523341  8379 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.000s	sys 0.029s
W20260709 13:02:56.578933  8528 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.015s	sys 0.023s
I20260709 13:02:56.579242  8535 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:56.437664 12894 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:56.540812  8500 connection.cc:256] RPC call timeout handler was delayed by -1.7316115090000039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2931s for a response
I20260709 13:02:56.536507 12848 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:56.581459  8500 connection.cc:256] RPC call timeout handler was delayed by -1.7262115089999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2937s for a response
W20260709 13:02:56.581791  8500 connection.cc:256] RPC call timeout handler was delayed by -1.13581150899995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3593s for a response
I20260709 13:02:56.582475  8500 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:56.471076 12888 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:56.555519 12858 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:56.557004  8385 raft_consensus.cc:1240] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:56.514276 12851 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.011s	sys 0.020s
W20260709 13:02:56.577229 12968 log.cc:927] Time spent T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:02:56.437016 12645 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:56.600049  8382 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:56.600581  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:56.601759  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:56.601876  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:56.602923  8382 raft_consensus.cc:2368] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 8. Current term is 9.
W20260709 13:02:56.579303  8528 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.015s	sys 0.023s
W20260709 13:02:56.555380  8452 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.014s	sys 0.018s
I20260709 13:02:56.585440  8500 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:56.549093 12958 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:56.471321 12880 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:56.510409 12913 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.480547 12938 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:56.596772 12851 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.012s	sys 0.020s
I20260709 13:02:56.481225 12928 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:56.562393 12674 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:56.575544 12931 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.082s	sys 0.117s
I20260709 13:02:56.463591 12855 consensus_queue.cc:237] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:56.598510  8461 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:56.600204  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:02:56.626554  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 406949us
I20260709 13:02:56.603976  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:56.628422  8426 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:56.629189  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:02:56.580250  8379 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.001s	sys 0.029s
I20260709 13:02:56.605185  8535 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:56.471868  8533 rpcz_store.cc:276] 0709 13:02:53.425419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.195465 (+770046us) service_pool.cc:224] Handling call
0709 13:02:54.195818 (+   353us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:54.277269 (+ 81451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.277303 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:54.278013 (+   710us) log.cc:844] Serialized 52 byte log entry
0709 13:02:54.335012 (+ 56999us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:54.782408 (+447396us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.730967 (+948559us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b480012c258. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36cd3aeaa1 00007f36cd3a5b37 00007f36cd3a59ca 00007f36cd49d26f 00007f36cd49cf37 00007f36cd4b155c 00007f36cd4b1508 00007f36cd4b1488 00007f36cd4b1443 00007f36cd4b06ec 00007f36cc3daa96
0709 13:02:55.939108 (+208141us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b1800463d80. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c5312c0a 00007f36cea52219 00007f36c539aa40 00007f36c53954e4 00007f36c5395455 00007f36c847d060 00007f36c848f716 00007f36c84a0287 00007f36c84a0208
0709 13:02:56.471156 (+532048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.471228 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:56.471267 (+    39us) raft_consensus.cc:1685] finished
0709 13:02:56.471277 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.471400 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":479220,"prepare.queue_time_us":154256,"prepare.run_cpu_time_us":1688,"prepare.run_wall_time_us":16117,"raft.queue_time_us":1780539,"raft.run_cpu_time_us":11342,"raft.run_wall_time_us":797798,"spinlock_wait_cycles":116747136,"thread_start_us":930150,"threads_started":4,"wal-append.queue_time_us":1123717,"wal-append.run_cpu_time_us":1968,"wal-append.run_wall_time_us":1002927}
I20260709 13:02:56.589665 12950 consensus_queue.cc:1059] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:02:56.612360 12896 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:56.630119  8426 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:56.610883 12940 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:02:56.590569 12919 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.018s	sys 0.021s
I20260709 13:02:56.593495 12941 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:56.614439  8454 raft_consensus.cc:1275] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:02:56.622918 12262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.015s	sys 0.019s
I20260709 13:02:56.594365  8427 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:56.587016 12848 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:56.592356 12858 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.619988  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:56.594362 12877 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:56.605710  8500 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:56.611586 12860 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.635635  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:56.622360 12931 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.083s	sys 0.118s
I20260709 13:02:56.615422 12866 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:56.622193 12674 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:56.615015 12880 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:56.627812 12927 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:56.632179 12897 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:56.618312 12913 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:56.641252 12824 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:56.642421 12919 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.018s	sys 0.022s
I20260709 13:02:56.594627 12802 consensus_queue.cc:237] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:56.636770 12894 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:56.661620  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3047) took 1995 ms. Trace:
I20260709 13:02:56.633390 12898 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:56.662057  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 84732.3us
I20260709 13:02:56.647099  8426 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:56.640703 12682 consensus_queue.cc:1059] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:02:56.649730  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:56.619326 12853 consensus_queue.cc:1059] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:02:56.647923 12940 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:56.649369 12950 consensus_queue.cc:1243] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer 446d9310dce14ff4afff2dc2d64f68d8 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:56.657382 12858 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:56.659646 12873 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:56.636962 12826 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 13:02:56.646303 12262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.016s	sys 0.019s
W20260709 13:02:56.663326  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 57755.3us
I20260709 13:02:56.693753  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:56.730356  8386 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:56.730780  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:56.622107 12938 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:56.650640  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:56.732522  8382 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:56.733671  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:56.735039  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:56.735689  8382 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:56.663152 12937 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:56.702209  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 55177.7us
I20260709 13:02:56.739784  8426 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:56.703883  8427 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:56.641458 12958 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
W20260709 13:02:56.705328  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 450233us
I20260709 13:02:56.698794  8381 rpcz_store.cc:276] 0709 13:02:54.665883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.636193 (+970310us) service_pool.cc:224] Handling call
0709 13:02:55.636544 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.645529 (+  8985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.645561 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:55.652087 (+  6526us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.907709 (+255622us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:56.071471 (+163762us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.071695 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.071763 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:56.661427 (+589664us) raft_consensus.cc:1685] finished
0709 13:02:56.661456 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.661567 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10516,"prepare.queue_time_us":97445,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":9638,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":5392,"thread_start_us":237695,"threads_started":1,"wal-append.queue_time_us":595737}
I20260709 13:02:56.659305 12856 consensus_queue.cc:1048] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:02:56.685241 12941 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:56.663476 12877 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:02:56.662313 12860 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:56.698010 12930 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:56.699429 12816 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:02:56.658983 12924 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:56.748273  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 44493.9us
I20260709 13:02:56.751716  8500 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:56.724043 12894 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:56.754402  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:56.720942 12986 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:56.761942  8501 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.000s	sys 0.028s
I20260709 13:02:56.780267  8527 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 7.
I20260709 13:02:56.773048  8382 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:02:56.755424 12937 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:56.758924  8426 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:56.778867  8500 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:56.753448 12941 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:56.790091  8501 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.000s	sys 0.028s
I20260709 13:02:56.788208  8386 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:02:56.789624  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:56.789716  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:56.795245  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 689274us
I20260709 13:02:56.795825  8381 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 15: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:56.793257  8500 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:56.759927 12888 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:56.793907 12974 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:02:56.790692 12930 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:56.811053  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:56.789361 12674 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:56.809439  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.797920  8501 leader_election.cc:336] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.072s (SENT)
I20260709 13:02:56.832597  8501 leader_election.cc:400] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 8. Current term is 9.
I20260709 13:02:56.834759  8501 leader_election.cc:403] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:02:56.835414 12681 consensus_meta.cc:287] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.000s
I20260709 13:02:56.835513 12976 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:56.836057  8456 raft_consensus.cc:606] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:56.836207 12681 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:56.836453  8456 raft_consensus.cc:614] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:56.808561 12927 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:56.833293 12816 consensus_queue.cc:1059] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:56.812053 12888 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:56.841993 12456 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:56.842746  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 545066us
I20260709 13:02:56.842581 12456 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:56.843547  8501 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:56.843837 12860 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:56.842525 12888 raft_consensus.cc:3055] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:56.844362 12888 raft_consensus.cc:740] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:56.845364 12888 consensus_queue.cc:260] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:56.846696 12927 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:56.847256 12927 raft_consensus.cc:697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:56.832769  8455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 2213) took 1057 ms. Trace:
I20260709 13:02:56.833323 12928 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:56.849681  8382 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 13. Ops: []
I20260709 13:02:56.848065  8455 rpcz_store.cc:276] 0709 13:02:55.775527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.776336 (+   809us) service_pool.cc:224] Handling call
0709 13:02:55.815102 (+ 38766us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:55.815626 (+   524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.815676 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:55.867550 (+ 51874us) log.cc:844] Serialized 52 byte log entry
0709 13:02:56.531377 (+663827us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:56.531416 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.531481 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:56.832547 (+301066us) raft_consensus.cc:1685] finished
0709 13:02:56.832568 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.832709 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":713,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3017,"thread_start_us":608069,"threads_started":1,"wal-append.queue_time_us":757428}
I20260709 13:02:56.792668 12987 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:56.796512 12898 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:56.836874 12681 raft_consensus.cc:697] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:56.850893 12898 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:56.851403 12898 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:56.797533 12941 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:56.854375 12976 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 8. Current term is 9.
I20260709 13:02:56.855183  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:56.856328  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:56.791949 12937 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:56.856981 12824 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:56.857379 12937 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:56.842764 12788 consensus_meta.cc:287] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.591s	user 0.007s	sys 0.003s
I20260709 13:02:56.858094 12788 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:56.859275  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:56.859858  8534 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:02:56.860215  8377 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 13: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:56.849972 12940 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:56.849272  8501 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:56.848136 12927 consensus_queue.cc:237] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:56.865804  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 209984us
I20260709 13:02:56.869115  9258 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:56.850679 12674 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:56.873925  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:56.890937  8383 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:56.892104  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:56.844067  9261 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:56.889412  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.894868  8383 raft_consensus.cc:2393] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 7: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:56.890738 12930 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:56.900699  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:56.902009  8383 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:02:56.892127 12911 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:56.919972 12788 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:56.924722  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 165869us
I20260709 13:02:56.928265  9260 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:02:56.930018  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 86014us
W20260709 13:02:56.909216 12980 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.181s	user 0.001s	sys 0.001s
I20260709 13:02:56.932588  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:56.943017  8459 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:56.933540  8453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 820) took 1020 ms. Trace:
W20260709 13:02:56.943876  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 173565us
I20260709 13:02:56.937315 12681 consensus_queue.cc:237] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:56.944202  9261 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:56.940742 12880 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:56.913269 12913 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:56.944552  8427 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:56.944103  8453 rpcz_store.cc:276] 0709 13:02:55.913020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.913247 (+   227us) service_pool.cc:224] Handling call
0709 13:02:55.929744 (+ 16497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.448996 (+519252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:56.449030 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:56.449074 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:56.449134 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.933355 (+484221us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b540041a854. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:56.933395 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.933488 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1193725312}
I20260709 13:02:56.938644 12938 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:56.905925 12930 raft_consensus.cc:697] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:02:56.895148 12348 consensus_queue.cc:1175] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "105d6581548546b98eddd4ee7083bb12" responder_term: 14 status { last_received { term: 14 index: 14 } last_committed_idx: 14 last_received_current_leader { term: 14 index: 14 } }
W20260709 13:02:56.954193  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 202098us
I20260709 13:02:56.914307 12911 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.944630 12860 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:56.958382  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:56.966678  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:56.967895  8455 raft_consensus.cc:2410] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:02:56.962383  8427 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:56.953761  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2553) took 2674 ms. Trace:
I20260709 13:02:56.956040 12946 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:56.966185  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:56.988854  8460 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:02:56.966302  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:56.901057 12665 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:56.993764  8459 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:56.957742  9260 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:56.969177  8531 rpcz_store.cc:276] 0709 13:02:54.279760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.279908 (+   148us) service_pool.cc:224] Handling call
0709 13:02:54.280292 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:54.280534 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:54.389049 (+108515us) log.cc:844] Serialized 14 byte log entry
0709 13:02:54.841862 (+452813us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.762537 (+1920675us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.953408 (+190871us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:56.953458 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:56.953509 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.953586 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.953703 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1312879,"prepare.queue_time_us":378830,"prepare.run_cpu_time_us":156,"prepare.run_wall_time_us":149,"raft.queue_time_us":2411521,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":5658,"thread_start_us":1259445,"threads_started":4,"wal-append.queue_time_us":1006972,"wal-append.run_cpu_time_us":1713,"wal-append.run_wall_time_us":1003859}
I20260709 13:02:56.986142 12913 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:56.986979 12260 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.001518  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:56.966673 12874 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:56.968138 12855 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:57.004892  9292 raft_consensus.cc:2393] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 9: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:57.005200  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 750) took 1244 ms. Trace:
W20260709 13:02:57.006098  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 48400us
I20260709 13:02:56.969774 12911 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:57.010780  8427 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:56.989382 12824 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.009372  8379 rpcz_store.cc:276] 0709 13:02:55.760562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.892135 (+131573us) service_pool.cc:224] Handling call
0709 13:02:55.916136 (+ 24001us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.957285 (+ 41149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.957332 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:55.970770 (+ 13438us) log.cc:844] Serialized 26 byte log entry
0709 13:02:56.629985 (+659215us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:56.630011 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.630055 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:57.004961 (+374906us) raft_consensus.cc:1685] finished
0709 13:02:57.004981 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.005136 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41252,"raft.queue_time_us":41404,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":17321,"thread_start_us":658918,"threads_started":1,"wal-append.queue_time_us":731152}
I20260709 13:02:57.014570  9260 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:57.012836  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:57.015849  9296 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:57.017294  8457 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 15: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:02:57.001382 12987 raft_consensus.cc:2764] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:57.031020 12848 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.032066  9288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55734 (request call id 1002) took 1121 ms. Trace:
I20260709 13:02:57.032454  9288 rpcz_store.cc:276] 0709 13:02:55.910430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.910601 (+   171us) service_pool.cc:224] Handling call
0709 13:02:57.031874 (+1121273us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b540049fcd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:57.032009 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2287444736}
I20260709 13:02:57.033267  9287 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 12. Current term is 14. Ops: []
W20260709 13:02:57.034188 12995 log.cc:927] Time spent T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:02:57.034940 12888 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:57.035377 12921 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:57.037706 12998 log.cc:927] Time spent T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:02:57.010134 12913 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:57.040120  8452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 817) took 1128 ms. Trace:
I20260709 13:02:57.040673  8452 rpcz_store.cc:276] 0709 13:02:55.912050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.917553 (+  5503us) service_pool.cc:224] Handling call
0709 13:02:55.963162 (+ 45609us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.963525 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:56.604282 (+640757us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.828229 (+223947us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:56.893738 (+ 65509us) log.cc:844] Serialized 26 byte log entry
0709 13:02:56.893917 (+   179us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:56.893962 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.894049 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:57.039863 (+145814us) raft_consensus.cc:1685] finished
0709 13:02:57.039890 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.040049 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14630,"prepare.queue_time_us":468888,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":27261,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":14187,"spinlock_wait_cycles":748288,"thread_start_us":797688,"threads_started":2,"wal-append.queue_time_us":284153}
W20260709 13:02:57.042341 12994 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:02:57.052343 12941 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.019217 12824 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.020462 12260 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:57.020231  9260 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:57.022950 12861 consensus_meta.cc:287] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.574s	user 0.010s	sys 0.000s
W20260709 13:02:57.023203  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:57.069702  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 49630.6us
I20260709 13:02:57.047768 12895 raft_consensus.cc:3055] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:57.019452 12860 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:57.024775 12957 raft_consensus.cc:3055] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:57.008237 12850 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:57.059108  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.071261  9260 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:57.083599  9296 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:02:57.084403  8527 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:57.089702  9260 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:57.119302  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:57.120095  8531 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:57.074150 12895 raft_consensus.cc:740] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:57.075857 12851 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:57.078562 12957 raft_consensus.cc:740] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:57.086431 12848 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:57.155495  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:57.175851  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 165137us
W20260709 13:02:57.182518  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 170393us
I20260709 13:02:57.193730  8531 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:02:57.183192  8424 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:57.196740  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 107108us
I20260709 13:02:57.136938 12861 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:02:57.182377 12883 consensus_meta.cc:287] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.599s	user 0.005s	sys 0.006s
I20260709 13:02:57.137198 12850 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:57.198239  9260 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:57.200495  8427 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:57.069458 12930 consensus_queue.cc:237] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.182049 12921 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:57.197233 12851 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:57.212195  9260 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:57.137018 12937 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.226439  9260 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:57.239388 12348 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:57.239528 13009 log.cc:927] Time spent T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:57.241453 12824 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:57.241307 12911 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:57.242408 13006 log.cc:927] Time spent T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:02:57.242317 13011 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:57.247910  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:57.249280  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:57.249945  9292 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:57.211405 12850 raft_consensus.cc:697] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:57.255231  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:57.217383 12665 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:57.258240  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:57.260402  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:57.207752 12883 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.219173 12860 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:57.270054 13012 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:02:57.270650 12941 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:57.271859 13004 log.cc:927] Time spent T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:02:57.277257 13008 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:02:57.279942 12850 consensus_queue.cc:237] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.216739 13019 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:02:57.221028 12957 consensus_queue.cc:260] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.301860 12957 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:57.287799 12898 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.291280 12883 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:57.291958  8530 raft_consensus.cc:1240] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:57.258024 12262 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:57.268222 12858 consensus_meta.cc:287] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.542s	user 0.004s	sys 0.007s
I20260709 13:02:57.298880 12665 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:57.309209  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 133890us
I20260709 13:02:57.311609  8528 raft_consensus.cc:1240] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:57.311820 12855 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:57.220886 12895 consensus_queue.cc:260] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.267655 12894 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:57.353928 12894 raft_consensus.cc:697] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:57.345892  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3051) took 1239 ms. Trace:
I20260709 13:02:57.354921 12894 consensus_queue.cc:237] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:57.355712  8385 rpcz_store.cc:276] 0709 13:02:56.106248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.107269 (+  1021us) service_pool.cc:224] Handling call
0709 13:02:56.194135 (+ 86866us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.592468 (+398333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.345602 (+753134us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54003b6d54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:57.345811 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":833866624}
I20260709 13:02:57.356269  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:57.358624 12665 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.360759 12665 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:57.361897  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:57.362264  8458 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 2218) took 1066 ms. Trace:
I20260709 13:02:57.362651  8458 rpcz_store.cc:276] 0709 13:02:56.295811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.295957 (+   146us) service_pool.cc:224] Handling call
0709 13:02:56.309982 (+ 14025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.418561 (+108579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:56.418589 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:56.418627 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:56.418661 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.362050 (+943389us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b540015a4d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:57.362097 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.362212 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249254272}
I20260709 13:02:57.364449 12845 raft_consensus.cc:3055] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:57.364890 12845 raft_consensus.cc:740] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:57.365797 12845 consensus_queue.cc:260] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.367121 12845 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:57.370164 12972 log.cc:927] Time spent T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.908s	user 0.000s	sys 0.004s
I20260709 13:02:57.312726 12898 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:57.313601 12937 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:57.314494 12982 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.614s	user 0.002s	sys 0.000s
I20260709 13:02:57.314393 12911 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:57.253722 12348 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:57.371706  8384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3044) took 3002 ms. Trace:
I20260709 13:02:57.347330  8500 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:57.371937 12348 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.356945  8386 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:02:57.345003 12913 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:57.342815 12918 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:02:57.373070  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 566491us
I20260709 13:02:57.375345 12456 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:57.316954  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:57.376333  8500 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:57.376780  8457 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:57.373824  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 3055) took 1258 ms. Trace:
I20260709 13:02:57.377732  8377 rpcz_store.cc:276] 0709 13:02:56.115778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.115955 (+   177us) service_pool.cc:224] Handling call
0709 13:02:57.373663 (+1257708us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b5400269b54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:57.373775 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1687357696}
I20260709 13:02:57.379220  8384 rpcz_store.cc:276] 0709 13:02:54.369121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.394123 (+1025002us) service_pool.cc:224] Handling call
0709 13:02:55.394464 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.749520 (+355056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.749547 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:55.749980 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:02:56.195418 (+445438us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:56.195475 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.226033 (+ 30558us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54003dccd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:56.226099 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:57.369508 (+1143409us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:57.371507 (+  1999us) raft_consensus.cc:1685] finished
0709 13:02:57.371528 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.371655 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37360,"raft.queue_time_us":1780,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":10659,"spinlock_wait_cycles":842772096,"thread_start_us":389889,"threads_started":1,"wal-append.queue_time_us":591130}
I20260709 13:02:57.380875  8500 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:57.388262  8457 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
W20260709 13:02:57.349598 12973 log.cc:927] Time spent T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.685s	user 0.000s	sys 0.001s
I20260709 13:02:57.407522  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.408074 12913 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.409063  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:57.499333  8529 raft_consensus.cc:2368] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 17. Current term is 18.
I20260709 13:02:57.409714  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:57.373287 12937 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:57.411545  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.411801  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.412523  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:57.501863  8535 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:57.502182  8526 raft_consensus.cc:2368] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 6. Current term is 7.
W20260709 13:02:57.412536  8284 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59480 (request call id 203) took 18121 ms (client timeout 15000 ms). Trace:
I20260709 13:02:57.374274 12348 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:57.393622 12918 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:57.415885  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.504451  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.416597  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.505729  8531 raft_consensus.cc:2410] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:02:57.505766  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.404963 12456 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.406380 12783 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:57.333277 12858 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:57.415522  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 215084us
I20260709 13:02:57.490248 12953 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:57.509905  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:57.510212  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.511059  8526 raft_consensus.cc:2410] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:57.511188  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.511811  8533 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:57.389569 12898 consensus_queue.cc:1059] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:02:57.455101  8452 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:57.464581 12996 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:57.466104 12924 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.481065  9295 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:02:57.482705  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 279775us
I20260709 13:02:57.488457  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:57.513438  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:57.475958 12874 raft_consensus.cc:697] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:57.475033 12861 raft_consensus.cc:697] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:57.493881  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:57.495373  8426 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:57.525738  9293 raft_consensus.cc:2368] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 8. Current term is 9.
I20260709 13:02:57.525789  9289 raft_consensus.cc:2393] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 11: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:02:57.497614  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:57.497952  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:57.502717  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.504976  8532 raft_consensus.cc:2410] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:02:57.511806  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.512840  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.450450  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:57.529410  8527 raft_consensus.cc:2376] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9. Re-sending same reply.
I20260709 13:02:57.530268  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.530908  8527 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:57.531898  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.514425  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:57.533579  8380 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 15: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:57.519424  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.533933  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:57.534678  8385 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 15: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:57.534452  8526 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:02:57.522022  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:57.528959  8533 raft_consensus.cc:2410] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:02:57.536948  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:57.537258  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:57.539486  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:57.538774  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.601027  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.611698  8533 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:57.613152  8527 raft_consensus.cc:2410] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:02:57.540752  8427 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:57.603606  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.607749  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:57.604120  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 108821us
I20260709 13:02:57.603034  8534 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:57.615283  8426 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:57.603713  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.615553  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.616288  8526 raft_consensus.cc:2410] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:02:57.614650  8535 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 16.
I20260709 13:02:57.617158  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:57.618122  8531 raft_consensus.cc:2376] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13. Re-sending same reply.
I20260709 13:02:57.616441  8534 raft_consensus.cc:2393] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 10: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:57.620184  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.630163  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.526777 12724 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:57.628922  9290 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:02:57.632032  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.633844  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:57.638458  8383 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:57.509646 12456 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:57.636171  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:57.639869  8526 raft_consensus.cc:2410] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:02:57.506363 12913 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.640640  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.637658  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:02:57.502568  8284 rpcz_store.cc:269] 0709 13:02:39.314720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.345640 (+ 30920us) service_pool.cc:224] Handling call
0709 13:02:57.412460 (+18066820us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:48.988717 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:49.183399 (+194682us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:49.193416 (+ 10017us) write_op.cc:435] Acquired schema lock
0709 13:02:49.193442 (+    26us) tablet.cc:662] Decoding operations
0709 13:02:49.544766 (+351324us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:49.567558 (+ 22792us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:49.575729 (+  8171us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:02:49.776084 (+200355us) tablet.cc:701] Row locks acquired
0709 13:02:49.776140 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:02:49.776344 (+   204us) write_op.cc:270] Start()
0709 13:02:49.776547 (+   203us) write_op.cc:276] Timestamp: P: 1783602169776261 usec, L: 0
0709 13:02:49.776581 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:02:49.777496 (+   915us) log.cc:844] Serialized 5156 byte log entry
0709 13:02:50.967184 (+1189688us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b18002d2a40. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:02:51.818599 (+851415us) op_driver.cc:464] REPLICATION: finished
0709 13:02:52.289626 (+471027us) write_op.cc:301] APPLY: starting
0709 13:02:52.289770 (+   144us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:52.792214 (+502444us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:52.826983 (+ 34769us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:55.003075 (+2176092us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:55.003562 (+   487us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:02:55.003633 (+    71us) write_op.cc:312] APPLY: finished
0709 13:02:55.004202 (+   569us) log.cc:844] Serialized 121 byte log entry
0709 13:02:55.309260 (+305058us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:55.309461 (+   201us) write_op.cc:454] Released schema lock
0709 13:02:55.309550 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:55.334853 (+ 25303us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:55.350496 (+ 15643us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5035058,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":430801,"apply.run_cpu_time_us":42954,"apply.run_wall_time_us":3041635,"cfile_cache_hit":50,"cfile_cache_hit_bytes":52300,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6219,"cfile_init":2,"lbm_read_time_us":26604,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":10,"num_ops":13,"prepare.queue_time_us":1095140,"prepare.run_cpu_time_us":23609,"prepare.run_wall_time_us":1112004,"raft.queue_time_us":174156,"raft.run_cpu_time_us":24911,"raft.run_wall_time_us":346183,"replication_time_us":2026470,"spinlock_wait_cycles":10859776,"thread_start_us":1436056,"threads_started":5,"wal-append.queue_time_us":781872,"wal-append.run_cpu_time_us":18534,"wal-append.run_wall_time_us":2783624}]]}
I20260709 13:02:57.642235  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.649011  8535 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:57.649422  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.649879  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.650476  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.650946  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.651611  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.650226  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.651717  8527 raft_consensus.cc:2410] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:57.652398  8526 raft_consensus.cc:2410] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:57.653934  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.656173  8534 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:57.657337  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.529762 12924 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.526322 12996 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.611896 12783 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:57.696938  8526 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:57.659436  8534 raft_consensus.cc:2393] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 8: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:57.699288  8527 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 13:02:57.701436  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 160762us
I20260709 13:02:57.521114 12953 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.710582 12783 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.711908  8532 raft_consensus.cc:2410] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:02:57.712368 12953 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:57.638123 13021 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:57.713338 13021 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.713733 13021 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:57.714855 12783 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:57.704100  8528 raft_consensus.cc:1275] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:57.710482 12456 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:57.712424 12996 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:57.617805  8270 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 56cc480ba6f642e08bb2e547a0ef50a1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 105d6581548546b98eddd4ee7083bb12 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 9 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:02:57.677742 12874 consensus_queue.cc:237] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:57.723606  8270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 197559us
I20260709 13:02:57.724687  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:57.631986 12990 consensus_queue.cc:1059] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:02:57.729465  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:57.730078  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:57.730541  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.731109  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:57.725517  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:57.737848  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:57.733722  8500 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:57.741297 12883 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:57.732748  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:57.744102  8500 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:57.746199  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:57.747932  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:57.750216  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:57.754105 12861 consensus_queue.cc:237] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.737926 12975 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:57.756956 12975 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.760998 12975 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:57.649585 12724 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.763294  8529 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:57.765838  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2562) took 1521 ms. Trace:
I20260709 13:02:57.766222  8530 rpcz_store.cc:276] 0709 13:02:56.244411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.448290 (+203879us) service_pool.cc:224] Handling call
0709 13:02:56.448599 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.315266 (+866667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.765606 (+450340us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b54002aeed4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:57.765780 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938976512}
I20260709 13:02:57.726032 12681 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:57.769214  8455 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:57.771044 12783 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:57.782078 12783 raft_consensus.cc:697] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:57.783002 12783 consensus_queue.cc:237] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:57.789884 13030 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:02:57.737782 12898 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:57.763329 12724 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:57.817094  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:57.818156  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:57.816489  8501 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:57.826414  8501 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:57.828049  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.832453  8380 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:57.834769  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:57.835558  8380 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:57.839321  8384 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:57.846405  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:57.846486  8501 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:57.848816  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:57.834038 12975 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:57.859441 12975 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.859843 12975 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:57.868203  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 252984us
I20260709 13:02:57.869575  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:57.870430 12913 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:57.870950  8526 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:57.871505  9260 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:57.872334 12906 raft_consensus.cc:2804] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:57.872826 12906 raft_consensus.cc:697] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:57.855198 12858 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:57.882236  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 173825us
I20260709 13:02:57.882109 12850 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:57.883167  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2276) took 1342 ms. Trace:
I20260709 13:02:57.883555  8382 rpcz_store.cc:276] 0709 13:02:56.540320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.801033 (+260713us) service_pool.cc:224] Handling call
0709 13:02:56.801855 (+   822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.850094 (+ 48239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.882947 (+1032853us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b54001a77d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:57.883110 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109542144}
I20260709 13:02:57.884371  8427 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:57.885097 12456 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:57.885721 12456 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:57.887039 13036 log.cc:927] Time spent T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:02:57.888175  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:57.888957  8532 raft_consensus.cc:2393] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 13: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:57.889480  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:57.889971 12456 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:57.889427  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:57.890875  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:57.891285  8461 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:57.890707  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:57.892108  8529 raft_consensus.cc:1240] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:57.892130  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:57.893497  8459 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:57.894927  8529 raft_consensus.cc:3055] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:57.895280  8529 raft_consensus.cc:740] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:57.899461  8452 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:02:57.896026  8529 consensus_queue.cc:260] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.902410  8529 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:57.908422  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:57.908931  8380 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:02:57.909408  8384 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:02:57.854769 12724 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:57.910888  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.911317  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:57.915189  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:57.913720  9258 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:02:57.910395 13033 log.cc:927] Time spent T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.154s	user 0.000s	sys 0.003s
I20260709 13:02:57.918265  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:57.922995  8529 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:02:57.923374  8529 pending_rounds.cc:85] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 9
I20260709 13:02:57.923205  8452 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:02:57.923672  8529 pending_rounds.cc:107] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:02:57.923964  8529 raft_consensus.cc:2889] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:57.919152  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 72784.3us
W20260709 13:02:57.924846  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.893193 12888 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:57.926931  8384 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:02:57.928613  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:57.930655  8455 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:02:57.905355 12858 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:02:57.937577  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.938354  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:57.822072 12898 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.917452 12683 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:57.911923 12826 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:57.934515  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:57.914892 12724 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:57.925580 12976 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:57.946131  8427 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:57.940866  8351 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:57.941112  8452 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:57.932245 12850 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:57.916690  8459 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:02:57.958977  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:57.941583  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:57.957032  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:57.958726 13019 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:57.947378 12826 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:57.974139  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 209203us
I20260709 13:02:57.952634 12724 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:57.978737 12967 log.cc:927] Time spent T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 1.573s	user 0.005s	sys 0.000s
I20260709 13:02:57.956744 12906 consensus_queue.cc:237] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:57.974076 13019 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.954833 12976 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.971180 12924 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:57.942891 12858 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:57.868178 12975 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:57.961520 12957 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:57.987562  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:58.004045  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:58.004307  8452 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:57.981321 12850 raft_consensus.cc:697] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:57.975741 12826 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:58.015436  8452 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:02:57.970319 12873 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:02:57.985888 13019 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:57.986037 12976 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:57.983892 12953 consensus_queue.cc:1059] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:02:58.042754 12895 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.049052 13017 raft_consensus.cc:3055] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:02:58.050477 13035 log.cc:927] Time spent T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 13:02:58.051353 12898 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:58.052544 12850 consensus_queue.cc:237] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:58.050477 12937 consensus_meta.cc:287] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.000s
I20260709 13:02:58.054876 12858 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:58.059823 12845 consensus_meta.cc:287] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.689s	user 0.010s	sys 0.000s
I20260709 13:02:58.069772 12930 raft_consensus.cc:3055] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:02:58.112589  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 176886us
I20260709 13:02:58.118551 12682 consensus_queue.cc:1059] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:58.119957 12682 raft_consensus.cc:3055] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:58.120412 12682 raft_consensus.cc:740] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:58.120033 12732 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:58.113694 12937 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:58.115131 12930 raft_consensus.cc:740] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:58.098917 13017 raft_consensus.cc:740] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:58.127395  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:58.128716  9290 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:58.130201  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:58.139447  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:58.141857  9258 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:58.048898 13021 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:58.151495  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:58.154156  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:58.155687  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:58.154171  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:58.159040  9289 raft_consensus.cc:1240] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:58.161844  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.160565  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:58.165709  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:02:58.167186  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 239120us
W20260709 13:02:58.169445 13050 log.cc:927] Time spent T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:02:58.189244 13056 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.201368 13021 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:58.205720 13055 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.206508 13055 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:58.210880 13056 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:58.072196  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 375882us
I20260709 13:02:58.253789  8379 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.081775  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:58.262205  8452 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.067122  8461 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:02:58.265271  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:58.266463  8461 raft_consensus.cc:1240] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:58.268541  8461 pending_rounds.cc:85] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12: Aborting all ops after (but not including) 7
I20260709 13:02:58.062333  8456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43296 (request call id 54) took 4164 ms. Trace:
I20260709 13:02:58.269461  8456 rpcz_store.cc:276] 0709 13:02:53.898004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.026755 (+128751us) service_pool.cc:224] Handling call
0709 13:02:58.062085 (+4035330us) spinlock_profiling.cc:243] Waited 2.72 s on lock 0x7b540037a854. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c847f853 00007f36cd44d60a 00007f36c69d37d4 00007f36c69d3762 00007f36c69d3691 00007f36c69d360c 00007f36c69d28c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:58.062230 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6258590080}
I20260709 13:02:58.106628  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:58.273701  8531 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:02:58.277595  8459 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:58.280102  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 138199us
I20260709 13:02:58.284057  8378 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:58.266597  8454 raft_consensus.cc:2368] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12.
W20260709 13:02:58.286545  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 329407us
I20260709 13:02:58.293377  8459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
W20260709 13:02:58.294072  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.294517  8459 raft_consensus.cc:606] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:58.268886  8461 pending_rounds.cc:107] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:02:58.295475  8461 raft_consensus.cc:2889] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:58.296314 12260 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.297392 12260 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:58.300773 12681 consensus_meta.cc:287] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.526s	user 0.006s	sys 0.003s
W20260709 13:02:58.325364 12927 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.200s	user 0.015s	sys 0.007s
W20260709 13:02:58.336459 12927 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.213s	user 0.016s	sys 0.007s
I20260709 13:02:58.349354 12788 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:58.350478 12788 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:58.354399  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 44124.2us
W20260709 13:02:58.358084 12918 consensus_meta.cc:287] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.849s	user 0.007s	sys 0.006s
I20260709 13:02:58.341132 12260 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:58.367002 12913 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:58.359586 12975 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:58.362855  8351 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:58.187690 13017 consensus_queue.cc:260] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:58.367983 12918 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:58.165937 12682 consensus_queue.cc:260] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:58.368047 12913 raft_consensus.cc:697] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:58.370864 13017 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:58.334888 12681 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:58.374042  8528 raft_consensus.cc:3060] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:58.374169  8457 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:02:58.377382 12858 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.356612  8500 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:58.378420 12858 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:58.385787 13059 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:58.167444 12930 consensus_queue.cc:260] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:58.388621 12930 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.385907  8500 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:58.392130 13059 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:58.402171  8349 leader_election.cc:336] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.674s (SENT)
I20260709 13:02:58.405586 12996 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:58.404878  8349 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:58.394841 12877 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:58.423274 12877 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:58.425206 12845 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:58.425915 12906 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:58.430487  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.431555 12918 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:02:58.432338 12918 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:58.434403 13062 log.cc:927] Time spent T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.213s	user 0.001s	sys 0.001s
I20260709 13:02:58.436709 13055 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:58.439322 13067 consensus_queue.cc:1059] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:02:58.482615  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.552898  8379 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:02:58.567689  8528 raft_consensus.cc:2468] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:02:58.554214  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:02:58.372663 12913 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:58.629272  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:58.630628 12788 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:58.630868 12683 consensus_meta.cc:287] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.008s
I20260709 13:02:58.631353 12863 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:58.666060  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 327139us
I20260709 13:02:58.632105 12918 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:58.637493 13019 consensus_meta.cc:287] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.007s
I20260709 13:02:58.611945 12996 raft_consensus.cc:697] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:58.668251  8452 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:02:58.599610 13055 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
W20260709 13:02:58.674432  8501 leader_election.cc:336] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.578s (SENT)
W20260709 13:02:58.696230  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 291666us
W20260709 13:02:58.692625  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 70830.6us
I20260709 13:02:58.691601  9288 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 15: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:02:58.680738 12877 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:58.686916 12858 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:58.709162 13064 raft_consensus.cc:3055] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:58.710722 12911 consensus_queue.cc:1059] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:02:58.713104  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 100770us
I20260709 13:02:58.715472 12919 raft_consensus.cc:3055] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:58.716207  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:58.728904  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 344807us
W20260709 13:02:58.741153 13048 log.cc:927] Time spent T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.574s	user 0.001s	sys 0.015s
I20260709 13:02:58.742333  8500 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:58.725142 13064 raft_consensus.cc:740] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:58.742590  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:58.744036  9290 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:02:58.743876 13059 consensus_queue.cc:1059] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:58.745020 13059 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:58.745983 13059 raft_consensus.cc:3055] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:58.746486 13059 raft_consensus.cc:740] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:58.749104  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:58.744059 13064 consensus_queue.cc:260] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:58.750640  9290 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.747812 13059 consensus_queue.cc:260] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:58.750958 13064 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.728842 12919 raft_consensus.cc:740] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:58.754338 12919 consensus_queue.cc:260] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:58.755362 12850 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:02:58.758834 13052 log.cc:927] Time spent T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.592s	user 0.000s	sys 0.005s
I20260709 13:02:58.761708 12683 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:58.766364  9294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 1009) took 1448 ms. Trace:
I20260709 13:02:58.772847  8380 raft_consensus.cc:1275] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:58.777145  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3066) took 1256 ms. Trace:
W20260709 13:02:58.777369 12895 consensus_meta.cc:287] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.674s	user 0.011s	sys 0.006s
I20260709 13:02:58.778949 13056 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:58.777621  8381 rpcz_store.cc:276] 0709 13:02:57.520613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.522178 (+  1565us) service_pool.cc:224] Handling call
0709 13:02:57.522433 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.715507 (+193074us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:57.827666 (+112159us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.101225 (+273559us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.253102 (+151877us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:58.253242 (+   140us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:58.253355 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.424088 (+170733us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b48002dc558. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36cd3aeaa1 00007f36cd3a5b37 00007f36cd3a59ca 00007f36cd49d26f 00007f36cd49cf37 00007f36cd4b155c 00007f36cd4b1508 00007f36cd4b1488 00007f36cd4b1443 00007f36cd4b06ec 00007f36cc3daa96
0709 13:02:58.740039 (+315951us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:02:58.776722 (+ 36683us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54003b6854. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:58.776765 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.776924 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":246497,"prepare.queue_time_us":61178,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":319285,"raft.run_cpu_time_us":4218,"raft.run_wall_time_us":97297,"spinlock_wait_cycles":496262144,"thread_start_us":299979,"threads_started":2,"wal-append.queue_time_us":301731}
W20260709 13:02:58.780856 12724 consensus_meta.cc:287] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.782s	user 0.019s	sys 0.001s
I20260709 13:02:58.781996 12724 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:58.784266 12682 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.787143  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:58.787676 12996 consensus_queue.cc:237] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:58.789340  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.792126 13026 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:58.696317 13019 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:58.772746  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.794883  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 52714.4us
I20260709 13:02:58.756271 12850 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:02:58.803764  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.776165 13059 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.756266 12919 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:58.811769  9289 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:02:58.726158 12863 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:58.819964  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:02:58.787153 12732 consensus_meta.cc:287] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.665s	user 0.007s	sys 0.014s
I20260709 13:02:58.829594  8424 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
W20260709 13:02:58.833148  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 100110us
I20260709 13:02:58.834036 12990 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:58.834481 12990 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:58.838313  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:58.839493  8461 raft_consensus.cc:1240] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:58.838565 12990 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:58.851893 12976 consensus_meta.cc:287] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.786s	user 0.007s	sys 0.007s
I20260709 13:02:58.844080 13019 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:58.868860 13017 consensus_queue.cc:1048] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:02:58.819094 12845 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.876358 12845 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:58.868904 12826 consensus_meta.cc:287] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.838s	user 0.020s	sys 0.000s
I20260709 13:02:58.877606 12826 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:58.844434 13021 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:58.846969 12863 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:58.884095 12826 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:58.837734  8453 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:58.841382 13026 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:58.858023  9292 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:02:58.858767  8377 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:58.859630  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:02:58.860455  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 152874us
I20260709 13:02:58.861457 13054 consensus_queue.cc:1059] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:02:58.862273  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 50223.1us
I20260709 13:02:58.856598  8380 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:58.766965  9294 rpcz_store.cc:276] 0709 13:02:57.318184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.318410 (+   226us) service_pool.cc:224] Handling call
0709 13:02:57.318762 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.375342 (+ 56580us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:57.525515 (+150173us) log.cc:844] Serialized 14 byte log entry
0709 13:02:57.928050 (+402535us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.053839 (+125789us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b1800121a80. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c5398522 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:02:58.161040 (+107201us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:58.161131 (+    91us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:58.161198 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.765726 (+604528us) spinlock_profiling.cc:243] Waited 56.3 ms on lock 0x7b54006310d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:02:58.765814 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.766089 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4639,"prepare.queue_time_us":342865,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":78,"raft.queue_time_us":56869,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":9908,"spinlock_wait_cycles":137951872,"thread_start_us":762819,"threads_started":3,"wal-append.queue_time_us":461461}
I20260709 13:02:58.827898  9291 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
W20260709 13:02:58.906597  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 80694.7us
I20260709 13:02:58.910439  8349 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:58.913465  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:58.913901  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47306 (request call id 947) took 1044 ms. Trace:
I20260709 13:02:58.914314  8528 rpcz_store.cc:276] 0709 13:02:57.869813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.873180 (+  3367us) service_pool.cc:224] Handling call
0709 13:02:58.913680 (+1040500us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b5400095954. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:58.913822 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1109240192}
I20260709 13:02:58.921277 12855 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.922102 12855 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:58.923610 12906 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:58.878960 12845 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:58.928211  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:58.929265  9295 raft_consensus.cc:2393] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 11: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:58.929610 12930 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.930353 12930 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:58.934333  9288 raft_consensus.cc:1240] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:58.936574  9288 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:58.937263 13018 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.937772  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:58.937979 13018 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:58.938536  8528 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:02:58.938587 13026 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:58.942765  8530 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:58.945417 13054 raft_consensus.cc:3055] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:58.945874 13054 raft_consensus.cc:740] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:02:58.945910  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:58.947074 13054 consensus_queue.cc:260] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:58.949038  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:58.949222  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:58.949837  8386 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:58.949952  8380 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.951743 13054 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:58.907895  8500 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:58.956959 12918 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:58.957329  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 82370.8us
I20260709 13:02:58.959499  8500 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
W20260709 13:02:58.961484  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 54611.8us
I20260709 13:02:58.962505  9296 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:02:58.956513  9289 raft_consensus.cc:1217] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[7.7-10.9]   Dedup: 7.7->[8.8-10.9]
I20260709 13:02:58.964639  9289 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 10. Current term is 11. Ops: [7.7-10.9]
I20260709 13:02:58.912530  8349 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:02:58.979842  9296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 626) took 1492 ms (client timeout 1741 ms). Trace:
I20260709 13:02:58.901561 12976 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:58.984151  9292 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55734 (request call id 1007) took 1729 ms (client timeout 1550 ms). Trace:
I20260709 13:02:58.984679  9294 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:02:58.984576  9292 rpcz_store.cc:269] 0709 13:02:57.254780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.254980 (+   200us) service_pool.cc:224] Handling call
0709 13:02:58.983922 (+1728942us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54007378d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:58.984039 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3681963264}
W20260709 13:02:58.980458  9296 rpcz_store.cc:269] 0709 13:02:57.487005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.487117 (+   112us) service_pool.cc:224] Handling call
0709 13:02:58.979590 (+1492473us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54004ed4d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:58.979753 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2876057472}
I20260709 13:02:58.986109  9294 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:58.936789 12850 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:59.002285  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:59.003118  8384 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:02:59.007112 12855 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:59.009298 12826 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:59.011217 12826 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:59.009316 12348 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.013576 12348 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:59.016146 12348 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:59.017222 12918 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:59.017602  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 105238us
I20260709 13:02:59.017817 12918 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:59.018296 12918 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:59.018987 13018 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:59.019622  8349 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:59.021109 12850 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:59.021711  8351 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:02:59.019865  8281 catalog_manager.cc:5697] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.023191  8351 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:59.024122 12976 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:59.024665 13072 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:59.025645 13072 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:59.026059 13072 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:02:59.026464 13072 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:59.029342 12858 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:59.030032 12930 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:02:59.030656  9291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 623) took 2791 ms (client timeout 1630 ms). Trace:
I20260709 13:02:59.024214  8351 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
W20260709 13:02:59.031188  9291 rpcz_store.cc:269] 0709 13:02:56.239315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.239488 (+   173us) service_pool.cc:224] Handling call
0709 13:02:59.030398 (+2790910us) spinlock_profiling.cc:243] Waited 2.35 s on lock 0x7b54003a20d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:02:59.030557 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5394688896}
I20260709 13:02:59.042573  8349 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:02:59.045068  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.046310  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 58937.3us
I20260709 13:02:58.996692 12724 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:59.052951  8426 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:59.052105  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:59.030036 12858 raft_consensus.cc:697] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:59.049198 13018 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:59.079663  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 55560.8us
I20260709 13:02:59.085487  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:59.085747 12681 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:59.086058  8529 raft_consensus.cc:1240] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:59.086234  8534 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:59.082525 12855 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:59.087663 12855 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:59.056962 12788 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:59.090303 12855 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:59.091219  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:59.091972  9295 raft_consensus.cc:2376] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10. Re-sending same reply.
I20260709 13:02:59.093397  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:59.093627  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:59.094653  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:59.095010  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:59.096127  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:59.096354  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:59.097949  9289 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:59.098177  8281 catalog_manager.cc:5697] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.098937  8427 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:02:59.099805  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 65352.3us
I20260709 13:02:59.100881 12826 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:59.101395 12826 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:59.101852 12826 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.094847  8535 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:59.109635  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 57044.2us
I20260709 13:02:59.113507  9291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8"
dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:54044
I20260709 13:02:59.113812  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:59.114228  9291 raft_consensus.cc:606] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:02:59.114744  9291 raft_consensus.cc:614] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:59.115279  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:59.116356  8532 raft_consensus.cc:2393] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 18: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:02:59.100548  8281 catalog_manager.cc:5697] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 4 to 5, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 5 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:02:59.117504  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 84847.8us
I20260709 13:02:59.118462  8426 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:59.118357  8281 catalog_manager.cc:5697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 8 to 11, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 11 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:02:59.128633  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 49399.1us
I20260709 13:02:59.132918  8386 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:02:59.134799  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:59.134912  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:59.135411 12877 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:59.135669  8529 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:02:59.135833  8534 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:02:59.136160 12877 raft_consensus.cc:697] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:59.136708  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:59.137368 12877 consensus_queue.cc:237] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:59.138937  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:59.140960  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:02:59.137387  9289 raft_consensus.cc:2376] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12. Re-sending same reply.
I20260709 13:02:59.141181  8281 catalog_manager.cc:5697] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 6 to 9, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 9 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.145434  8535 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:02:59.146365 12855 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.124504 13018 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:59.172842  8500 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:59.182193  9290 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:02:59.150815  8281 catalog_manager.cc:5697] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.184001  9258 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:59.200683  8380 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:02:59.199976  9258 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:59.206720  8427 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:59.212306  8426 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:02:59.215010  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:59.201956 12845 raft_consensus.cc:2764] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:02:59.218456  8533 raft_consensus.cc:1275] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:59.218725  9294 raft_consensus.cc:2368] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 8. Current term is 9.
I20260709 13:02:59.216604 12986 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:59.222401 12986 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.222834 12986 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:59.118372 12858 consensus_queue.cc:237] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:59.224592  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:59.225456 12976 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:59.226198 12976 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:59.228443  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:59.229619  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:59.221407 12953 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:59.224614 12930 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:59.203922 12855 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:59.231846  8533 pending_rounds.cc:85] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 8
I20260709 13:02:59.232159  8533 pending_rounds.cc:107] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:02:59.232416  8533 raft_consensus.cc:2889] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:59.232990  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:59.233507 12855 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:59.233714  9291 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:02:59.221339  8384 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:59.230545 12953 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.242000 12953 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.229641  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:59.237926  8534 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:59.245139  9289 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:59.231251 12930 raft_consensus.cc:697] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 9 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:59.207625 12906 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:59.237635  8383 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:02:59.246273  9288 raft_consensus.cc:2393] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 11: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
W20260709 13:02:59.246589  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.246932  8386 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:59.239887  8427 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:59.251118  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:59.211256 12724 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:59.272891  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:59.284319  8535 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:02:59.285036  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:59.286384  8532 raft_consensus.cc:2410] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:02:59.290946  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 51165.1us
I20260709 13:02:59.252838 13021 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:59.306174  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:02:59.310469  8530 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:59.311373  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 268930us
I20260709 13:02:59.253152 12906 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:59.313886  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:59.253783 12976 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:59.315732  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:59.287438 12681 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:59.250195 12990 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:59.305895 12260 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:59.317464  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:02:59.330967  8532 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:59.332949  8386 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:59.315106 12906 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:59.297158 13054 consensus_queue.cc:1048] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:02:59.292906 13055 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:02:59.348169  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:59.349159  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 519821us
I20260709 13:02:59.355015  8349 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:59.316391 13021 raft_consensus.cc:697] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:02:59.354522 12957 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.030s	sys 0.019s
I20260709 13:02:59.352341  8383 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:02:59.322271 12681 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:02:59.358419  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 443163us
W20260709 13:02:59.361846  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 179318us
W20260709 13:02:59.361045 12957 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.031s	sys 0.019s
I20260709 13:02:59.322584 12724 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:59.349265 12260 raft_consensus.cc:697] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:59.374261 13072 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:59.366853 12681 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.384389  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:59.385521  8535 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 6.
I20260709 13:02:59.386112  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:59.399499  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:02:59.393312  8378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.014s	sys 0.014s
W20260709 13:02:59.400499  8378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.014s	sys 0.014s
I20260709 13:02:59.400722  8281 catalog_manager.cc:5697] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 3 to 4, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 4 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:02:59.404940  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.399777  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 91867.5us
I20260709 13:02:59.395931  8426 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:02:59.402963  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:59.409423  8380 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:59.414489  8453 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
W20260709 13:02:59.423928  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.408535 12863 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:59.428704  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 109674us
I20260709 13:02:59.429029  8454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:02:59.432747  8461 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:59.426667  8457 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
W20260709 13:02:59.429663  8501 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.870s (SENT) [suppressed 28 similar messages]
I20260709 13:02:59.435570  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:59.432415  8454 raft_consensus.cc:606] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:02:59.422351  8281 catalog_manager.cc:5697] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 2 to 3, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 3 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:59.447110  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.447510  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.448668  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:59.392621 12930 consensus_queue.cc:237] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:59.406530 12826 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:59.458056  8500 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:59.462590  8349 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:59.444259 13018 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:59.457046 12894 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:02:59.471433 12262 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:59.468437  8383 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
W20260709 13:02:59.472563  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 95277.7us
W20260709 13:02:59.472954  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.477546  8458 raft_consensus.cc:2410] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:02:59.474195  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:59.478888  8384 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:59.479305 13080 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:59.464507 13071 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:59.480010 13080 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:59.481284 13019 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:02:59.482064 13019 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:59.477051 12913 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:59.489073 13083 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:02:59.497480  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:59.498806  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:59.478987  8424 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:59.512712  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:59.506601 12262 raft_consensus.cc:697] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:59.524647  9293 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:02:59.523463  8281 catalog_manager.cc:5697] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.446060 13021 consensus_queue.cc:237] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:59.543311  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:59.459656 12260 consensus_queue.cc:237] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:59.466346 12975 consensus_queue.cc:1059] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
W20260709 13:02:59.532938 12918 consensus_meta.cc:287] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.514s	user 0.013s	sys 0.000s
W20260709 13:02:59.561611 13082 log.cc:927] Time spent T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
W20260709 13:02:59.563216  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 112304us
I20260709 13:02:59.564172  8349 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:59.565670 12975 raft_consensus.cc:3055] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:59.566138 12975 raft_consensus.cc:740] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:59.567225 12975 consensus_queue.cc:260] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:59.568677 12975 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:59.560252 12262 consensus_queue.cc:237] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:59.581459 12826 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:59.582677 12906 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:59.530367 12990 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:59.533159 13072 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:59.567683  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 88919us
I20260709 13:02:59.538554 13026 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:59.535848 12976 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:02:59.543946 13059 consensus_meta.cc:287] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.685s	user 0.012s	sys 0.001s
I20260709 13:02:59.599858  8349 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:02:59.585008 12906 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:02:59.520016 13019 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:59.613387  8530 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:02:59.584506 12986 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:59.616554  8526 raft_consensus.cc:2410] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:02:59.625252 13059 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.626240 12863 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:02:59.625986 13059 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:59.626727 12863 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:59.628662 13059 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:59.635780  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:02:59.617544 12724 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:59.588995 12918 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:59.593851 12953 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:59.644186  8461 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:59.646730  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.648172 13089 log.cc:927] Time spent T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.123s	user 0.002s	sys 0.001s
W20260709 13:02:59.653097  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.651234  8382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.022s	sys 0.041s
W20260709 13:02:59.657509  8382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.022s	sys 0.041s
I20260709 13:02:59.716787  8529 raft_consensus.cc:1240] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:59.721863  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 99638.4us
I20260709 13:02:59.724743  8349 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:59.705168 13072 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:59.734536 12858 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.029s	sys 0.037s
W20260709 13:02:59.752144 12858 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.029s	sys 0.037s
I20260709 13:02:59.801371  8384 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
W20260709 13:02:59.803473  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 345480us
W20260709 13:02:59.812093  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 105632us
I20260709 13:02:59.816726  8424 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:59.803499 12877 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:59.820101  8351 connection.cc:256] RPC call timeout handler was delayed by -1.2388636870000482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
I20260709 13:02:59.838862  9287 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:59.840468  8384 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:59.841895  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:59.838083  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:59.843073  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:59.847499  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:59.850081  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:59.851217  8383 raft_consensus.cc:2410] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:02:59.845855  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:59.852828  8382 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:02:59.854368  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:59.859861  8349 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:59.838521 12262 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:59.865856  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 60608.5us
I20260709 13:02:59.869542 12873 consensus_queue.cc:1059] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:59.865921 13095 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:59.871454 13085 raft_consensus.cc:993] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:02:59.871973 13085 raft_consensus.cc:1081] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
W20260709 13:02:59.873730 13099 log.cc:927] Time spent T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:02:59.873870  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:02:59.874940 12976 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:59.875444 12976 raft_consensus.cc:697] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 10 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:02:59.876677  8379 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:59.877238 13059 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:02:59.879534 13098 log.cc:927] Time spent T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:02:59.881253 13100 log.cc:927] Time spent T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:02:59.882571  8377 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:59.884721  8500 leader_election.cc:400] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 8. Current term is 9.
I20260709 13:02:59.886615  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:59.887349  8384 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:02:59.888795  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:02:59.891929  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:02:59.893446  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 51636.5us
I20260709 13:02:59.853564 12986 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:02:59.904170  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:02:59.859650 13096 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:02:59.942751  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 52126us
I20260709 13:02:59.944941 12826 consensus_queue.cc:1059] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:59.946588 12826 raft_consensus.cc:3055] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:59.946976 12826 raft_consensus.cc:740] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:02:59.947953 12826 consensus_queue.cc:260] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:02:59.936256  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 105586us
I20260709 13:02:59.936791 13059 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:02:59.938185  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 212420us
I20260709 13:02:59.950198  8383 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:02:59.876477 12976 consensus_queue.cc:237] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:02:59.890504 12953 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:02:59.939533  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 54158.4us
I20260709 13:02:59.872640 12863 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:02:59.856788 13021 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:02:59.940644  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 52257us
I20260709 13:02:59.890707 12918 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:02:59.938478  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:02:59.963541  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:59.905994 12877 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:59.966620 13015 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:02:59.972203  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:59.972643  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:59.973304  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:59.973450  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:02:59.986183  9289 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:02:59.976646  9288 raft_consensus.cc:1240] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:59.972062  9292 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:59.979182  8424 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:02:59.900892 12975 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:02:59.986218  9287 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:02:59.984553  9295 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:02:59.980459 12826 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:00.004295  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 98706.7us
I20260709 13:03:00.004650  8501 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:02:59.985579 13096 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:00.010347  8349 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:02:59.993824 12873 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:00.012609  8351 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:00.006011 13111 log.cc:927] Time spent T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.062s	user 0.001s	sys 0.001s
I20260709 13:03:00.016233  8349 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:00.017122 12845 consensus_queue.cc:1048] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:00.018535 12845 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:00.005793 12918 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:03:00.024681 12918 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:03:00.025848  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 46750.2us
I20260709 13:02:59.996266 13095 consensus_queue.cc:1059] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:03:00.028466 13095 raft_consensus.cc:3055] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:00.028805 13095 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:02:59.995097 13021 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:00.025003 12975 raft_consensus.cc:3055] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:00.025766 12877 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:00.025156 12918 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:00.053817  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:00.054032  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:00.054704  8452 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:03:00.054579  8458 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:03:00.060801  9260 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:00.040278 13095 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:00.067375 13095 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:00.067090 12858 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:00.061685 13096 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:03:00.070129 13026 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:00.070595  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:00.071208  8452 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:00.071554  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3108) took 1029 ms. Trace:
I20260709 13:03:00.071938  8385 rpcz_store.cc:276] 0709 13:02:59.041765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.041951 (+   186us) service_pool.cc:224] Handling call
0709 13:02:59.049583 (+  7632us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:59.524558 (+474975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:59.524598 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:59.551007 (+ 26409us) log.cc:844] Serialized 26 byte log entry
0709 13:02:59.807402 (+256395us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:59.807451 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.807526 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:00.071211 (+263685us) raft_consensus.cc:1685] finished
0709 13:03:00.071237 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:00.071386 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11936,"raft.queue_time_us":32069,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":53,"thread_start_us":692441,"threads_started":2,"wal-append.queue_time_us":450443}
W20260709 13:03:00.073645 13113 log.cc:927] Time spent T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 13:03:00.075119 13114 log.cc:927] Time spent T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:03:00.041023 12975 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:00.078131 12975 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:00.079612 12975 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:00.083877  8452 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:03:00.095559  8426 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:00.096750 12873 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:00.097282 12873 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:00.097203  9261 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:00.098558  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 61691.6us
I20260709 13:03:00.101370 13081 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:00.103379 13103 log.cc:927] Time spent T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.209s	user 0.001s	sys 0.001s
I20260709 13:03:00.108490 13080 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:00.105433 12863 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:00.106746 13021 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:00.107710 13106 log.cc:927] Time spent T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:03:00.111904 12873 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:00.118216  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.119994  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:00.120200  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:00.120887  9287 raft_consensus.cc:2393] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 11: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:00.122429  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:00.123299  9288 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:00.125473  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:00.126307  9292 raft_consensus.cc:2376] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11. Re-sending same reply.
I20260709 13:03:00.127462  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:00.129393  9293 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 634) took 2000 ms (client timeout 1682 ms). Trace:
W20260709 13:03:00.129894  9293 rpcz_store.cc:269] 0709 13:02:58.128683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.148350 (+ 19667us) service_pool.cc:224] Handling call
0709 13:03:00.129200 (+1980850us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400735854. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:00.129325 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2593893760}
I20260709 13:03:00.140057  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:00.142570  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:00.143244 12986 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:00.144115 12894 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.144353 13085 raft_consensus.cc:3055] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:00.143883 12986 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:00.144917 13085 raft_consensus.cc:740] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:00.144637 12894 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:00.145885 13085 consensus_queue.cc:260] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:00.146605 12986 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:00.147018 13085 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:00.147248 12894 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:00.052052 12918 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:00.151535  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 90860.4us
I20260709 13:03:00.163729  9260 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:00.177671  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:00.175783  9260 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:00.180593 13018 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:00.181218 13018 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.181644 13018 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:00.185436  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:00.189929  8529 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:00.192195  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:00.196166 13018 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:00.197569  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:00.204638  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:00.176322 13064 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:03:00.209285 13097 log.cc:927] Time spent T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.319s	user 0.000s	sys 0.003s
I20260709 13:03:00.243175  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:00.247255  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 44286.8us
I20260709 13:03:00.248086  9261 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:00.148680 12986 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:03:00.212960 13072 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:00.221709  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:00.252740  9289 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:03:00.222967  8530 raft_consensus.cc:1275] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:00.176821 13059 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.224591  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:00.225963 13081 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:03:00.225342  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 49634.4us
I20260709 13:03:00.241430  8533 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:03:00.259099  9260 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:00.251655  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:00.259955  8452 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:03:00.257911  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:00.255568  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:00.234951 12681 consensus_meta.cc:287] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.784s	user 0.011s	sys 0.002s
I20260709 13:03:00.262543  8526 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:03:00.269632  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:00.273022  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:00.276969  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:00.286993  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:00.247442 13064 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.295305  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:00.296871  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:00.285574  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:00.305510  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:00.258478 13081 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.307999  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:00.326623  8535 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:00.259436 13072 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:00.311398  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:00.327306  9261 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:03:00.332316  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 314552us
W20260709 13:03:00.333810  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 329206us
I20260709 13:03:00.350545  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:00.351795  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.352063  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:03:00.352386  8500 leader_election.cc:336] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.550s (SENT)
I20260709 13:03:00.352770  8452 raft_consensus.cc:2368] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:03:00.352813  8500 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:00.279510 13015 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.303333 13021 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.314164  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:00.321795  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:00.322526  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:00.322760  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:00.303001 13064 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:00.323477  8458 raft_consensus.cc:1240] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:00.323494  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 957) took 1238 ms. Trace:
I20260709 13:03:00.373582  8528 rpcz_store.cc:276] 0709 13:02:59.084940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.086702 (+  1762us) service_pool.cc:224] Handling call
0709 13:02:59.087041 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:59.087551 (+   510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:59.087579 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:59.088043 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:02:59.510831 (+422788us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:59.510869 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.510939 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:00.208584 (+697645us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:00.323181 (+114597us) raft_consensus.cc:1685] finished
0709 13:03:00.323212 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:00.323418 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7052,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"spinlock_wait_cycles":99097984,"thread_start_us":422385,"threads_started":1,"wal-append.queue_time_us":730304}
I20260709 13:03:00.322521 13096 consensus_queue.cc:1059] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:03:00.324473  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:00.299968  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:00.360261  8532 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:00.286353 12953 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:03:00.364315  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:00.380051  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:00.380432  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.264631 13059 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:00.370091 13139 consensus_queue.cc:1059] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:00.323167  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:00.365497  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:00.210911 12873 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:00.396605  8526 raft_consensus.cc:2393] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 12: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:00.403280  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:00.268584 12681 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:00.408107  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:00.409616  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:00.330680 13081 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:00.403635  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:00.414105  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:00.414486  8452 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:00.408938  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:00.412084  8533 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:03:00.412551  8385 raft_consensus.cc:2410] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:03:00.415313  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:00.379212 13054 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:00.416787  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:00.437623  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:00.416836  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 44628.6us
I20260709 13:03:00.419323  8526 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:03:00.439854  8457 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:00.440287  8526 pending_rounds.cc:85] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 4
I20260709 13:03:00.440582  8526 pending_rounds.cc:107] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:03:00.440837  8526 raft_consensus.cc:2889] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:00.422012  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:00.423416  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:00.424002  8529 raft_consensus.cc:1240] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:00.427717  8378 raft_consensus.cc:2410] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:03:00.421752  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:00.429973  8383 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:03:00.425016  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:00.451196  8460 raft_consensus.cc:2410] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:03:00.446907  8458 raft_consensus.cc:2376] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13. Re-sending same reply.
W20260709 13:03:00.416456  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 153198us
I20260709 13:03:00.454011  8461 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:00.456676  8530 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:03:00.397146 13120 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:00.408135 12930 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.470175  8349 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:00.467120  8533 raft_consensus.cc:2393] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 14: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:03:00.417379 13116 log.cc:927] Time spent T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:03:00.477974  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:00.472766  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:00.478746  8455 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:03:00.417074 12863 raft_consensus.cc:3055] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:00.473184  8501 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:00.480624  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:00.438170 13055 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:00.439586 12976 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:00.421483  8528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38894
I20260709 13:03:00.398234 13021 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:00.543532  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:00.453423 13110 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:00.545872  8528 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:00.550359  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:00.554095  8528 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:00.486419  8459 raft_consensus.cc:2393] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 12: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:00.561420  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:03:00.562158  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 209801us
W20260709 13:03:00.562849  8500 leader_election.cc:336] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.556s (SENT)
W20260709 13:03:00.469914 13127 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:03:00.421139 12986 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:03:00.437891 12990 consensus_queue.cc:1048] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:03:00.490039 12863 raft_consensus.cc:740] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:00.478399 12953 raft_consensus.cc:697] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:00.590428  8535 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:00.592628  8461 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:00.416654 13015 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:00.594805  8454 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 13. Ops: [11.7-11.7]
I20260709 13:03:00.545107 12877 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:00.486034 13096 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:00.620240  8452 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:00.548027 13055 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:00.621919  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 321488us
I20260709 13:03:00.630221  9261 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:00.574463 12802 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:00.583216 13132 log.cc:927] Time spent T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:03:00.629045  8385 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:00.584061 13095 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.479202 12930 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:00.637254  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 150619us
I20260709 13:03:00.638252  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:00.645773  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 185695us
I20260709 13:03:00.642303  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:00.635859 13096 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:00.649137  9261 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:00.625957 12877 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.651683  8349 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:00.634758 13055 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:00.632156 13018 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:00.593894 12858 consensus_queue.cc:1059] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 13:03:00.656252  9288 consensus_meta.cc:287] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.001s
W20260709 13:03:00.656404  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 93584us
I20260709 13:03:00.662820  8528 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:00.667744  8349 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:00.668296 13145 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:00.836588 13131 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
W20260709 13:03:00.832755  9258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.007s	sys 0.003s
I20260709 13:03:00.643815 13095 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:00.838822 13129 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:03:00.673475  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:00.676386 13072 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:00.840852  8385 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
W20260709 13:03:00.681825  8500 leader_election.cc:336] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.578s (SENT)
I20260709 13:03:00.848886  8500 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:00.786731  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 144562us
I20260709 13:03:00.645466 12845 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:00.787053  9288 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:03:00.584774 13110 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:00.652158 13125 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:00.655758 12877 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:00.854300 12845 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:00.802102  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 328989us
I20260709 13:03:00.549755 13120 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:00.832203  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:00.880718  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:00.835705 13137 log.cc:927] Time spent T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:03:00.672695 13124 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.099s
W20260709 13:03:00.841327  9258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.007s	sys 0.003s
W20260709 13:03:00.883054  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 621416us
W20260709 13:03:00.677618 12975 consensus_meta.cc:287] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.001s
I20260709 13:03:00.848111  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:00.884873  8381 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 13: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:00.885470  8534 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
W20260709 13:03:00.853353  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.694222 13096 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:00.814740 13142 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:00.815914 13059 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:00.820703 12873 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:00.865279 12724 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.890148 12724 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:00.865944 13150 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:00.789956 12863 consensus_queue.cc:260] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:00.840296 13095 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:00.827899 12681 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:00.869980  8535 raft_consensus.cc:1240] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:00.893997 13138 raft_consensus.cc:3055] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:00.894527 13138 raft_consensus.cc:740] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:00.895139  8501 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:00.895511 13138 consensus_queue.cc:260] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:00.874588 12845 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:00.899466  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:00.874814 13141 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:00.875303 13146 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:00.875731 13151 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:00.876936 13015 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:00.877427 13021 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:00.905547 13124 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:00.906736 13096 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:00.908702  8528 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:00.896845 13138 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:00.913188  8455 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:00.913975 13110 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:00.914737 13120 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:00.916868 12845 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:00.923844  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 242067us
W20260709 13:03:01.182747  8500 leader_election.cc:336] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.585s (SENT)
I20260709 13:03:01.183215  8500 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:01.183804 12845 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:00.929631  9258 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:03:01.184516  8500 leader_election.cc:336] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.630s (SENT)
W20260709 13:03:01.184775  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 255185us
I20260709 13:03:01.185354 13120 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:00.926345  8381 raft_consensus.cc:2376] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13. Re-sending same reply.
I20260709 13:03:00.925038  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:01.188964  8500 leader_election.cc:336] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.643s (SENT)
I20260709 13:03:01.189495  8500 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:01.189932 13155 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:01.190392 13120 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:01.190464 13155 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:01.191078 13155 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:01.193475 13145 raft_consensus.cc:3055] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:01.193945 13145 raft_consensus.cc:740] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:01.194900 13145 consensus_queue.cc:260] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.195948 13142 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.196298 13145 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:01.197345 12906 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.198060 12906 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.201295 13141 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.201864 13141 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.204144 13141 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:01.208081  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:01.208920  8454 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:01.200766 12906 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:01.213483 13018 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:00.917034 13085 consensus_meta.cc:287] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.770s	user 0.008s	sys 0.003s
I20260709 13:03:01.151961 12877 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:00.921657 12930 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:00.854521 12953 consensus_queue.cc:237] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:00.978569 12918 consensus_meta.cc:287] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.792s	user 0.009s	sys 0.002s
I20260709 13:03:00.931452 12681 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:01.222754 12681 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:00.924706 12802 consensus_queue.cc:1059] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:03:01.225841 12802 raft_consensus.cc:3055] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:01.226248 12802 raft_consensus.cc:740] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:01.227322 12802 consensus_queue.cc:260] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:00.955879 13150 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:01.230669 12877 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:01.231503  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:01.232097  8455 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:01.232599 12802 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:01.217238 13018 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.235641 13018 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:01.237965  8351 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:01.239442 12845 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:01.239989 12845 raft_consensus.cc:697] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:01.240942 12845 consensus_queue.cc:237] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:01.241392 13096 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:01.243448 12681 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:01.153898  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 486206us
W20260709 13:03:01.143321  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 248237us
I20260709 13:03:01.246800  8501 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:01.247375  8455 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 16.
W20260709 13:03:01.155642 13081 consensus_meta.cc:287] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.717s	user 0.014s	sys 0.000s
I20260709 13:03:01.251042 13081 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:00.918392 13072 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:01.156335  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 507241us
I20260709 13:03:01.255386  9261 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:00.931841 12863 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:01.163041  8532 consensus_meta.cc:287] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.773s	user 0.011s	sys 0.003s
I20260709 13:03:01.257917  8532 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:03:00.925557 13146 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:01.143190 13151 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:01.167495 13167 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.169396 13125 raft_consensus.cc:697] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:03:01.148614 13064 consensus_meta.cc:287] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.743s	user 0.012s	sys 0.005s
W20260709 13:03:01.142908 13054 consensus_meta.cc:287] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.683s	user 0.015s	sys 0.000s
W20260709 13:03:01.172403  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.274823 13146 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:01.277235 13167 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.263976 13123 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.257757 12930 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:01.277861 13018 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:01.281543 13018 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:01.281960 13136 log.cc:927] Time spent T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.660s	user 0.002s	sys 0.000s
I20260709 13:03:01.282096 13018 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.277287 12906 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:03:01.285230  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:01.145406 13095 consensus_queue.cc:1059] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:01.173053 13021 consensus_queue.cc:1059] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:03:01.175518  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 246901us
I20260709 13:03:01.144225 12724 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:00.957013  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:01.196484 13142 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.221691 12918 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.144518 13055 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.248524  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:01.250336  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:01.296460  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 48059.1us
I20260709 13:03:01.255793  8349 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:01.256456  8454 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:01.259575  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:01.260056  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:01.260854  8501 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:01.262480  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:01.293459  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:01.269639  9261 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:01.278050  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:01.276751  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:01.285986  8455 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 16: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:01.285015  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:01.300005  8533 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:01.287932  8385 raft_consensus.cc:1275] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:03:01.257543 13128 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.006s	sys 0.014s
I20260709 13:03:01.267928 13081 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:01.301565  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:01.305858  8457 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:01.311733 12724 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:01.300609  8459 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:01.302111  8381 raft_consensus.cc:2368] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16.
I20260709 13:03:01.315699  8534 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:03:01.317927  8457 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:03:01.321484  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:01.322083  8461 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:03:01.323348  8460 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:03:01.278715 13123 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:01.324541  9261 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:01.325130 13151 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:01.319761 13080 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:03:01.325896  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 65118.9us
I20260709 13:03:01.279968 13167 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:01.287988 13064 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.326974  8501 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:01.328217 13123 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:01.328486 13167 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:01.299585 13124 raft_consensus.cc:3055] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:01.329460 13124 raft_consensus.cc:740] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:01.330368  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:01.330948 12953 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:01.331291  9294 raft_consensus.cc:2410] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:03:01.331492 12953 raft_consensus.cc:697] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:01.319036 12681 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:03:01.333613  9291 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:03:01.334848  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:01.335721  9288 raft_consensus.cc:2393] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 14: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:01.287781 13054 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:01.338694  8528 raft_consensus.cc:1240] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:01.339025  9295 raft_consensus.cc:1240] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:01.340584  9258 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:01.350150  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:01.320226 12877 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:01.362317  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:01.345259  9258 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:01.361415  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:01.360814  9288 raft_consensus.cc:1240] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:01.332510 12953 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.367610  9287 raft_consensus.cc:2368] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16.
I20260709 13:03:01.364267  8501 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:01.349660 12906 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:01.366498  8351 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:01.336762 13163 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.372925  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:01.367566  8427 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:01.374915  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:01.375541  8383 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:01.370967  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:01.377283  8424 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:01.380357  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:01.343616 13072 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:01.408041  8426 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:01.408806  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:01.387421  8534 raft_consensus.cc:2410] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:03:01.389287  9260 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:01.389358  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:01.389920 12858 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:01.391110  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:01.391582 13123 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:01.391309 13125 consensus_queue.cc:237] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.393177 13142 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:01.394131  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.394059 13064 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:01.394892 12873 raft_consensus.cc:2764] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:03:01.396515 13018 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:01.385741 13085 consensus_queue.cc:1059] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:03:01.361501 12863 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.370798 13081 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:01.370954 13164 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:01.405332 12260 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.405975  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:01.413405 13167 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.425858 13085 raft_consensus.cc:3055] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:01.422273 12858 raft_consensus.cc:697] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:01.426414 13085 raft_consensus.cc:740] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:01.427443 13085 consensus_queue.cc:260] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:01.429551  8426 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:01.431028 12873 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:01.425788  8535 raft_consensus.cc:2410] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:03:01.431767  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 183625us
I20260709 13:03:01.406400  8427 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:01.407164 13143 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:01.407265 12918 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:01.398312  8501 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:01.411094  8383 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:03:01.371234 12906 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.407941 12681 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.374171 13146 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:01.368325 12845 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.452075  8349 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:01.371675 12877 raft_consensus.cc:697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 16 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:03:01.464736  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 58413.5us
I20260709 13:03:01.464679 13164 raft_consensus.cc:697] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 12 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:01.467975 13026 consensus_queue.cc:1059] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:01.387568 13163 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:01.471045  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:01.476619  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 78627.8us
I20260709 13:03:01.427318 12858 consensus_queue.cc:237] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:01.479732  8535 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:01.495258  8534 raft_consensus.cc:1275] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:01.443257 13081 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.486680  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:01.489812  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:01.496723  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 105679us
I20260709 13:03:01.497164  8383 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:01.490916  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:01.467438 12906 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:01.422606 13080 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:01.466578 13151 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:01.330379 13124 consensus_queue.cc:260] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.518146  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:01.425784 13167 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.517596  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:01.520939  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:01.522737  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:01.492254 12874 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:01.480470 13072 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:01.528744  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:01.529574  8378 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:01.533797  8386 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:01.525938  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:01.452399 13021 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:03:01.482028 13085 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:01.469843 12681 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.550419  8383 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:03:01.492486 12918 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:03:01.551851  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 119373us
I20260709 13:03:01.501576 13143 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:01.500422 13081 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:01.422816 13155 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.474699 12845 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:01.452519 12863 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.552929  8349 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:01.565761  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:01.567634  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:01.578231  8533 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:01.582306  8535 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:03:01.583854  9258 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:01.535414 13080 raft_consensus.cc:697] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:03:01.586192  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 88404.1us
I20260709 13:03:01.586949  8500 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:01.584838  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:01.469236 13164 consensus_queue.cc:237] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.480854 12260 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.581378 13124 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:01.588352 12877 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.590867 13064 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:01.640041 13064 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.640568 13064 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:01.593118  8500 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:01.593953 13146 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:01.593627 13123 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:01.603365 12260 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:01.608978 13016 raft_consensus.cc:3055] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:01.648146 13016 raft_consensus.cc:740] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:03:01.648267  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 55254.2us
I20260709 13:03:01.610611 12681 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:01.649372  8500 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:01.649813 13016 consensus_queue.cc:260] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:01.650710  8500 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:01.651106 13016 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:01.651532 12930 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:01.652490 13123 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:01.654150  8500 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:01.656885 13120 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:03:01.543767 13096 consensus_queue.cc:1175] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "446d9310dce14ff4afff2dc2d64f68d8" responder_term: 13 status { last_received { term: 13 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 13 index: 12 } }
I20260709 13:03:01.660166  8500 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:01.616711  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:01.663501  8383 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:03:01.591355  8385 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
W20260709 13:03:01.612848  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:01.639397  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 86574us
I20260709 13:03:01.643549  8501 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:01.667611  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:01.669031  8501 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:01.671887  8386 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:03:01.586879 13072 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:01.686533  8501 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:01.694355  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 221110us
W20260709 13:03:01.695957  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.698535  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:03:01.593773 13176 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:03:01.660001 13096 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:01.719246  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 287886us
I20260709 13:03:01.719282  8427 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:01.722977  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:01.725283  9291 raft_consensus.cc:1240] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:01.728142  8379 raft_consensus.cc:1240] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:01.719730  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:01.730280  9290 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:01.611912 13167 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:01.613947 13163 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:01.693688 13018 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.724653  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:01.632141 13055 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:01.741132  9292 raft_consensus.cc:1240] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:01.620275 12845 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:01.687016 13120 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:03:01.731838  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 65890us
I20260709 13:03:01.746800  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:01.784727  9296 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 16: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:01.749199  9287 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 9. Current term is 10. Ops: [8.8-9.9]
I20260709 13:03:01.688148 13142 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.717489 13095 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:01.773814  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 212529us
I20260709 13:03:01.694419 13072 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:01.777047  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 62222.8us
I20260709 13:03:01.699715 13054 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.781450  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:01.699251 12802 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:01.717124 12918 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:01.718242 13123 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:01.729511  9261 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:01.788268  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:01.741150 13168 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:03:01.825603  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 96255.3us
I20260709 13:03:01.727669 13110 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.092s
I20260709 13:03:01.851361  9290 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:01.820081 13072 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:01.819061 13120 raft_consensus.cc:697] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:01.733979 13096 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.783375 13135 consensus_queue.cc:1059] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:03:01.821226 13145 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.823688 13123 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.860581  8500 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:01.783286 13018 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.788383 12906 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.837793 13163 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:01.893316  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 49718.1us
I20260709 13:03:01.853564 13168 raft_consensus.cc:697] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:03:01.905484  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 44999.4us
I20260709 13:03:01.853515 12873 raft_consensus.cc:697] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:01.821063 13142 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.910988  8349 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:01.835930 13054 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.914939 13163 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:01.916546 12906 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:01.916386 13120 consensus_queue.cc:237] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.936136 13015 raft_consensus.cc:2764] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:03:01.922271  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:01.844205 13095 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:01.937774  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 153494us
I20260709 13:03:01.938516  8427 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:01.939553 13095 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:01.941461  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:01.842926 12802 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:01.924391  8378 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:01.893808 13164 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:01.833550 13080 consensus_queue.cc:237] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:01.909024 13123 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:01.977272  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:01.978008  8456 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:01.910861 13145 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:01.954680  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.913512 12845 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:01.970081  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:01.953790  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 177260us
I20260709 13:03:01.946898 12863 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:01.989194  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:01.989523  8461 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:02.054323  9260 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:02.013872 13189 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:02.056885  8426 leader_election.cc:400] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16.
I20260709 13:03:02.066752  8426 leader_election.cc:403] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:03:02.013005 13179 log.cc:927] Time spent T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:03:02.013149 13153 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.058s	user 0.000s	sys 0.005s
I20260709 13:03:02.013674 13109 raft_consensus.cc:993] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
W20260709 13:03:01.998597 13177 log.cc:927] Time spent T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:03:02.087769  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 252276us
W20260709 13:03:02.089293  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 148886us
I20260709 13:03:02.095021  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:01.998853 13055 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:02.101918  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 283286us
I20260709 13:03:02.013463 13154 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:02.112425 12930 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:01.999275 13157 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:02.018608 13145 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:02.114001  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 51410.6us
I20260709 13:03:02.060508 13189 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.986544 13164 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:02.137998  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 81322.6us
W20260709 13:03:02.013557 13181 log.cc:927] Time spent T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:03:02.045665 12873 consensus_queue.cc:237] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:02.014472 13180 log.cc:927] Time spent T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:03:02.113592 13154 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:01.998869 13160 consensus_queue.cc:1059] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.164s
I20260709 13:03:02.101455 12918 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:01.999962 12845 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:02.119122 13109 raft_consensus.cc:1081] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:03:02.012455 13146 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:02.146440  8427 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:02.107878 13201 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:02.183141  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 73083.4us
W20260709 13:03:02.138903 13124 consensus_meta.cc:287] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.513s	user 0.014s	sys 0.000s
I20260709 13:03:02.068400 13168 consensus_queue.cc:237] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:02.227788 13197 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:03:02.228461 13164 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:02.255537 13183 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:03:02.256011 13085 consensus_meta.cc:287] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.691s	user 0.007s	sys 0.004s
I20260709 13:03:02.256222 13183 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:02.258467 13183 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:02.259028 13015 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:03:02.259048 12874 consensus_meta.cc:287] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.716s	user 0.006s	sys 0.003s
I20260709 13:03:02.260070  8378 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:02.260250 12874 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:02.261304  8461 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:02.261431 13054 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:02.264065  8456 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:02.184549 13154 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:02.269721  9260 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:02.273556 13207 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:02.274359 13207 raft_consensus.cc:697] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:02.275614 13207 consensus_queue.cc:237] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:02.254238 13158 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16.
I20260709 13:03:02.279498 13163 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:02.244714 13096 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:02.229640 12845 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:02.229867  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:02.252846 13146 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:02.292135 13146 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:02.233606 12802 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:02.234108 13193 log.cc:927] Time spent T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 13:03:02.235086 13187 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
I20260709 13:03:02.136762 13157 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:02.102392 13081 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:02.295118 13157 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:02.295691 13081 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:02.136317 13189 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:02.153419 12724 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:02.253342  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 108357us
I20260709 13:03:02.298669  8427 leader_election.cc:400] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16.
I20260709 13:03:02.299595  8427 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:02.230997 13184 log.cc:927] Time spent T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:03:02.309351 13085 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:02.309286 12260 consensus_queue.cc:1048] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:03:02.310385  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 56909.3us
I20260709 13:03:02.311094  8424 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:02.312366  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:02.312430  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:02.313429  8456 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 14: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:02.313253 13158 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:02.313207  8457 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:02.314755  8455 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:02.318156 12874 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:02.322425 13054 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:02.324579  8457 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:02.325937  9260 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
W20260709 13:03:02.326525 13208 log.cc:927] Time spent T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:03:02.326895 13054 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:02.327482 13054 raft_consensus.cc:697] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:02.328459 13054 consensus_queue.cc:237] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:02.329183 13139 raft_consensus.cc:3055] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:02.329629 13139 raft_consensus.cc:740] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:02.330389 13139 consensus_queue.cc:260] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:02.312723  8424 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:02.338035 13064 consensus_meta.cc:287] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.001s
I20260709 13:03:02.338488 13064 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:02.338888 12260 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:02.376320  8461 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
W20260709 13:03:02.410806  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 98130.4us
I20260709 13:03:02.563517 13161 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:03:02.533895 12874 consensus_queue.cc:1048] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:03:02.593114 13157 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:02.597031 13157 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:02.600056 13157 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:02.601537  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.533633 12873 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:03:02.593842 13142 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:02.627455  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:02.629101  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:02.629668  8454 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:03:02.631865  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:02.633381  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:02.633489  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:02.634267  8453 raft_consensus.cc:2368] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13.
I20260709 13:03:02.635010  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:02.635277  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:02.637645  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:02.637019  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:02.636915  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:02.636981  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:02.641755  8455 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:03:02.637319  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:02.625960  8500 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.127s	sys 0.153s
W20260709 13:03:02.646209  8500 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.127s	sys 0.153s
W20260709 13:03:02.646831  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 724594us
I20260709 13:03:02.648387  8500 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:02.648910 13080 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.047s	sys 0.076s
I20260709 13:03:02.659508  8456 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:03:02.660164  8500 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:02.661166  8500 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:02.662629  8452 raft_consensus.cc:1240] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:03:02.666338 13167 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:02.667071  8500 leader_election.cc:400] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13.
I20260709 13:03:02.668079  8500 leader_election.cc:403] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:03:02.665608 12918 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:02.668665 12724 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:02.699433  8500 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:02.703214  8500 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:02.678016 12918 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.678277 13167 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:02.718111 13213 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:02.719648  8500 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:02.720861  8500 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:02.722990  8500 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:02.705668 12918 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:02.725518 13123 consensus_meta.cc:287] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.741s	user 0.008s	sys 0.004s
W20260709 13:03:02.734203 13072 consensus_meta.cc:287] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.841s	user 0.009s	sys 0.006s
I20260709 13:03:02.726168 13110 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:02.733624 13213 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:02.787659  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 60515.6us
I20260709 13:03:02.738497 12724 consensus_queue.cc:1059] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:03:02.720429 13216 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:02.724874 13151 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:02.800295  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:02.803529 13196 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.578s	user 0.011s	sys 0.018s
I20260709 13:03:02.807981  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:02.808962  8532 raft_consensus.cc:2410] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:03:02.809630  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:02.812752  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:02.813896  8533 raft_consensus.cc:2393] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 17: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:02.741743 13123 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:02.800792 13018 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:02.817874  8530 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:02.821957  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:02.795167 13110 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.826318  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:02.827196  8529 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:02.783893 13072 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:02.822296 13150 raft_consensus.cc:3055] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:02.851384 13150 raft_consensus.cc:740] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:02.853329  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:02.829178 13110 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.965415  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:02.966220  8529 raft_consensus.cc:2393] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:03:02.967646 13190 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.733s	user 0.000s	sys 0.013s
I20260709 13:03:02.967789  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:02.968297  8452 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:02.969056 12877 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:02.969197  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:02.971540 12877 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:02.969372  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:02.973317  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:02.973850 12877 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:02.974658 12802 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.974946 13146 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.975160 12802 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:02.975538 13146 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:02.977331 12802 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:02.977948 13146 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:02.977945 12845 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:02.978812 12845 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:02.979380 13218 log.cc:927] Time spent T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.283s	user 0.002s	sys 0.000s
I20260709 13:03:02.982375  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:02.983112  9294 raft_consensus.cc:2368] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:02.983376  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:02.984177  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.984866  9296 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:02.985060  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:02.986049 13191 log.cc:927] Time spent T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.761s	user 0.010s	sys 0.013s
I20260709 13:03:02.987020  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:02.987726  9292 raft_consensus.cc:2393] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 14: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:02.988000  9293 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:03:02.988914  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:02.980981 12845 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:02.989621  9295 raft_consensus.cc:2393] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 14: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:02.989904  9294 raft_consensus.cc:1240] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:02.990439  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:02.991501  9287 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:02.991580 13096 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:02.992233 13096 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:02.992772  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2625) took 1449 ms. Trace:
I20260709 13:03:02.994295 13096 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:02.995180 13064 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:02.995404 13096 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.993180  8534 rpcz_store.cc:276] 0709 13:03:01.543188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.543352 (+   164us) service_pool.cc:224] Handling call
0709 13:03:01.575624 (+ 32272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:01.584832 (+  9208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.584863 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:01.589072 (+  4209us) log.cc:844] Serialized 26 byte log entry
0709 13:03:01.859654 (+270582us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:01.894959 (+ 35305us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.070138 (+175179us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b1800350b60. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c5312c0a 00007f36cea52219 00007f36c539aa40 00007f36c53954e4 00007f36c5395455 00007f36c847d060 00007f36c848f716 00007f36c84a0287 00007f36c84a0208
0709 13:03:02.112196 (+ 42058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.112320 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.985483 (+873163us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:02.992556 (+  7073us) raft_consensus.cc:1685] finished
0709 13:03:02.992577 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.992717 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25278,"prepare.queue_time_us":40857,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":8986,"raft.queue_time_us":205134,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":79071,"spinlock_wait_cycles":54767744,"thread_start_us":311640,"threads_started":2,"wal-append.queue_time_us":530456}
I20260709 13:03:03.002731  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:03.004618 13054 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.953642 12262 raft_consensus.cc:3055] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:03.008939 12877 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:03.015200  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:03.018314  9293 raft_consensus.cc:2393] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 13: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:03.016450  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:03.018657  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:03.012650  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:03.013867  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:02.964308 13189 consensus_meta.cc:287] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.008s
I20260709 13:03:03.009158  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:03.023792  8529 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:03.020606  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.017956 13064 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.008983 13054 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.025776 13064 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.027233  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:03.027771 12877 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:03.028527 13064 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:03.030010 12877 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:03.030216  9294 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:03.030035  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:03.034993  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.035667  8534 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:03.027341 13054 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:03.040171 13110 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:03.062611  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.069692  8534 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 18.
I20260709 13:03:03.064458  8461 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:03.047288  9261 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:03.067881  8529 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:03:03.007864 12802 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:03.074280  8456 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:03:03.009698 13141 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:03.076696  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 55483us
I20260709 13:03:03.010293 12262 raft_consensus.cc:740] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:03.082679  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.080751  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.085546  8526 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:03:02.995868 13096 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:03.083657  8531 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:03:03.092310  8460 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:03.095114  8528 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:03.098263  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.069301 12877 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:03.080399 13213 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.022789 13016 consensus_queue.cc:1059] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:03:03.073359 12845 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.084986 13055 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:03.102141 13216 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:03.113907 13224 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:03.114450 12877 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.092049 13151 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:03.117417  8527 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:03.058867 13189 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.089457 13217 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:03.083266 13150 consensus_queue.cc:260] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.105018 13168 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:03.088961 13141 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.094094 12802 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:03.152179  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.157795  8531 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:03:03.132164 13123 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:03.144937 13055 raft_consensus.cc:697] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:03.169574  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.133191 12845 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:03.172212 13205 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.939s	user 0.000s	sys 0.003s
I20260709 13:03:03.173381 12845 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:03.174140  9288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 654) took 1484 ms. Trace:
I20260709 13:03:03.174517  9288 rpcz_store.cc:276] 0709 13:03:01.689917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.690033 (+   116us) service_pool.cc:224] Handling call
0709 13:03:01.727252 (+ 37219us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:01.915725 (+188473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.915757 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:01.916363 (+   606us) log.cc:844] Serialized 52 byte log entry
0709 13:03:02.064112 (+147749us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:02.224573 (+160461us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.224858 (+   285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.224970 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:03.171586 (+946616us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:03.173839 (+  2253us) raft_consensus.cc:1685] finished
0709 13:03:03.173940 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.174083 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9914,"prepare.queue_time_us":205194,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":78876,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":15501,"spinlock_wait_cycles":45155712,"thread_start_us":392540,"threads_started":3,"wal-append.queue_time_us":197041}
I20260709 13:03:03.154173 12262 consensus_queue.cc:260] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.182329 12877 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:03.182804 12262 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:03.156286 13217 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:03.184962 13217 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:03.131213 13213 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:03.186085 13110 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:03.157094 13168 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.186932 13213 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:03.187928 13222 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:03:03.188606 13168 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:03.189550  8455 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11. Ops: []
W20260709 13:03:03.189672 13154 consensus_meta.cc:287] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.924s	user 0.016s	sys 0.003s
I20260709 13:03:03.190114 13154 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:03.190634 13141 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:03.191241  9287 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 18.
I20260709 13:03:03.192299 13154 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:03.194068 13096 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:03.194700 13072 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:03.186969 13155 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:03.196666 12802 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:03.152091 13151 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.200515 13151 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:03.200821 13021 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:03.201423 13021 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:03.203176 12260 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.205770  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:03.203742 12260 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:03.203631 13021 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:03.209378 12802 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:03.211510 13072 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.211833 12802 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.212127 13072 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.214382 13072 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:03.214780 12802 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:03.218411 13189 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:03.219457  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:03.203637 13055 consensus_queue.cc:237] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.168859 13146 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:03.222498  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:03.137246 13224 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:03.223826  8383 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:03.226792  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.227648  8531 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:03:03.230676  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:03.136883 13216 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.231287  8381 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:03.231274  8378 raft_consensus.cc:1240] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:03.207552 12918 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.237986  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.242089  8527 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:03:03.239274  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:03.239547  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:03.243081  8379 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:03.245870  8381 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:03.238677  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:03.247068  8378 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:03:03.242996  8385 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
W20260709 13:03:03.250519  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 109423us
I20260709 13:03:03.253458  8381 raft_consensus.cc:1240] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:03.254554  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:03.255143  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:03.255888  8384 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:03.255208  8386 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:03.254060  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.260437  8351 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:03.261842  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.262048  8351 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:03.263574  8529 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:03.222113 12802 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:03.268226  8532 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:03.268698  8379 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:03.229220 13146 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.270430  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:03.275570  9287 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.273377  8528 raft_consensus.cc:2393] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 14: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:03.283892  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:03.299355  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:03.300031  9293 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:03:03.301045  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:03.301800  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:03.303805  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:03.304783  8457 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 14: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:03.313444  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:03.314298 13224 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:03.316089 12260 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:03.318969 12918 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:03.320097  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:03.320935  8529 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:03.323328  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.324590  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.275858 13154 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:03.325515  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:03.327768 13216 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:03.301259  9292 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:03:03.274983 13167 consensus_meta.cc:287] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.555s	user 0.011s	sys 0.000s
I20260709 13:03:03.332376  8501 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:03.262791 13231 consensus_queue.cc:1059] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.150s
I20260709 13:03:03.333709  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:03.460271  8384 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:03.328099 13154 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.275447 12802 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:03.469547 12802 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:03.433007 13230 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:03.470463 13235 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:03:03.383050 13146 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:03.470708  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.472128  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:03.472934 13189 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.473193  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:03.473551 13189 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:03.451242 13158 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.475903 13189 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:03.476234 13158 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:03.389322  8386 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:03:03.480520  8386 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:03.480991  8386 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:03.483428 12873 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:03.484082 12873 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.484452  9260 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:03.484977 13081 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:03.485505 13081 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.269138 12877 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:03.486450 12877 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.487635 12877 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:03.488188  9292 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
W20260709 13:03:03.483850  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.512535  8532 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:03.490203  8383 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:03:03.486223 13207 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:03.492062  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:03.358597  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:03.494117  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.518771  8531 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:03:03.520176  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.427798  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.521347  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.521601  8526 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:03.522181  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.523046  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.337193  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:03:03.358434  8377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48484 (request call id 786) took 1966 ms (client timeout 1555 ms). Trace:
W20260709 13:03:03.451305  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 96503.3us
I20260709 13:03:03.527151  8500 leader_election.cc:400] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:03.527238  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:03.527661  8500 leader_election.cc:403] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:03:03.389830 13229 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:03:03.520839  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:03.522986  8535 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
W20260709 13:03:03.525704  8377 rpcz_store.cc:269] 0709 13:03:01.372530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.372654 (+   124us) service_pool.cc:224] Handling call
0709 13:03:03.338877 (+1966223us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400269654. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:03.339043 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3010884992}
I20260709 13:03:03.532646  8461 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:03:03.528976  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 63566.2us
I20260709 13:03:03.382711  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:03.358934  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:03.513209  8383 pending_rounds.cc:85] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 8
I20260709 13:03:03.534722  8383 pending_rounds.cc:107] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:03:03.535056  8383 raft_consensus.cc:2889] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:03.514274  9287 raft_consensus.cc:2410] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:03:03.353102  8528 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
W20260709 13:03:03.515357  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 183089us
I20260709 13:03:03.516599  9261 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:03.533161  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.537024  8461 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:03.538607  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.539865  8535 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:03:03.493492 13154 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.504243 13139 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:03.552465  9258 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:03.503201  8529 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:03:03.554941  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:03.555461  8526 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:03.555696  8527 raft_consensus.cc:2393] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 14: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:03.337095 13110 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:03.543478  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:03.543048 13207 raft_consensus.cc:697] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:03.547577  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:03.577045 13110 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:03.577744  8458 raft_consensus.cc:3060] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.577939 13207 consensus_queue.cc:237] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.579142 13110 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:03.580591 13141 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:03.548323  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.558133 12918 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:03.581496  8532 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:03.582121 13123 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:03.493348 13167 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13.
I20260709 13:03:03.583585 13123 consensus_queue.cc:1059] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:03.584311 13123 consensus_queue.cc:1243] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer 446d9310dce14ff4afff2dc2d64f68d8 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:03:03.548120  8386 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.553668  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:03.565263  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:03.534051  9294 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:03.587634  8460 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 14: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:03.406064 12260 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.559070  8535 raft_consensus.cc:3055] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:03.589720  8535 raft_consensus.cc:740] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:03.547091  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:03.592289  8452 raft_consensus.cc:2410] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 16 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:03:03.559979 12724 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:03.529397 13146 raft_consensus.cc:3055] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:03.560796 13064 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:03.561266  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:03.603159  8383 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.603615  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.604575  8528 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:03:03.565212 13158 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:03.566025  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:03.567737  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.605979  8531 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:03.573817 13081 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:03.470610 13230 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.574122  9258 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:03.574926  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:03.575763 12873 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:03.576406  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.611440  8529 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:03:03.519989 13224 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:03.615909  8526 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:03.616032  8527 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:03.621762 13150 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.608534 13151 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:03.594599  8535 consensus_queue.cc:260] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.624017 13151 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.624631  8535 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:03.606482  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:03.628679  8455 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:03.612782 13217 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.606818  8351 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:03.614285  8386 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:03.602205 12260 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.615578 13230 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:03.621778  9258 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:03:03.646121  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:03.609552 13232 log.cc:927] Time spent T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:03:03.603719 13016 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.593931 13146 raft_consensus.cc:740] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:03.602519 12802 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:03.651294  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:03.656667  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:03.661509  8383 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:03.662034  8530 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:03.607002 12845 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:03:03.667229 13016 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.632742 13224 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:03.696269  8458 raft_consensus.cc:2468] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:03.708930  8535 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:03:03.720216  8535 pending_rounds.cc:85] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 10
I20260709 13:03:03.721232  8535 pending_rounds.cc:107] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:03:03.722223  8535 raft_consensus.cc:2889] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:03.632932 13081 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:03.729494  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:03.730224  8383 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
W20260709 13:03:03.731444  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 174826us
I20260709 13:03:03.699551 13016 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:03.734259  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 189491us
I20260709 13:03:03.735316  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.736123  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:03.657353 13064 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:03:03.732190 13167 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:03:03.714920 13072 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:03.648214 13217 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:03.725904 13224 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:03.726207 13081 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.750212 13064 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.756713 13064 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:03.732931  9261 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:03.762049 13238 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:03:03.763114 12260 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:03.773288 13081 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:03.779644  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 254361us
I20260709 13:03:03.781205  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:03.781361  8427 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:03.788641  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 185769us
I20260709 13:03:03.789765  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:03.733952 13055 consensus_queue.cc:1059] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.053s
W20260709 13:03:03.816030  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 276460us
W20260709 13:03:03.814839  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 58890.5us
I20260709 13:03:03.818674  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:03.823902  8383 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
W20260709 13:03:03.827037  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 93009.2us
I20260709 13:03:03.823766  8349 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:03.828387  9261 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:03.829347  8427 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:03.835031  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:03.793227 13151 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:03.795493 12262 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:03.843713  9260 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:03.850812 13258 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:03:03.853572  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:03.854218  8456 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:03.826694 12845 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:03.837536 13055 consensus_queue.cc:1243] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer b8eb0ad4490645598004d862412f4e31 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:03:03.856184 12874 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:03.821727 13021 consensus_queue.cc:1059] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:03:03.820961 13158 consensus_queue.cc:1059] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:03:03.833698 12877 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.865532 13016 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.869390 13016 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:03.869783 13217 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:03.870538 13258 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:03.871469 13016 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:03.863130 13141 raft_consensus.cc:2764] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:03:03.875545 13064 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.877065 13154 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:03.866375 13055 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:03.882148 12845 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.882535 13055 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:03.882704 12845 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:03.883549  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 135869us
W20260709 13:03:03.912186  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 88506.3us
I20260709 13:03:03.914270  8349 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:03.873006 13141 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:03.864821 12874 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:03:03.916504  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 114015us
I20260709 13:03:03.911051 13072 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:03.920423  8349 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:03.917577 13141 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.919600 12874 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:03.920794 13161 consensus_queue.cc:1059] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:03:03.925429 13264 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:03.917272 13139 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:03:03.925155 13257 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:03:03.983851  8526 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:03:04.054438  8526 pending_rounds.cc:85] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 11
I20260709 13:03:04.055733  8526 pending_rounds.cc:107] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:03:03.927495  9290 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
W20260709 13:03:03.990121  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 69791.1us
W20260709 13:03:03.994113  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 66731.5us
I20260709 13:03:04.057992  8526 raft_consensus.cc:2889] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:04.061544  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:03:04.061935  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 233717us
I20260709 13:03:04.062335  8534 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:03:03.979943 13243 log.cc:927] Time spent T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.117s	user 0.001s	sys 0.002s
W20260709 13:03:04.074973  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 231325us
I20260709 13:03:04.064134  8349 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:03.980224 13248 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 13:03:03.941296 13141 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:04.079793  8349 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:04.080152  8351 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:03.981127 12845 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:04.082496  9261 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:03.929823 13154 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:03.980938 13064 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:04.049105 13264 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:04.098254  8349 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:04.104310  9261 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:03:04.108111  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 277189us
I20260709 13:03:03.986125 13081 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:04.089946 12802 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:04.116190  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:04.121402  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:04.123396  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:04.125321  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:04.126183  8383 raft_consensus.cc:2393] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 19: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:04.125233  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:04.127112  9291 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:04.126258  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:04.091351 13054 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:03:04.129554  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:04.129902  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:04.130813  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:04.132864  9287 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:04.132560  8386 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:04.109474 12845 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:04.137133  9289 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:04.137979  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:03.929595 13146 consensus_queue.cc:260] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:04.141870  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:04.114535 13264 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:04.100411 13072 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:03:04.122797 13230 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:04.131755 13231 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:04.148769  8383 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:04.146893  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:04.145267 13167 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:03:04.147255  8528 raft_consensus.cc:1217] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 7.8->[9.9-13.11]   Dedup: 11.10->[13.11-13.11]
I20260709 13:03:04.163921  8528 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14. Ops: [9.9-13.11]
I20260709 13:03:04.150940  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:04.115674 13150 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:04.159574  8460 raft_consensus.cc:3055] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:04.161422  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:04.084937 13268 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:03:04.154510  8456 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:03:04.166361  8460 raft_consensus.cc:740] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:03:04.152313  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 54152.1us
I20260709 13:03:04.166852  8459 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:03:04.172152  8349 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:04.155954 13252 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:04.148793 13264 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.177683  8349 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:04.178056  8386 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:04.145156 13267 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:04.153568 13230 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:04.158746 13231 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.190827  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:04.161837 13257 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:04.179639 12802 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:04.177349  8460 consensus_queue.cc:260] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:04.193792  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:04.205443  8456 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:04.207779  8460 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:04.200650  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:04.200935  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:04.202224  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:04.203078  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:04.192420  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:04.175973 13252 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:04.200197  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:04.204759  8427 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:04.212479  8427 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:04.187453 13264 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:04.213577  8386 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:04.191143 13096 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:04.220381 13096 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:04.203333 13154 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.188745 13267 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:04.220832 13096 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:04.221174 13158 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:04.221136 13154 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:04.221868 13158 raft_consensus.cc:697] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:04.221288 13267 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:04.222829 13158 consensus_queue.cc:237] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:04.223495 13154 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:04.224181 13154 consensus_queue.cc:1059] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:04.224797 13154 consensus_queue.cc:1243] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer b8eb0ad4490645598004d862412f4e31 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:04.226097  8427 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:04.217363  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:04.193859 13230 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:04.193277 13146 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:04.219005  8349 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:04.195751 13231 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:04.218348  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:04.227550  8383 raft_consensus.cc:1275] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:04.175298 13150 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:04.213479 12802 raft_consensus.cc:697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:04.233726  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:04.191011 13266 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:03:04.237531  9294 raft_consensus.cc:2393] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 14: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:04.240780  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:04.215400 13252 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:04.256759  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:04.191478 13271 consensus_queue.cc:1059] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:03:04.234818 13021 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:04.232250 13072 raft_consensus.cc:3055] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:04.254565 13154 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:04.278120  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:03:04.278877  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 134074us
I20260709 13:03:04.287182  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:04.279847  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:04.208729 13257 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:04.250775  8349 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:04.280349  8383 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:04.294301  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:04.297019  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 46356.4us
I20260709 13:03:04.253901 13272 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:04.298069  8349 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:04.282653 13026 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:04.242419 13224 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:04.280860 13072 raft_consensus.cc:740] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:04.268083  8460 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:03:04.291003 13268 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:03:04.321291  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 91436.2us
I20260709 13:03:04.282325 13021 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.326390  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:04.308741 13026 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:04.336164  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 46717.4us
I20260709 13:03:04.310537 13275 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:03:04.345067  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.321987 13268 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.311512 13081 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:04.326380 13021 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:04.339448  8424 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:04.319978  9261 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:04.349288  8426 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
W20260709 13:03:04.392475  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 72580.3us
I20260709 13:03:04.361856  8534 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
W20260709 13:03:04.347698 13274 log.cc:927] Time spent T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:03:04.354060 13275 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:04.402101 13275 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:04.367422 12874 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:04.368098 13257 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:04.407305 12874 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:04.407478 13264 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:04.379392 13016 raft_consensus.cc:3055] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:04.380811 12877 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:04.308589 13272 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:04.409935 13016 raft_consensus.cc:740] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:04.410858 13016 consensus_queue.cc:260] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:04.411746 13272 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:04.412043 13016 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:04.385736 13265 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:04.343693 13026 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:04.399515  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 50318.4us
I20260709 13:03:04.369004 13150 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:04.409030 12874 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:04.409318 13250 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:04.363361 13268 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:04.422116  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:04.398779 13202 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:04.429287  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:04.404842 13283 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.429422  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:04.334394 12802 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:04.305639  8386 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:04.439585  9295 raft_consensus.cc:2393] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 19: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
W20260709 13:03:04.439543  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 100309us
I20260709 13:03:04.440933  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:04.425338 13250 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:04.447522  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:04.448832  8424 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:04.364895 13072 consensus_queue.cc:260] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:04.451831 13250 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:04.454092  9288 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:03:04.423730 13265 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:04.475466  8385 raft_consensus.cc:1240] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:04.472325  8424 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:04.439337 13283 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:04.479189 13283 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:04.481410  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:04.489475  8424 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:04.490527  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:04.494714 13161 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:04.495168 13161 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.495544 13161 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:04.480901 13264 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:04.469671 13141 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:04.499940 13283 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:04.509215 13283 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:04.509584  9292 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:03:04.509984 13141 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:04.481359 13292 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:04.510797 13292 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:04.511173 13292 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:04.511497 13275 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:04.480729 13021 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:04.514842 13021 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:04.517544  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 431373us
I20260709 13:03:04.509644 13283 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:04.519142  9260 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:04.519964 12260 raft_consensus.cc:3055] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:04.520386 12260 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:04.521246 12260 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:04.522753 12260 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:04.524266 13150 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:04.524848 13150 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:04.527227  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.529567 13202 raft_consensus.cc:2804] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:04.530256 13202 raft_consensus.cc:697] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:04.531178 13202 consensus_queue.cc:237] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:04.532094 13150 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:04.532629 13224 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:04.446727 13285 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:03:04.531668 13268 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:04.491842 13072 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:04.544862  8427 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:04.547530 13267 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:04.550060 13267 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:04.551753 13026 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:04.554133  9296 raft_consensus.cc:2393] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 11: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:04.554438 13265 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:04.554701  8386 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:03:04.554463 13268 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:04.537235 13231 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:04.556758  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 62779.2us
I20260709 13:03:04.557902 13231 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:04.560875  8461 raft_consensus.cc:1240] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:04.569504  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:04.574721  8459 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:04.577605 13291 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:04.578079 13291 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.578380 13291 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:04.582211 13275 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:04.583345  8460 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:04.586861 13161 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:04.597656 13135 raft_consensus.cc:3055] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:04.598088 13276 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.598881 13276 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:04.600374 13021 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.600895 13021 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:04.601318 13276 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:04.602945 13021 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:04.603677  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:04.604341  9258 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:04.604535  8461 raft_consensus.cc:2393] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 11: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:04.607870  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:04.607952 13064 consensus_queue.cc:1059] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:04.608544  8534 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:04.608724 13064 consensus_queue.cc:1243] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer b8eb0ad4490645598004d862412f4e31 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:03:04.611884  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:04.612066  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 324944us
I20260709 13:03:04.606841  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:04.616528  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:04.618021  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:04.622401  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:04.623467  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:04.499217 13096 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:04.625065  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:04.609886  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:04.627728  8533 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:04.628228  8461 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:04.627396  9295 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:04.628757  8383 raft_consensus.cc:2393] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 13: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:04.629881  8426 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:04.631881  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:04.641372  8535 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:04.629369  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:04.633430  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:04.642635  8529 raft_consensus.cc:1240] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:04.644076  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:04.644642  8533 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:04.646827  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:04.649942  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:04.650635  9290 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 659) took 1668 ms (client timeout 1885 ms). Trace:
I20260709 13:03:04.652884  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:04.653321  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:04.659698  9260 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:04.651130  9290 rpcz_store.cc:269] 0709 13:03:02.982510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.990234 (+  7724us) service_pool.cc:224] Handling call
0709 13:03:04.650449 (+1660215us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b5400708fd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:04.650583 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035936640}
I20260709 13:03:04.659734  8377 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:04.660986  9287 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:04.661976  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:04.666676  8456 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:04.662295  9289 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:03:04.662520  8455 raft_consensus.cc:2393] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 14: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:04.664183  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:04.598168 13135 raft_consensus.cc:740] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:04.625216 13284 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.628628 13064 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:04.675858  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:04.545655 13230 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:04.651257 13276 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:03:04.681874  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 69107.9us
I20260709 13:03:04.682548  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:04.664642 13257 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:04.695179  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:04.695809  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:04.697631  8500 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:04.698529  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:04.698938 13096 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:04.627357 13139 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:03:04.699632  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:04.660447 13150 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:04.702446  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:04.703049  8535 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
W20260709 13:03:04.707718  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 43880.7us
I20260709 13:03:04.659802 13269 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:04.708177  8380 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:04.700330 13135 consensus_queue.cc:260] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:04.710045  8500 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:04.711242  8351 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:04.706507  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:04.713564  8377 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:04.719365  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:04.681989 13276 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.686901 13054 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:04.668920 13283 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:04.660382 13224 consensus_queue.cc:1059] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:03:04.717636 13167 consensus_queue.cc:1059] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:03:04.681625 13262 consensus_queue.cc:1059] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:03:04.720532 13272 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
W20260709 13:03:04.731334 13296 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:04.726186  8456 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:03:04.724668 13217 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:04.699638 13213 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:04.681775 13284 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:04.727659 13155 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:03:04.719017 13150 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:04.738171  8377 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:03:04.703637 13257 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:04.714218 13064 raft_consensus.cc:697] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:04.717723 13258 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:04.818163  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:04.663300 13252 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:04.746074  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 448048us
I20260709 13:03:04.703363 13154 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:03:04.750342  8351 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:04.728001 13276 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:04.767284  8424 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:04.733454 13026 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:04.860205 13299 log.cc:927] Time spent T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:03:04.845901 13167 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:04.849436 13250 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:04.891470  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 141187us
I20260709 13:03:04.847390 13291 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:04.902177 13309 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:04.902344 13292 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:04.906122  8458 raft_consensus.cc:2393] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 18: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:04.761799 13262 raft_consensus.cc:3055] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:04.766078 13230 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:04.818329 13257 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:04.750651 13275 raft_consensus.cc:2764] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:03:05.066496  8349 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:04.979971  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.070839  8535 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:05.072670  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:05.073382  8535 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:04.987501  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 93858.1us
I20260709 13:03:05.074445  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:05.074823  8501 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:05.075651  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:05.078896  8533 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:05.081522  8456 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:03:05.066920  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 299700us
I20260709 13:03:05.087111  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:05.087945  8452 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:05.088900  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:03:04.939913  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 220634us
I20260709 13:03:05.092787  8500 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:03:05.096172  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 341811us
I20260709 13:03:05.099956  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:05.101836  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:05.089601  8501 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:05.104044  8533 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:04.850279 13213 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.820627 13258 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:05.105630  8349 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:05.111274  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:05.112212  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:05.115814  8535 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 19.
W20260709 13:03:04.941282 13303 log.cc:927] Time spent T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:03:05.108341  8377 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:03:05.108752  8424 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:04.904242 13217 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:05.118340  8457 raft_consensus.cc:2393] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 13: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:05.118942  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:04.939707 13154 consensus_queue.cc:1243] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer 446d9310dce14ff4afff2dc2d64f68d8 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:05.117511  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:05.135157  8351 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:05.036602 13158 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:04.948231 13262 raft_consensus.cc:740] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:05.141304  8349 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:05.144407  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:05.145545  8380 raft_consensus.cc:2393] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 11: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:05.103107 13072 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:05.087152 13250 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:05.120098  8424 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:05.105780 13291 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:05.151510  8351 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:05.150594  8378 raft_consensus.cc:2393] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 19: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:03:05.136752 13308 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:05.152670  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:05.105626 13314 raft_consensus.cc:3055] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:05.189687  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:05.192277  8377 raft_consensus.cc:2393] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 14: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:05.189770  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:05.193202  8380 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:03:05.193501  8378 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:05.118927 13258 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:05.195442  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 54232.3us
I20260709 13:03:05.196281  8349 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:05.199505  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 79537.9us
I20260709 13:03:05.134320 12873 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:05.204892  8349 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:05.105505 13277 consensus_queue.cc:1059] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:03:05.143447 13158 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:05.107892 13230 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:03:05.011107 13309 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.188s
I20260709 13:03:05.146174 13270 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:05.190372 13275 raft_consensus.cc:2764] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:03:05.200238 12877 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:05.119104 13213 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.118083 13217 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.197289 13314 raft_consensus.cc:740] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:05.201052 13224 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:05.203233 13231 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:05.105331 13064 consensus_queue.cc:237] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.203171 13288 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:05.200404 13312 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:05.214181 13202 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
W20260709 13:03:05.219516  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 80650.4us
I20260709 13:03:05.211339  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:05.250265  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 97662us
I20260709 13:03:05.253742 13312 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:05.254508 13275 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:05.254328 13312 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.254418  8349 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:05.256616 13312 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:05.201043  8424 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:05.237303 13315 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:05.230291 13310 log.cc:927] Time spent T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.457s	user 0.001s	sys 0.000s
W20260709 13:03:05.236754  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 147235us
I20260709 13:03:05.253055 13154 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.230486 13270 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:05.265475  9258 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:05.210310 13096 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:05.216095 13158 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:05.210234 13072 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:05.269450  8452 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:05.218890 13269 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:05.242254 13317 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:05.270102  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 69149.9us
I20260709 13:03:05.257397 13321 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.297704  8501 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:05.242350 13231 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.233604 12802 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:03:05.266060 13288 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:05.232731 12873 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:05.272578 13270 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:05.270970 13054 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 13:03:05.312709  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 56491.1us
I20260709 13:03:05.300632 13292 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:05.311785  8424 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:05.305490 13231 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:05.301146 13072 raft_consensus.cc:697] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:05.316640  8501 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:05.314224  8349 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:05.303752 13096 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:03:05.314265  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 58346.4us
I20260709 13:03:05.245802 13262 consensus_queue.cc:260] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.308802 13252 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:05.328939  8501 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:05.318531  8424 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:05.272789 13154 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.269708 13315 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:05.335525 13331 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:05.336035 13335 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.336182 13328 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:05.341084  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:05.341852  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:05.355584  8533 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:05.336732 13306 log.cc:927] Time spent T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:03:05.326668 13096 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:05.318966 13317 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:05.326696 13319 log.cc:927] Time spent T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:03:05.318691 13155 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:05.344909  8378 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:03:05.380471  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:05.381059  8378 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:03:05.345655  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:05.344197  8500 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:05.325327 13288 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:05.308928 13224 consensus_queue.cc:1048] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:03:05.319685 13322 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.342022 13337 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:05.389259  8378 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:03:05.359030  8453 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:05.360198  8455 raft_consensus.cc:2368] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 14. Current term is 15.
I20260709 13:03:05.357961  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:05.311739 12873 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.338620 13311 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:05.367617  8533 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:05.338799 13292 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:05.298046 13321 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:05.345695 13150 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:05.382295  8380 raft_consensus.cc:2410] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:03:05.359215 13262 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:05.387620  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 43492.5us
I20260709 13:03:05.328817 13327 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:03:05.342365  8349 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:05.369762 13096 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:05.395854  8424 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:05.413743  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:05.413442  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 71206.2us
I20260709 13:03:05.396194  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:05.391985 13322 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:05.415084  8378 raft_consensus.cc:2393] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 11: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:05.416373 13322 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:05.417183 13337 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:05.397421  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:05.419955 13315 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:05.397707 13305 log.cc:927] Time spent T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:03:05.360728 13335 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.423261 13335 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:05.369417 13328 raft_consensus.cc:697] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:05.410283 13213 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:05.426170 13217 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:05.426983 13276 consensus_meta.cc:287] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.000s
I20260709 13:03:05.427429 13276 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.429791 13276 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:05.430411 13339 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:05.430970 13339 raft_consensus.cc:697] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:05.431790 13339 consensus_queue.cc:237] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:05.433588 13338 consensus_queue.cc:1059] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:03:05.435014  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:05.435895  8380 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:05.436653  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:05.437209  8380 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:03:05.438589 13321 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:05.398274 13155 raft_consensus.cc:697] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:05.440094 13155 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.445937 13275 raft_consensus.cc:3055] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:05.446437 13275 raft_consensus.cc:740] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:05.447214 13275 consensus_queue.cc:260] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:05.450086  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 54328.4us
I20260709 13:03:05.402346  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:05.305598 13314 consensus_queue.cc:260] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:05.403180  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:05.383669 13288 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.407331  8500 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:05.454229  8533 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:05.454244  8534 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:05.456542  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 49390.4us
I20260709 13:03:05.460289  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:05.460914  8461 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:03:05.461375  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:05.475765  8501 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:05.480592  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:05.403609 13072 consensus_queue.cc:237] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.487993  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:05.486853  8501 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:05.462450 13288 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:05.489305  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:05.490836  8501 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:05.414314 13292 raft_consensus.cc:697] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:05.495927  8453 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:03:05.496935  8501 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:05.509481  8533 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:03:05.512112 13224 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:05.513105  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:05.514775  8424 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:05.515002  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:05.515695  8533 raft_consensus.cc:2393] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 19: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:05.516873  8349 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:05.466053 13217 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:05.523767  8534 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:05.525971  8424 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:05.530506  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:05.510114 13311 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:05.495358 13213 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:05.424585 13328 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.510375 13150 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:05.482621 13321 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:03:05.482722 13231 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:05.521505 13276 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:05.538442  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:05.550235  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3182) took 1078 ms. Trace:
I20260709 13:03:05.548849  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:05.535100 13278 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:05.550601  8386 rpcz_store.cc:276] 0709 13:03:04.471455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.471606 (+   151us) service_pool.cc:224] Handling call
0709 13:03:04.472040 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:04.555133 (+ 83093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.549971 (+994838us) spinlock_profiling.cc:243] Waited 82.4 ms on lock 0x7b540026a054. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:05.550168 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189521664}
I20260709 13:03:05.510919 13322 consensus_queue.cc:1059] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:03:05.553776  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:05.537376 13213 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:05.581677  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:05.582320  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:05.582561  8531 raft_consensus.cc:2393] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 11: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:05.585392  8500 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:05.595227  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:05.537961 13096 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.596223  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:05.599301  8533 raft_consensus.cc:2393] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 13: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:05.574119 13213 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:05.601495  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 84671.6us
I20260709 13:03:05.570411 13276 raft_consensus.cc:697] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:05.606396  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:05.602769  8349 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:05.602922  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:05.574105 13278 raft_consensus.cc:697] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:05.619735 13258 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.572009 13257 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:05.628931  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:05.629897  8533 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:03:05.634035 13348 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:05.635689  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:05.605626 13276 consensus_queue.cc:237] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:05.611899 13324 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:05.607237 13322 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:05.665887  8386 raft_consensus.cc:1240] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:03:05.666010 13158 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.666074 13322 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.667093  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:05.668205 13158 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:05.668272 13322 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:05.668736  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:05.668949  8531 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:03:05.670863  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:05.671651  8456 raft_consensus.cc:1240] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:05.672947  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:05.636896  8533 raft_consensus.cc:1240] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:03:05.641609 13346 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:05.629415 13269 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:05.651235 13336 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:03:05.651806 13161 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:05.653211 13278 consensus_queue.cc:237] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:05.656688 13324 raft_consensus.cc:697] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:05.627871 12873 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:05.658437 13258 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:05.600050 13292 consensus_queue.cc:237] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:05.662309 13231 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:05.665488 13257 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:05.675552  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:03:05.651924 13345 log.cc:927] Time spent T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:03:05.651254 13342 log.cc:927] Time spent T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:03:05.680641  8534 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 10. Current term is 11. Ops: [9.5-10.6]
I20260709 13:03:05.683107 13096 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:05.674724 13346 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.685889 13262 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.702020 13346 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:05.721901 13096 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:05.724190 13096 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.697044 13161 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:05.732538  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:05.738420  8527 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:03:05.702816 13257 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:05.760232 13288 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.720466 13262 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.781054  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:05.750209 13161 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.726099 13266 raft_consensus.cc:3055] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:05.749740 13324 consensus_queue.cc:237] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:05.767413 13213 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:05.769642 13276 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:05.770553 13284 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:05.774294  9260 leader_election.cc:400] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 14. Current term is 15.
I20260709 13:03:05.739715 13270 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:05.795753  9260 leader_election.cc:403] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:03:05.774775 13064 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:05.777535  8384 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:03:05.775750 13283 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:05.779197  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:05.791910  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:05.793897  8452 raft_consensus.cc:1240] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:03:05.798409  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:05.801695  8455 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:03:05.777890 13257 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.789578 13266 raft_consensus.cc:740] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:05.806458  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:05.807947 13341 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:05.805439 13257 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:05.808094  8378 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:05.809803 13161 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:05.810672  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:05.818102  9296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 1058) took 1203 ms. Trace:
I20260709 13:03:05.818527  9296 rpcz_store.cc:276] 0709 13:03:04.615074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.693870 (+ 78796us) service_pool.cc:224] Handling call
0709 13:03:04.694166 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.740057 (+ 45891us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.740091 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.740149 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:04.740181 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.817879 (+1077698us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b54004ec854. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:05.817924 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.818045 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105086336}
I20260709 13:03:05.830008  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:05.830363  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:05.830744  8384 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:05.831878  8384 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:05.835533  8378 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:05.795027 13096 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:05.842909 13283 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:05.931034 13283 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:05.934238 13288 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:05.934763 13355 log.cc:927] Time spent T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:03:05.801591 13276 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:05.938678 13276 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:05.804553 13266 consensus_queue.cc:260] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:05.961720 13262 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:05.993224 13262 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:05.993832 13262 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:05.994146 13213 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:05.995951 13270 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:05.998013  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:06.000721  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:06.011013  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:06.011844  8384 raft_consensus.cc:2368] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 14. Current term is 15.
I20260709 13:03:06.012948  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:06.013839  8380 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:03:06.015373  8380 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:06.019629  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:06.020561  9296 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:03:06.022991  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:06.023972  9296 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 9: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:06.026198  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:06.027846  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:06.029136  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:06.029966  9290 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:03:06.030457  8379 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:03:06.027109  9295 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:03:06.027679  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:06.028594  9288 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:06.034482  9287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 1053) took 1874 ms. Trace:
I20260709 13:03:06.002348  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:05.976238 13283 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:06.035048  9287 rpcz_store.cc:276] 0709 13:03:04.161619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.511960 (+350341us) service_pool.cc:224] Handling call
0709 13:03:04.660772 (+148812us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.665921 (+  5149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.034210 (+1368289us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400047750. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:06.034404 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341481344}
I20260709 13:03:05.995978 13262 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:06.048190  9288 raft_consensus.cc:1217] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[7.7-12.10]   Dedup: 7.7->[8.8-12.10]
I20260709 13:03:06.048753  9288 pending_rounds.cc:85] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting all ops after (but not including) 7
I20260709 13:03:06.049008  9288 pending_rounds.cc:107] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:03:06.049283  9288 raft_consensus.cc:2889] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:06.049021  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:06.047435  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:06.051247  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:06.029425 13266 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:06.067754  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:06.068558  8378 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:03:06.075263 12873 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:06.075882 12873 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:06.077611  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:06.078105 12873 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:06.079316 13189 raft_consensus.cc:3055] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:06.079741 13189 raft_consensus.cc:740] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:06.036407 13325 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.086410  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:06.028867 13267 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:06.088804  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:06.094250  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:06.095219  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:05.980288 13346 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:06.039814 13341 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 14. Current term is 15.
I20260709 13:03:06.106967  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:06.106948  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:06.117262 13278 consensus_queue.cc:1059] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:06.118372  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:06.120743  8427 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:06.124112  8427 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:06.125308 13284 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:06.126006 12873 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:06.126611 12873 raft_consensus.cc:697] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:06.126289 13158 consensus_queue.cc:1059] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:06.127507 12873 consensus_queue.cc:237] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:06.127882 13158 consensus_queue.cc:1059] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:06.129555 13271 raft_consensus.cc:3055] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:06.129922 13271 raft_consensus.cc:740] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:06.117699 13213 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:06.140985  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:06.144786  8534 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
W20260709 13:03:06.145229  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 99256.6us
W20260709 13:03:06.112565 13305 log.cc:927] Time spent T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:03:06.149489  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:06.151265  8528 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:06.080591 13189 consensus_queue.cc:260] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:06.161057  9287 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
W20260709 13:03:06.162886 13318 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.898s	user 0.000s	sys 0.003s
W20260709 13:03:06.163645 13358 log.cc:927] Time spent T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 13:03:06.214553  8411 heartbeater.cc:646] Failed to heartbeat to 127.7.25.254:44471 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.7.25.254:44471 timed out after 15.000s (SENT)
I20260709 13:03:06.113667 13267 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:06.217347 13167 raft_consensus.cc:3055] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:06.217808 13167 raft_consensus.cc:740] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:06.218175 13267 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:06.113490 13325 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:06.165060 13363 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:03:06.168375 13154 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:06.150822 13213 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:06.126068 13284 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:06.232789  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 108730us
I20260709 13:03:06.220181 13317 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:06.235909  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 102890us
I20260709 13:03:06.221432 13189 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:06.130650 13271 consensus_queue.cc:260] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:06.231637 13158 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:03:06.270887  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.273208 13341 consensus_queue.cc:1059] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:03:06.279357 13352 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.668s	user 0.008s	sys 0.004s
I20260709 13:03:06.281234 13312 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:06.281868 13312 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:06.283499 13314 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.284037 13312 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:06.284626 13312 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:06.291051 13317 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:06.254724  9261 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:06.293990 13317 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:06.294318 13275 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:06.234748 13340 log.cc:927] Time spent T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.660s	user 0.000s	sys 0.014s
I20260709 13:03:06.218669 13167 consensus_queue.cc:260] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:06.297814  9261 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:06.298795  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 44552.2us
I20260709 13:03:06.305634  9261 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:06.253547 13339 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:06.297562 13372 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:06.307611 13141 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:06.285069 13312 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:06.338406 13312 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:06.346251  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 1020) took 1268 ms. Trace:
I20260709 13:03:06.349663  8349 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:06.346819  8532 rpcz_store.cc:276] 0709 13:03:05.078047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.099272 (+ 21225us) service_pool.cc:224] Handling call
0709 13:03:05.099604 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:05.317436 (+217832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.317477 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:05.327890 (+ 10413us) log.cc:844] Serialized 26 byte log entry
0709 13:03:05.406143 (+ 78253us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:05.406194 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.046322 (+640128us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:06.286222 (+239900us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54002b9154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:06.286288 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:06.344086 (+ 57798us) raft_consensus.cc:1685] finished
0709 13:03:06.344107 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.346188 (+  2081us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31769,"raft.queue_time_us":11057,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":6475,"spinlock_wait_cycles":347146880,"thread_start_us":131177,"threads_started":2,"wal-append.queue_time_us":199115}
I20260709 13:03:06.353327  8379 raft_consensus.cc:3055] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:06.315635 13339 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:06.353698  8379 raft_consensus.cc:740] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:06.355993  8349 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:06.366262  8349 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:06.362634  8386 raft_consensus.cc:1240] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:06.369697  9289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 663) took 2197 ms. Trace:
I20260709 13:03:06.369982  8381 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:06.348729 13267 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:06.370162  9289 rpcz_store.cc:276] 0709 13:03:04.167036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.167213 (+   177us) service_pool.cc:224] Handling call
0709 13:03:04.650869 (+483656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.667645 (+ 16776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.362447 (+1694802us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b5400708fd0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:06.364247 (+  1800us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1068269312}
I20260709 13:03:06.371436  8501 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:06.364807  8379 consensus_queue.cc:260] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:06.375964  8379 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.376426  8501 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:06.372620  8382 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:06.375579 12877 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:06.354506 13331 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:06.378212  8349 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:06.380002  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 59981.1us
I20260709 13:03:06.384239 13016 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:06.350090 13141 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:03:06.370340 12802 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:06.372433 13341 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.380496 13379 consensus_queue.cc:1059] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:03:06.388727 13341 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:06.377539 13267 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:06.390988 13341 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:06.384413  9261 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:06.370455 13346 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:06.393318  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.391428 13267 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:06.381858 13312 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:06.397825  8349 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:06.381597 13373 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:06.432181  9261 leader_election.cc:400] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 14. Current term is 15.
I20260709 13:03:06.394713 13265 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:03:06.433367 13335 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:06.439990  8379 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:06.392570 13381 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:06.391618 13154 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:03:06.453502 13376 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:03:06.428151 13375 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:06.447144  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:06.437150 13335 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:06.459712  8379 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:03:06.461263  9287 raft_consensus.cc:2410] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:03:06.457396  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:06.392692 13317 consensus_queue.cc:1059] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:03:06.397151 13377 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:03:06.467193 13377 consensus_queue.cc:1243] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer d653e71832b7402b9a03b46249d3b885 log is divergent from this leader: its last log entry 11.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:06.467484 13339 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:06.456696 13381 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:06.470610 13381 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:06.472105  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:06.434288 13141 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:03:06.472657  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:06.473399  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:06.473954  9289 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:06.474869  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:06.475021  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:06.475420  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:06.476751  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:06.477368  9294 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:06.477921  9287 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:03:06.478293  9287 pending_rounds.cc:85] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting all ops after (but not including) 10
I20260709 13:03:06.478516  9287 pending_rounds.cc:107] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:03:06.478719  9287 raft_consensus.cc:2889] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:06.481643  8379 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:06.451871 13284 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:06.491086  8426 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:06.492657  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:06.499630  8426 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:06.460260 13375 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.505136  9289 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:06.511830  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:06.512080  8426 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:06.506770  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:06.512936 13265 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:06.507714  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:06.513417  9291 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:03:06.507663  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:06.509210  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:06.507016  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:06.463835 13213 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:06.515467  9289 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 16. Current term is 17. Ops: [16.15-16.15]
I20260709 13:03:06.518744  9292 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:06.513514 13265 raft_consensus.cc:697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:06.487195 13335 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:06.525146 13265 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:06.529855 13378 log.cc:927] Time spent T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:03:06.515384 13189 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:06.533492 13189 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:06.533984 13189 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:06.536614 13335 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:06.538977 13335 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:06.540477 13275 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.540953 13275 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:06.543366 13275 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:06.515429 13375 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:06.510846 13284 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:06.514662 13324 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:03:06.551721 13375 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:06.553294  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:06.554771  9296 raft_consensus.cc:2368] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10.
I20260709 13:03:06.555584 13335 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.556139 13335 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:06.558051  8456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 902) took 1217 ms. Trace:
I20260709 13:03:06.554509 13375 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:06.558460  8456 rpcz_store.cc:276] 0709 13:03:05.340399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.340538 (+   139us) service_pool.cc:224] Handling call
0709 13:03:05.346464 (+  5926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.671942 (+325478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.557798 (+885856us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b540041a854. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:06.557970 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":747451776}
I20260709 13:03:06.559722 13335 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:06.560951 13267 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:06.563198 13383 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:06.563759 13383 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:06.565549  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:06.566689  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:06.568573  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:06.569044  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:06.569587  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:06.570763  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:06.571382  8461 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:03:06.573658  8351 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:06.577597  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:06.580734  8351 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:06.583722  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:06.584527  8377 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:06.586979  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:06.588220  8351 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:06.577795 13016 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.598548  8351 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:06.577452 13323 raft_consensus.cc:3055] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:06.580463 13213 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.604354  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:06.612671  8378 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:06.607672  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:06.586894 13304 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:06.583343 13154 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:03:06.630851  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.615451  8377 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:03:06.588904 13270 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:06.625599  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:06.626562  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:06.635098  8461 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:03:06.597867 13275 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:06.637171  8382 raft_consensus.cc:2393] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 12: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:03:06.622316 13389 log.cc:927] Time spent T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:03:06.601758 12802 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:06.602660 13323 raft_consensus.cc:740] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:06.641896 13383 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:06.645638  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:06.646498  8382 raft_consensus.cc:2393] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 12: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:06.629474 13304 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:06.630051 13154 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:06.640333 12873 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:06.615202 13331 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:03:06.615036 13327 consensus_queue.cc:1059] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
W20260709 13:03:06.659098  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.642087 13055 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:06.655128 13154 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:06.654932 13267 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:06.654347 13304 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:06.622707 13213 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:06.610486 13016 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:06.660887  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:06.677071 13262 consensus_queue.cc:1059] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:06.679606 13262 consensus_queue.cc:1059] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:06.680924 13375 raft_consensus.cc:3055] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:06.681419 13375 raft_consensus.cc:740] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:06.682619 13375 consensus_queue.cc:260] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:06.687335  8377 pending_rounds.cc:85] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 4
I20260709 13:03:06.687759  8377 pending_rounds.cc:107] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260709 13:03:06.688048  8377 raft_consensus.cc:2889] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:06.690692  8384 raft_consensus.cc:1240] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:03:06.690869  8378 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:03:06.692319  8382 raft_consensus.cc:2393] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 7: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:06.695043  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:06.697471  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:06.698338  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:06.701676  9290 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:03:06.707351 13270 raft_consensus.cc:697] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:06.707937  9260 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:06.709535 13267 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:06.709656 13270 consensus_queue.cc:237] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:06.671401 13189 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:06.660343 12873 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:06.662223 13055 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:06.726517  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:03:06.729688  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.730459  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:06.731457  8461 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:06.733202  8454 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:06.735031  8351 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:06.698709 13373 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:03:06.735658  8461 raft_consensus.cc:1240] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:06.752768  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:06.753517  8461 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:06.754485  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:06.755191  8461 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:03:06.756268  8455 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 16: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:06.756541  8461 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:06.756964  8527 raft_consensus.cc:1217] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Deduplicated request from leader. Original: 7.8->[9.9-13.11]   Dedup: 11.10->[13.11-13.11]
I20260709 13:03:06.757545  8527 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14. Ops: [9.9-13.11]
I20260709 13:03:06.736495  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:06.738029 13158 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:06.740134 13325 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:06.740200  8454 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:06.741221  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:06.742471  8460 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:06.696020 13323 consensus_queue.cc:260] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:06.743166 13167 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.743521  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:06.768500 13323 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:06.744544 13213 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:06.744838  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:06.746241  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:06.747718  8459 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 16. Current term is 17. Ops: [16.15-16.15]
I20260709 13:03:06.751428  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:06.734122 13384 log.cc:927] Time spent T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:03:06.762697  8532 raft_consensus.cc:1275] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:06.772583  8535 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 8.
I20260709 13:03:06.774719 12873 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:06.757829 13391 log.cc:927] Time spent T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:03:06.795164  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:06.801429 13375 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.809240 13158 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:06.819069  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.820302  8535 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:06.820719  8384 raft_consensus.cc:1240] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:06.823309  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:06.823918  8529 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:03:06.839493 13331 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:06.754030 13377 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:06.847525  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:06.848429  8528 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:03:06.763355 13315 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:06.860731  8529 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:03:06.867015  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:06.868417  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:06.872993  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:06.898923  8535 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:06.902525  9258 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:06.861697 13377 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:06.910907  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:06.915174  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 197097us
I20260709 13:03:06.865873 13315 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:06.909937 13081 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:06.927892 13377 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:06.934118  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:06.936573  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.924547  9258 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:06.916481 13016 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:06.909822 13273 consensus_queue.cc:1048] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:03:06.947841 13273 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:06.948357 13273 raft_consensus.cc:697] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:06.910125 13155 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:03:06.952111 13135 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.954545 13055 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:06.941479 13189 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:06.941852 13377 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.960273 13377 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:06.962255 13377 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:06.938501  9260 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:06.975237  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:06.976639  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:06.977036  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38894 (request call id 2680) took 1385 ms. Trace:
I20260709 13:03:06.976022  9292 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:03:06.978909  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:06.935321 13401 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:06.977499  8531 rpcz_store.cc:276] 0709 13:03:05.586191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.602674 (+ 16483us) service_pool.cc:224] Handling call
0709 13:03:06.971783 (+1369109us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x7b540024c2d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:06.971903 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140848512}
I20260709 13:03:06.946290  9258 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:06.811198 13379 consensus_queue.cc:1175] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d653e71832b7402b9a03b46249d3b885" responder_term: 13 status { last_received { term: 11 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13. Ops: [12.7-12.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:06.989228  8531 raft_consensus.cc:1240] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:06.990217  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:06.990353  9258 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:06.989605  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:07.002246  8526 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:06.978785 13333 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:07.014858  8532 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:06.975539 13154 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:06.986054 13325 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.019950  8426 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:07.030777  8526 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:03:07.037827  8380 raft_consensus.cc:1240] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13. Ops: []
W20260709 13:03:07.042651  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 57139us
I20260709 13:03:07.057101 13271 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:07.058655 13154 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:07.061709  9288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 721) took 1014 ms. Trace:
I20260709 13:03:07.062608 13304 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.064967 13304 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:07.040923 13016 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:07.066332 13016 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.066717 13016 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.062117  9288 rpcz_store.cc:276] 0709 13:03:06.047451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.047577 (+   126us) service_pool.cc:224] Handling call
0709 13:03:06.047944 (+   367us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:03:06.090843 (+ 42899us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:06.090893 (+    50us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:03:06.791092 (+700199us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b2c00047b98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2
0709 13:03:06.791925 (+   833us) log.cc:844] Serialized 78 byte log entry
0709 13:03:07.004805 (+212880us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:07.004841 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.005580 (+   739us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:07.061367 (+ 55787us) raft_consensus.cc:1685] finished
0709 13:03:07.061388 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.061609 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2335,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":85,"spinlock_wait_cycles":30787840,"thread_start_us":212419,"threads_started":1,"wal-append.queue_time_us":261226}
I20260709 13:03:07.070767 13055 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:07.071189 13324 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:07.071717 13324 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:07.075554  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:07.076690  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:07.077781  9295 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:07.078567  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:07.079643  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:07.080597  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:07.081418  8461 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:06.990237 13273 consensus_queue.cc:237] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.078013  8456 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:03:07.093912  8460 raft_consensus.cc:1240] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:03:07.095585  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:07.105680  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:07.048197 13341 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:03:07.082669  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 347702us
I20260709 13:03:07.117908  8351 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:07.121192  8351 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:07.133685  8351 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:07.139945  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.136979  8461 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
W20260709 13:03:07.143122  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 57980.8us
I20260709 13:03:07.126626 12845 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:07.129526 13304 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:07.119189 13339 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:07.138442 13396 log.cc:927] Time spent T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:03:07.145098  8424 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:07.136138 13055 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.136337 13315 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:07.137831 13395 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.149124  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:07.143666 13374 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.156277 13395 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.141526 13405 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:03:07.147688 13411 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:07.172338 13411 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:07.172766 13411 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.173028 13395 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:07.174085 12845 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:07.169988 13270 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:07.170193 13374 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.176353 13331 raft_consensus.cc:3055] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:07.176776 13331 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:07.177773 13374 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:07.177552 13331 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:07.153553 13339 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:07.180552  8424 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:07.166399 12873 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:07.185281  8424 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:07.188243 13395 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:07.188670  8424 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:07.188755 13250 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:07.187665  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:07.168685 13324 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:07.169556 13328 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:07.191134  8351 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:07.181721 13399 log.cc:927] Time spent T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260709 13:03:07.195214  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.196164 13189 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:07.186404 13026 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:07.202896 13339 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:07.197885 13304 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.213742 13154 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:07.192420 12845 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:07.214344 13154 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:07.194240 13395 consensus_queue.cc:1059] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:03:07.215571 13395 raft_consensus.cc:3055] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:07.215914 13395 raft_consensus.cc:740] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:07.216574 13154 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:07.216674 13395 consensus_queue.cc:260] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.217962 13395 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.165498 13055 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.221273 13154 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.221877 13154 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.222934 13055 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:07.197769 13267 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.224121 13267 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.225337 13154 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:07.226454 13267 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:07.196761 13331 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:07.197948 13328 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:07.195369  8351 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:07.234318  8351 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:07.234681 12845 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:07.235360 13154 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:07.235965 13154 consensus_queue.cc:1059] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:07.236663 13154 consensus_queue.cc:1243] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer 105d6581548546b98eddd4ee7083bb12 log is divergent from this leader: its last log entry 17.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:03:07.239840  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:07.241873 12845 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:07.242442 12845 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:07.245008 12845 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:07.245901 13158 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.247026  8457 raft_consensus.cc:1240] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14. Ops: []
W20260709 13:03:07.241932 13387 log.cc:927] Time spent T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.588s	user 0.003s	sys 0.000s
I20260709 13:03:07.249769 13158 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:07.254854  8458 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:07.194998  8424 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:07.256037 13374 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:03:07.256186  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 63123.5us
I20260709 13:03:07.256840 13249 raft_consensus.cc:3055] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:07.256979  8424 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:07.257269 13249 raft_consensus.cc:740] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:07.258471 12802 raft_consensus.cc:3055] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:07.258157 13249 consensus_queue.cc:260] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.258832 12802 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:07.259251 13249 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:07.259728 12802 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.262349 13021 raft_consensus.cc:2764] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:03:07.262255 13016 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.257938  8424 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:07.264744 13016 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:07.265774 13016 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:07.266362 13016 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:07.272154 13016 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:07.278908 13386 log.cc:927] Time spent T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.627s	user 0.000s	sys 0.004s
I20260709 13:03:07.279085  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:07.279407  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:07.279686  9295 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.280174  9289 raft_consensus.cc:2393] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 12: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:07.282568 13262 raft_consensus.cc:3055] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:07.282642  8455 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:03:07.283087 13262 raft_consensus.cc:740] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:07.284026 13262 consensus_queue.cc:260] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.285535  8455 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:03:07.288066  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:07.288254  9260 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:07.289354  9295 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:07.290083  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:07.266489  8424 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:07.270170  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:07.270569  9288 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:03:07.291038  9288 pending_rounds.cc:85] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting all ops after (but not including) 8
I20260709 13:03:07.291271  9288 pending_rounds.cc:107] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:03:07.291492  9288 raft_consensus.cc:2889] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:07.271121  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:07.292438  9290 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:07.262627 12802 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:07.293849  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:07.294214  8426 leader_election.cc:400] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10.
W20260709 13:03:07.297251  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.235994 13328 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:07.299275  9292 raft_consensus.cc:2410] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:03:07.300971 13374 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.301476 13374 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:07.303514 13374 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:07.304132  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:07.299542 13379 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:07.305568 13379 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:07.307614 13379 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:07.272756 12262 raft_consensus.cc:3055] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:07.308194 12262 raft_consensus.cc:740] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:07.309027 12262 consensus_queue.cc:260] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:06.076094  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:07.309595 13275 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:07.310249 13064 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:07.310478 13275 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:07.311137  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 44730us
I20260709 13:03:07.311859  8424 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:07.312582 13275 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:07.313239 13266 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:07.290182 13272 consensus_queue.cc:1059] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:03:07.314061 12877 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.314723 12877 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:07.315003  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:07.315775  8457 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 14: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:07.316840 12877 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:07.314069 13266 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:07.314141 13272 raft_consensus.cc:3055] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:07.318980 13272 raft_consensus.cc:740] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:03:07.319934  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.319765 13272 consensus_queue.cc:260] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.320528  8351 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:07.320886 13272 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:07.321161 13372 consensus_queue.cc:1175] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d653e71832b7402b9a03b46249d3b885" responder_term: 13 status { last_received { term: 13 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 13 index: 11 } }
I20260709 13:03:07.310048 12262 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.325435 13304 consensus_queue.cc:1059] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:07.326331 13304 raft_consensus.cc:3055] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:07.326602  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:07.327262  9292 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:03:07.327977  9290 raft_consensus.cc:1240] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:07.328137 12877 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:07.328553 12877 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.326649 13304 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:07.328933 12877 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:07.329833 13304 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:07.330991 13304 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.335421  8351 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:07.335690  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:07.336511  8379 raft_consensus.cc:1240] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:07.341869  8380 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:03:07.342243  8380 pending_rounds.cc:85] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 5
I20260709 13:03:07.342444  8380 pending_rounds.cc:107] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:03:07.342676  8380 raft_consensus.cc:2889] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:07.342623 13275 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:07.343447 13275 raft_consensus.cc:697] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:07.343711  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:07.344573  8381 raft_consensus.cc:2393] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 13: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:07.344424 13275 consensus_queue.cc:237] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.346115  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:07.347754  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:07.349574  8381 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260709 13:03:07.350925  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 52431.5us
I20260709 13:03:07.355216  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:07.357162  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:07.357388  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:07.358374  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:07.359472  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:07.360576  8383 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:07.364408  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:07.365316  8535 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:07.366504  8378 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:07.367430  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:07.367847  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:07.367985  8378 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:03:07.369102  8378 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:07.369282  8500 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:07.370256  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:07.371364  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:07.372115  8535 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:03:07.373571  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:07.374379  8531 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
I20260709 13:03:07.354671  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:07.377501  8384 raft_consensus.cc:2393] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 12: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:07.378970  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:07.380079  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:07.380615  8386 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:07.364795  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:07.382388  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 81530us
I20260709 13:03:07.382735  8383 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:07.385937  8377 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:07.388818  8500 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:07.398056  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:07.398821  8380 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:03:07.398949  8426 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:07.399605  8384 raft_consensus.cc:1240] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12. Ops: []
W20260709 13:03:07.398988  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 46779.1us
I20260709 13:03:07.401783  8500 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:07.402961  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:07.403164  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:07.402987  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:07.409150  8529 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:07.410616  8532 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:07.412686  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:07.377758 13262 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:07.398854 13322 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:07.415412  8528 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:03:07.417590  8281 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53486 (request call id 346) took 47000 ms (client timeout 15000 ms). Trace:
I20260709 13:03:07.421267 13026 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:07.439637  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:07.424218  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:07.443207  8529 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:07.426237  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:07.427203  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:07.413641  8533 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:07.428941  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:07.432315  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:07.387734 13328 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:07.425856  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:07.446152  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:07.447582  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:07.466600  8501 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:07.467208  8458 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:03:07.430738  8280 catalog_manager.cc:5697] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 10 to 11, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 11 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:07.450300  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:07.450662  8379 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 15. (term mismatch)
I20260709 13:03:07.471196  8379 pending_rounds.cc:85] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 14
I20260709 13:03:07.471024  9261 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:07.471577  8379 pending_rounds.cc:107] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 16.15
I20260709 13:03:07.471884  8379 raft_consensus.cc:2889] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:07.413237 13315 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:07.451709 13375 consensus_queue.cc:1059] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:07.451985  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:07.452560 13016 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.453249 13372 consensus_queue.cc:1059] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:07.442898 13064 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:07.457309 13415 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:07.458105 13213 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.459409  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:07.459743  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:07.483140  8457 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:07.460019 13417 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:03:07.460711  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:07.413065 13265 consensus_queue.cc:1059] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:03:07.464005  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:07.465006  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:07.377103 13249 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:03:07.408687 13339 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:07.466536  8377 raft_consensus.cc:2393] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 16: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:07.494328 13339 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:07.471071  9290 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:07.494774 13339 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:07.489626 13304 consensus_queue.cc:1059] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:03:07.496093 13304 raft_consensus.cc:3055] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:07.496553 13304 raft_consensus.cc:740] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:07.497946 13304 consensus_queue.cc:260] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.472602  9261 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:07.498783 13016 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:07.432267 13323 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
W20260709 13:03:07.437326  8281 rpcz_store.cc:269] 0709 13:02:20.417029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.461503 (+ 44474us) service_pool.cc:224] Handling call
0709 13:03:07.417473 (+46955970us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:00.366758 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:00.368684 (+  1926us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:00.368754 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:03:00.368798 (+    44us) tablet.cc:662] Decoding operations
0709 13:03:00.369988 (+  1190us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:00.370083 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:00.370111 (+    28us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:03:00.371043 (+   932us) tablet.cc:701] Row locks acquired
0709 13:03:00.371101 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:03:00.371347 (+   246us) write_op.cc:270] Start()
0709 13:03:00.371528 (+   181us) write_op.cc:276] Timestamp: P: 1783602180371265 usec, L: 0
0709 13:03:00.371551 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:03:00.575210 (+203659us) log.cc:844] Serialized 3656 byte log entry
0709 13:03:01.181229 (+606019us) spinlock_profiling.cc:243] Waited 7.55 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c537b0ac 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b
0709 13:03:01.593892 (+412663us) op_driver.cc:464] REPLICATION: finished
0709 13:03:01.636571 (+ 42679us) spinlock_profiling.cc:243] Waited 7.81 ms on lock 0x7b540014ebd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8480e28 00007f36cbebb581 00007f36cbebad58 00007f36cbebf9f1 00007f36cbebf9a9 00007f36cbebf939 00007f36cbebf901 00007f36cbebeb2d 000000000038f354 000000000038f199
0709 13:03:02.296650 (+660079us) write_op.cc:301] APPLY: starting
0709 13:03:02.296764 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:02.638508 (+341744us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:02.638549 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:02.976693 (+338144us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:02.977012 (+   319us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:03:02.977062 (+    50us) write_op.cc:312] APPLY: finished
0709 13:03:03.025789 (+ 48727us) log.cc:844] Serialized 89 byte log entry
0709 13:03:03.026020 (+   231us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:03.026137 (+   117us) write_op.cc:454] Released schema lock
0709 13:03:03.026207 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:03.026629 (+   422us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:03.026657 (+    28us) write_op.cc:454] Released schema lock
0709 13:03:03.358201 (+331544us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b18000b9c80. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c5398522 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
Metrics: {"mutex_wait_us":2190070,"reported_tablets":48,"spinlock_wait_cycles":3840,"child_traces":[["op",{"apply.queue_time_us":702445,"apply.run_cpu_time_us":51185,"apply.run_wall_time_us":729965,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41783,"num_ops":9,"prepare.queue_time_us":299636,"prepare.run_cpu_time_us":30256,"prepare.run_wall_time_us":1270068,"raft.queue_time_us":284578,"raft.run_cpu_time_us":18329,"raft.run_wall_time_us":291992,"replication_time_us":1212899,"spinlock_wait_cycles":74698880,"thread_start_us":1376168,"threads_started":4,"wal-append.queue_time_us":965329,"wal-append.run_cpu_time_us":37899,"wal-append.run_wall_time_us":2200505}]]}
I20260709 13:03:07.499524 13304 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.499853  9261 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:07.500206 13377 consensus_queue.cc:1059] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:07.501130 13381 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:07.501159  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:07.501734 13381 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.501859 13377 raft_consensus.cc:3055] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:07.477263 13379 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:07.502180 13381 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:07.502555 13379 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.462970  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:07.503011 13379 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:07.477787 12845 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:07.454785  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:07.483249  8459 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:07.493876 13372 raft_consensus.cc:3055] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:07.517500  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:07.493489 12877 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.471295 13374 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:07.525313 13374 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.481106 13267 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:03:07.468729 13328 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:07.492744 13266 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:07.512725 13372 raft_consensus.cc:740] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:07.512667 12802 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.502296 13377 raft_consensus.cc:740] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:07.466460 13314 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:03:07.529563  8424 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:07.506244 13273 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.496135  8280 catalog_manager.cc:5697] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 7 to 10, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 10 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:07.476151 13322 consensus_queue.cc:1059] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 13:03:07.563761  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 164860us
I20260709 13:03:07.526902 13064 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.528237 13341 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:07.489653 13395 consensus_queue.cc:1059] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:03:07.527721 13374 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:07.558636  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 147782us
I20260709 13:03:07.505364 12845 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.539847 13328 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.491418 13213 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:07.539891 12874 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:03:07.558765 13314 consensus_queue.cc:1243] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer 446d9310dce14ff4afff2dc2d64f68d8 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:03:07.568866  9292 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:03:07.569908  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:07.553661  8424 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:07.513687  8351 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:07.561712 13292 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:07.584893  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 71270us
I20260709 13:03:07.571597 13341 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.558525 12802 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:07.597903  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:07.598551  8459 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:03:07.599337  8427 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:07.600014  8351 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:07.602458 13417 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:07.602536 13189 consensus_queue.cc:1059] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:07.603330 13417 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:07.604671 13417 raft_consensus.cc:3055] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:07.588415 13270 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:07.605475 13270 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:07.605863 13270 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.591077 13377 consensus_queue.cc:260] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.600899 13395 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:07.568652 13284 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:03:07.596922 12802 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:07.586455 13292 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.588195 13278 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:07.577073 13369 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:07.592484 13341 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.580256 13411 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:07.605011 13417 raft_consensus.cc:740] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:07.584710 12873 consensus_queue.cc:1059] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 13:03:07.650914  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 74160.4us
I20260709 13:03:07.588541 13315 consensus_queue.cc:1059] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:03:07.655598  8379 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:07.636870 13395 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.642454 13292 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:07.655581 13377 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.685647 13135 consensus_queue.cc:1059] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:07.690843 12845 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:07.647755 13278 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:07.693002  8378 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:07.695091  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:07.691756 13411 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:07.696696  8379 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:07.697329  8426 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:07.700158  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 61347us
W20260709 13:03:07.709251  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.696775 13420 log.cc:927] Time spent T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:03:07.694319 13395 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:07.633448 13372 consensus_queue.cc:260] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:07.719549  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 61589.7us
I20260709 13:03:07.706212 13278 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:07.720489  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 152957us
I20260709 13:03:07.719558 13272 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:03:07.724753 13374 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.730105 13417 consensus_queue.cc:260] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.701071 12262 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:03:07.736150 12873 raft_consensus.cc:3055] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:07.736637 13285 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:07.737530 13158 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:07.737845  8427 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:07.701735 13314 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:07.650542 13369 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:07.745477  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 270374us
W20260709 13:03:07.746009  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 280717us
I20260709 13:03:07.746325  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:07.747313  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:07.760553  8459 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.761214  8461 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:07.748411  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:07.762228  8452 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:07.689064 13381 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.758482 13435 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:07.762320  8351 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:07.763370  8349 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:07.774678  9289 raft_consensus.cc:1240] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:03:07.775418  9288 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:07.772379 13411 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:07.776600 12877 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:07.776788 13372 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:07.778396 13333 raft_consensus.cc:3055] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:07.778825 13333 raft_consensus.cc:740] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:07.779747 13333 consensus_queue.cc:260] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.780826 13270 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.764976 13314 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:07.782913 13270 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:07.772576 13021 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:07.771411 13417 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.772585 13435 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:07.784801 13381 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:07.782924 13314 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:07.785595  9296 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15. Ops: [12.11-14.12]
I20260709 13:03:07.774523  8349 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:07.750801 12873 raft_consensus.cc:740] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:07.789858  8454 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:07.794251  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:07.817972 12873 consensus_queue.cc:260] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:07.819314 12873 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:07.785431 13339 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.823549 13270 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:07.824182 13270 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:07.824040 12877 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:07.824672 13270 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:07.820689 13341 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.827688  9292 raft_consensus.cc:1240] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:03:07.811089 13422 log.cc:927] Time spent T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:03:07.811872  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:07.814532 13328 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:07.816409 13379 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:07.816881  8349 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:07.823741 13339 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:07.804757  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.835543  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:07.838088  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:07.862053  8386 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:07.862062  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 93295.6us
I20260709 13:03:07.863580  8427 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:07.873924  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:07.874342  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:03:07.853574  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 93706.1us
I20260709 13:03:07.876438  8501 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:07.852531  8452 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:03:07.772785 12845 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:07.874611  9288 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:03:07.854338  8459 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:07.940914  9288 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
W20260709 13:03:07.971007  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 154192us
W20260709 13:03:07.977191  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 102127us
I20260709 13:03:08.115177  8349 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:08.117070  9261 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:07.980415  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.074800 13435 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:08.020116  8280 catalog_manager.cc:5697] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 9 to 11, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 11 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.122473  8531 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:08.122776  8280 catalog_manager.cc:5697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 11 to 12, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 12 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:08.125917 13328 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:08.126027 13016 consensus_queue.cc:1059] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:07.847898 13333 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:08.096649 13369 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:08.102133 13262 consensus_meta.cc:287] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.000s
I20260709 13:03:08.137892 13379 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:07.982635  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 106266us
I20260709 13:03:07.983525  8533 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:07.996032  8351 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:07.994304 13339 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:07.845611 13341 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:08.003921  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 140420us
I20260709 13:03:08.144122 12873 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:07.971513 13309 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:08.086616 13292 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.145793 13309 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:08.146186 13309 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.146515 13309 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:08.147013 13292 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:08.147673 13374 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:08.150631  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:08.151420  8535 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 15: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:03:08.152748 13441 log.cc:927] Time spent T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:03:08.154824 13395 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.158160 13270 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.160465 13270 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:08.161361 13270 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:08.011672  8386 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
W20260709 13:03:07.999506 13422 log.cc:927] Time spent T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:03:07.982761 13213 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:07.999326 13026 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.859133 13055 consensus_queue.cc:1059] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.148s
I20260709 13:03:08.001906 13275 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:08.009407 13424 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.357s	user 0.001s	sys 0.001s
I20260709 13:03:07.977191 13284 consensus_queue.cc:1059] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:03:08.009289 13324 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:08.013130 12802 consensus_queue.cc:1059] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:03:08.061743 13323 raft_consensus.cc:3055] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:08.103929 13307 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:08.214905  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:08.109251 12877 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:08.164752  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.169229  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:08.010049  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 160799us
I20260709 13:03:08.182374  8383 raft_consensus.cc:1240] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:03:08.197474  9295 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:03:08.156952 13395 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:08.215523  8386 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:08.180701 13381 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:08.224486  8500 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:08.206657 13064 consensus_meta.cc:287] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.635s	user 0.005s	sys 0.005s
I20260709 13:03:08.199414 13341 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.234166  8500 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:08.245023  8500 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:08.245277 13341 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.245868 13315 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:08.246554 13315 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:08.246616  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:08.247529 13341 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:08.248075  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:08.248257 13064 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:08.243813 13213 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:08.249857 13435 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:08.124778  8280 catalog_manager.cc:5697] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 6 to 15, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 15 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.253448  9290 raft_consensus.cc:1240] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:08.258234  8500 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:08.259943  8500 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:08.261013 13435 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:08.261795 13434 log.cc:927] Time spent T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.241s	user 0.005s	sys 0.005s
I20260709 13:03:08.262157 13189 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.262650 13189 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:08.263202 13278 consensus_meta.cc:287] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 13:03:08.263640 13278 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.265400 13189 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:08.265988 13438 log.cc:927] Time spent T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:03:08.211732 13323 raft_consensus.cc:740] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:08.199051 13026 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.267944  9293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 733) took 1292 ms. Trace:
I20260709 13:03:08.267576 13323 consensus_queue.cc:260] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.268711 13276 raft_consensus.cc:3055] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:08.268862 13323 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:08.269451 13026 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:08.269623 13278 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:08.232566 12877 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.227250 13307 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.205467 13275 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.247330 13315 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:08.276037  8500 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:08.318887  8500 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:08.319459  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:08.267576 13322 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:08.278349  8459 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:08.268311  9293 rpcz_store.cc:276] 0709 13:03:06.975487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.978965 (+  3478us) service_pool.cc:224] Handling call
0709 13:03:06.986332 (+  7367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:07.008112 (+ 21780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:07.008158 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:07.256735 (+248577us) spinlock_profiling.cc:243] Waited 9.57 ms on lock 0x7b2c00047b98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2
0709 13:03:07.257125 (+   390us) log.cc:844] Serialized 26 byte log entry
0709 13:03:07.560157 (+303032us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:07.560208 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.560271 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:08.267647 (+707376us) raft_consensus.cc:1685] finished
0709 13:03:08.267666 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.267882 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32105,"raft.queue_time_us":22054,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":11737,"spinlock_wait_cycles":22008192,"thread_start_us":302741,"threads_started":1,"wal-append.queue_time_us":351569}
W20260709 13:03:08.285579  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 289576us
I20260709 13:03:08.307826  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:08.325894  8531 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:03:08.311466  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:03:08.316089  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 86749us
I20260709 13:03:08.328792  8427 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:08.320101  9295 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:08.319370  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:08.241614  8386 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:08.322527  8500 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:08.331084  8460 raft_consensus.cc:2393] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 13: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:08.333629  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:08.334385  8459 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:08.339031  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:08.345422  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:08.345820  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:08.346055  8386 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:03:08.346432  8381 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:03:08.347343  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:08.347645  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:08.347954  8386 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 7.
I20260709 13:03:08.348445  8381 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 15: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:08.349462  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:08.350098  8386 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:08.346165  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:08.351531  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:08.352943  8500 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:08.352146  8381 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:08.281220 13276 raft_consensus.cc:740] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:03:08.363700  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 248612us
I20260709 13:03:08.366817  8459 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:03:08.364069  8379 raft_consensus.cc:2368] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:03:08.364295  8500 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:08.368743  8349 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:08.370674  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:08.372010  8351 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:08.372972  8531 raft_consensus.cc:2410] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:03:08.374593  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:08.374758  8349 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:08.375209  8386 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:08.376261  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:08.379084  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:08.380174  8379 raft_consensus.cc:2393] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 13: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:08.376897  8386 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:03:08.382472  8427 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:08.384075  8386 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:08.320552 13270 raft_consensus.cc:697] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:08.323319 13328 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:08.395951  8500 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:08.397461  8528 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:08.398985  8531 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:08.351256 13339 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:08.409725  8500 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
W20260709 13:03:08.391028 13441 log.cc:927] Time spent T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:03:08.420338  8424 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:08.318460 13189 consensus_queue.cc:1059] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 13:03:08.391530 13417 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:03:08.400651 13434 log.cc:927] Time spent T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:03:08.385703 13322 raft_consensus.cc:697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:08.385380 13439 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:08.421607  8424 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:08.385526 13437 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:08.397873 13432 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:03:08.438251  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 55894.4us
I20260709 13:03:08.252741  8280 catalog_manager.cc:5697] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 9 to 10, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 10 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.405360 13431 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:08.413615 13440 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:08.420567 13411 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:08.415380 13339 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:08.394716 13055 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 13:03:08.493391  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 71885.3us
I20260709 13:03:08.436430 13158 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:08.499967 13158 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:08.500152  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 90501.4us
I20260709 13:03:08.500463 13158 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:08.430240 13443 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:08.501497  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:08.501890 13439 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:08.502749  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:08.504367  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:08.476794  8427 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:08.506409  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:08.507057  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:08.507728  8460 raft_consensus.cc:2368] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:03:08.450560 13271 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:08.508499  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:08.509130  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:08.509197  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:08.509501  8454 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13. Ops: [10.5-12.6]
I20260709 13:03:08.510589  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:08.515178  8500 leader_election.cc:400] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:03:08.515527  8500 leader_election.cc:403] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:03:08.502426 13439 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:08.475438 13451 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:08.494370 13440 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.517593 13439 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:08.522802 13307 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:08.523945 13440 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:08.504107 13265 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:08.525048 13265 raft_consensus.cc:697] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:08.497520 13270 consensus_queue.cc:237] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.525753  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:08.495347 13276 consensus_queue.cc:260] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.532049  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:08.471010 13432 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.525949 13265 consensus_queue.cc:237] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.508009 12877 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:08.504807 13339 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:08.534519  9260 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:08.544360 13155 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:08.514179 13189 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:08.529527 13315 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:08.510079 13064 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:03:08.532119 13275 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:08.541560 13435 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:08.571601 12874 consensus_queue.cc:1059] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:08.574716 13469 raft_consensus.cc:3055] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:08.575112 13469 raft_consensus.cc:740] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:08.564997  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2713) took 1054 ms. Trace:
I20260709 13:03:08.566525 13432 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:08.568176 13331 raft_consensus.cc:3055] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:03:08.568787 13421 log.cc:927] Time spent T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.984s	user 0.007s	sys 0.005s
I20260709 13:03:08.577623  8534 rpcz_store.cc:276] 0709 13:03:07.511003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.511122 (+   119us) service_pool.cc:224] Handling call
0709 13:03:07.536389 (+ 25267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:07.536848 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:07.552606 (+ 15758us) log.cc:844] Serialized 14 byte log entry
0709 13:03:08.261212 (+708606us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:08.304660 (+ 43448us) log.cc:844] Serialized 14 byte log entry
0709 13:03:08.305065 (+   405us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:08.363198 (+ 58133us) log.cc:844] Serialized 26 byte log entry
0709 13:03:08.363376 (+   178us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:08.363427 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.363491 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:08.564746 (+201255us) raft_consensus.cc:1685] finished
0709 13:03:08.564770 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.564932 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134717,"prepare.queue_time_us":171235,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":5949,"raft.queue_time_us":68902,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":46461,"spinlock_wait_cycles":39115648,"thread_start_us":603778,"threads_started":3,"wal-append.queue_time_us":394635}
I20260709 13:03:08.550941 13189 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.548698 13322 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.590750 13447 raft_consensus.cc:3055] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:08.591235 13447 raft_consensus.cc:740] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:08.592038 13447 consensus_queue.cc:260] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.557822 13271 raft_consensus.cc:697] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:08.593812 13328 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:08.581337 13331 raft_consensus.cc:740] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:08.584043 13189 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:08.577350 13309 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.604254 13309 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:08.608376 13430 raft_consensus.cc:3055] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:08.608919 13430 raft_consensus.cc:740] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:08.609804 13430 consensus_queue.cc:260] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.610241 13331 consensus_queue.cc:260] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.611687 13339 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.612797 13331 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:08.613613 13271 consensus_queue.cc:237] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.615011 13339 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:08.616377 13430 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:08.620637 13439 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.626565 13439 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:08.662420  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 273210us
I20260709 13:03:08.665627  8377 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:03:08.666193  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 291300us
I20260709 13:03:08.667999  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:08.676899  8531 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 7.
I20260709 13:03:08.693910 13324 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.695099 13324 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.698783 13324 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:08.713950  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 176203us
I20260709 13:03:08.660794  8280 catalog_manager.cc:5697] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 8 to 9, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 9 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:08.738341  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 73828.2us
I20260709 13:03:08.739684 13439 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.739730  8351 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:08.738528 13315 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:03:08.740602 13439 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.741559 12877 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:08.742502 13453 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:08.747053 13154 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.747757 13375 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.747823 13154 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.748822 13375 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.753525  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:08.755926 13375 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:08.764068  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 96408.6us
I20260709 13:03:08.768508 13270 raft_consensus.cc:2764] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:03:08.769714 13451 raft_consensus.cc:697] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:08.770936 13395 raft_consensus.cc:3055] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:08.771535 13395 raft_consensus.cc:740] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:08.769630 13158 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.772099 13451 consensus_queue.cc:237] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.794009 13402 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:08.802047  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:08.802951 13402 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.810596  8280 catalog_manager.cc:5697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:08.799168  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 59737.5us
I20260709 13:03:08.800268 13465 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:08.816684 13309 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.816990  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2381) took 1387 ms. Trace:
I20260709 13:03:08.817484  8378 rpcz_store.cc:276] 0709 13:03:07.429587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.432021 (+  2434us) service_pool.cc:224] Handling call
0709 13:03:07.432307 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.702853 (+270546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.816380 (+1113527us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b54003dc2d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:08.816783 (+   403us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":599140736}
I20260709 13:03:08.782002 13395 consensus_queue.cc:260] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.820202 13395 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:08.820515 13154 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:08.821856 13447 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:08.817490 13309 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.829658  8452 raft_consensus.cc:2393] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 12: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:08.831090 13309 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:08.839349 13158 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:08.841499  8501 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:08.843227  8501 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:08.843240 13276 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:08.844552 13377 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:08.845041 13377 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.845468 13322 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:08.846266 13322 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:08.845502 13314 consensus_queue.cc:1059] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:08.847287 13314 consensus_queue.cc:1243] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer 446d9310dce14ff4afff2dc2d64f68d8 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:03:08.846688 13322 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:08.847976 13314 raft_consensus.cc:3055] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:08.850214 13251 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.849776 13314 raft_consensus.cc:740] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:08.850962 13251 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.851785 13314 consensus_queue.cc:260] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.853210 13189 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.855690 13189 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:08.856374  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:08.845538 13377 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:08.839416 13469 consensus_queue.cc:260] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.860553 13250 raft_consensus.cc:3055] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:08.861104 13250 raft_consensus.cc:740] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:08.862605 13465 raft_consensus.cc:697] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:08.862382 13250 consensus_queue.cc:260] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.863560 13250 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:08.863867 13465 consensus_queue.cc:237] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.855683 13273 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.865790 13273 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.866081 13328 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:08.866896 13328 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.868472 13273 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:08.869328  8501 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:08.865783 13251 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:08.872349 13328 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:08.872942 13328 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:08.873852  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:08.874074  8529 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:03:08.874482 13251 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.874707  8381 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:03:08.875180 13251 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.875432  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:08.876277  8528 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:08.876748  8377 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:08.881482  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:08.882053  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:08.882615  8501 leader_election.cc:400] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:03:08.882922  8532 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:08.882982  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:08.884018 13379 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:08.884529 13379 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:08.885011 13379 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:08.885442 13339 consensus_queue.cc:1059] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:08.886426  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:08.884536  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:08.887224  8456 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:03:08.887584 13432 raft_consensus.cc:3055] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:08.888042 13432 raft_consensus.cc:740] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:08.884104  8383 raft_consensus.cc:2393] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 16: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:08.889746  8377 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:08.889673  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:08.890916  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:08.891374  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:08.891685  8529 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:03:08.892091 12845 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:08.892800 13323 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:08.887247  8454 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:08.893599 13323 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.894059 13432 consensus_queue.cc:260] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.892719 12845 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.873590 13328 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.885689 13251 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:08.900454 13322 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.901953 13328 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:08.903493 13453 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.904068 13479 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.905570  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:08.906992 13439 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:08.907514  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.908200  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:08.896270 13432 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:08.896258 13323 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:08.910408  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:08.914806  9258 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:08.932168  8528 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 8.
I20260709 13:03:08.915797 13377 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.934048  9258 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:08.936218  9295 raft_consensus.cc:2368] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:03:08.937963  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:08.939591 13453 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.928936 13314 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:08.898813 13402 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:08.948815  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:08.948908 13064 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:08.950577  8378 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:08.951287 13322 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:08.952318 13377 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:08.954041  9288 raft_consensus.cc:1240] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:08.941044 13479 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:08.957441 13479 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:08.959658  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.962190 13375 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:08.950616 13064 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.963997 13064 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:08.967993  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:08.973331  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.975917 13382 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.976559 13453 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:08.813673  8280 catalog_manager.cc:5697] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 4 to 5, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 5 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.979472 13469 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:08.982283 12845 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:08.982563  8526 raft_consensus.cc:1240] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:08.979249  8280 catalog_manager.cc:5697] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.997112 13322 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:08.997932 13322 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.999346  8535 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:09.000334 13322 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:09.002296  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:09.005296  8529 raft_consensus.cc:2393] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 12: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:09.009397 13285 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:09.012976 13285 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.015842 12874 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.016563 12874 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:08.976790 13382 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.004541 13479 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.018018 13278 consensus_queue.cc:1059] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:09.017684 13021 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.090698  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:09.062184  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.062561 13322 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:09.055022 13285 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:09.002274 13375 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:09.089617  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.060914 13431 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:09.082731  8427 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:09.074383 13278 raft_consensus.cc:3055] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:09.077865 13276 consensus_queue.cc:1059] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:09.081770  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:09.074738 13382 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:09.078415 13479 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:09.130646  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:09.131390 13431 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:09.132519 13479 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:09.133131 13479 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.133898 13431 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:09.133705 13479 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:09.134558  8452 raft_consensus.cc:2393] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 16: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:09.071583  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.078855  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:09.097244 13021 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.097623  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:09.105026 13064 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.108777 13323 consensus_queue.cc:1059] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:09.109251 13271 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.112219  8351 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:09.075372  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:09.124568 13375 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.130424  8455 raft_consensus.cc:2368] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8.
I20260709 13:03:09.138064  8460 raft_consensus.cc:2393] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 14: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:09.138746  9288 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:09.126511 13278 raft_consensus.cc:740] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:09.135900 13479 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:09.155673  9295 raft_consensus.cc:2368] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
W20260709 13:03:09.154152  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 71526.6us
I20260709 13:03:09.144933 13465 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.159401 13465 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:09.161237 13481 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:09.161705 13481 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.162070 13481 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.157248 13285 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:09.163682 13285 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.164103 13285 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.162019 13465 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:09.166025 13453 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:09.166829 13453 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:09.169303 12845 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.169719 13278 consensus_queue.cc:260] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:09.169976 12845 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:09.171039 13278 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:09.172170 12845 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:09.173166 13453 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:09.173245  8529 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:03:09.173653  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:09.174338  9288 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:09.142673 13431 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.174998 13021 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:09.175148 13431 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.178923 13271 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:09.188331  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:09.188876  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:09.189570  8377 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:09.190083  8378 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:03:09.190439  8378 pending_rounds.cc:85] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 7
I20260709 13:03:09.190706  8378 pending_rounds.cc:107] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:03:09.190979  8378 raft_consensus.cc:2889] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:09.191360  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.194684  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:09.195439  8534 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:03:09.193495  8501 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:09.194689  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:09.198195  9258 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:09.198629  8529 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.124914 13322 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.190446 13064 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:09.201854  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:09.202740  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.202036  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:09.211395  8461 raft_consensus.cc:2393] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 12: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:09.211730  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.215962  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:09.221143  8452 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 14: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:09.214975  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.220736  8381 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:03:09.211287 13323 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:09.227216  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.233266  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.241566 13054 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:09.242027 13054 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.242375 13054 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:09.242527  8457 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:09.245189  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:09.246304 12873 consensus_queue.cc:1059] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:03:09.247524 12873 raft_consensus.cc:3055] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:09.247874 12873 raft_consensus.cc:740] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:03:09.249267  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.250747  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.253348 13381 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:09.253449  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 126148us
I20260709 13:03:09.253986  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:09.254606  8383 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.255667  8454 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:09.265209  8501 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:09.267210  8377 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:03:09.249863 13064 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.230829 13323 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.229107 13465 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:09.236920 13271 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:09.275202  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:09.275559 13323 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.276262  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:09.277715  8380 raft_consensus.cc:1240] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:09.279695  8529 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:03:09.274286  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:09.283494  8532 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:09.287065  9258 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:09.287210  8501 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:09.288439  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.289175  8454 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:09.270459 13315 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:09.297271  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:09.298249  8529 raft_consensus.cc:2393] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 15: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:09.270291 13453 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.304875  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.248771 12873 consensus_queue.cc:260] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.279371 13377 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:03:09.294239 13251 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:09.314445  8377 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:09.315084 13141 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:09.298256 13439 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:09.253995 13381 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.318076  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.295544 13315 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:09.322719  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.320555  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.301867 13431 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:09.329919  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.327193  8453 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
W20260709 13:03:09.305246 13331 consensus_meta.cc:287] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.666s	user 0.006s	sys 0.012s
I20260709 13:03:09.288816 13064 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.330547  8456 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:09.337863  8460 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:03:09.299484 13379 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:09.304365 13465 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.329330 13315 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.343274  8452 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
W20260709 13:03:09.346638  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 72235.9us
I20260709 13:03:09.344597  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.350556  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:09.354221  8384 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:03:09.351764 13469 raft_consensus.cc:3055] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:09.341284 12874 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:09.332105 13439 raft_consensus.cc:697] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 10 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:09.333256 13251 raft_consensus.cc:697] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:09.359301  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.322937 13250 consensus_queue.cc:1059] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 13:03:09.353544 13447 consensus_meta.cc:287] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.531s	user 0.013s	sys 0.000s
I20260709 13:03:09.358755  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:09.365340  8349 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:09.370301  8351 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:09.371539  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:09.339707 13453 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.357374 13469 raft_consensus.cc:740] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:09.374104  8379 raft_consensus.cc:2393] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 11: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:09.372670  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.376959  8456 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
W20260709 13:03:09.380890  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.352206 13141 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.379040 13458 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:09.385061  8424 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:03:09.387725  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 84191.6us
I20260709 13:03:09.361073 13395 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:03:09.393436  8351 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:09.372310 13331 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:03:09.397449  8351 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:09.325037  8280 catalog_manager.cc:5697] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 10 to 11, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 11 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:03:09.385960 13451 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:09.407727  8377 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:09.386464 13322 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:09.395396 13021 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:09.409360  8351 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:09.412757  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 53416.1us
I20260709 13:03:09.411738  8532 raft_consensus.cc:1275] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:09.418883  8386 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:09.384441 13251 consensus_queue.cc:237] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.410356 13451 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:09.426702  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 208629us
I20260709 13:03:09.426256 13141 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:09.414772 13458 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:09.431013  8459 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:03:09.421896 13451 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.434815 13339 raft_consensus.cc:3055] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:09.415098 13021 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.461338 13064 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:09.417240 13447 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:09.423336 13331 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:09.453465  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:09.456188  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 49873.6us
I20260709 13:03:09.476716  8383 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:03:09.471468  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.477912  8454 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
I20260709 13:03:09.478947 13026 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.479457 13026 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.480944 13292 consensus_queue.cc:1048] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:09.456916 13021 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.485635 13026 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:09.443722  8349 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:09.487136  8529 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:09.493052  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:09.493780  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:09.475489 13331 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.494683 13331 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.494747  8533 raft_consensus.cc:2410] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:03:09.497057  9261 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:03:09.501432 13484 log.cc:927] Time spent T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.140s	user 0.003s	sys 0.000s
W20260709 13:03:09.474275 13432 consensus_meta.cc:287] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.004s
I20260709 13:03:09.442133 13458 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.445154 13339 raft_consensus.cc:740] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:09.533197 13026 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:09.534986 13285 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.562389 13453 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:09.563462 13285 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:09.564258  8460 raft_consensus.cc:2368] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12.
W20260709 13:03:09.542879  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.542966 13314 consensus_meta.cc:287] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.595s	user 0.007s	sys 0.005s
I20260709 13:03:09.548034  8427 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:09.567108 13278 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:09.548873  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:09.568950  8427 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:09.570461 13417 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:09.570930 13417 raft_consensus.cc:697] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:09.571151 13250 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:09.571842 13417 consensus_queue.cc:237] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.572531  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:09.573107  8380 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.574793 13481 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:09.475719 13439 consensus_queue.cc:237] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:09.577637  8385 raft_consensus.cc:2368] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:09.552229 13395 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.509688 13447 raft_consensus.cc:697] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:09.578322 13395 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.579131 13447 consensus_queue.cc:237] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.580340 13395 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:09.554397  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:03:09.581269  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 137658us
I20260709 13:03:09.538484 13458 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.599412  8380 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:09.556074 13465 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:09.557577 12874 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.560096 13339 consensus_queue.cc:260] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.561443  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:09.561549  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 84609.1us
I20260709 13:03:09.554162  8500 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:09.607182  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 68944.4us
I20260709 13:03:09.608144 13314 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:09.421444 13469 consensus_queue.cc:260] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:09.581386  8454 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.554739 13271 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.554143  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:09.569414  8383 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
W20260709 13:03:09.584069  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 44274.3us
I20260709 13:03:09.601428  8427 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:09.602795  8349 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:09.609055  8500 leader_election.cc:400] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8.
I20260709 13:03:09.621726  8500 leader_election.cc:403] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:03:09.622875  8377 raft_consensus.cc:1275] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:09.538095 12845 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:09.636459 13461 log.cc:927] Time spent T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.052s	user 0.001s	sys 0.002s
I20260709 13:03:09.611652 13479 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:09.612622 13064 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:09.609915 13469 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:09.648360  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 47045.7us
I20260709 13:03:09.647979 13064 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:09.656803  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.644623 13432 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 7. Current term is 8.
W20260709 13:03:09.656478  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 47548.1us
I20260709 13:03:09.666731  9260 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:09.667481 13372 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:09.672230 13372 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.674299 13372 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:09.667872 13402 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:09.674961 13402 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.677043 13402 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:09.668270 13189 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:09.678560 13189 raft_consensus.cc:697] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:09.679478 13189 consensus_queue.cc:237] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.680577  8500 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:09.683804  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.685145  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:09.686470  8454 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:03:09.686920  8455 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.686517  8427 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:09.688982  8500 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:09.689992  8456 raft_consensus.cc:1275] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:09.686592  8461 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:09.604385 13375 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:09.696136  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 66579.9us
I20260709 13:03:09.693131  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:09.700649  8453 raft_consensus.cc:2393] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 14: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:09.641644 13481 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:09.702770  8500 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:09.703979 13278 consensus_queue.cc:1048] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:09.640220 13271 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.657375 13064 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.663833 12873 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.711388 13402 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:09.714485  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 111796us
I20260709 13:03:09.634299 12874 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.719285  9261 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:09.696228 13465 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:09.702204 13276 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:09.716837 13251 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:09.706003 13314 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:09.713888 13339 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.700465 13432 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:09.739908  8349 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:09.724437  8501 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:09.732880 13381 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:09.745433  8383 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:09.748435 13375 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:09.748648  8533 raft_consensus.cc:1240] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
W20260709 13:03:09.785595  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 67390.5us
I20260709 13:03:09.786455  8501 leader_election.cc:400] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:09.786758  8501 leader_election.cc:403] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:09.721033 13379 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:09.762398  8455 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:09.763295  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:09.741613 13251 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.765825 13322 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:09.768107 13271 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:09.768851  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:09.808347  8380 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:09.770560 13479 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:09.773547 13315 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:09.746168 13402 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.712720 13054 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.779127 12874 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:09.779626 13392 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:09.780436 13135 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:09.761468  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 58767us
I20260709 13:03:09.805966  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:09.742820 13276 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:09.805116 13323 consensus_meta.cc:287] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.003s
W20260709 13:03:09.833312  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 120386us
I20260709 13:03:09.797982 13377 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:09.798426 13465 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:09.805429 13251 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.821106 13432 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.808203 13395 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:09.855998  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:09.820714 13479 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.861641  9261 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
W20260709 13:03:09.863155  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 278083us
I20260709 13:03:09.866209  8528 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:09.866936  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:09.863222  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:09.846463 13392 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.872123  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:09.908651  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.854498 13322 raft_consensus.cc:697] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:09.911388  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:09.912271  8528 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:03:09.909651 13465 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:09.846606 13276 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.864004  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:09.873220  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:09.914558  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:09.948675  8455 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:03:09.850517 13323 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.909003 13392 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.860805 13377 raft_consensus.cc:697] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:09.884701  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:09.952919 13322 consensus_queue.cc:237] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:09.958041 13054 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:09.853945 13135 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:09.969903  8383 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:09.910741 13314 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:09.986521  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:09.987610  8383 raft_consensus.cc:2368] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12.
I20260709 13:03:09.967329 13372 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:03:09.989562  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.874562 13395 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:09.995316  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 92314.1us
I20260709 13:03:09.968698 13379 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.003247  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:09.969879 13480 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.007164  8383 raft_consensus.cc:2393] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 13: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:10.007290  9295 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:10.010725  8527 raft_consensus.cc:1240] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:10.011322 13492 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:10.011961 13492 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:10.012434 13480 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:10.013759 13495 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:03:10.015496  8455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30e70dfc88914a66b000a84bef302149"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:10.016320  8455 raft_consensus.cc:606] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:10.018009 13377 consensus_queue.cc:237] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:10.018601  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:10.018949  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:10.019603  9293 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
I20260709 13:03:10.021232  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:10.021586  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:10.022195  9292 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:10.023304  9293 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:03:10.023835 13490 log.cc:927] Time spent T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:03:10.025604  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:10.026317  8384 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
I20260709 13:03:10.027249  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:10.027884  8384 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:03:10.028870  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:09.981344 13481 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:09.951346 13021 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:10.031085  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:09.994421 13372 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.033021  8534 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:10.032747  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:10.041256  8383 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:10.042253  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:09.983541 13331 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:10.074386  9260 leader_election.cc:400] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12.
I20260709 13:03:10.074837  9260 leader_election.cc:403] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:09.990543 13314 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:10.074862  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:10.050060  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:10.060384  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:10.037438 13250 consensus_queue.cc:1059] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:03:10.086627 13135 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:10.101400  8533 raft_consensus.cc:1275] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:10.101879 13250 raft_consensus.cc:3055] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:10.102366 13250 raft_consensus.cc:740] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:10.102114 13392 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:10.088292 13021 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:09.994665 13465 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:10.107963  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:10.092535  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:10.093896  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:10.040390 13372 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:10.114321  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:10.108685  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 60990.7us
I20260709 13:03:10.095045  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:10.095875  8528 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:10.095773  9293 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:03:10.101380  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:10.109910  8386 raft_consensus.cc:2393] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 13: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:10.119016  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:10.120049  8460 raft_consensus.cc:2393] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 12: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:10.120747  8349 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:10.117921  8535 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:10.122022  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:10.122856  8460 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:10.101387 13502 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.124423  8459 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:10.124500 13502 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:10.125937 13500 log.cc:927] Time spent T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:03:10.127489  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:10.127795 13502 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:10.128324  8457 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 16: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:10.129529  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:10.130658  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:10.125313  8535 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:03:10.134788 13432 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:10.145494  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:10.148093  8532 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:10.149293 13470 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.150048 13470 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:10.161998  8385 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:03:10.163976 13064 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:10.163966  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:10.095045 13375 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.047241 13379 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:10.037577 13458 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:10.122872  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.213178  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 92497.7us
I20260709 13:03:10.254108  8534 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
W20260709 13:03:10.193373 13489 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:03:10.152855 13470 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:10.200271 13451 consensus_meta.cc:287] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.683s	user 0.003s	sys 0.007s
I20260709 13:03:10.266686  9292 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:10.178764 13314 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:10.249825 12873 consensus_meta.cc:287] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.002s
W20260709 13:03:10.194321 13498 log.cc:927] Time spent T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:03:10.033885 13481 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:10.195168 13323 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:10.269479  8500 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:10.169481 13402 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:10.264051  8349 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:10.187704 13496 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:03:10.177210 13315 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:10.200647 13285 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.242012 13417 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.278861  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:10.257568 13432 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:10.286854  8458 raft_consensus.cc:2410] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:03:10.169059 13276 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:10.280110 13469 consensus_meta.cc:287] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.002s
I20260709 13:03:10.294123 13491 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:10.294622  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:10.295637 13480 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:10.296200 13285 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:10.302490 13458 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:10.303150 12845 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:10.302774 13250 consensus_queue.cc:260] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:10.305455  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:10.307065 13331 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:10.308007  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:10.261135 13375 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:10.361980  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 92615.4us
I20260709 13:03:10.362238 13285 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:10.362918  8500 leader_election.cc:400] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11.
I20260709 13:03:10.363577 13375 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:10.364442  9287 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:03:10.365092 13135 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:10.365650 13135 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:10.366395  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:10.367533  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:10.367745 13135 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:10.368095  9287 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:10.369122 13432 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:10.341249 13491 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.370429 13491 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:10.371625 13432 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:10.357465  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:10.311352  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:10.378425  8527 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.312374 13064 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:10.313241  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:10.381507  8535 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:03:10.317461  8460 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:10.318807  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:10.319561  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:10.382903  8526 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.321475  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:10.323345 13251 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:10.324505 13395 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:10.325181 13379 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:10.330325  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:10.333323  8426 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:10.341696  9290 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:10.350556  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:10.278000 13451 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:10.311161  9292 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:10.379703  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:10.380218  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 123856us
I20260709 13:03:10.378057  9296 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:10.382125  8427 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:10.394359  8534 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:10.354638 13439 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:10.396112  9294 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:10.403388  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:10.415807  8500 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:03:10.418105  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 84857.6us
I20260709 13:03:10.339838 13417 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:10.419754  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:10.420614  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:10.421998  9261 leader_election.cc:400] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12.
I20260709 13:03:10.421859  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:10.419432  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:10.423023  9261 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:10.416494  8349 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:10.424095  9289 raft_consensus.cc:2368] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 14. Current term is 15.
I20260709 13:03:10.424793  8349 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:10.426365  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:10.426899  8460 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:03:10.427699  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:10.428193  8460 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:10.429555  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:10.422859  8384 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
I20260709 13:03:10.392030 13432 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:10.421260  8386 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:03:10.433125  8459 raft_consensus.cc:2393] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 13: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:10.433948 13392 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:10.434854  8500 leader_election.cc:400] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:10.435009 12845 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:10.435695  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:10.438184  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:10.432183 13331 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:10.441995 13492 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:10.443347 13251 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:10.416404 13064 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.444486 13451 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:10.432394 12873 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:10.459203  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:10.476910  8455 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:10.461966  8500 leader_election.cc:403] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:10.459892  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:10.479158  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:10.479753  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 56805.2us
I20260709 13:03:10.463426  8532 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:10.480484  9261 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:10.467762  8528 raft_consensus.cc:1240] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:10.432832 13395 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:10.430059 13158 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:10.472971  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 47017.7us
W20260709 13:03:10.476922  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 95822.3us
I20260709 13:03:10.462970  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:10.463642  8526 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:10.478610  8453 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 16.
I20260709 13:03:10.479934  8531 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:03:10.482889  8452 raft_consensus.cc:2393] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 13: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:10.484972  8351 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:10.485653 13331 consensus_queue.cc:1048] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:10.485922 13511 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:10.489763 13392 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:10.490188 13392 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:10.490588 13392 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:10.492555 13451 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:10.466553 13491 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:10.494074  9258 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:10.499796 13491 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:10.476329 13458 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:03:10.501183 13512 consensus_queue.cc:1059] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:03:10.502259 13278 raft_consensus.cc:3055] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:10.502607 13278 raft_consensus.cc:740] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:10.503311 13496 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 11. Current term is 12.
I20260709 13:03:10.479636 12873 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.504204 12873 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:10.481773 13395 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.509353 13417 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:10.511101  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:10.511765  8529 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:10.512656 13276 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:10.509423 13395 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.513914 13381 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:10.514446 13381 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:10.514991  9291 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:10.516682 13381 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:10.476202 13064 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:10.518872 13064 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:10.520567 13331 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:03:10.523665 13479 consensus_meta.cc:287] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.615s	user 0.005s	sys 0.003s
I20260709 13:03:10.524085 13479 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:10.525369 13465 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:10.467126 13432 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:10.527958 13432 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:10.486507 13502 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.528811  8351 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:10.529728 13465 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:10.532132 13432 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:10.532778 13432 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:10.535154 13432 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:10.487113  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 92960.2us
I20260709 13:03:10.488088  9261 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:03:10.495615  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 60868.1us
W20260709 13:03:10.542994  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 48999.3us
W20260709 13:03:10.547533  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 59515.7us
I20260709 13:03:10.546275  8527 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:10.545213 13481 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:10.550390  8458 raft_consensus.cc:1275] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:10.550601  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:10.551391  8456 raft_consensus.cc:2393] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 12: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:10.551486  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:10.552635  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:10.553122  8531 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:03:10.553455  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:10.554198  8534 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:10.555200  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:10.555785  8534 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.493191 13451 raft_consensus.cc:697] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:10.557350  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:10.557211 13315 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:10.559794  8454 raft_consensus.cc:1275] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:10.560616  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:10.560842  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:10.561542  8459 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:10.539713  9260 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:10.563212  9260 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:10.563387 13273 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:10.565004 13273 raft_consensus.cc:697] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:10.565956 13273 consensus_queue.cc:237] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:10.546880 13141 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:10.569386 13504 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:10.570200 13504 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:10.570703 13504 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.572327 13395 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:10.556967 13451 consensus_queue.cc:237] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:10.569495 13141 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.576110 13372 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:10.576529 13141 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:10.577375  9295 raft_consensus.cc:2368] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12.
I20260709 13:03:10.583526 13278 consensus_queue.cc:260] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:10.585203 13381 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:10.585601 13250 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:10.585697 13381 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:10.586162 13381 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:10.590102  8424 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:10.591223 13430 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:10.591668 13430 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.592228 13430 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:10.531725  8455 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:10.601835  8424 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:10.602731 13315 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:10.603088  8424 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:10.603318 13315 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:10.604041 13284 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:10.602773 13469 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:10.604456 13284 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.604687 13469 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.604869 13284 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:10.605129 13469 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:10.612329  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:10.612356  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:10.613626  8377 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
I20260709 13:03:10.615391 13479 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:10.615392  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:10.616451  8377 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:10.548928  9261 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:10.550140  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:10.622738  8527 raft_consensus.cc:2393] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 13: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:10.579949  8349 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:10.627635 13479 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:10.627213 13372 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:10.635413  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:10.636053  8386 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:03:10.638108 12873 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:10.639467  8461 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 17: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
W20260709 13:03:10.640548  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 221580us
I20260709 13:03:10.642109 12873 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:10.643368 13278 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:10.645594  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:10.646301  8382 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:03:10.647320  8531 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:10.648605  9258 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:10.651250  8535 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:10.652107  8385 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:10.653189 13439 raft_consensus.cc:2764] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:03:10.654434 13315 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:10.656060 13502 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:10.656445  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 76702.4us
I20260709 13:03:10.656854  8386 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:10.657709 13481 consensus_queue.cc:1048] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:10.660174 13481 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:10.661911  8349 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:10.662757 13481 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:10.663525  8534 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
W20260709 13:03:10.665861  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 116989us
I20260709 13:03:10.667724 13447 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:10.668308 13496 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:10.668853 13496 raft_consensus.cc:697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:03:10.669186  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 60138.8us
I20260709 13:03:10.669806 13496 consensus_queue.cc:237] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:10.671178  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:10.674897  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:10.675532  8500 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:10.675874  8528 raft_consensus.cc:2393] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 9: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:10.676950  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:10.677896  8526 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:10.680354  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:10.681658  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:10.689333  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:10.689951  9292 raft_consensus.cc:2393] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 15: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:10.690140  8381 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:10.683905  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:10.691161  8529 raft_consensus.cc:2410] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:03:10.693154  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:10.693504  8531 raft_consensus.cc:2393] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 15: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:10.693775  8459 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:10.678785 13315 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.695413  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:10.695479 13315 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:10.696173  9289 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:03:10.697052  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:10.697158 13520 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:03:10.698715  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:10.699802 13432 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:10.701134  8383 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:10.702037  8500 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:10.665863  8349 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:10.704512  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:10.705044  8380 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:10.705226  8349 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:10.710521  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:10.711500  8534 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:03:10.717764  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:10.718488  8382 raft_consensus.cc:1275] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:10.718545  8455 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:03:10.719177  8455 pending_rounds.cc:85] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12: Aborting all ops after (but not including) 8
I20260709 13:03:10.719461  8455 pending_rounds.cc:107] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:03:10.719694  8455 raft_consensus.cc:2889] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:10.718683  8535 raft_consensus.cc:2393] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 13: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:10.720038  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:10.722101  8459 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:03:10.723456  8349 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:10.724166  8500 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:10.725474  8377 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:10.727025  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:10.727633  8381 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.727785  8385 raft_consensus.cc:1275] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:10.728211  8500 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:10.729715  8500 leader_election.cc:400] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12.
I20260709 13:03:10.729784  8424 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:10.730271  8500 leader_election.cc:403] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:10.732095  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:10.722103  8386 raft_consensus.cc:2393] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 14: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:10.734277  8349 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:10.726811 13315 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:10.730999  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:10.739768  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:10.740525  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:10.736852  8454 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:10.738590  9295 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:10.740360  8453 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:03:10.743408  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:10.744009  9289 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.744344  9288 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:10.744822  8534 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:10.721344 13481 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:10.750288  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:10.722160 13520 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:10.731666 13323 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:10.765825  8526 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:10.755429  8501 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:10.762533  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:10.762821  8385 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:10.761651  8500 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:10.763582  8380 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:10.764153  9292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88"
dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:54044
I20260709 13:03:10.733670 13379 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:10.765005  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:10.747365  9260 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:10.682101 13439 consensus_queue.cc:1048] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:03:10.806356  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:10.810369  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:10.811033  8461 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.767140  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:10.806730  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:10.738711 13395 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:10.817458  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:10.817508  8386 raft_consensus.cc:2393] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 12: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:10.806255  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:10.741231 13479 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:10.812176  8427 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:10.746537  8426 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.196:40669 timed out after 1.528s (SENT) [suppressed 14 similar messages]
I20260709 13:03:10.813513  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:10.723608 13432 consensus_queue.cc:1048] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:03:10.831262  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:03:10.831894  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 84632.6us
I20260709 13:03:10.735643 13518 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:10.743705 13451 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:10.738021 13322 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:03:10.846680  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 85074.3us
I20260709 13:03:10.847566  8351 leader_election.cc:400] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 14. Current term is 15.
I20260709 13:03:10.770015  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:10.840888  9261 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:10.768926 13323 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:10.844594  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:10.806444 13292 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:10.854780  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:10.855592  8380 raft_consensus.cc:2393] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 15: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:10.856104  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:10.847927  8351 leader_election.cc:403] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:03:10.844017  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 88645.3us
I20260709 13:03:10.850083  8349 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:10.851598  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:10.858829  9288 raft_consensus.cc:2393] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 15: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:10.852865  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:10.863236  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:10.863612  8501 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:10.866044  8378 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:10.759388 13520 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:10.832171 13481 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.879704  8386 raft_consensus.cc:2368] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14.
I20260709 13:03:10.831827 13273 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:10.839466 13251 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:10.884374  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:10.929700  8453 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.839671 13479 raft_consensus.cc:697] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 12 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:10.885058  8381 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:10.885980  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:10.816545 13021 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:03:10.816058 12873 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 13:03:10.931732  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 49848.4us
W20260709 13:03:10.931378  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 83948.9us
I20260709 13:03:10.831619 13392 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:10.858206 13315 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:03:10.935056 13489 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:03:10.868248 13285 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:10.944660  9261 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:10.945571  8351 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:10.936546  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:10.879347 13520 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:10.854187 13323 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:10.873368 13292 raft_consensus.cc:697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:10.884730 13026 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.884876 13339 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:10.956213 13439 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:10.930804 13395 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:10.937657 13502 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:10.982486  8384 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:10.942062 13480 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:10.990391  9292 raft_consensus.cc:606] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:03:11.013311  9292 raft_consensus.cc:614] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:10.992312  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 47732.7us
I20260709 13:03:11.014315  9261 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:11.018337  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:03:10.994479  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 129740us
I20260709 13:03:11.022528  8501 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:10.951589 13518 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:10.943800 13451 raft_consensus.cc:697] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:10.950757 13315 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:10.884192 13481 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:11.004065 13402 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:11.026571  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 175068us
W20260709 13:03:11.027151  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 280618us
I20260709 13:03:10.954493 13511 consensus_queue.cc:1048] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:03:11.006299 13439 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:10.941437 13273 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:10.978179 13469 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:11.002563 13339 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:10.999117 13430 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:11.008569 13502 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.074954 13315 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:11.107787 13284 consensus_meta.cc:287] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.007s
I20260709 13:03:11.115161  8500 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:11.126025  8460 raft_consensus.cc:2393] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:11.118958  8426 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:11.149405  8426 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:11.110805 13439 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:11.121659 13529 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:03:11.027796 13518 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.025303 13251 raft_consensus.cc:697] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:11.137481 13502 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:11.107882 13489 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:03:11.007014 13026 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:11.179111 13026 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:11.122557 13493 log.cc:927] Time spent T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:03:11.125941 13339 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:11.166826 13518 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:11.151612  8426 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:11.121438 13430 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:11.153970 13491 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:11.186906 13532 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 13:03:11.187103 13525 log.cc:927] Time spent T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:03:11.158247 13511 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:11.213400 13266 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:11.213891 13266 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:11.214285 13266 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:11.156451 13284 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:11.118574 13542 consensus_queue.cc:1048] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:03:11.219457 13284 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:11.221155 13537 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:11.222528 13537 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:11.223353 13451 consensus_queue.cc:237] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:11.162653 13535 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:11.157294 13395 raft_consensus.cc:697] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:11.227252 13502 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:11.227835 13395 consensus_queue.cc:237] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:11.113318 13479 consensus_queue.cc:237] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:11.209894 13531 log.cc:927] Time spent T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
W20260709 13:03:11.211097 13381 consensus_meta.cc:287] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.624s	user 0.006s	sys 0.005s
I20260709 13:03:11.238689  9289 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:11.242466  9293 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 17: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:11.244987  8461 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:11.246742  8384 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:03:11.198144 13554 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:11.073102 13534 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:03:11.272425  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 327391us
I20260709 13:03:11.031059 13432 consensus_queue.cc:1059] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.224s
I20260709 13:03:11.125876 13292 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:11.280282  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:11.251667 13491 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:11.284194  8351 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:11.261770 13372 raft_consensus.cc:2764] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:03:11.291814  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 100666us
I20260709 13:03:11.270364 13554 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.255354 13285 raft_consensus.cc:697] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:11.272018 13021 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:11.258849 13381 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:11.300128  8351 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:11.293771 13534 raft_consensus.cc:697] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:11.296324 13554 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:11.318476  9295 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:11.340097 13544 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.155s	user 0.002s	sys 0.001s
I20260709 13:03:11.380307 13534 consensus_queue.cc:237] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:11.381577 13458 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:11.382659 13480 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 14. Current term is 15.
I20260709 13:03:11.306800 13469 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:11.300503 13491 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:11.321130 13553 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:11.326524 13541 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.325740 13543 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:11.367347 13141 consensus_meta.cc:287] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.790s	user 0.012s	sys 0.019s
I20260709 13:03:11.367444 13548 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:03:11.396643  8427 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.018s	sys 0.032s
W20260709 13:03:11.413910  8427 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.018s	sys 0.032s
W20260709 13:03:11.414286  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 602141us
I20260709 13:03:11.368201 13273 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:11.372473 13381 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:11.282989 13251 consensus_queue.cc:237] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:11.374313 13542 raft_consensus.cc:3055] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:03:11.375617 13250 consensus_meta.cc:287] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.790s	user 0.012s	sys 0.006s
W20260709 13:03:11.376035 13278 consensus_meta.cc:287] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.732s	user 0.009s	sys 0.002s
I20260709 13:03:11.378773 13520 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:11.307076 13021 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:11.341547 13285 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:11.461747  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:11.387246 13481 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:11.387470  8453 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
W20260709 13:03:11.388015 13322 consensus_meta.cc:287] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 13:03:11.400573  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:03:11.471421  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 474883us
I20260709 13:03:11.421394  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:11.436914  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:11.438547  9295 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:11.442770  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:11.390857 13504 consensus_meta.cc:287] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.798s	user 0.011s	sys 0.003s
I20260709 13:03:11.445506  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:11.445788  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:11.445564  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:11.392601 13518 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:11.392376 12845 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.392704 13553 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.392922 13451 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:11.449373  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 149689us
I20260709 13:03:11.436479 13141 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:11.440971 13543 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:11.436555 13379 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:11.437693 13541 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:11.462374  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:11.468822  8382 raft_consensus.cc:2410] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
W20260709 13:03:11.465946 13562 log.cc:927] Time spent T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:03:11.416428  8426 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:11.442276 13542 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:11.465937 13554 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:11.441514 13026 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.681660  8380 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:11.581259  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 98761.8us
W20260709 13:03:11.683271  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 266915us
I20260709 13:03:11.682008  8378 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:11.504056  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:11.509465  8526 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:11.686880  8383 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:03:11.681667  8535 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:11.690248  8457 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:03:11.689687  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:11.682175  9287 raft_consensus.cc:2376] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14. Re-sending same reply.
I20260709 13:03:11.472280 13323 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:11.695490  8528 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:11.697962  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:11.716624  8533 raft_consensus.cc:2393] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 10: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:11.720857  8531 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:11.694119  9258 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:11.727062  8456 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6427ce7790bd4629985d340936d6f356"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:11.727818  8456 raft_consensus.cc:606] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:03:11.728165  8456 raft_consensus.cc:614] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:11.474176 13322 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12.
I20260709 13:03:11.730074  8349 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:11.466813 13402 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.235s
I20260709 13:03:11.495374 13502 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:11.730885  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 46329.5us
I20260709 13:03:11.689208 12874 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:11.494153 13021 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:11.495280 13520 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:11.773279  9290 raft_consensus.cc:2393] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 15: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:11.493224 13314 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:11.503468 13491 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:11.684818 13504 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:11.772145  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 323033us
I20260709 13:03:11.701203 13553 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:11.870592 13395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.037s	sys 0.075s
W20260709 13:03:11.871311 13395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.037s	sys 0.075s
I20260709 13:03:11.790055  8528 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
W20260709 13:03:11.844426 13315 consensus_meta.cc:287] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.677s	user 0.006s	sys 0.006s
I20260709 13:03:11.791553  8535 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
W20260709 13:03:11.748847 13439 consensus_meta.cc:287] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.001s
I20260709 13:03:11.824986  9291 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:11.702845 13492 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:03:11.611151 13266 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:11.886934  8534 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:11.741319 13548 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:11.692492 13379 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:11.696681 13451 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:11.848487  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 61622.7us
I20260709 13:03:11.472563 13382 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.265s
I20260709 13:03:11.791635 13314 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:11.841370  8457 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36448 (request call id 2328) took 1699 ms (client timeout 2010 ms). Trace:
I20260709 13:03:11.862010  8527 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:03:11.862313  8351 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:11.692211 13026 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:11.868414  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:11.934461  8455 raft_consensus.cc:2368] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13.
I20260709 13:03:11.935285  8455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:11.708645 12845 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:11.612752 13339 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:11.938625  9291 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:11.874104  9258 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:11.791340 13271 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:11.801374 13323 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:11.881400  9295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55720 (request call id 760) took 1051 ms. Trace:
I20260709 13:03:11.821480 13417 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:11.841790 12874 raft_consensus.cc:697] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:11.883641  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:11.884790  8424 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:11.977028  8453 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:11.890759  8380 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:11.853662 13520 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:11.892876  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:11.897449 13432 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:11.897466  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:11.899768  8458 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:11.905978 13564 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:11.907413 13392 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:11.913141 13541 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:11.913511 13492 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:11.916172 13543 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:11.918637 13504 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:11.842656 13542 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:11.919108 13266 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:11.875382 13430 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:03:11.897481 13570 log.cc:927] Time spent T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:03:11.922163  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:11.885126 13439 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:11.925233 13548 raft_consensus.cc:697] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:11.926183 13518 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:11.932176  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:03:11.932991  8457 rpcz_store.cc:269] 0709 13:03:10.120060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.130424 (+ 10364us) service_pool.cc:224] Handling call
0709 13:03:11.800148 (+1669724us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54001e7dd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:11.819280 (+ 19132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3055962368}
W20260709 13:03:11.937017  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 74818.9us
I20260709 13:03:11.941112  9295 rpcz_store.cc:276] 0709 13:03:10.822944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.823137 (+   193us) service_pool.cc:224] Handling call
0709 13:03:11.873641 (+1050504us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b5400047754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:11.873731 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1080179584}
I20260709 13:03:11.882335 13315 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:11.938756 13479 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:03:12.012389  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.974080  8427 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:12.007609 13430 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:11.972007 13314 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:11.997219 13292 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.994232 13402 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:03:11.973690  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 99639.5us
I20260709 13:03:11.989464 13271 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:11.986037  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 101329us
W20260709 13:03:12.030098  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 56104.2us
I20260709 13:03:12.028242  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:11.997378 13189 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:11.994750 13417 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:12.012439 13542 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:12.042300  8500 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:11.998085 13520 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:12.040189  8424 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:12.035071 13266 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:12.074530  9261 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:12.074739  8501 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:12.008136 13492 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:12.033948 13141 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:12.106078  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:12.081096  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:12.106726  8382 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:12.107482  8383 raft_consensus.cc:2368] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:12.106078  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:12.035023 13402 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:12.108635  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:12.004801 13432 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:12.078030 13323 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.109403  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:12.114894  8378 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:03:12.110448  8452 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:12.116334  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:12.116724  8459 raft_consensus.cc:2393] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:12.117690  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:12.112251  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:12.111294  9261 leader_election.cc:400] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14.
I20260709 13:03:12.119315  9261 leader_election.cc:403] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:03:12.120330  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:12.120131 13323 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:12.120558  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:12.120790 13026 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:12.121415 13379 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:12.121491  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:12.121763  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:12.122198  8383 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 9.
I20260709 13:03:12.122304 13323 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:12.123104  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:12.124094  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:12.157166  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:12.157426 13565 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 13:03:12.157884 13571 log.cc:927] Time spent T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:03:12.158313 13339 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:12.158537 13576 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:03:12.165809  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 124634us
W20260709 13:03:12.166328 13575 log.cc:927] Time spent T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:03:12.076540 13266 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:12.159431  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 48336us
I20260709 13:03:12.160287  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:12.073318 13479 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:12.163105  8386 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:12.075974 13535 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:12.078770 13541 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:12.167706  9290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55720 (request call id 758) took 1359 ms. Trace:
I20260709 13:03:12.169334  8383 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 17: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:12.038226 13292 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:12.066004 13189 raft_consensus.cc:697] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:12.078434 13511 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:12.123234  8452 raft_consensus.cc:1275] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:12.078855 13504 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 13:03:12.114339 13402 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:12.073009 13469 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:12.124769 13372 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:03:12.115934 13502 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:12.190402  9261 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:12.234974  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 44697.3us
I20260709 13:03:12.197650  9260 leader_election.cc:400] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13.
I20260709 13:03:12.201650  8526 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:12.237540  9260 leader_election.cc:403] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:03:12.221463  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:12.106251 13465 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:12.238711  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:12.238987  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:12.239629  8383 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:12.239846  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:12.236429  9261 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:12.241851  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:12.242527  8528 raft_consensus.cc:2368] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14.
I20260709 13:03:12.213645  9290 rpcz_store.cc:276] 0709 13:03:10.807900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.808088 (+   188us) service_pool.cc:224] Handling call
0709 13:03:12.167520 (+1359432us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b54004ea7d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:12.167647 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077350272}
I20260709 13:03:12.159029 13451 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:12.226462  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:12.073035 13518 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.108s
I20260709 13:03:12.230015  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:12.230547  8527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47306 (request call id 1109) took 1484 ms (client timeout 1928 ms). Trace:
I20260709 13:03:12.232478  8535 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:12.252279  8384 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:12.240489  8457 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:03:12.186661 13266 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:12.251442  8532 raft_consensus.cc:2393] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 15: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:12.252808  8452 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
W20260709 13:03:12.235220  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 164715us
W20260709 13:03:12.259213  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.252306  8427 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:12.252794  8527 rpcz_store.cc:269] 0709 13:03:10.731331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.733464 (+  2133us) service_pool.cc:224] Handling call
0709 13:03:12.215379 (+1481915us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400097c54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:12.215494 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2484435712}
W20260709 13:03:12.264125  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 152713us
I20260709 13:03:12.225194 13479 raft_consensus.cc:697] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:12.265867  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:12.224519 13339 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:12.267424  8351 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:12.248070 13469 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:12.228114 13534 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.271144  8501 leader_election.cc:400] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:12.272727  8351 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:12.353638  8501 leader_election.cc:403] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:03:12.354235  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 88923.4us
I20260709 13:03:12.355513  8501 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:12.106528 12874 consensus_queue.cc:237] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:12.162663 13548 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:12.360841  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:12.303710  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:12.277493 13511 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:12.245007 13382 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:12.324275  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:12.368598  8527 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:12.346711 13534 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:12.357782  8535 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:12.250545 13465 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:12.359270  9258 leader_election.cc:400] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14.
I20260709 13:03:12.383333  9258 leader_election.cc:403] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:03:12.232941 13541 raft_consensus.cc:697] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 8 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:12.257246 13564 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:12.364755  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:12.351239  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:12.365335  8455 raft_consensus.cc:606] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:12.394922  8455 raft_consensus.cc:614] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:12.358146  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 85515.3us
I20260709 13:03:12.375284  8384 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:03:12.377254  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 114921us
I20260709 13:03:12.349473 13273 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13.
I20260709 13:03:12.286158 13339 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:12.372962 13568 log.cc:927] Time spent T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.342s	user 0.001s	sys 0.001s
I20260709 13:03:12.361822 13379 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:12.363677 13315 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:12.366629 13395 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:12.401712  8533 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:12.388089 13417 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:12.382887 13323 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.402943 13518 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:12.373575 13432 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:12.395710 13512 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:12.395371 12845 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:12.397538 13372 consensus_queue.cc:1059] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
W20260709 13:03:12.420722 13572 log.cc:927] Time spent T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
I20260709 13:03:12.412727  8427 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:12.401131  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 203654us
I20260709 13:03:12.374346 13511 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:12.396627 13382 raft_consensus.cc:697] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:12.425208 13271 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:12.431320 13323 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:12.479584 13534 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:12.472334 13541 consensus_queue.cc:237] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:12.437477 13512 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.413373 13479 consensus_queue.cc:237] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:12.447813 13579 log.cc:927] Time spent T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:03:12.449465 13465 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:12.449873 13580 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:12.454339 13339 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:12.455854 13284 raft_consensus.cc:993] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:03:12.419745 13395 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:12.493052 13379 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:12.494437 13395 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:12.489871 13598 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:12.373381 13189 consensus_queue.cc:237] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:12.474397  8383 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:12.490653  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:12.491596  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:12.497608  8535 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:12.498966  8383 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:03:12.499217  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 104685us
I20260709 13:03:12.399384  8454 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:03:12.411298 13564 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14.
W20260709 13:03:12.432382 13458 consensus_meta.cc:287] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.050s	user 0.006s	sys 0.006s
I20260709 13:03:12.480461 13534 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:12.484195 13492 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:12.463912 13553 consensus_meta.cc:287] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.593s	user 0.000s	sys 0.007s
I20260709 13:03:12.489185 13542 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:12.458125 13292 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:12.427057 13273 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:03:12.489744 13511 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:12.515699  8527 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:12.481974 13512 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:12.492379  8500 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:12.530109  8349 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:12.463881 13402 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:12.485755 13271 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:12.658061 13271 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:12.660012 13402 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:12.660447 13271 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:12.547858  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 46082.3us
I20260709 13:03:12.503687 13372 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:12.636605  8460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36448 (request call id 2339) took 1114 ms. Trace:
W20260709 13:03:12.636890  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 106916us
I20260709 13:03:12.498607 13465 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:03:12.638746  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 146462us
I20260709 13:03:12.666143  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:12.674006  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:12.534762 13458 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:12.562975 13535 raft_consensus.cc:697] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:12.555928 13492 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.660928 13379 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:12.702778  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:12.749742  9289 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:03:12.638289 13292 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.704356  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:12.661409 13314 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.699445  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:12.741858  8379 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:12.747179  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:12.674724 13339 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:12.538719 13534 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:12.770540  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:12.771687  8457 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 16: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:12.632123 13542 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:12.555686 13553 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:12.752372  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 356051us
I20260709 13:03:12.663610  8460 rpcz_store.cc:276] 0709 13:03:11.442562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.442958 (+   396us) service_pool.cc:224] Handling call
0709 13:03:11.443271 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:11.473830 (+ 30559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:11.473863 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:11.522652 (+ 48789us) log.cc:844] Serialized 26 byte log entry
0709 13:03:12.072847 (+550195us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:12.072889 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.073287 (+   398us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:12.556528 (+483241us) raft_consensus.cc:1685] finished
0709 13:03:12.556560 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:12.556787 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133375,"raft.queue_time_us":30692,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":5425,"thread_start_us":434524,"threads_started":1,"wal-append.queue_time_us":613083}
I20260709 13:03:12.790272  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:12.791602  8383 raft_consensus.cc:2393] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 12: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:12.794878  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:12.794905  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:12.703975 13511 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:12.748045 13564 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.739672 13586 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:12.703709 13581 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:12.807046  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:12.816609  8460 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:12.685006 13465 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:12.819573  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:12.823623  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:12.826908  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:12.740170 13382 consensus_queue.cc:237] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:12.773684 13314 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:12.762868 13458 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 13:03:12.758360 13492 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:12.831799  8382 raft_consensus.cc:2368] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 16. Current term is 17.
I20260709 13:03:12.865984  9288 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:12.895959  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:13.125175  8377 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
W20260709 13:03:13.125398 13266 consensus_meta.cc:287] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.841s	user 0.008s	sys 0.005s
W20260709 13:03:13.126076  8427 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.008s	sys 0.050s
I20260709 13:03:13.125849 13266 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:13.126443  8427 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.008s	sys 0.050s
I20260709 13:03:13.126983  8454 raft_consensus.cc:1240] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 13:03:13.127861  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 715215us
I20260709 13:03:13.128104 13266 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:12.800307 13591 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:12.764008 13379 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:12.799886 13597 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:13.133419 13597 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:13.134030 13379 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:13.052740 13548 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.001s	sys 0.012s
I20260709 13:03:12.984601  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:12.832023 13518 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.800467 13323 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:12.898202 13542 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:12.772785 13292 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.163914 13518 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.165253 13271 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:13.165741 13292 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:13.166067 13518 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:13.166949  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:13.151971 13548 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.001s	sys 0.015s
I20260709 13:03:13.168123  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:13.168249 13548 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:12.884635  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:12.833009 13586 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.169726 13586 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.169960 13491 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:13.170531 13491 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:13.153206 13595 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:03:13.172691 13491 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:13.168960  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:13.173866  8377 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:03:13.174854  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:13.158175 13372 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:03:12.763298 13339 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:03:13.138505 13541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.009s	sys 0.046s
I20260709 13:03:12.831000 13432 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.832119 13564 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:12.831794 13511 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:13.003001  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:03:13.030321  8381 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.006s	sys 0.008s
I20260709 13:03:12.967437 13535 consensus_queue.cc:237] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:12.889150 13534 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:12.772188 13599 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:13.030004  8501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.002s	sys 0.011s
W20260709 13:03:13.208302  8501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.003s	sys 0.012s
I20260709 13:03:12.904945  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:13.030841  8424 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.011s	sys 0.003s
I20260709 13:03:13.135861 13597 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:13.139693  8379 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:03:13.156219  8383 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:12.832365 13600 raft_consensus.cc:1081] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:03:13.100086 13520 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:12.914940 13315 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:13.160948 13604 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:13.168294  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:13.243283  8384 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:13.138230  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:12.895684 13590 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:13.136319 13492 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:13.115033 13469 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:13.116886 13430 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:13.180313  9288 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:13.186378  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:13.261505  9287 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
W20260709 13:03:13.196110  8381 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.008s	sys 0.009s
I20260709 13:03:13.188265 13548 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.185565 13339 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:13.199662 13554 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:13.200321 13511 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:13.196913 13432 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:13.201901 13439 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:13.203519 13564 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:13.203929  9290 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:13.294196 13141 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14.
I20260709 13:03:13.209479  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:13.297712  8453 raft_consensus.cc:2393] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 13: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
W20260709 13:03:13.209969  8424 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.011s	sys 0.005s
W20260709 13:03:13.298871  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 938634us
W20260709 13:03:13.211009  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 855484us
W20260709 13:03:13.185592 13541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.009s	sys 0.046s
W20260709 13:03:13.227113  8349 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.018s	sys 0.031s
I20260709 13:03:13.247458 13589 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.236137  8383 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
I20260709 13:03:13.239985 13597 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:13.240454 13614 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:13.245746  8457 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 12: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:13.248667  9261 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:13.252492  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:13.159082 13605 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:03:13.258448  8384 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:13.197108  9296 raft_consensus.cc:2393] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 15: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:13.266558  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:13.222114 13599 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:13.274412  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3320) took 1858 ms. Trace:
I20260709 13:03:13.291741 13432 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:13.301498  8349 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.019s	sys 0.031s
W20260709 13:03:13.347219  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 682173us
I20260709 13:03:13.181978 13379 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:13.304127  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:13.304625  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:13.304956  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:13.259277 13382 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.302286  8500 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:13.301577  8501 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:13.319139  9290 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
W20260709 13:03:13.336501  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 87932.5us
I20260709 13:03:13.338467  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:13.245666 13315 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.302186 13553 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:13.373690  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 85147us
I20260709 13:03:13.374269  8528 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
W20260709 13:03:13.376499  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 75028.1us
I20260709 13:03:13.346979  8381 rpcz_store.cc:276] 0709 13:03:11.416163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.417457 (+  1294us) service_pool.cc:224] Handling call
0709 13:03:11.417773 (+   316us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:11.440566 (+ 22793us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:11.469574 (+ 29008us) log.cc:844] Serialized 14 byte log entry
0709 13:03:11.517399 (+ 47825us) spinlock_profiling.cc:243] Waited 6.61 ms on lock 0x7b180027b6e0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c5398522 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:03:11.876087 (+358688us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:12.400218 (+524131us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b180027b6e0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53662a6 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a
0709 13:03:12.457196 (+ 56978us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b2c000014c8. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2
0709 13:03:12.457804 (+   608us) log.cc:844] Serialized 52 byte log entry
0709 13:03:12.457991 (+   187us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:13.262500 (+804509us) log.cc:844] Serialized 14 byte log entry
0709 13:03:13.273977 (+ 11477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.274083 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:13.274138 (+    55us) raft_consensus.cc:1685] finished
0709 13:03:13.274156 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.274339 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36160,"prepare.queue_time_us":396102,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":104,"raft.queue_time_us":73804,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":41703,"spinlock_wait_cycles":27320960,"thread_start_us":1186549,"threads_started":2,"wal-append.queue_time_us":385305}
W20260709 13:03:13.376528  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 74323.1us
I20260709 13:03:13.340443 13564 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:13.406659  8501 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:13.375276  8532 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:13.326541 13465 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:13.326365 13372 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:13.413887  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:13.419054  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:13.421594 13518 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:13.422617 13542 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:13.423015 13323 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:13.475003  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:13.431782  9292 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:13.475163  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:13.250142 13604 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.336109 13589 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.451828  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:13.416728 13600 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:13.409271 13432 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:13.452318 13609 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.402333 13382 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:13.437703 13372 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:13.340143 13597 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.405243 13379 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.373021 13541 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.375850 13617 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:03:13.417424 13560 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.185s	user 0.014s	sys 0.032s
I20260709 13:03:13.409199 13439 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:13.440404  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:13.479355  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 173076us
I20260709 13:03:13.409190 13458 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:13.340636 13339 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:13.474387 13512 consensus_meta.cc:287] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.813s	user 0.010s	sys 0.001s
I20260709 13:03:13.430022 13587 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:03:13.485641  8349 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:13.459573 13534 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:13.458755 13586 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:13.471998 13520 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:13.492543  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:13.509742 13613 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.492838  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:13.493537  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:13.472251 13465 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:13.495409  9294 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:13.498533  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:13.483501 13605 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.481701 13542 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.513007 13617 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.505467 13323 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:13.505954 13619 log.cc:927] Time spent T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:03:13.507145 13372 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:13.508782 13597 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:13.480497 13314 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:13.483132 13612 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:13.474943 13518 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:13.520450  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:13.491761 13451 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.530704  8453 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:03:13.511731 13560 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.287s	user 0.015s	sys 0.032s
W20260709 13:03:13.550410  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 64865.7us
I20260709 13:03:13.691998  8349 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:13.562928  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:13.587951  8535 raft_consensus.cc:1275] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:13.512887 13439 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.504084  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:13.694720  8458 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:13.591324  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:13.592038  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:13.489121 13600 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:13.594389  8527 raft_consensus.cc:1240] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:03:13.529668 13458 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:13.623716 13621 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:03:13.647931 13604 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:13.590308 13553 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:13.509647 13541 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.647977  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:13.493608 13609 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.592491 13613 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:13.699800  8530 raft_consensus.cc:2393] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 20: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:13.700964  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:13.701242  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:13.699978 13560 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:13.704577  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:13.578924 13534 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:13.650765 13616 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:13.550887 13512 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.589735 13520 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:13.590703 13465 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.594542 13542 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.591581 13605 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.696825 13439 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:13.784464 13609 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:13.655669 13314 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:13.785681 13314 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.786711  8528 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
W20260709 13:03:13.787499 13628 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:03:13.789119 13613 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:13.789997 13589 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:13.762569 13616 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.693269 13612 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:13.802513 13612 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:13.804884 13465 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:13.808385 13534 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:13.811671 13578 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 1.556s	user 0.010s	sys 0.002s
I20260709 13:03:13.813810  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2572) took 1899 ms. Trace:
I20260709 13:03:13.814344  8534 rpcz_store.cc:276] 0709 13:03:11.914776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.922654 (+  7878us) service_pool.cc:224] Handling call
0709 13:03:11.922975 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:11.923340 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:11.923368 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:11.923839 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:03:12.035985 (+112146us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:12.036022 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.036088 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:13.810858 (+1774770us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:13.813102 (+  2244us) raft_consensus.cc:1685] finished
0709 13:03:13.813136 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.813685 (+   549us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1050,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":10925824,"thread_start_us":111791,"threads_started":1,"wal-append.queue_time_us":238852}
I20260709 13:03:13.815255  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:13.816484  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:13.817641  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:13.818195  8534 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:13.818979  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:13.724812  9296 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
I20260709 13:03:13.724867  9288 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:13.624191 13323 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.730289  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:13.697800 13432 raft_consensus.cc:697] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:13.728801  9294 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:03:13.719192 13553 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.832366 13553 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:13.832554 13432 consensus_queue.cc:237] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.696976 13451 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:13.837559 13451 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:13.725394 13315 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:13.776648  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:13.838658  9295 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:13.777969 13605 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:13.778465 13625 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.691625 13548 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:13.793433 13616 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:13.796017 13439 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:13.791118  8458 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
I20260709 13:03:13.800019 13512 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:13.822507 13635 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.846460 13635 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:13.704191  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 222825us
I20260709 13:03:13.826326  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:13.771562 13621 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:13.830152 13633 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:13.843569 13625 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.867014  9295 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
W20260709 13:03:13.848955 13557 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 2.000s	user 0.004s	sys 0.015s
I20260709 13:03:13.872893  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 1113) took 1671 ms. Trace:
I20260709 13:03:13.855607  8351 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:13.888320  8535 raft_consensus.cc:2393] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 13: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:13.891438  8351 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:13.890144  8531 rpcz_store.cc:276] 0709 13:03:12.205882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.224347 (+ 18465us) service_pool.cc:224] Handling call
0709 13:03:12.245745 (+ 21398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:12.414398 (+168653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:12.414445 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:12.414504 (+    59us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:12.414550 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.872612 (+1458062us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54002b9154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:13.872673 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.872831 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":387352960}
I20260709 13:03:13.752195 13587 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:13.887638 13381 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:13.939038  8535 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:13.954844  9258 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:13.897058 13382 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:13.897533 13616 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:13.954501  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 63146.9us
I20260709 13:03:13.938921 13600 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:13.911897 13605 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:13.969280  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 1120) took 1749 ms. Trace:
I20260709 13:03:13.976114  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2561) took 3238 ms. Trace:
I20260709 13:03:13.977253  9293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 1122) took 2231 ms. Trace:
I20260709 13:03:13.975011  8533 rpcz_store.cc:276] 0709 13:03:12.219426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.224401 (+  4975us) service_pool.cc:224] Handling call
0709 13:03:12.234689 (+ 10288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:12.409408 (+174719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.967364 (+1557956us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54000f73d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:13.969201 (+  1837us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378945408}
I20260709 13:03:13.908171 13633 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:13.976577  8529 rpcz_store.cc:276] 0709 13:03:10.737812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.739213 (+  1401us) service_pool.cc:224] Handling call
0709 13:03:10.739585 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:10.748128 (+  8543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:10.748174 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:10.762511 (+ 14337us) log.cc:844] Serialized 26 byte log entry
0709 13:03:11.244407 (+481896us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:11.244832 (+   425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:11.244942 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:13.848361 (+2603419us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:13.975773 (+127412us) raft_consensus.cc:1685] finished
0709 13:03:13.975798 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.976013 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21840,"raft.queue_time_us":25720,"raft.run_cpu_time_us":1674,"raft.run_wall_time_us":48042,"spinlock_wait_cycles":8089472,"thread_start_us":397679,"threads_started":1,"wal-append.queue_time_us":878872}
I20260709 13:03:13.978566 13639 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:03:13.980422 13633 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:13.958375 13439 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:13.963879 13382 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:13.943110 13381 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:13.977684  9293 rpcz_store.cc:276] 0709 13:03:11.739028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.739252 (+   224us) service_pool.cc:224] Handling call
0709 13:03:11.739663 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:11.740106 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:11.921902 (+181796us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b18003d8640. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5395455 00007f36cbe7d3c7 00007f36c848f9a7 00007f36c849f0bf 00007f36c849f038
0709 13:03:12.035777 (+113875us) log.cc:844] Serialized 14 byte log entry
0709 13:03:13.205350 (+1169573us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b18003d8640. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c802523a 00007f36c848fa2a
0709 13:03:13.287030 (+ 81680us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:13.293625 (+  6595us) log.cc:844] Serialized 26 byte log entry
0709 13:03:13.293815 (+   190us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:13.293863 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.293982 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:13.969853 (+675871us) raft_consensus.cc:1685] finished
0709 13:03:13.969874 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.970021 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":322972,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":4362,"raft.queue_time_us":10696,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":8290,"spinlock_wait_cycles":50980992,"thread_start_us":189645,"threads_started":2,"wal-append.queue_time_us":1398494}
I20260709 13:03:13.992256  8533 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:13.913098 13587 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:13.988590 13458 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:13.988376 13518 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:14.022193  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 1121) took 1324 ms. Trace:
I20260709 13:03:14.022722  8527 rpcz_store.cc:276] 0709 13:03:12.697729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.698377 (+   648us) service_pool.cc:224] Handling call
0709 13:03:12.747416 (+ 49039us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:13.697321 (+949905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.021902 (+324581us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b54002ba554. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:14.022122 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1947071872}
W20260709 13:03:14.025302 13643 log.cc:927] Time spent T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.064s	user 0.000s	sys 0.002s
I20260709 13:03:14.025729  8456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36448 (request call id 2343) took 1951 ms. Trace:
I20260709 13:03:14.026115  8456 rpcz_store.cc:276] 0709 13:03:12.074621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.074818 (+   197us) service_pool.cc:224] Handling call
0709 13:03:14.025543 (+1950725us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540041ad54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:14.025673 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2979445120}
I20260709 13:03:14.027277 13381 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:14.028298 13588 raft_consensus.cc:3055] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:14.028748 13588 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:14.029667 13588 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:14.033519  8533 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 19. Current term is 20. Ops: []
W20260709 13:03:14.037775  8378 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48484 (request call id 880) took 1932 ms (client timeout 2137 ms). Trace:
W20260709 13:03:14.038301  8378 rpcz_store.cc:269] 0709 13:03:12.085560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.123803 (+ 38243us) service_pool.cc:224] Handling call
0709 13:03:14.015053 (+1891250us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b5400189554. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:14.017757 (+  2704us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2261163392}
I20260709 13:03:14.040129 13520 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:14.040849 13587 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:14.047559 13625 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:14.048645  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 186996us
I20260709 13:03:13.986801 13553 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:14.086601 13553 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:14.088533  8534 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:03:14.089162  8379 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 3321) took 2672 ms (client timeout 1571 ms). Trace:
W20260709 13:03:14.089751  8379 rpcz_store.cc:269] 0709 13:03:11.416481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.440679 (+ 24198us) service_pool.cc:224] Handling call
0709 13:03:14.088832 (+2648153us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400269154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:14.088992 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2930748672}
I20260709 13:03:14.096913  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:14.097669  9293 raft_consensus.cc:2376] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13. Re-sending same reply.
I20260709 13:03:14.098549 13599 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:14.100354  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:14.101450  8526 raft_consensus.cc:2393] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 14: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:14.104415  8349 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:14.105412  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:14.106097  9293 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:14.108058  9295 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:14.110487 13635 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:14.113472 13625 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:14.114939 13520 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:14.114866  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:14.115350 13542 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:14.115453 13520 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:14.116060 13520 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:14.119408 13492 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.120047 13492 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:14.125675  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:14.126421  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:14.127049  8379 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:14.127367  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:14.127853  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:14.128434  8379 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:03:14.128463  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:14.129390  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:14.129665  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:14.130898  8384 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:14.136698 13541 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:14.138090 13379 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:14.138923  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:14.139644  8380 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:03:14.141968  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:14.127074  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:14.129398  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:14.151978  9258 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:14.153442  9258 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:14.119511 13617 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:14.171785  8500 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:14.184319  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:14.185312  8532 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:14.186679  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:14.188369  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:14.190186  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:14.191541  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:14.192709  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:14.204201  8351 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:14.142495 13535 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:14.155386 13379 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:14.209993  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:14.210599  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:14.206972  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:14.209610  9296 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:03:14.211675  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 623783us
I20260709 13:03:14.212460  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:14.170775 13597 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:14.207674  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:14.207175  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:14.215844  9295 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:14.215777  8528 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:14.217206  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.216768  8351 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:14.156311 13599 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:14.212352  8427 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:14.173463 13542 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.174058 13251 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:14.215130  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:14.203997 13635 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:14.224391  8526 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:14.197230 13491 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.221892  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:14.222368  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:14.209285 13543 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:14.179606 13625 consensus_queue.cc:1059] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:03:14.225863 13285 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.173401 13587 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:03:14.228315  9295 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:14.234164  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:14.234939  9295 raft_consensus.cc:2393] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 14: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:14.235875  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:14.236490  9295 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:14.237147  9291 raft_consensus.cc:1240] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:14.224285 13379 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:14.237960  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.238583  8453 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:14.239215 13379 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:14.239367  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.229032  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:14.240407  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.240430  8456 raft_consensus.cc:2368] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13.
I20260709 13:03:14.240849 13601 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:14.227597 13542 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:14.241648  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.215584 13535 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:14.232715 13285 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:14.242774  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.243283 13542 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:14.243775  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.243937 13535 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:14.244167 13285 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:14.241073  8453 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:03:14.219981 13589 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.209573 13604 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:03:14.241508 13601 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:14.246143  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.230167  8528 raft_consensus.cc:2393] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 14: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:14.244841  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.196906 13617 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:03:14.260331  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.207036 13382 consensus_queue.cc:1059] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:03:14.223981 13553 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:14.302184  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 89917.5us
I20260709 13:03:14.302747  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.220045 13273 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:03:14.305038  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.270799  8460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 993) took 1145 ms. Trace:
I20260709 13:03:14.313756  8460 rpcz_store.cc:276] 0709 13:03:13.125683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.141760 (+ 16077us) service_pool.cc:224] Handling call
0709 13:03:13.142043 (+   283us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:13.155450 (+ 13407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.155482 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:13.186588 (+ 31106us) log.cc:844] Serialized 52 byte log entry
0709 13:03:13.339444 (+152856us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:13.350615 (+ 11171us) log.cc:844] Serialized 14 byte log entry
0709 13:03:14.142233 (+791618us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b180031b280. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c5312c0a 00007f36cea52219 00007f36c539aa40 00007f36c53954e4 00007f36c5395455 00007f36c847d060 00007f36c848f716 00007f36c84a0287 00007f36c84a0208
0709 13:03:14.270249 (+128016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.270351 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:14.270427 (+    76us) raft_consensus.cc:1685] finished
0709 13:03:14.270542 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.270723 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85950,"prepare.queue_time_us":11010,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":841956,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":11540,"spinlock_wait_cycles":12782336,"thread_start_us":255786,"threads_started":2,"wal-append.queue_time_us":227223}
I20260709 13:03:14.316426  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.317888  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.319129  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.322460  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:14.323122  9295 raft_consensus.cc:2376] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14. Re-sending same reply.
I20260709 13:03:14.226542 13635 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.261636  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:14.312852  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 91016.1us
I20260709 13:03:14.220069 13597 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:14.327198  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.336826  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:14.329099  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:14.341693  8456 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:03:14.245404 13491 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:14.364295 13584 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.240752 13520 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:14.364952 13584 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:14.366304 13601 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:14.335211  8424 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:14.350692 13630 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:14.313653 13553 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:14.354732 13650 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:03:14.354830  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:14.361774 13645 log.cc:927] Time spent T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.404s	user 0.001s	sys 0.003s
I20260709 13:03:14.365489  8377 raft_consensus.cc:2393] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 14: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:14.348502  8427 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:14.326606 13560 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:03:14.401778  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 66768.2us
I20260709 13:03:14.401643  9295 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:03:14.373409  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:14.388339  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 59222.7us
I20260709 13:03:14.373018  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.370035  8459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 987) took 1669 ms. Trace:
I20260709 13:03:14.410334  8457 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:03:14.326643 13635 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:14.346931 13492 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:14.416628  8424 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:14.355404 13542 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.417843  9289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 762) took 1353 ms. Trace:
I20260709 13:03:14.369130 13520 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:14.416316  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 67879.8us
I20260709 13:03:14.357131 13583 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:14.455461  8424 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:14.418915  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:14.463907  9295 raft_consensus.cc:2410] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 14 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 13:03:14.425828  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.357695 13607 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:14.409500 13331 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:14.367240 13584 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:14.370098 13491 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:14.410929 13601 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:14.258679 13589 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:14.453706  9289 rpcz_store.cc:276] 0709 13:03:13.060667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.123539 (+ 62872us) service_pool.cc:224] Handling call
0709 13:03:13.123845 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.124071 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:13.217875 (+ 93804us) log.cc:844] Serialized 14 byte log entry
0709 13:03:14.263034 (+1045159us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b18001b8140. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c802d4bc 00007f36c537b48b 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c802523a
0709 13:03:14.407306 (+144272us) log.cc:844] Serialized 14 byte log entry
0709 13:03:14.413048 (+  5742us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:14.413771 (+   723us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:14.413835 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.413913 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.414032 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65152,"prepare.queue_time_us":164333,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":11571,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":15754,"spinlock_wait_cycles":61401984,"thread_start_us":290361,"threads_started":3,"wal-append.queue_time_us":293511}
I20260709 13:03:14.413264 13504 raft_consensus.cc:3055] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:14.466259  8351 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:14.470718  8424 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:14.421552 13021 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:14.452970  8459 rpcz_store.cc:276] 0709 13:03:12.701006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.777294 (+ 76288us) service_pool.cc:224] Handling call
0709 13:03:12.777620 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:12.798700 (+ 21080us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:13.271639 (+472939us) spinlock_profiling.cc:243] Waited 69.7 ms on lock 0x7b18003b3c80. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5395455 00007f36cbe7d3c7 00007f36c848f9a7 00007f36c849f0bf 00007f36c849f038
0709 13:03:13.345871 (+ 74232us) log.cc:844] Serialized 14 byte log entry
0709 13:03:14.212817 (+866946us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:14.214533 (+  1716us) log.cc:844] Serialized 26 byte log entry
0709 13:03:14.214742 (+   209us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:14.214800 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.214871 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:14.369651 (+154780us) raft_consensus.cc:1685] finished
0709 13:03:14.369751 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.369962 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":754442,"prepare.queue_time_us":370290,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":711088,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":37112,"spinlock_wait_cycles":160231808,"thread_start_us":191945,"threads_started":2,"wal-append.queue_time_us":278744}
I20260709 13:03:14.461411 13585 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:14.415400 13560 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:14.481388 13331 raft_consensus.cc:697] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 17 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:03:14.598595  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 127948us
I20260709 13:03:14.609851  8424 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:14.488246  8455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43296 (request call id 59) took 2582 ms. Trace:
I20260709 13:03:14.488868 13553 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:14.452776 13266 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:03:14.463307 13542 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:14.630736  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:14.470718 13607 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.490154 13292 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:14.611189  8455 rpcz_store.cc:276] 0709 13:03:11.905839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.935159 (+ 29320us) service_pool.cc:224] Handling call
0709 13:03:14.488043 (+2552884us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b540037a854. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c847f853 00007f36cd44d60a 00007f36c69d37d4 00007f36c69d3762 00007f36c69d3691 00007f36c69d360c 00007f36c69d28c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:14.488156 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":987789056}
W20260709 13:03:14.632306  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 136635us
I20260709 13:03:14.640252  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:14.598256 13491 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:14.647657  8384 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:14.610924 13560 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:14.601588  8381 raft_consensus.cc:1240] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:03:14.646658 13021 raft_consensus.cc:697] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:14.651412 13585 raft_consensus.cc:697] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:14.658576  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:14.694299  8378 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:14.659021  9290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55734 (request call id 1126) took 1986 ms. Trace:
I20260709 13:03:14.695086  9290 rpcz_store.cc:276] 0709 13:03:12.673174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.674052 (+   878us) service_pool.cc:224] Handling call
0709 13:03:14.658793 (+1984741us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54003a20d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:14.658948 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040491776}
I20260709 13:03:14.665519 13331 consensus_queue.cc:237] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:14.666553  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 56815.3us
W20260709 13:03:14.671474 13651 log.cc:927] Time spent T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.496s	user 0.002s	sys 0.000s
I20260709 13:03:14.675264 13586 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:14.676589  8383 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 2428) took 1883 ms (client timeout 1856 ms). Trace:
I20260709 13:03:14.679752  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.680543  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.681229  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.681985  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.493556 13504 raft_consensus.cc:740] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:14.718138  8424 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:14.718412  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.718978 13585 consensus_queue.cc:237] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:14.719590  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.720683  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.721675 13021 consensus_queue.cc:237] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:14.730496 12874 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:14.687187  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:14.735633  8501 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:14.600175 13598 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:03:14.737344 13598 consensus_queue.cc:1243] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer 446d9310dce14ff4afff2dc2d64f68d8 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:03:14.610162 13583 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.105s
I20260709 13:03:14.739522 13586 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.656140 13491 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:14.740794 13491 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:14.740885 13379 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:14.741366 13379 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:14.741767 13379 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:14.700587  8528 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:14.701510  8456 raft_consensus.cc:2410] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:03:14.705963  8386 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:14.716311  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:14.649003 13629 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:03:14.699707  8383 rpcz_store.cc:269] 0709 13:03:12.792702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.794644 (+  1942us) service_pool.cc:224] Handling call
0709 13:03:14.676415 (+1881771us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54002c7754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:14.676520 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":822522240}
I20260709 13:03:14.646776 13625 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.717530  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:14.740092 13586 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:14.649741 13607 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:14.716749  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.763489  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.746450  8379 raft_consensus.cc:2376] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10. Re-sending same reply.
I20260709 13:03:14.690012  8530 raft_consensus.cc:1240] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:03:14.753295  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:14.753800  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 54817.6us
W20260709 13:03:14.752024 13646 log.cc:927] Time spent T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:03:14.763760  8453 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:14.716974  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:14.765616  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:14.771649  8381 raft_consensus.cc:2393] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 13: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:03:14.778628 13658 log.cc:927] Time spent T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:03:14.781697 13542 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:14.783164 13589 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:14.785877  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:14.759434 13629 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:14.411528 13630 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:14.791910  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:14.792666  8378 raft_consensus.cc:2393] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 14: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:14.795233  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:14.795825  8457 raft_consensus.cc:606] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:14.796134  8457 raft_consensus.cc:614] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:14.790362 13629 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:14.764010 13625 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:14.718453 13504 consensus_queue.cc:260] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:14.827622  8457 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:14.841199 13504 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:14.845191  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:14.845410  8501 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:14.846096  8380 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:03:14.846928  8501 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:14.847846  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:14.848723 13542 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:14.854375 13586 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:14.854899 13542 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.855369 13542 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:14.849270 13594 raft_consensus.cc:2804] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:14.851287  8454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 983) took 2161 ms. Trace:
I20260709 13:03:14.851531 13381 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:14.852346  8382 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48484 (request call id 877) took 2767 ms (client timeout 2110 ms). Trace:
W20260709 13:03:14.853029 13599 consensus_queue.cc:1175] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b8eb0ad4490645598004d862412f4e31" responder_term: 16 status { last_received { term: 13 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 15. Current term is 16. Ops: [15.12-15.12]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:03:14.844772  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 497587us
I20260709 13:03:14.829572  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:14.846944  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:14.860738  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:14.863144  8426 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:14.861500  8382 rpcz_store.cc:269] 0709 13:03:12.084759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.123864 (+ 39105us) service_pool.cc:224] Handling call
0709 13:03:14.852066 (+2728202us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b54003b7754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:14.852259 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1515607936}
I20260709 13:03:14.858143  8454 rpcz_store.cc:276] 0709 13:03:12.689850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.689997 (+   147us) service_pool.cc:224] Handling call
0709 13:03:12.690384 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:13.127351 (+436967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.850890 (+1723539us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b540037c3d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:14.851166 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1003511168}
I20260709 13:03:14.868844  9261 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:14.836424 13379 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:14.882432  9291 pending_rounds.cc:85] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting all ops after (but not including) 10
I20260709 13:03:14.911101  9291 pending_rounds.cc:107] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:03:14.911528  9291 raft_consensus.cc:2889] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:14.885852  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.858065 13594 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:14.874089 13624 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:14.861351 13381 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:14.887210 12874 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:14.879361 13662 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:03:14.917367  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:14.927060  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:14.927466  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.895661 13640 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:03:14.934478  8457 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:14.957108  9293 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:03:14.958824  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:14.919611 13594 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:14.963816 13666 log.cc:927] Time spent T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:03:14.964588 13381 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:14.965183  8452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 994) took 1758 ms. Trace:
I20260709 13:03:14.965610  8452 rpcz_store.cc:276] 0709 13:03:13.207208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.207326 (+   118us) service_pool.cc:224] Handling call
0709 13:03:13.207681 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:13.263087 (+ 55406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.263118 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:14.168923 (+905805us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b2c0007a8e8. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2
0709 13:03:14.206183 (+ 37260us) log.cc:844] Serialized 26 byte log entry
0709 13:03:14.496628 (+290445us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:14.496958 (+   330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.497054 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:14.964878 (+467824us) raft_consensus.cc:1685] finished
0709 13:03:14.964900 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.965124 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71493,"raft.queue_time_us":55133,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"spinlock_wait_cycles":3962752,"thread_start_us":286572,"threads_started":1,"wal-append.queue_time_us":579811}
W20260709 13:03:14.967620 13667 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:03:14.936694 12874 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:14.970053 13625 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:14.965281 13381 consensus_queue.cc:1059] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:03:14.973340 13504 raft_consensus.cc:3055] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:14.973780 13504 raft_consensus.cc:740] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:14.974637 13504 consensus_queue.cc:260] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:14.975777  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:14.976599  8532 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:14.977922 13630 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:14.978533  9258 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:14.979770 13382 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:14.980162 13382 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.980577 13382 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:14.982868 13491 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:14.999567  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 114002us
I20260709 13:03:14.937173 13635 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:15.000761  9261 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:14.990021 13491 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:15.006107 13629 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:15.018657  8457 raft_consensus.cc:1240] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:15.019976 13629 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:15.021978 13635 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:15.022554  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 304470us
I20260709 13:03:15.023355  8424 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:15.014539  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 59820.8us
I20260709 13:03:14.988878 13560 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:15.025581  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:15.025508  8533 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:03:15.031816  8454 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 13. Current term is 14. Ops: []
W20260709 13:03:15.035662  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 169207us
I20260709 13:03:15.036830  8501 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:15.039116  8351 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:15.057451  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:15.025621 13669 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:15.065516  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:15.032202 13625 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:15.072252  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:15.072690  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:15.072301  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:15.073902  8380 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:03:15.075256  9261 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:15.076721 13683 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:15.079906  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:15.082010  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:15.085516  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:15.089140  8427 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:15.079677  9260 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:15.048650 13583 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:15.048703 13629 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:15.078110 13683 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:15.093849 13624 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:15.094295 13640 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:15.095372 13674 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:03:15.098623  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.048955 13491 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:03:15.111208 13339 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:15.115096  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:15.116334 12874 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:15.121624 13504 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:15.070130 13669 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:15.133559  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:15.129073 13560 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:15.136229  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:15.198395  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:15.199054  8377 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:03:15.200018  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:15.078523  8532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30e70dfc88914a66b000a84bef302149"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38894
I20260709 13:03:15.200906  8532 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:15.201290  8532 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:15.080680 13598 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:15.204571  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:15.145251 13251 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:15.147842 13586 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:15.156701  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:15.210355  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:15.217222  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:15.219202  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:15.141326 13585 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:15.224373  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 50643.2us
I20260709 13:03:15.225690  8424 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:15.086158 13375 consensus_queue.cc:1059] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.117s
I20260709 13:03:15.159850 13624 raft_consensus.cc:697] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:15.225654  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:15.240108  8380 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:03:15.253201  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:15.202837 13669 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:15.146275 13683 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:15.266158  9261 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:15.232851  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:15.210696 13379 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:15.274212  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:15.278590  8380 raft_consensus.cc:2393] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 14: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:15.281576  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:15.289592  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:15.296572  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:15.297621  8378 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:03:15.246474 13629 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:15.301469  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:15.302196  8527 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:15.303041  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:15.304013  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:15.304572  8527 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:03:15.246743 13586 raft_consensus.cc:697] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 20 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:15.310238  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:15.310948  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:15.311619  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:15.312288  8382 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:03:15.313521  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:15.303043  8458 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.958s	user 0.015s	sys 0.043s
W20260709 13:03:15.318508  8458 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.015s	sys 0.044s
I20260709 13:03:15.320021  8458 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36448 (request call id 2351) took 1099 ms. Trace:
W20260709 13:03:15.332079  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 266017us
I20260709 13:03:15.339730  8501 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:15.319597 13535 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:15.276260 13607 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:15.351506  8501 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:15.263055 13382 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:15.359926 13607 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:15.360668  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:15.361882  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:15.362471  8385 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:03:15.365392  8460 raft_consensus.cc:2393] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 13: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:15.338845 13339 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.335935 13583 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:15.392908  8501 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:15.285831 13585 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:15.417471  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 151381us
I20260709 13:03:15.354573 13379 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:15.398902 13339 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:15.397935 13583 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:15.445624  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 268270us
I20260709 13:03:15.447922  9261 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:15.462608  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:15.431386 13379 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:15.430168 13688 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:15.473178  9261 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:15.450182 13598 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:15.348543 13624 consensus_queue.cc:237] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:15.486409  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 93563.8us
I20260709 13:03:15.487295  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:15.487721  8501 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:15.488148  9295 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:15.472612 13689 log.cc:927] Time spent T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 13:03:15.499902  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.500217  8385 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:15.474988 13688 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.474457 13640 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:15.469946 13379 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:15.506019  8427 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:15.513304  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:15.519795  9295 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 16.
I20260709 13:03:15.521903  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:15.515710 12874 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:15.528084 12874 raft_consensus.cc:697] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:15.528916 13581 raft_consensus.cc:3055] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:15.529523 13581 raft_consensus.cc:740] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:15.530623 13581 consensus_queue.cc:260] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:15.532822  8382 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:03:15.536093 13687 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:03:15.536732 13597 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:15.538149 13675 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:03:15.544360 13690 log.cc:927] Time spent T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:03:15.455653 13586 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:15.549649 13339 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:15.550330 13339 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:03:15.539552 13678 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:03:15.540827  8460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36448 (request call id 2364) took 1300 ms. Trace:
I20260709 13:03:15.549682  8386 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:15.499367 13141 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:15.538895 13697 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:03:15.562240  8460 rpcz_store.cc:276] 0709 13:03:14.240215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.318873 (+ 78658us) service_pool.cc:224] Handling call
0709 13:03:15.540598 (+1221725us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540041b254. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:15.540760 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2404359424}
I20260709 13:03:15.532227 13581 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:15.558048  8532 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:15.503971 13694 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:15.490614 13598 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:15.511018 13688 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:15.583869  8532 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:15.528978 12874 consensus_queue.cc:237] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:15.634815 13598 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:15.636140 13314 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:15.641786  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2601) took 1385 ms. Trace:
I20260709 13:03:15.642324  8533 rpcz_store.cc:276] 0709 13:03:14.256809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.257064 (+   255us) service_pool.cc:224] Handling call
0709 13:03:14.382733 (+125669us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:15.027414 (+644681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.641467 (+614053us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54002add54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:15.641704 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1477439232}
I20260709 13:03:15.654706  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:15.655521  8457 raft_consensus.cc:606] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:03:15.576786 13683 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:15.563437 13339 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:15.669848  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.669880  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:15.670699 13601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.010s	sys 0.001s
I20260709 13:03:15.674813 13705 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:03:15.667049  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 179385us
W20260709 13:03:15.682381 13704 log.cc:927] Time spent T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:03:15.683332 13583 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:15.686364 13542 consensus_meta.cc:287] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.825s	user 0.011s	sys 0.002s
I20260709 13:03:15.714948 13542 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:15.696979 13688 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:15.717902 13542 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:15.687229 13585 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:15.656389 13458 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:15.719409 13688 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:15.719292 13458 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:15.722741 13458 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:15.712414  8501 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:15.724912 13542 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:15.725608 13542 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:15.726181 13542 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:15.726917 13379 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:15.688259  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:03:15.688350 13594 consensus_meta.cc:287] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.688s	user 0.007s	sys 0.004s
W20260709 13:03:15.691874 13676 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.430s	user 0.001s	sys 0.000s
I20260709 13:03:15.674849 13382 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:15.706670  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:15.707599  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:15.700899 13323 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:15.709443 13669 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:15.737697 13314 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:15.739446 13669 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:15.710127 13705 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:15.739902 13583 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:15.740782 13705 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:15.741133 13583 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:15.741719 13583 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:15.743963 13612 consensus_queue.cc:1059] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:15.745039  9292 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:15.749369 13560 raft_consensus.cc:3055] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:15.749797 13560 raft_consensus.cc:740] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:15.750106  8351 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:15.734117 13594 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:15.752661  8526 raft_consensus.cc:1240] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:15.754427 13594 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:15.754578 13379 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:15.750685 13560 consensus_queue.cc:260] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:15.761715 13560 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:15.711901 13339 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:15.712075 13601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.011s	sys 0.001s
I20260709 13:03:15.766861  8426 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:15.769443 13581 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:15.775187  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:15.772927 13617 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:15.781018  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:15.781343 13271 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:15.781823 13271 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:15.782445  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:15.782130  8426 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:15.783057  8460 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:03:15.783421 13266 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:15.782585  9292 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:15.778743  9293 raft_consensus.cc:2376] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13. Re-sending same reply.
I20260709 13:03:15.791482 13469 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:15.792372  8351 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:15.792565  9293 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:03:15.792972  9293 pending_rounds.cc:85] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting all ops after (but not including) 8
I20260709 13:03:15.793210  9293 pending_rounds.cc:107] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:03:15.793452  9293 raft_consensus.cc:2889] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:15.799575 13705 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:15.807185  8349 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:15.783464  8455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 2398) took 1104 ms. Trace:
I20260709 13:03:15.808579  8455 rpcz_store.cc:276] 0709 13:03:14.679032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.682467 (+  3435us) service_pool.cc:224] Handling call
0709 13:03:14.682763 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:14.683100 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:14.683126 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:15.549811 (+866685us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b2c0007a8e8. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2
0709 13:03:15.550232 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 13:03:15.668460 (+118228us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:15.668509 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.668608 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:15.776470 (+107862us) raft_consensus.cc:1685] finished
0709 13:03:15.776499 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.783407 (+  6908us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":537,"raft.queue_time_us":356,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":4622720,"thread_start_us":117809,"threads_started":1,"wal-append.queue_time_us":195406}
I20260709 13:03:15.811404  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:15.815594 13588 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:15.781018 13617 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:15.821558  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:15.831223  9293 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:15.831377  9292 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:03:15.782192 13271 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:15.836633  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:15.838128  9293 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16. Ops: [13.10-15.11]
I20260709 13:03:15.839052  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:15.839013  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:15.860893  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:15.864395  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:15.865525  9287 raft_consensus.cc:2393] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 15: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:15.800690 13583 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:15.868002  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:15.871412  9293 raft_consensus.cc:2410] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:03:15.868911  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:15.873644  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:15.878016  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:15.833297 13625 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:15.884670  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:15.804914 13458 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:03:15.890038 13554 consensus_queue.cc:1059] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:03:15.842693 13600 consensus_queue.cc:1059] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 13:03:15.907226 13585 raft_consensus.cc:3055] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:15.885233 13601 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:03:15.884907 13625 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.914433  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:15.953320  9287 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:15.954313  8500 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.194:36925 timed out after 1.823s (SENT) [suppressed 8 similar messages]
I20260709 13:03:15.891454 13285 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:15.888574 13595 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:03:15.887003 13417 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:03:15.320506  8458 rpcz_store.cc:276] 0709 13:03:14.220627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.220862 (+   235us) service_pool.cc:224] Handling call
0709 13:03:14.245399 (+ 24537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:14.245596 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:14.344987 (+ 99391us) log.cc:844] Serialized 14 byte log entry
0709 13:03:15.319294 (+974307us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:15.319362 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:15.319430 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.319638 (+   208us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.319951 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":164067,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":149,"thread_start_us":1065519,"threads_started":2,"wal-append.queue_time_us":574368}
I20260709 13:03:16.084625  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 2391) took 3250 ms. Trace:
W20260709 13:03:16.127517  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.953958 13625 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:15.912961 13617 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:15.920176 13585 raft_consensus.cc:740] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:03:16.051296  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 96995.9us
W20260709 13:03:16.114794 13691 log.cc:927] Time spent T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.604s	user 0.002s	sys 0.005s
W20260709 13:03:16.156831  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 364487us
I20260709 13:03:16.171386  8500 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:15.960547 13635 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.009s	sys 0.010s
I20260709 13:03:15.994485  9287 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
W20260709 13:03:16.065665 13715 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:03:15.986970 13598 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:16.106441 13292 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:03:16.116278 13339 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:16.055363 13141 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.963229 13285 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:16.172226  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:15.955920 13586 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:16.173277  8500 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:16.178853 13141 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:16.026036 13581 raft_consensus.cc:697] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 16 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:16.166878 13583 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:16.173930 13617 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:16.158141  8461 rpcz_store.cc:276] 0709 13:03:12.833884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.121641 (+287757us) service_pool.cc:224] Handling call
0709 13:03:13.122056 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:13.164769 (+ 42713us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:13.320279 (+155510us) log.cc:844] Serialized 14 byte log entry
0709 13:03:14.179580 (+859301us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:14.203209 (+ 23629us) log.cc:844] Serialized 26 byte log entry
0709 13:03:14.203433 (+   224us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:14.203486 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.840436 (+636950us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b4800251dd8. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36cd3aeaa1 00007f36cd3a5b37 00007f36cd3a59ca 00007f36cd49d26f 00007f36cd49cf37 00007f36cd4b155c 00007f36cd4b1508 00007f36cd4b1488 00007f36cd4b1443 00007f36cd4b06ec 00007f36cc3daa96
0709 13:03:16.084276 (+1243840us) spinlock_profiling.cc:243] Waited 42.4 ms on lock 0x7b540015b8d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:16.084337 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:16.084386 (+    49us) raft_consensus.cc:1685] finished
0709 13:03:16.084398 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.084545 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":697385,"prepare.queue_time_us":4496,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":716482,"raft.run_cpu_time_us":3336,"raft.run_wall_time_us":643628,"spinlock_wait_cycles":104656128,"thread_start_us":171788,"threads_started":2,"wal-append.queue_time_us":250270,"wal-append.run_cpu_time_us":3618,"wal-append.run_wall_time_us":1817315}
W20260709 13:03:15.969040  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 161927us
I20260709 13:03:16.180624 13718 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:16.181175 13733 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:16.180240 13586 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:16.174631 13635 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.012s	sys 0.010s
I20260709 13:03:15.980767 13705 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:16.183336  8500 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:16.186694  8349 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:16.187405  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:16.082381 13271 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:16.178340 13598 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:16.195139  8500 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:16.093299 13542 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:16.198428  8349 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:16.200519  8500 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:16.200519  8349 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:16.201412  9294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 1140) took 1110 ms. Trace:
I20260709 13:03:16.206775  8500 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:16.207240  8349 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:16.195195 13726 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:16.218429  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:16.219699  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:16.222913  8459 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:03:16.223068  8349 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:16.197995 13598 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:16.220407  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:16.220494  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:16.207096 13732 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:16.206890 13705 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:16.204659 13729 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:16.190718 13560 consensus_queue.cc:1059] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:03:16.203359 13583 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:16.202793 13733 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:16.221570  9292 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:16.228730  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:16.204766 13617 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:16.197149 13518 consensus_queue.cc:1059] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:03:16.230525  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:16.260528  9287 raft_consensus.cc:2393] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 14: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:03:16.226344  8500 connection.cc:256] RPC call timeout handler was delayed by -1.8790039950000619s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
I20260709 13:03:16.223817 13379 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:16.240888 13732 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:16.256971  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2604) took 1953 ms. Trace:
I20260709 13:03:16.235445 13590 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:16.263252  8528 rpcz_store.cc:276] 0709 13:03:14.303284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.405415 (+102131us) service_pool.cc:224] Handling call
0709 13:03:14.405714 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:14.745808 (+340094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.256712 (+1510904us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b540024cf54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:16.256912 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661485952}
I20260709 13:03:16.191493 13585 consensus_queue.cc:260] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:16.229836 13726 raft_consensus.cc:697] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:16.274129 13726 consensus_queue.cc:237] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:16.275207 13733 raft_consensus.cc:3055] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:16.275665 13733 raft_consensus.cc:740] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:16.275216 13271 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:16.256476 13729 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.277019 13542 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:16.277456  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:16.277410 13729 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:16.239861 13583 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:16.263064 13732 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:03:16.270529  8500 connection.cc:256] RPC call timeout handler was delayed by -1.8639355459999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
W20260709 13:03:16.285322  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 62344.1us
W20260709 13:03:16.287556  8500 connection.cc:256] RPC call timeout handler was delayed by -1.7459473950000302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
W20260709 13:03:16.288534  8500 connection.cc:256] RPC call timeout handler was delayed by -1.7043677760000264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27140000000000003s for a response
I20260709 13:03:16.286304  8349 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:03:16.289013  8500 connection.cc:256] RPC call timeout handler was delayed by -1.5897611960000404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
W20260709 13:03:16.291589  8500 connection.cc:256] RPC call timeout handler was delayed by -1.3045674989999725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
W20260709 13:03:16.292064  8500 connection.cc:256] RPC call timeout handler was delayed by -1.2883674989999463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
I20260709 13:03:16.276537 13733 consensus_queue.cc:260] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:16.292408  8500 connection.cc:256] RPC call timeout handler was delayed by -1.2171611960000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
W20260709 13:03:16.293017  8500 connection.cc:256] RPC call timeout handler was delayed by -1.1323806930000728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
I20260709 13:03:16.293206 13733 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:16.293350  8500 connection.cc:256] RPC call timeout handler was delayed by -1.0029771099999607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
I20260709 13:03:16.296927  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:16.297657  8377 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:03:16.283644 13705 raft_consensus.cc:3055] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:16.284070 13617 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.299477 13560 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:16.300194  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:16.301067 13331 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:16.301782  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:16.364627  8381 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:16.303133  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:16.365397  8384 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:16.202191  9294 rpcz_store.cc:276] 0709 13:03:15.091994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.299361 (+207367us) service_pool.cc:224] Handling call
0709 13:03:15.313629 (+ 14268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.313865 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:15.314187 (+   322us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.073817 (+759630us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b18004688e0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c802d4bc 00007f36c537b48b 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c802523a
0709 13:03:16.074414 (+   597us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.074807 (+   393us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.194917 (+120110us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.195202 (+   285us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:16.195249 (+    47us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:16.195289 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.201221 (+  5932us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.201346 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26323,"prepare.queue_time_us":35640,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":107,"raft.queue_time_us":8519,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":5712,"spinlock_wait_cycles":15030528,"thread_start_us":199680,"threads_started":2,"wal-append.queue_time_us":119308}
I20260709 13:03:16.305541  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:16.285559 13583 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:16.314165  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:16.422466  8377 raft_consensus.cc:2393] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 13: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:16.422784  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:16.423431  8385 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:16.423727  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:16.235816 13581 consensus_queue.cc:237] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:16.424515  8377 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:16.287312 13732 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:16.291676 13542 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:16.308430 13718 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:03:16.426440 13686 log.cc:927] Time spent T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:03:16.308293 13705 raft_consensus.cc:740] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:16.445554  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:16.443652  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:16.420864 13590 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:16.430156 13678 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:03:16.447844  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:16.364779 13708 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:16.365463 13729 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:16.452764  8530 raft_consensus.cc:2393] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 14: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:16.453181  8385 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
I20260709 13:03:16.454701  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:16.453365  8535 raft_consensus.cc:2393] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 14: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:16.457567  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:16.501159  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:16.502103  8385 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:16.506767  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:16.457607  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:03:16.508414  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 50903.2us
I20260709 13:03:16.509438  8500 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:16.517153  8384 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:03:16.518601  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:16.521240  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 222213us
I20260709 13:03:16.520790  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:16.523404  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:16.524333  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:16.525228  8384 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:16.530243  8500 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:16.537783  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:16.537969  8500 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:16.446393 13470 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:16.424311 13617 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:16.540330  8501 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:16.544955  8534 raft_consensus.cc:2393] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 19: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:16.451342 13339 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:16.554468  8385 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:03:16.545799  8377 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:03:16.452353 13590 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.567134  8351 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:16.569398  8381 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:16.576025  8384 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:03:16.426712 13331 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:16.426613 13560 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:16.533694 13588 consensus_meta.cc:287] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.717s	user 0.011s	sys 0.000s
W20260709 13:03:16.584419  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 44174.9us
I20260709 13:03:16.585515  8501 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:16.445015 13542 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:16.533352 13379 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:16.539760 13731 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.588068  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:16.558593 13469 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.010s	sys 0.015s
I20260709 13:03:16.538882 13518 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:16.581555 13590 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:16.689733 13687 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:03:16.546324 13141 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:16.568397 13594 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:16.455559 13718 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:16.684180 13469 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.010s	sys 0.015s
I20260709 13:03:16.589254 13683 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.672225 13746 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:16.684213 13339 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:16.532737 13708 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:16.577117 13470 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:16.576653 13740 consensus_queue.cc:1059] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.128s
W20260709 13:03:16.708461 13735 log.cc:927] Time spent T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.424s	user 0.001s	sys 0.000s
I20260709 13:03:16.704861 13379 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:16.589825 13705 consensus_queue.cc:260] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:16.704614 13746 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:16.704746 13745 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:16.707526 13339 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:16.719408  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 180337us
I20260709 13:03:16.718819 13379 raft_consensus.cc:697] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:16.726956  8379 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:16.745172  8500 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:16.697301 13739 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:03:16.684423 13731 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:16.708434 13683 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:16.763432  8500 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:16.768545  8377 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:16.767390  8500 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:16.748135 13339 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:16.738131 13746 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:16.750056 13705 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:16.774976  8500 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:16.763307 13745 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:16.780156  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 194692us
I20260709 13:03:16.792568  8501 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:16.769131 13751 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:16.774091 13518 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:16.834611  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 46704.2us
W20260709 13:03:16.839643  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 251194us
W20260709 13:03:16.845566  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 53056.3us
I20260709 13:03:16.846678  8500 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:16.840583 13617 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:16.841315 13640 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:16.860085  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:03:16.854651 13748 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:03:16.848551 13518 consensus_queue.cc:1059] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:03:16.848160 13542 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:16.864398 13470 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:16.865736  8351 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:16.791333 13745 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:16.850950 13594 raft_consensus.cc:2804] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:16.849802 13331 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:16.875097  8351 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:16.878042  8380 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 16 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:16.882242 13731 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:16.862059 13640 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:16.840857 13379 consensus_queue.cc:237] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:16.888202 13612 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:16.846096 13758 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:16.870832 13752 log.cc:927] Time spent T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:03:16.909679  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:16.912791  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:16.874140 13491 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:16.910194  8501 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:16.923614 13718 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:16.925243 13749 log.cc:927] Time spent T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:03:16.900710 13755 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:16.916940 13594 raft_consensus.cc:697] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 10 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:16.938835 13594 consensus_queue.cc:237] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:16.947806  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:16.946614  8501 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:16.949589  8501 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:16.895928 13769 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:16.915823 13612 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:16.901317 13708 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:16.952478  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 96825.5us
I20260709 13:03:16.957372  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:16.956480  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:16.960613 13745 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:16.953837  8455 raft_consensus.cc:2393] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 17: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:16.958484  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:16.971622  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:16.972419  8385 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
W20260709 13:03:16.972625 13625 consensus_meta.cc:287] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.804s	user 0.006s	sys 0.005s
I20260709 13:03:16.974772 13285 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:16.968348  8500 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:16.978593 13771 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:16.979177 13771 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:16.979012 13583 consensus_meta.cc:287] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.546s	user 0.003s	sys 0.007s
I20260709 13:03:16.980182 13583 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:16.981169 13625 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:16.982275 13189 raft_consensus.cc:993] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:03:16.982803 13189 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:16.983295 13625 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:16.983249 13189 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:16.984342  8382 raft_consensus.cc:2393] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 14: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:16.985383 13770 raft_consensus.cc:1081] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:03:16.987581 13617 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:16.951391 13518 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:16.998320  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:17.000315  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:17.001104  8458 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:17.023208  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:16.970603 13733 consensus_meta.cc:287] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.000s
I20260709 13:03:16.966478 13718 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:16.996690  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:17.039585  8461 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:17.038677  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 70395us
I20260709 13:03:16.964416 13612 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:17.023765 13774 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:17.046743 13718 raft_consensus.cc:697] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:17.047712 13718 consensus_queue.cc:237] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:16.955541 13769 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:17.049343 13769 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:16.955035 13758 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:16.991326  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:17.033383  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:17.041694  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:17.067508  8457 raft_consensus.cc:3055] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:17.067926  8457 raft_consensus.cc:740] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:17.042240  8454 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:17.042320  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:17.043972  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:17.053287  8386 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
W20260709 13:03:17.044355 13732 consensus_meta.cc:287] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.605s	user 0.008s	sys 0.001s
I20260709 13:03:17.057808  8458 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:17.071399  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:17.072407  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:17.040987  8500 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:17.075313  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:17.076712  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:17.068854  8457 consensus_queue.cc:260] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:17.077888  8457 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:17.079460  8456 raft_consensus.cc:2393] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 14: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:17.033370 13189 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:17.082203  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:17.083127  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:17.084115  8456 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:03:17.085213  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:17.089872 13774 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:17.039433 13518 raft_consensus.cc:697] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:17.103036 13683 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:17.070580 13771 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:17.112190  8379 raft_consensus.cc:1240] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:17.109045  8380 raft_consensus.cc:1240] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:17.076236 13617 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:17.114768  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:17.116076  8461 raft_consensus.cc:2410] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:03:17.109917  8383 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:17.109504  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:17.116281  8379 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:17.117867  8500 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:17.083847 13758 raft_consensus.cc:697] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:17.127167  8379 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:17.160066  8380 raft_consensus.cc:1240] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:17.077772 13732 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.167266  8385 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:17.169461  8349 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:17.163808  8380 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:17.172535  8349 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:17.158097 13598 consensus_meta.cc:287] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.920s	user 0.011s	sys 0.000s
I20260709 13:03:17.177996  8380 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:17.180025  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:17.180874  8529 raft_consensus.cc:2393] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 13: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:17.094201 13590 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:17.184136 13625 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:17.183584  8349 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:17.185158 13775 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:03:17.185403 13625 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:17.187556  8349 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:17.188874 13625 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:17.190171  8349 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:17.191764 13625 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:17.192308 13732 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:17.193343  8384 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:17.189793 13758 consensus_queue.cc:237] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:17.195362 13597 raft_consensus.cc:3055] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:17.195881 13597 raft_consensus.cc:740] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:17.197700 13554 raft_consensus.cc:3055] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:17.198216 13554 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:17.199255 13554 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.200117 13746 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:17.206912 13746 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:17.158424 13708 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:17.213400  8385 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:17.200853 13554 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:17.166411 13751 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:17.172974 13733 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:17.218644  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.219830  8535 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:17.225747  8377 raft_consensus.cc:2393] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 16: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:17.226790  8529 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:03:17.216650  8457 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
I20260709 13:03:17.219318 13635 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:17.209945 13598 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:17.196885 13597 consensus_queue.cc:260] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:17.253732  8527 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:17.234877 13583 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:17.257674  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 204061us
W20260709 13:03:17.265026  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.265129  8382 raft_consensus.cc:1240] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:17.268656  8461 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:17.271288  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:17.271952  8457 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:03:17.275094  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:17.282642  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:17.283318  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:17.283648  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:17.283994  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:17.301371  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:17.302014  8458 raft_consensus.cc:2410] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:03:17.284957  8534 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:17.303885  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.285878  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:17.290980 13585 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.264062 13597 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:17.294389 13598 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:17.296065  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:17.297530  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.312580  8532 raft_consensus.cc:2393] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 14: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:17.219540 13518 consensus_queue.cc:237] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.302093  8457 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 12: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
W20260709 13:03:17.288735  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:17.316965  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.304706  8534 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:03:17.313689  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.319579  8533 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:17.319954  8535 raft_consensus.cc:2393] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 16: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:17.315368  8532 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:03:17.313175 13339 consensus_meta.cc:287] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.528s	user 0.005s	sys 0.005s
W20260709 13:03:17.334919  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 166540us
I20260709 13:03:17.340222  8383 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16. Ops: []
W20260709 13:03:17.360208  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.322679 13590 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:17.365120  8532 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:17.368081  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.370190  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:17.370711  8532 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.372637  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.375614  8349 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:17.376835  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:17.379621 13584 consensus_queue.cc:1059] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:17.380664 13773 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:17.381290 13584 raft_consensus.cc:3055] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:17.381667 13584 raft_consensus.cc:740] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:17.378755  8456 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:17.383896  8424 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:17.327821 13339 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:17.417482  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:17.377858 13640 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.418737  8380 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:17.420104 13640 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:17.388669 13026 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:17.422046  8530 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:17.422115 13339 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:17.385931 13586 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:17.393998 13560 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:17.385535 13590 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:17.390832  9290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 790) took 1172 ms. Trace:
I20260709 13:03:17.423738  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:17.424068  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.398063 13504 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:17.424870 13504 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.423008  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:17.425925  8377 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:17.427143 13504 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:17.386376 13189 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:03:17.429606  8379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:03:17.430143  8427 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:17.430619  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:17.394826 13682 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.431658 13607 consensus_queue.cc:1059] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:17.432363 13682 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.413216  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:17.436311 13743 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.707s	user 0.002s	sys 0.000s
I20260709 13:03:17.439487 13612 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:17.433390  8284 catalog_manager.cc:5697] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.443396  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 2470) took 1141 ms. Trace:
I20260709 13:03:17.443820  8386 rpcz_store.cc:276] 0709 13:03:16.302482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.305284 (+  2802us) service_pool.cc:224] Handling call
0709 13:03:17.443221 (+1137937us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b54003dc2d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:17.443337 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1578379648}
I20260709 13:03:17.444169 13612 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:17.446149 13458 raft_consensus.cc:3055] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:17.446604 13458 raft_consensus.cc:740] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:17.447510 13458 consensus_queue.cc:260] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.448714 13458 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:17.416675 13769 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.450203  8535 raft_consensus.cc:1240] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:17.433665 13630 raft_consensus.cc:3055] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:17.451699 13630 raft_consensus.cc:740] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:17.452939 13769 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:17.395615 13583 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:17.382529 13584 consensus_queue.cc:260] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.453698 13583 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.454434 13584 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:17.455332 13607 consensus_queue.cc:1175] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d653e71832b7402b9a03b46249d3b885" responder_term: 10 status { last_received { term: 9 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:17.456372 13583 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:17.456954  8379 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:17.457415  8379 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:17.459470  8384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 903) took 1029 ms. Trace:
I20260709 13:03:17.459842  8384 rpcz_store.cc:276] 0709 13:03:16.430200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.700211 (+270011us) service_pool.cc:224] Handling call
0709 13:03:16.700528 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.193878 (+493350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.459240 (+265362us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b54002f9ed4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:17.459416 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1132745472}
I20260709 13:03:17.461447  8378 raft_consensus.cc:1240] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:17.467555  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:17.468824  9296 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:17.396574 13382 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:17.440821 13672 consensus_queue.cc:1059] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:03:17.388051 13736 log.cc:927] Time spent T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 1.034s	user 0.002s	sys 0.001s
I20260709 13:03:17.478739  8379 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.469954  9293 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16. Ops: [13.10-15.11]
I20260709 13:03:17.477221 13640 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:17.471150  9295 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:17.479982 13640 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.482474  8528 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
I20260709 13:03:17.485417  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:17.486110  8454 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
I20260709 13:03:17.487454 13470 consensus_queue.cc:1059] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:17.487884 13672 raft_consensus.cc:3055] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:17.488263 13672 raft_consensus.cc:740] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:17.488519 13470 raft_consensus.cc:3055] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:17.491518  8427 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:17.492388 13021 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:17.493288 13469 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:17.495158 13469 consensus_queue.cc:1059] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:17.495887  8459 raft_consensus.cc:2410] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:03:17.497459 13285 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:17.497921 13285 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:17.498299 13285 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:17.500193 13773 raft_consensus.cc:3055] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:17.500640 13773 raft_consensus.cc:740] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:17.477334  8532 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:03:17.503844 13583 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:17.504218  8351 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:17.505236 13559 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.505412 13583 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:17.505990 13583 raft_consensus.cc:697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:17.505796 13559 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:17.506955 13583 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:17.507244 13600 consensus_queue.cc:1059] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:17.508064 13559 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:17.508275 13600 raft_consensus.cc:3055] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:17.508685 13600 raft_consensus.cc:740] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:17.509464 13600 consensus_queue.cc:260] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:17.511214  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:03:17.513013  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 136260us
I20260709 13:03:17.513808  8500 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:17.514031  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:17.388024  8424 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:17.452550 13630 consensus_queue.cc:260] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:17.521823  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 133862us
I20260709 13:03:17.521991  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:17.522107  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 115565us
I20260709 13:03:17.522560  8500 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:17.404791  8534 raft_consensus.cc:1240] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:17.513761  8427 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
W20260709 13:03:17.523790  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.423867  9290 rpcz_store.cc:276] 0709 13:03:16.218028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.218562 (+   534us) service_pool.cc:224] Handling call
0709 13:03:16.228229 (+  9667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.228446 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:03:16.350527 (+122081us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.425336 (+ 74809us) log.cc:844] Serialized 14 byte log entry
0709 13:03:17.390234 (+964898us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b18003a75c0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c5312c0a 00007f36cea52219 00007f36c539aa40 00007f36c53954e4 00007f36c5395455 00007f36c847d060 00007f36c848f716 00007f36c84a0287 00007f36c84a0208
0709 13:03:17.390412 (+   178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:17.390476 (+    64us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:17.390541 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.390625 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:17.390764 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1031547,"prepare.queue_time_us":438662,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":4032,"raft.queue_time_us":1047088,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":10557,"spinlock_wait_cycles":11566848,"thread_start_us":75775,"threads_started":1}
I20260709 13:03:17.517988  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:17.525111  8533 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:17.526124  8500 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:17.519520  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.524950  8501 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:17.520462  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.519132  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.528573  8535 raft_consensus.cc:2410] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:03:17.488881 13470 raft_consensus.cc:740] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:17.528983  8532 raft_consensus.cc:2393] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 11: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:17.433174 13771 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:17.527710  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:17.530141  9292 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 12: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:17.549701  8378 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:17.530325  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.530797  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:17.531366  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:17.510568 13600 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:17.477980 13372 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.571254  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:17.572422  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.575258  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:17.581566  8460 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:17.578972  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:17.582679  9292 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:17.586475  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.587910  8526 raft_consensus.cc:2393] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 13: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:17.588358  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:17.521347 13612 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:17.530411 13339 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:17.529526 13554 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:17.609403  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:17.614708  9260 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:17.617102  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.535250 13586 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:17.623906  9292 raft_consensus.cc:1240] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:17.624257  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:17.636588  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.631134  8379 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:17.576969 13292 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:17.576826 13271 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:17.639514  9290 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 12. Current term is 13. Ops: []
W20260709 13:03:17.644302  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 118251us
I20260709 13:03:17.583999 13189 raft_consensus.cc:2764] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:03:17.577139 13708 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:17.643909 13684 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:17.624085 13630 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:17.512897 13382 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.574800 13737 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:17.648275  8500 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:17.645872  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 121012us
I20260709 13:03:17.612283 13629 consensus_queue.cc:1059] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:03:17.658208  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:17.590232 13372 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.685104  8452 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:03:17.669538  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:17.688365  8533 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:17.636287 13554 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:17.693293 13554 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:17.655853 13292 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.696101 13292 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:17.703028  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.703943  8526 raft_consensus.cc:2410] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:03:17.630595 13682 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:17.576309 13584 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:03:17.673840  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:17.708478  8461 raft_consensus.cc:3055] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:17.708784  8461 raft_consensus.cc:740] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:17.675346  8534 raft_consensus.cc:2368] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14.
I20260709 13:03:17.649819 13470 consensus_queue.cc:260] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:17.655576 13271 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:17.705768  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:17.683763 13737 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.589602 13769 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:03:17.715833  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:17.721711 13271 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:17.715380  9296 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 20.
I20260709 13:03:17.662622 13684 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.663297 13597 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:17.730135  8456 raft_consensus.cc:2393] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:17.709466  8461 consensus_queue.cc:260] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.737464  8461 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:17.631860 13612 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:17.698410 13726 raft_consensus.cc:2764] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:03:17.640235 13772 consensus_queue.cc:1059] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 13:03:17.733434 13684 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:17.746311  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 61333.2us
W20260709 13:03:17.746507  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 98284.6us
I20260709 13:03:17.721784 13559 raft_consensus.cc:3055] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:17.607827 13773 consensus_queue.cc:260] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.750639  8500 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:17.751807  8500 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:17.751811  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.752767  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.752578  8526 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
I20260709 13:03:17.740293 13597 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:17.766237  8500 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:17.754187 13559 raft_consensus.cc:740] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:17.756986 13640 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:17.775203  8460 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
W20260709 13:03:17.763129  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 368529us
I20260709 13:03:17.759533 13705 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:17.769479 13586 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:17.783540 13737 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:17.777649  8379 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:03:17.785876  8378 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:03:17.785784 13559 consensus_queue.cc:260] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:17.786823  8384 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:03:17.787281 13559 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:17.754928 13751 consensus_queue.cc:1059] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:03:17.790545 13382 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:17.772913 13773 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:17.793207 13767 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:17.793630 13382 consensus_queue.cc:1059] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:17.765650 13597 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:17.794934 13640 raft_consensus.cc:3055] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:17.795346 13640 raft_consensus.cc:740] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:17.796185 13640 consensus_queue.cc:260] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.796592 13751 raft_consensus.cc:3055] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:17.779942  8351 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:17.779371  8500 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:17.797816  9258 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:17.819371  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:03:17.821874  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.818121  8501 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:17.823187  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 44085.2us
I20260709 13:03:17.797061 13470 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:17.817414 13718 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.011s	sys 0.030s
I20260709 13:03:17.813468 13640 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.841481  8461 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:17.858429  8349 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:17.813571 13751 raft_consensus.cc:740] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:17.861601  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:17.832088 13708 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:17.832278 13769 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:03:17.860576  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.842794  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:17.820039 13696 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:17.875356 13588 consensus_queue.cc:1059] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:17.819834 13583 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:17.876586 13588 raft_consensus.cc:3055] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:03:17.836544 13718 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.011s	sys 0.030s
I20260709 13:03:17.876998 13588 raft_consensus.cc:740] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:17.877776  8529 raft_consensus.cc:1240] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:17.833366 13554 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:17.880610 13554 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:17.881258  8457 raft_consensus.cc:1240] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:17.881830 13372 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:17.883320 13458 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:17.883767 13458 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:17.884177 13458 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:17.877935 13588 consensus_queue.cc:260] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.886030 13751 consensus_queue.cc:260] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:17.887362 13751 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:17.888973  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.889462  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.890347  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:17.891098  8529 raft_consensus.cc:2393] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 15: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:17.890625 13590 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:17.892386 13590 raft_consensus.cc:697] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:17.893322 13590 consensus_queue.cc:237] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.890597  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:17.894989  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.895716  8533 raft_consensus.cc:2393] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 14: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:17.891600  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:17.869789  9258 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:17.899230 13588 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:17.798759 13285 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.869539  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:17.903479  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:17.906333  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:17.866671 13744 consensus_queue.cc:1059] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:03:17.920161 13744 raft_consensus.cc:3055] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:17.920552 13744 raft_consensus.cc:740] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:17.921365 13744 consensus_queue.cc:260] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:17.921876  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:17.922698 13744 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:17.914106 13734 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:17.925772 13734 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.929442 13734 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:17.930420  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:17.901388 13682 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:17.932283 13682 raft_consensus.cc:697] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:17.933492 13682 consensus_queue.cc:237] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:17.937772  8284 catalog_manager.cc:5697] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:17.829926 13379 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:03:17.946151  8529 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:17.939994  8284 catalog_manager.cc:5697] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:03:17.858917  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.948637  8453 raft_consensus.cc:1240] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:17.957648  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:03:17.959456  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.940591 13684 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:17.964504  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.960927  9261 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:03:17.970216  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.970885  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:17.948998 13769 raft_consensus.cc:697] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:17.954738 13518 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.951125 13612 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:17.978713  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:17.976426  9261 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:18.000349  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.978243 13141 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:18.017627  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:17.990165 13504 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:17.990446 13683 consensus_queue.cc:1059] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:03:17.991001 13518 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:18.026846 13141 raft_consensus.cc:697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:03:18.070106  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 211752us
I20260709 13:03:18.073125  8349 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:18.080778  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:18.076723  8349 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:18.084606  8349 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:18.086997  8529 raft_consensus.cc:2393] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 14: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:03:18.095938  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.075858 13382 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.077775 13598 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:18.099489  8349 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:18.107860  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.087662 13737 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:18.089985 13285 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:18.096871 13774 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:18.078781 13597 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:18.119140  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:18.109488 13789 log.cc:927] Time spent T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:03:18.101720 13762 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:18.140098 13684 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:18.112744  8349 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:18.117715 13790 log.cc:927] Time spent T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:03:18.140656 13771 raft_consensus.cc:3055] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:18.141644 13771 raft_consensus.cc:740] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:18.142668 13771 consensus_queue.cc:260] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:18.144064 13771 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:18.144405  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:18.144649  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:18.145473  8461 raft_consensus.cc:2410] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:03:18.146469  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:18.146631 13737 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:18.147166  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:18.148422  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:18.149540  8456 raft_consensus.cc:2410] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
W20260709 13:03:18.150620 13791 log.cc:927] Time spent T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:03:18.158105 13737 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:18.159325 13458 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:18.161885  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:18.162724  8453 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:18.114223 13560 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:18.165047  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:18.129549  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:18.147183  8461 raft_consensus.cc:2376] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19. Re-sending same reply.
I20260709 13:03:18.171402  8460 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:03:18.176815  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:18.177951  8460 raft_consensus.cc:2376] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14. Re-sending same reply.
I20260709 13:03:18.184429  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:18.076515 13769 consensus_queue.cc:237] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:18.191075  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 348379us
I20260709 13:03:18.195483  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:18.110260 13382 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:18.198820  8460 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:18.136032 13141 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:18.199817  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:18.167850 13597 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:18.205734  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.206489  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:18.218446  8458 raft_consensus.cc:2393] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 17: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:18.246608  8453 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:18.248373  9260 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:18.181205 13696 consensus_queue.cc:1059] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
W20260709 13:03:18.250344  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 261238us
I20260709 13:03:18.252995  8379 raft_consensus.cc:1275] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:18.256039  8379 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:18.257053  8351 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:18.267674  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:18.268945  8500 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:18.270730  8458 raft_consensus.cc:1240] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:18.271464  8377 raft_consensus.cc:1240] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:18.220804 13583 raft_consensus.cc:697] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:18.225342 13612 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:18.273034  8453 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:18.276173  8383 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:18.279376  8426 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:18.276968  8500 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:18.273715  8379 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:18.284027  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:18.296082  9294 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:18.295807  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:18.303500  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:18.303871  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:18.304596  9287 raft_consensus.cc:2410] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:03:18.308336  8385 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:18.316746  8426 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:18.326628  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.270925 13458 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:18.273936 13684 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:18.342216  9294 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:18.336391  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:18.277837 13762 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.343915  9289 raft_consensus.cc:3055] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:18.345835  9289 raft_consensus.cc:740] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:03:18.344225  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 68509us
I20260709 13:03:18.282662 13586 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:18.297448 13518 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:18.314389 13542 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:18.299547 13806 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:18.363965  8535 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
I20260709 13:03:18.278833 13705 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:03:18.274791 13597 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
I20260709 13:03:18.368031  8349 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:18.344821 13671 raft_consensus.cc:2764] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:03:18.364216  9289 consensus_queue.cc:260] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:18.357336 13794 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:18.314188 13590 consensus_queue.cc:1059] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:03:18.389127 13382 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:18.389587 13583 consensus_queue.cc:237] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:18.297971 13612 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:18.338913 13617 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:03:18.359653 13684 raft_consensus.cc:697] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:18.277988 13672 consensus_queue.cc:260] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:18.411031  8351 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
W20260709 13:03:18.417234 13799 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:03:18.421207  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.379897 13458 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:18.351718 13762 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:18.428427  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:18.434703  8456 raft_consensus.cc:2393] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 12: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:18.429411  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:18.436962  8500 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:18.438460  8500 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:18.427255  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:18.442183  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:18.444949  8500 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:18.443277  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:18.446743 13746 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:18.447036 13339 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:18.447417 13802 log.cc:927] Time spent T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:03:18.447336  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:18.429620 13662 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:18.448061 13801 log.cc:927] Time spent T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
W20260709 13:03:18.449896 13800 log.cc:927] Time spent T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:03:18.448542 13586 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:18.455283  8526 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:03:18.448473  8424 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:18.585692  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 137330us
I20260709 13:03:18.586419  8424 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:18.586913  8526 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:18.587556  8424 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:18.588445  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:18.457566  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:18.589257 13585 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:18.590258 13585 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:18.590919 13585 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:18.459741  8500 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
W20260709 13:03:18.465692 13796 log.cc:927] Time spent T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:03:18.469448  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.589048  8531 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:18.593617  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:18.594033  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.595870 13806 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:18.447455 13518 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:18.596786 13560 raft_consensus.cc:3055] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:18.596881 13671 consensus_queue.cc:1059] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:18.597304 13560 raft_consensus.cc:740] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:18.597427 13669 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.597961 13669 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:18.598292 13595 consensus_queue.cc:1059] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:18.598217 13560 consensus_queue.cc:260] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:18.599364 13595 raft_consensus.cc:3055] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:18.599776 13595 raft_consensus.cc:740] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:18.600106 13765 raft_consensus.cc:3055] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:18.600507 13765 raft_consensus.cc:740] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:18.601394 13765 consensus_queue.cc:260] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:18.475608 13773 consensus_meta.cc:287] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.682s	user 0.008s	sys 0.004s
W20260709 13:03:18.481706 13600 consensus_meta.cc:287] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.897s	user 0.008s	sys 0.003s
W20260709 13:03:18.483198 13744 consensus_meta.cc:287] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.560s	user 0.012s	sys 0.000s
I20260709 13:03:18.485400 13762 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:18.485658 13598 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:03:18.487808 13559 consensus_meta.cc:287] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.700s	user 0.011s	sys 0.000s
I20260709 13:03:18.488413 13612 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:18.489554  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:18.490695 13684 consensus_queue.cc:237] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:18.602563 13765 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:18.370214 13805 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
W20260709 13:03:18.498323 13751 consensus_meta.cc:287] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.610s	user 0.004s	sys 0.006s
W20260709 13:03:18.501684 13819 log.cc:927] Time spent T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 13:03:18.502964 13804 log.cc:927] Time spent T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:03:18.515625 13811 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:03:18.518024 13640 consensus_meta.cc:287] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.657s	user 0.011s	sys 0.000s
W20260709 13:03:18.520483  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.520146  8452 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:03:18.528468  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2474) took 2224 ms. Trace:
I20260709 13:03:18.613823 13598 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:18.630098  8381 rpcz_store.cc:276] 0709 13:03:16.303546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.570796 (+267250us) service_pool.cc:224] Handling call
0709 13:03:16.571083 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.687599 (+116516us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:03:16.769196 (+ 81597us) log.cc:844] Serialized 14 byte log entry
0709 13:03:17.456453 (+687257us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b180032d6a0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c802523a 00007f36c848fa2a
0709 13:03:17.746180 (+289727us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:17.746251 (+    71us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:17.746318 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.528216 (+781898us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54002f94d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:18.528276 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.528405 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10320,"prepare.queue_time_us":40803,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":3420,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":312968448,"thread_start_us":350604,"threads_started":2,"wal-append.queue_time_us":1136673}
I20260709 13:03:18.539147  9288 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:03:18.536787 13672 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:18.562574 13823 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:18.574819  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 130069us
I20260709 13:03:18.580921  8535 raft_consensus.cc:1240] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:18.583241  9289 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:18.588774  8424 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:18.600809 13669 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:18.605520  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 146163us
I20260709 13:03:18.643958  8500 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:18.604811  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:18.613673  8458 raft_consensus.cc:1275] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:18.615950  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:18.492635 13774 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:18.600579 13595 consensus_queue.cc:260] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:18.613641 13339 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:18.529757  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:18.534024 13683 raft_consensus.cc:3055] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:18.668190 13683 raft_consensus.cc:740] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:18.666052 13769 consensus_queue.cc:1059] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:03:18.631937  8457 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:18.602537 13662 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:18.639729  8455 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:18.635768  8531 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
W20260709 13:03:18.641839  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 53132.2us
I20260709 13:03:18.678787  8424 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:18.654299  8532 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:18.656134  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:18.660713  8500 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:18.632932 13598 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:18.627182 13542 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:18.642930 13559 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:18.687680  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.694844  9296 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:18.695880  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:18.646196 13751 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:18.699436  9258 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:18.705037  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:18.697575  8424 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:18.711112  8424 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:18.643280 13458 raft_consensus.cc:697] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 17 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:18.706104 13595 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:18.697194 13819 log.cc:927] Time spent T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:18.692253 13339 raft_consensus.cc:697] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:18.646885 13823 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:18.632076 13811 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:18.843068  8455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53010 (request call id 1025) took 1256 ms. Trace:
I20260709 13:03:18.075847  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:18.844049  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 132897us
I20260709 13:03:18.691890 13683 consensus_queue.cc:260] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:18.706219 13600 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:18.706279 13769 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:03:18.918124  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 207069us
I20260709 13:03:18.932843  8424 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:18.934230 13630 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:18.935338  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.880213  8284 catalog_manager.cc:5697] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.937599  8424 leader_election.cc:400] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14.
I20260709 13:03:18.919027  8377 raft_consensus.cc:1240] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14. Ops: []
W20260709 13:03:18.918479 13827 log.cc:927] Time spent T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.188s	user 0.002s	sys 0.011s
I20260709 13:03:18.939436  8284 catalog_manager.cc:5697] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.844049  8527 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:03:18.854573  8455 rpcz_store.cc:276] 0709 13:03:17.586527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.588129 (+  1602us) service_pool.cc:224] Handling call
0709 13:03:18.763105 (+1174976us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540019dcd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:18.843004 (+ 79899us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2338332928}
I20260709 13:03:18.916996  8533 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 11.
W20260709 13:03:18.849669 13800 log.cc:927] Time spent T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.165s	user 0.002s	sys 0.007s
I20260709 13:03:18.849948 13682 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:18.844691 13746 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:18.928109  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 84585.5us
I20260709 13:03:18.929670 13769 raft_consensus.cc:697] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:18.943245  8284 catalog_manager.cc:5697] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 5 to 9, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 9 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:18.937448  9289 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:18.954111  9258 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:18.926028 13824 log.cc:927] Time spent T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.259s	user 0.003s	sys 0.008s
I20260709 13:03:18.944815  8533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2634) took 1025 ms. Trace:
I20260709 13:03:18.939522  8424 leader_election.cc:403] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:18.963215  8533 rpcz_store.cc:276] 0709 13:03:17.919860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.704700 (+784840us) service_pool.cc:224] Handling call
0709 13:03:18.944738 (+240038us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.850895 13617 consensus_queue.cc:1048] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 13:03:18.966249  9258 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:18.972363  8533 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:18.965469 13382 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:18.946177 13607 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:18.923236 13671 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:18.920750 13585 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:18.978200  8424 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:18.981633  8424 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:18.937384 13600 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:18.925064 13379 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:03:18.918335 13823 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:18.968043 13773 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14.
I20260709 13:03:18.923149 13705 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:03:18.991755  8424 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:18.961814 13746 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:18.990064 13825 log.cc:927] Time spent T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:03:18.921262 13339 consensus_queue.cc:237] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:18.991515 13585 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:18.978797 13375 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:18.989706 13607 raft_consensus.cc:697] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:18.985394 13630 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:19.045365 13769 consensus_queue.cc:237] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:19.056627 13831 log.cc:927] Time spent T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:03:19.058775 13811 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:19.061770 13746 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:19.060637 13829 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
W20260709 13:03:19.065676 13828 log.cc:927] Time spent T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:03:18.984705 13458 consensus_queue.cc:237] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:19.055281 13662 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:19.145457 13662 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:19.146909 13662 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.149367 13662 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:19.169793 13607 consensus_queue.cc:237] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:19.174156 13765 consensus_meta.cc:287] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.016s
W20260709 13:03:19.170742  9296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55720 (request call id 798) took 1351 ms (client timeout 1727 ms). Trace:
W20260709 13:03:19.175514  9296 rpcz_store.cc:269] 0709 13:03:17.818976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.819107 (+   131us) service_pool.cc:224] Handling call
0709 13:03:19.170169 (+1351062us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b54007701d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:19.170426 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1864453504}
W20260709 13:03:19.183176  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 191398us
I20260709 13:03:19.189582 13662 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:19.201619  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 151531us
I20260709 13:03:19.213496 13588 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:19.240899 13598 consensus_meta.cc:287] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.014s
W20260709 13:03:19.245479 13672 consensus_meta.cc:287] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.606s	user 0.003s	sys 0.017s
I20260709 13:03:19.256681 13588 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:19.258021 13765 consensus_queue.cc:1059] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:03:19.264500 13765 raft_consensus.cc:3055] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:19.264983 13765 raft_consensus.cc:740] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:19.261866 13811 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:19.266464 13811 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:19.267699 13765 consensus_queue.cc:260] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:19.260301 13682 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:19.269498 13765 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:19.256796 13598 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:19.258692 13375 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:19.278141 13598 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:19.285158 13595 consensus_meta.cc:287] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.014s
W20260709 13:03:19.287945  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.258315 13504 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:03:19.292021 13504 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:19.292208 13588 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:19.278157 13375 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:19.292971 13811 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:19.292779 13504 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:19.295393 13504 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:19.294458 13375 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:19.319002 13586 raft_consensus.cc:3055] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:19.319832 13586 raft_consensus.cc:740] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:19.323338 13586 consensus_queue.cc:260] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:19.349480  8284 catalog_manager.cc:5697] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 10 to 14, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 14 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:19.350519  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:19.353248  8284 catalog_manager.cc:5697] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:19.355098  8284 catalog_manager.cc:5697] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:19.364341  8284 catalog_manager.cc:5697] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 11 to 15, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 15 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:19.366717  8284 catalog_manager.cc:5697] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:19.368744  8284 catalog_manager.cc:5697] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:19.370824  8284 catalog_manager.cc:5697] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:19.376848 13607 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.377909 13607 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:19.385453 13607 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:19.386960  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:19.390322  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.392568  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.394130 13607 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:19.395107 13607 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:19.397872 13607 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:19.396862 13683 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:19.426977 13560 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:19.414007  9289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 744) took 1130 ms. Trace:
I20260709 13:03:19.429262  9289 rpcz_store.cc:276] 0709 13:03:18.283109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.283238 (+   129us) service_pool.cc:224] Handling call
0709 13:03:18.314007 (+ 30769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.583017 (+269010us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b580075b3d0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c83e10aa 00007f36c8463447 00007f36c847bfe7 00007f36c847d7de 00007f36c8487b49 00007f36c8488416 00007f36c8484d8f 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4
0709 13:03:18.959722 (+376705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.413390 (+453668us) spinlock_profiling.cc:243] Waited 29.7 ms on lock 0x7b540053d754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:19.413775 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110258688}
I20260709 13:03:19.438828 13607 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.439606 13607 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:19.446672 13607 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:19.448971  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.495879  8458 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36448 (request call id 2417) took 1102 ms. Trace:
I20260709 13:03:19.496438  8458 rpcz_store.cc:276] 0709 13:03:18.393247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.395170 (+  1923us) service_pool.cc:224] Handling call
0709 13:03:18.395573 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.647862 (+252289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.495282 (+847420us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b540040f6d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:19.495617 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":485516160}
I20260709 13:03:19.512033 13662 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.512951 13662 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:19.518361 13662 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:19.518977 13662 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.519495 13662 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:19.523675  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:19.524679 13607 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.525492 13607 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:19.528324 13607 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:19.530288 13662 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:19.531800  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:19.537031  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47306 (request call id 1160) took 1636 ms. Trace:
I20260709 13:03:19.537640  8527 rpcz_store.cc:276] 0709 13:03:17.900394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.529478 (+629084us) service_pool.cc:224] Handling call
0709 13:03:19.536472 (+1006994us) spinlock_profiling.cc:243] Waited 47.3 ms on lock 0x7b54000f8cd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:19.536708 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108766080}
I20260709 13:03:19.541056  9258 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:19.549396 13683 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:19.549930 13683 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.550319 13683 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:19.579478  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.581180 13683 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:19.586030 13662 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.586918 13662 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:19.588845  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:19.589659  8534 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:19.590744 13662 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:19.594929 13683 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:19.594143  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:19.607549 13662 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.608464 13662 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:19.612884  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:19.614779 13662 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:19.627667 13662 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.628506 13662 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:19.692333  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.636864  8534 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
W20260709 13:03:19.732997  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.733968  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.747289  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:19.754351 13630 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:19.755095 13630 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:19.759440 13630 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:19.759651  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:19.760440  8280 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53484 (request call id 336) took 52587 ms (client timeout 15000 ms). Trace:
I20260709 13:03:19.769855 13339 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.770603 13339 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:19.772679 13339 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:19.784175  8454 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:03:19.784643  8454 pending_rounds.cc:85] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12: Aborting all ops after (but not including) 5
I20260709 13:03:19.787117  8455 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:03:19.784889  8454 pending_rounds.cc:107] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:03:19.790524  8454 raft_consensus.cc:2889] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:19.794394  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:19.796082  8454 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:19.842238  8455 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:19.846146 13771 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.846797 13771 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:19.849153 13771 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:19.852319 13559 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.852986 13559 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:19.855419 13559 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:19.857614  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.858165 13672 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:19.858865 13672 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:19.861442 13339 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.862196 13672 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:19.862203 13339 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:19.863926 13542 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:19.864651 13542 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:19.866323  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3418) took 1262 ms. Trace:
I20260709 13:03:19.867460 13542 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:19.867661  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 1.21787e+06us
I20260709 13:03:19.868064 13542 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.869478  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:19.870070  8533 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:19.872180  8455 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:03:19.872594  8455 pending_rounds.cc:85] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Aborting all ops after (but not including) 12
I20260709 13:03:19.872851  8455 pending_rounds.cc:107] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:03:19.873358 13767 raft_consensus.cc:476] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Not starting pre-election -- already a leader
I20260709 13:03:19.874755 13767 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:03:19.760912  8280 rpcz_store.cc:269] 0709 13:02:27.177358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.183317 (+  5959us) service_pool.cc:224] Handling call
0709 13:03:19.760163 (+52576846us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:09.752747 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:09.753651 (+   904us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:09.753716 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:03:09.753769 (+    53us) tablet.cc:662] Decoding operations
0709 13:03:09.755013 (+  1244us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:09.755108 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:09.755138 (+    30us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:03:10.026811 (+271673us) tablet.cc:701] Row locks acquired
0709 13:03:10.026859 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:03:10.027025 (+   166us) write_op.cc:270] Start()
0709 13:03:10.027171 (+   146us) write_op.cc:276] Timestamp: P: 1783602190026966 usec, L: 0
0709 13:03:10.027194 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:03:10.027933 (+   739us) log.cc:844] Serialized 4369 byte log entry
0709 13:03:10.439530 (+411597us) op_driver.cc:464] REPLICATION: finished
0709 13:03:10.672869 (+233339us) write_op.cc:301] APPLY: starting
0709 13:03:10.672975 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:11.218216 (+545241us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:11.218351 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:11.613687 (+395336us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:11.614056 (+   369us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:03:11.614112 (+    56us) write_op.cc:312] APPLY: finished
0709 13:03:11.614585 (+   473us) log.cc:844] Serialized 105 byte log entry
0709 13:03:11.769024 (+154439us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:11.769231 (+   207us) write_op.cc:454] Released schema lock
0709 13:03:11.769321 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:11.866848 (+ 97527us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:11.873541 (+  6693us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1146545,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":233042,"apply.run_cpu_time_us":41726,"apply.run_wall_time_us":1149121,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50151,"num_ops":11,"prepare.queue_time_us":259666,"prepare.run_cpu_time_us":71696,"prepare.run_wall_time_us":516344,"raft.queue_time_us":135393,"raft.run_cpu_time_us":11177,"raft.run_wall_time_us":243115,"replication_time_us":412184,"thread_start_us":822528,"threads_started":5,"wal-append.queue_time_us":657181,"wal-append.run_cpu_time_us":11684,"wal-append.run_wall_time_us":2229286}]]}
I20260709 13:03:19.875317 13767 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:19.876782 13597 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.872184  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:19.877471 13597 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:19.878556  8458 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
W20260709 13:03:19.879582  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 1.23623e+06us
I20260709 13:03:19.880821 13597 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:19.881805  8424 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:19.882081  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:19.903893  8458 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:19.884090  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:19.866703  8386 rpcz_store.cc:276] 0709 13:03:18.603490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.603763 (+   273us) service_pool.cc:224] Handling call
0709 13:03:18.604146 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.604358 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:18.613530 (+  9172us) log.cc:844] Serialized 14 byte log entry
0709 13:03:19.865259 (+1251729us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b1800280960. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c5312c0a 00007f36cea52219 00007f36c539aa40 00007f36c53954e4 00007f36c5395455 00007f36c847d060 00007f36c848f716 00007f36c84a0287 00007f36c84a0208
0709 13:03:19.865591 (+   332us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:19.865708 (+   117us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:19.865803 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.865935 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:19.866081 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3000,"prepare.queue_time_us":10588,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"spinlock_wait_cycles":3814144}
I20260709 13:03:19.885713 13767 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:19.868783 13542 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:19.874289  8455 raft_consensus.cc:2889] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:19.893525 13765 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:19.915125 13765 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:19.905846 13771 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:19.917623  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:19.918409  8383 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:19.919937  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:19.920717  8380 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
I20260709 13:03:19.921555  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:19.921712  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:19.916815 13771 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.925827  8385 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:19.926944  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:19.927649  8385 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:19.928485  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:19.928675  8427 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:19.929322  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:19.929561 13672 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:19.929940 13672 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.930258 13672 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:19.930446  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:19.932582  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:19.933389  8386 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:19.934451  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:19.935307  8386 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:03:19.922356  8382 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:19.929033  8385 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:19.945451  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:19.937209 13771 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:19.950304  8427 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:19.946713 13765 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:19.956400  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:19.958670  8454 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:03:19.961542  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:19.962415  8384 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:19.967993 13683 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.969538 13683 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:19.971387 13662 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:19.971772 13683 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:19.958156 13559 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:19.979157  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:19.961602 13339 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:19.968523 13542 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:19.978175 13559 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.963864 13767 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:03:19.986605  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:19.964497 13765 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:03:19.990389  8427 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:19.991837  8455 raft_consensus.cc:2393] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 14: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:19.992131  8427 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:19.993235 13765 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:19.993527 13662 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:19.993691 13765 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:19.994140 13662 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.994285 13765 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:19.994556 13662 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:19.996305 13851 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:19.996654 13339 consensus_queue.cc:1048] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:19.998888  8427 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:19.999728  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.988564 13559 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:19.999709  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:20.007835  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:20.009917  8427 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:20.017174 13504 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:19.999210 13855 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:03:20.017848 13504 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.022213 13630 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:20.003163 13607 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:19.999277 13339 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:03:19.997430 13542 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:03:20.020256 13504 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:20.024832  8526 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:20.024782 13607 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.024092  8454 raft_consensus.cc:2376] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13. Re-sending same reply.
I20260709 13:03:20.045770 13607 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:20.046216  8500 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:20.038374 13586 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:20.033895 13141 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:20.052945 13141 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.055982 13630 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:20.063493  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:20.065541  8454 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:20.070849  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:20.056699 13630 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.074110  8458 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:20.059535 13141 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:20.083184  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:20.080678  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:20.087560  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:20.088614 13769 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:20.089303 13769 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.091709 13769 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:20.081776 13683 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 13:03:20.094175  8453 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:20.096865  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:20.077441 13672 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.107034  8526 raft_consensus.cc:1240] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:20.075101 13559 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.113718  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:20.115360  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:20.125617  8452 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:03:20.136221  9260 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
W20260709 13:03:20.142760  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.143618  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:20.143811  8460 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:20.144397  8378 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
W20260709 13:03:20.145735  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.146081  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:20.146979  8381 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:20.148550  8427 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:20.149267 13851 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.149848 13857 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:20.150341 13857 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:20.150717 13857 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.151548  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:20.153097 13705 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:20.153766 13705 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:20.157385  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 61849.4us
I20260709 13:03:20.156838 13705 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:20.158753  9260 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:20.158916 13630 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:20.160058 13683 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:20.160629 13683 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:20.149890 13851 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.161444 13683 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:20.161715 13382 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:20.163506 13382 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:20.163908 13382 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:20.164263 13382 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:20.160868 13705 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:20.167549 13705 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.169620  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:20.169961  8461 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:03:20.170311  8532 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:20.170128 13630 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:20.171322  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:20.171993  8457 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:20.172456  8500 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:20.163347 13851 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:20.173560 13851 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:20.179596 13851 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.180176 13851 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.178918 13560 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:20.181099 13560 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.183326 13560 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:20.183513  8530 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:03:20.184012 13705 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:20.181120  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:20.127612 13746 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:20.184617 13559 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:20.104769 13765 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.202160  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:20.202594  8427 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:20.202909  8381 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:20.207957 13672 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:20.209174  8380 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:20.192355 13746 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:20.210688 13861 log.cc:927] Time spent T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:03:20.212918 13771 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.214146  8455 raft_consensus.cc:2393] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 15: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:20.217116 13586 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:20.217991 13586 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.202500  9260 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:20.221511  8427 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:20.210495 13746 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.179838 13583 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:20.230654  8381 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 20.
I20260709 13:03:20.232250  8427 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:20.233943 13860 log.cc:927] Time spent T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.110s	user 0.002s	sys 0.000s
W20260709 13:03:20.237234  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.238315 13585 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:20.238740 13585 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.238682 13382 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.239248 13585 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:20.240434  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:20.241011  8380 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:20.208666 13672 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.241962  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 54441.4us
I20260709 13:03:20.242959  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:20.246543  8378 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.261438  8454 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:20.244077 13583 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.267869 13583 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:20.202131 13769 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:20.270373 13859 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.270531 13769 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.270947 13774 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:20.271098 13859 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.271842 13774 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.230151 13559 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:03:20.276890  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 89874.4us
I20260709 13:03:20.278071 13672 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.272943 13769 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:20.290131 13859 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:20.297679 13862 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:20.298352 13862 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.300734 13862 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:20.279302 13559 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.286449 13504 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:20.310544  8380 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:20.303241  9258 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:20.313334 13559 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:20.316188  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:20.291992 13141 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.317010 13141 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:20.319391  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.319475 13141 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:20.320662 13504 raft_consensus.cc:697] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:03:20.321609  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 437600us
I20260709 13:03:20.321985 13504 consensus_queue.cc:237] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.323458  8351 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:20.313951 13586 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:20.325359 13805 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.325666 13382 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:20.326002 13805 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.328282 13805 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:20.329376 13559 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.330715 13598 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.331298 13598 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.331750 13559 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:20.332768 13765 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:20.333334 13856 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.333866 13856 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.334857 13744 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:20.335028 13662 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.335649 13744 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:20.336220 13856 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:20.339169 13858 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.339818 13858 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.340335 13560 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:20.334213 13458 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:20.342370 13858 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:20.341049 13560 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.341343 13612 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:20.345829 13612 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.347425 13826 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:20.341828 13862 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:20.348261 13862 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:20.348681 13862 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:20.342195 13774 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:20.356616  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 188738us
I20260709 13:03:20.290424 13771 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:20.332413 13559 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.360692  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 128523us
I20260709 13:03:20.361907  8378 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:20.331827 13857 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:20.349128 13865 log.cc:927] Time spent T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:03:20.377118  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:20.376384  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:20.334869 13765 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:20.392381  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:20.382666  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 57605.8us
I20260709 13:03:20.485984  8380 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:20.358546 13560 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:20.379796  8534 raft_consensus.cc:1275] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:20.491123  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:20.380143  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:20.485042  8427 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:20.376070  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:20.485199  9296 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:03:20.387339  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:20.380551  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:20.377871  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:20.382447  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:20.369568  8424 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:20.387995  8528 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:20.393301  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:20.495782  8382 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:20.379734  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:20.498076  9288 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 13: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:20.500787  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:20.375424  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:20.378656  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:20.386147  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:20.484508  9294 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:20.503371  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:20.504062  8381 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:20.379056  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:20.502985 13876 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:03:20.348785 13585 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.506677  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:20.512804  8527 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:20.376202 13598 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:20.508426  8534 raft_consensus.cc:2410] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:03:20.369863 13662 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:20.375241 13612 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:20.520543  8351 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:20.521636  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:20.501997  9290 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:20.517313  8526 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 16.
W20260709 13:03:20.517840  8284 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59480 (request call id 204) took 17385 ms (client timeout 15000 ms). Trace:
I20260709 13:03:20.522291  9294 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:20.526885  9260 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:20.389472 13559 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.371178 13746 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.498381 13856 consensus_queue.cc:1048] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:03:20.372232 13851 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.376173 13607 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.535764 13598 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:03:20.523402  8284 rpcz_store.cc:269] 0709 13:03:03.125857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.126204 (+   347us) service_pool.cc:224] Handling call
0709 13:03:03.390389 (+264185us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b540014ebd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ef090 00007f36c848df3a 00007f36ce2441cc 00007f36ce34237e 00007f36cc8032a4 00007f36cc803232 00007f36cc803161 00007f36cc8030dc 00007f36cc802392 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:20.511320 (+17120931us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:19.409237 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:19.411261 (+  2024us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:19.411322 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:03:19.411362 (+    40us) tablet.cc:662] Decoding operations
0709 13:03:19.413439 (+  2077us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:19.413611 (+   172us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:19.413658 (+    47us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:03:19.415569 (+  1911us) tablet.cc:701] Row locks acquired
0709 13:03:19.415636 (+    67us) write_op.cc:260] PREPARE: finished
0709 13:03:19.420298 (+  4662us) write_op.cc:270] Start()
0709 13:03:19.442936 (+ 22638us) write_op.cc:276] Timestamp: P: 1783602199415816 usec, L: 0
0709 13:03:19.443003 (+    67us) op_driver.cc:348] REPLICATION: starting
0709 13:03:19.450582 (+  7579us) log.cc:844] Serialized 5218 byte log entry
0709 13:03:19.575032 (+124450us) op_driver.cc:464] REPLICATION: finished
0709 13:03:19.634244 (+ 59212us) write_op.cc:301] APPLY: starting
0709 13:03:19.636563 (+  2319us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:19.733324 (+ 96761us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:19.733466 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:19.757975 (+ 24509us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:19.758375 (+   400us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:03:19.758448 (+    73us) write_op.cc:312] APPLY: finished
0709 13:03:19.758849 (+   401us) log.cc:844] Serialized 121 byte log entry
0709 13:03:19.759053 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:19.759205 (+   152us) write_op.cc:454] Released schema lock
0709 13:03:19.777122 (+ 17917us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:19.785667 (+  8545us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:19.785703 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1728132,"reported_tablets":33,"spinlock_wait_cycles":2941312,"child_traces":[["op",{"apply.queue_time_us":57940,"apply.run_cpu_time_us":21495,"apply.run_wall_time_us":151422,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58519,"num_ops":13,"prepare.queue_time_us":23559,"prepare.run_cpu_time_us":8326,"prepare.run_wall_time_us":46084,"raft.queue_time_us":76461,"raft.run_cpu_time_us":28208,"raft.run_wall_time_us":52889,"replication_time_us":131841,"thread_start_us":146950,"threads_started":4,"wal-append.queue_time_us":43461}]]}
I20260709 13:03:20.563608  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:20.564419  9287 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:20.515745 13683 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.543366 13662 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.567792  8534 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:20.576824  8453 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:03:20.577901  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:20.579660  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:20.536702 13382 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.030s
W20260709 13:03:20.587401  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.577267  8349 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:20.590525  8349 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:20.590775  9294 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:20.555639 13141 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:20.582333 13559 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:20.583691 13590 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:20.591650 13612 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:20.591750 13141 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:20.592140 13612 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.592305 13141 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:20.584182 13869 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.592561 13612 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:20.593020 13869 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.593541 13823 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:20.593858 13871 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:20.593971 13823 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.594348 13871 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.594494 13823 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:20.594843 13871 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:20.595332 13869 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:20.592087 13590 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.592465 13559 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:20.597313 13559 raft_consensus.cc:697] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:20.597261 13560 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:20.598469 13559 consensus_queue.cc:237] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.602264  8378 raft_consensus.cc:2393] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 13: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:03:20.581434  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 54681.6us
I20260709 13:03:20.604197  9293 raft_consensus.cc:2393] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 14: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:20.604617  8382 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
W20260709 13:03:20.606375  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:20.606212  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 121285us
I20260709 13:03:20.601241 13874 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.608553  8380 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
W20260709 13:03:20.623965  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.605260  9260 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:20.607375  8427 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:20.562937 13598 raft_consensus.cc:697] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:20.636529  8381 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:20.581982 13662 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.674518 13765 raft_consensus.cc:697] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 20 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:20.645351 13857 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:20.672071  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:20.628077 13874 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.637316 13382 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:03:20.656942  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.683706  8380 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:03:20.645753 13585 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:20.639209  8529 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:03:20.639616  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:20.685384 13874 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:20.685925  9294 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:20.686625  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:20.646733 13746 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:20.682209 13765 consensus_queue.cc:237] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.637070  8427 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:20.683066  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 325221us
I20260709 13:03:20.622937 13862 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.652137 13683 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:20.698556  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 59815.9us
I20260709 13:03:20.709414  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:03:20.714496  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 79708.6us
I20260709 13:03:20.717430  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:20.718151  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:20.718792  8533 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.720865  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:20.715397  8427 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:20.723676  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:20.723842  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:20.720229  8500 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:20.719512  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:20.696766 13672 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:20.724609  9294 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:20.728778  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:20.731827  8455 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:20.732311  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:20.719166 13746 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.730216  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:20.735064  8427 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:20.736474  8460 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
I20260709 13:03:20.739732  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:20.740489  8535 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:20.720283 13382 raft_consensus.cc:697] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:20.741539  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:20.754550  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:20.734473 13597 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:20.758658  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:20.762045  8454 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:03:20.741026 13857 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:20.775045 13862 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:20.775827 13867 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:20.776474 13881 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:03:20.775164  8556 debug-util.cc:398] Leaking SignalData structure 0x7b08002a0280 after lost signal to thread 7274
I20260709 13:03:20.779610 13590 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:20.780004  8556 debug-util.cc:398] Leaking SignalData structure 0x7b0800288100 after lost signal to thread 8318
W20260709 13:03:20.782035  8556 debug-util.cc:398] Leaking SignalData structure 0x7b08002886a0 after lost signal to thread 8410
W20260709 13:03:20.782457  8556 debug-util.cc:398] Leaking SignalData structure 0x7b08002889a0 after lost signal to thread 8411
I20260709 13:03:20.737340 13769 consensus_queue.cc:1059] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:03:20.766511 13598 consensus_queue.cc:237] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.767908  8381 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:20.728479 13774 consensus_queue.cc:1059] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:03:20.787833  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:20.784206  8556 debug-util.cc:398] Leaking SignalData structure 0x7b0800262b80 after lost signal to thread 8485
I20260709 13:03:20.806474  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:20.790051  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:20.807140  8556 debug-util.cc:398] Leaking SignalData structure 0x7b0800262b60 after lost signal to thread 8486
I20260709 13:03:20.807260  8383 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.775017  9287 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
I20260709 13:03:20.805823  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:20.808209  8382 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:20.727779 13612 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.788645  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:20.808769  8556 debug-util.cc:398] Leaking SignalData structure 0x7b0800194d00 after lost signal to thread 8559
I20260709 13:03:20.795849  9294 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:03:20.835047  8556 debug-util.cc:398] Leaking SignalData structure 0x7b080025e740 after lost signal to thread 8560
I20260709 13:03:20.786366  8460 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:20.805359  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:20.793911  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:20.792055  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:20.810456  9293 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:20.743729 13882 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.836650  8556 debug-util.cc:398] Leaking SignalData structure 0x7b08001f7f00 after lost signal to thread 9320
W20260709 13:03:20.839028  8556 debug-util.cc:398] Leaking SignalData structure 0x7b080035dd20 after lost signal to thread 13379
I20260709 13:03:20.736569 13683 consensus_queue.cc:1059] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:03:20.836262  8530 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:20.839696  8378 raft_consensus.cc:2368] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 16. Current term is 17.
I20260709 13:03:20.836534  8385 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:20.782389 13662 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:20.763320 13597 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:20.835445  8384 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:20.834756  8456 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 8.
I20260709 13:03:20.837984  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:20.788986 13585 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:20.748517 13746 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.790599 13851 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:20.811697 13881 raft_consensus.cc:697] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:20.790223 13883 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:20.805392 13857 raft_consensus.cc:697] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:20.856027  8454 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
W20260709 13:03:20.856880  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 50635.3us
I20260709 13:03:20.860262  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:20.863153  8533 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:20.839129 13607 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:20.837363 13867 raft_consensus.cc:697] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:20.846055 13705 raft_consensus.cc:3055] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:20.845197 13586 raft_consensus.cc:3055] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:20.902189 13705 raft_consensus.cc:740] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:03:20.879527  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 153151us
I20260709 13:03:20.869309  8427 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:20.870290  8459 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:20.903838  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:20.903584 13705 consensus_queue.cc:260] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.904418  8459 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.787508 13871 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.907058 13871 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:20.848047 13597 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.902369 13586 raft_consensus.cc:740] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:20.787974 13141 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.846468 13826 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.912616  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:20.916189  8453 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.917001  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:20.920933  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:20.922720  8379 raft_consensus.cc:2410] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:03:20.918634  9260 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:20.904953 13705 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:20.854034 13805 consensus_queue.cc:1059] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:03:20.948557  9260 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:20.951674  8459 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
W20260709 13:03:20.954061 13892 log.cc:927] Time spent T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:03:20.954622 13504 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:20.955080 13504 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.955332 13871 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.955476 13504 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:20.955912 13871 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.958328 13871 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:20.959039 13896 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:20.958572 13881 consensus_queue.cc:237] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.959479 13896 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.959919 13896 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:20.960090 13874 raft_consensus.cc:3055] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:20.960517 13874 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:20.910317 13883 raft_consensus.cc:697] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:20.855100 13882 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:20.965957  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 129076us
I20260709 13:03:20.964144  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:20.973838  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:20.898144 13585 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.974776  9287 raft_consensus.cc:2393] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 14: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:20.935763 13771 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:20.852985 13382 consensus_queue.cc:237] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:20.982496  8379 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:03:20.981032  8349 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:20.985002  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:20.980300  8500 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:20.985631  8377 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:20.986999  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:20.994939  8500 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:20.995903  8500 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:20.998728  8382 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
I20260709 13:03:21.002378  8461 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:03:21.006456  8382 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:20.983165 13771 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.992700 13896 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:21.015399  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:21.016659  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 98875.5us
I20260709 13:03:20.975129 13826 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:21.036751  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.005157 13560 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:21.009943 13886 log.cc:927] Time spent T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:03:21.038000  8500 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:03:21.040355  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.027717 13771 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:20.985565 13823 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:20.964674 13867 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:21.066180  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:21.079404  8532 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:21.050241 13560 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:21.091028  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:21.061816 13612 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:21.053820 13899 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:21.008312 13857 consensus_queue.cc:237] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:21.101233  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:21.102291  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:21.106670  8528 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:21.010294 13874 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:21.111836  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.067103 13903 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:21.116251  8381 raft_consensus.cc:2368] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 18. Current term is 19.
I20260709 13:03:21.094575 13560 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:21.097246 13769 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:21.122433  8459 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:21.116164  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 78252.4us
I20260709 13:03:21.120042  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.101052 13851 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:21.120889 13903 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:21.135228 13903 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:21.135509 13141 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:21.136166 13896 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:21.058393 13586 consensus_queue.cc:260] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:21.145017  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 148571us
I20260709 13:03:21.133960 13769 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:03:21.139928  9261 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.820s (SENT) [suppressed 20 similar messages]
I20260709 13:03:21.140488  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:21.100687 13899 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:21.155511  8455 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:21.156998  8456 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:21.158123  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.149688 13769 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:21.167263 13504 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:21.167754 13894 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:03:21.114087 13708 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.176s
W20260709 13:03:21.167850 13891 log.cc:927] Time spent T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:03:21.145952 13746 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:21.160723 13901 log.cc:927] Time spent T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:03:21.161115 13874 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:21.177241  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.156776 13899 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:21.184842  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.185738  8426 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:21.171800 13585 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:21.181118 13586 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:21.105216 13883 consensus_queue.cc:237] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:21.195827  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 96665.2us
W20260709 13:03:21.210106 13893 log.cc:927] Time spent T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:03:21.213604  8426 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:21.216048  8528 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:21.189771 13765 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:21.223604  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:21.224339  8379 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:21.225831  8426 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:21.227629  8500 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:21.228899 13909 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:21.229501 13909 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.229918 13909 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:21.231676  8500 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:21.232897 13913 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:21.215636 13504 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:21.238722  8500 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:21.195329 13882 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:21.242287  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 102503us
I20260709 13:03:21.257018  8535 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:21.233518 13913 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:21.267619  8426 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:21.269992  8426 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:21.272959  8426 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:21.278611  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:21.279052  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.279336  8528 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.279713  8381 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:21.273806 13873 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:21.281962 13873 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:21.282332 13873 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:21.285240 13672 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:21.259999 13871 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:21.292338  8453 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:21.292845  8383 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:21.267328 13585 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:21.259464 13708 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:21.328331  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:21.329249 13908 log.cc:927] Time spent T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:03:21.329767  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:21.319248  9260 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:21.332549  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:21.333164  8460 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:21.271584 13913 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:21.334724  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.333195  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:21.332396 13141 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:21.340266  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:21.340976  8459 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:03:21.335636  8529 raft_consensus.cc:1240] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:21.272607 13882 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:21.336136  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:21.345252  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:21.317203 13906 log.cc:927] Time spent T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:03:21.338555  8379 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:21.347205  8528 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
I20260709 13:03:21.347923 13141 raft_consensus.cc:697] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:03:21.348384  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:21.366185  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.349052  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:21.349530 13885 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:03:21.327623 13708 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:21.357846 13920 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:03:21.317379 13585 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.330619 13826 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:21.392915  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.399222  8532 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:03:21.422735  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.423458  8380 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:21.432523  8377 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:21.375612 13708 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.390748 13585 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:21.444010 13597 consensus_meta.cc:287] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.001s
I20260709 13:03:21.451210 13918 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:21.452333 13923 log.cc:927] Time spent T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:03:21.452174  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:21.453356  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.467207  8380 raft_consensus.cc:2393] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 21: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:21.454321  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:21.455265  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:21.468626  9287 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:21.459394  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:21.385511 13851 raft_consensus.cc:697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:03:21.434208 13906 log.cc:927] Time spent T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:03:21.475660  9293 raft_consensus.cc:2393] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 17: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:21.483608  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:21.484269  8532 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:21.488699 13769 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:21.490551  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 102289us
I20260709 13:03:21.441365 13560 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:21.497931  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:21.499847  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 132920us
I20260709 13:03:21.500538  8500 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:21.501927 13920 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:21.502345 13920 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:21.502712 13920 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:21.505244 13141 consensus_queue.cc:237] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:21.506069 13878 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.799s	user 0.005s	sys 0.000s
I20260709 13:03:21.507562  8458 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 1062) took 1248 ms. Trace:
I20260709 13:03:21.508527 13873 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:21.510696 13873 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:21.512625 13560 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:21.512292 13920 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:21.514575  8500 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:21.516633 13920 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:21.517369 13859 consensus_queue.cc:1059] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:21.518265 13859 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:21.517999 13903 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:21.518784 13859 raft_consensus.cc:697] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:21.518764 13899 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:21.520260 13903 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:21.519981 13859 consensus_queue.cc:237] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:21.524255  8500 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:21.523748  8528 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:21.473793 13826 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:21.529436  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.530646  8382 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:03:21.482024 13821 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:21.532609  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:21.533325  8459 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:21.507931  8458 rpcz_store.cc:276] 0709 13:03:20.258835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.258949 (+   114us) service_pool.cc:224] Handling call
0709 13:03:20.269024 (+ 10075us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:20.381294 (+112270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:20.381325 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:20.381855 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:03:20.538277 (+156422us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:20.556699 (+ 18422us) log.cc:844] Serialized 14 byte log entry
0709 13:03:20.556910 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.556980 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:21.505383 (+948403us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:21.507277 (+  1894us) raft_consensus.cc:1685] finished
0709 13:03:21.507366 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:21.507503 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17618,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":3568,"raft.queue_time_us":133334,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":192,"spinlock_wait_cycles":8495360,"thread_start_us":253054,"threads_started":2,"wal-append.queue_time_us":245290}
I20260709 13:03:21.536536  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:21.537057  8458 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:21.537343  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.538472  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.540984  8461 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 18: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:21.542758  8459 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:21.543812  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:21.543973  8386 raft_consensus.cc:1275] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:21.534550  9258 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:21.544354  8459 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:21.475749 13597 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:21.546388  8530 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:21.547559 13597 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:21.549515 13851 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:21.555002  8530 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:21.555784  8535 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:21.563330  8458 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:21.564781  8460 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:03:21.565817  8455 raft_consensus.cc:1240] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:03:21.520871 13903 raft_consensus.cc:3055] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:21.566659  9287 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
W20260709 13:03:21.523975 13805 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.003s	sys 0.004s
I20260709 13:03:21.566862  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:21.566489  8424 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:03:21.579532  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 47562.5us
I20260709 13:03:21.574307  8381 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:21.574818  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:21.582692  8380 raft_consensus.cc:2368] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 18. Current term is 19.
W20260709 13:03:21.587883  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.515026 13870 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.521025 13899 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:21.595112  9290 raft_consensus.cc:2410] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 19 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
W20260709 13:03:21.595183  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.597890  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:21.596937  8459 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:03:21.473917 13918 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:21.578326 13805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.004s	sys 0.004s
I20260709 13:03:21.573876 13885 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:21.572016 13903 raft_consensus.cc:740] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:21.601914  8424 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:21.649297  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:21.608986  8349 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:21.662010  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 60173.6us
I20260709 13:03:21.662452  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.663971  8531 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:21.642809 13612 consensus_queue.cc:1059] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:03:21.664662 13885 raft_consensus.cc:697] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:21.665686 13885 consensus_queue.cc:237] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:21.574178 13821 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:21.667240 13903 consensus_queue.cc:260] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:21.667644  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:21.668427  8459 raft_consensus.cc:2368] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16.
I20260709 13:03:21.669094 13821 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:21.669839 13926 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:21.670248 13926 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.670604 13926 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:21.673163 13870 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:21.675943 13870 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:21.644488  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:21.677501  8529 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:21.522444 13913 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:21.590323 13597 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:21.685367  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 80596.9us
W20260709 13:03:21.699862  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:21.705410  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 44755.1us
I20260709 13:03:21.713904  9294 raft_consensus.cc:1240] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:03:21.564638 13826 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:21.644826 13857 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:21.693794 13903 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:21.720014  8533 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:21.729310  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:21.695497 13925 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:03:21.714746 13705 consensus_meta.cc:287] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.770s	user 0.011s	sys 0.000s
I20260709 13:03:21.733888  8454 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:21.740893  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:21.745412  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:21.750211 13769 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:21.718979 13771 consensus_meta.cc:287] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.644s	user 0.008s	sys 0.003s
I20260709 13:03:21.697659 13918 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:21.760291 13934 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:21.761852 13913 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:21.762917 13925 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.768191  9288 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 18: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:21.751991 13708 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:21.773284  8529 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:21.776443  8526 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:03:21.783555  8526 pending_rounds.cc:85] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 9
I20260709 13:03:21.783875  8526 pending_rounds.cc:107] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:03:21.784162  8526 raft_consensus.cc:2889] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:21.785847  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:21.801555  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:21.820572  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 216071us
I20260709 13:03:21.824144 13708 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:21.783671 13925 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:21.824940 13909 consensus_meta.cc:287] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.002s
I20260709 13:03:21.825449 13909 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:21.829221 13586 consensus_meta.cc:287] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.625s	user 0.008s	sys 0.001s
I20260709 13:03:21.830230  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:21.831204 13826 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:21.831490  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.831808  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:21.832765  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.832901  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.833468  8384 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:21.831492  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:21.832792  8380 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:21.834965 13926 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:21.837242  8500 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:21.779250 13934 raft_consensus.cc:697] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 17 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:21.838340  8500 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:21.841300 13586 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:21.841984 13586 raft_consensus.cc:697] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:21.842360  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.842954 13586 consensus_queue.cc:237] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:21.819396 13585 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:21.846415 13585 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:21.818118 13857 raft_consensus.cc:697] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:21.847680 13857 consensus_queue.cc:237] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:21.849303  8424 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:21.849704 13708 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:21.850288 13708 raft_consensus.cc:697] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:21.851122 13708 consensus_queue.cc:237] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:21.853359  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.854559  8457 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:21.856396 13883 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:21.856943 13883 raft_consensus.cc:697] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:21.854512  9260 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:21.859942  8530 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:21.863235  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:21.858687  8500 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:21.864027  8533 raft_consensus.cc:2393] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 13: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:21.864886 13927 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:21.865453 13927 raft_consensus.cc:697] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 9 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:21.865479  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.863279  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:21.866397  9288 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:21.866530 13927 consensus_queue.cc:237] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:21.869730  8454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36448 (request call id 2445) took 1078 ms. Trace:
I20260709 13:03:21.870123  8454 rpcz_store.cc:276] 0709 13:03:20.790893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.913481 (+122588us) service_pool.cc:224] Handling call
0709 13:03:20.935594 (+ 22113us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:21.766743 (+831149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.869495 (+102752us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b54003c7654. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:21.869649 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1835431808}
I20260709 13:03:21.872776 13805 raft_consensus.cc:3055] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:21.873291 13805 raft_consensus.cc:740] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:21.874289 13805 consensus_queue.cc:260] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:21.875888 13805 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:21.877688 13598 raft_consensus.cc:3055] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:21.878057 13598 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:21.877209  8279 catalog_manager.cc:5697] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 10 to 13, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 13 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.878955 13598 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:21.879516  8279 catalog_manager.cc:5697] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 4 to 6, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 6 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:21.878957  8500 leader_election.cc:400] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16.
I20260709 13:03:21.881592  8500 leader_election.cc:403] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:03:21.777889 13771 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:21.883050  8427 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:21.884297 13771 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:21.885763 13339 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16.
I20260709 13:03:21.883049  8456 raft_consensus.cc:2393] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 17: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:21.891676  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:21.892814  8427 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:21.899116  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.900297  8379 raft_consensus.cc:2410] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:03:21.901386  8349 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:21.903677  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:21.904512  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.905272  8380 raft_consensus.cc:2393] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 13: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:21.905823  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:21.906227  8528 raft_consensus.cc:1275] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:03:21.906616  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:21.906617  8528 pending_rounds.cc:85] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 6
I20260709 13:03:21.908353  8528 pending_rounds.cc:107] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:03:21.908607  8528 raft_consensus.cc:2889] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:21.908960  8382 raft_consensus.cc:1275] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:21.910133  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:21.910738  8454 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:21.911242  8535 raft_consensus.cc:1275] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:21.912595  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.913843  8379 raft_consensus.cc:2376] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13. Re-sending same reply.
I20260709 13:03:21.914846  8427 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:21.880292 13598 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:21.915894  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:21.916520  9290 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:21.918457  8383 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:21.920094  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:21.925220  9289 raft_consensus.cc:2393] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 17: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:21.901441 13771 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:21.926961  8427 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:21.929857 13826 consensus_queue.cc:1059] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:21.930133  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.915828 13612 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:21.930624  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:21.931734 13929 consensus_queue.cc:1059] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:03:21.932991  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.979585  8427 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:21.934561  8458 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1663cf9302e8495c8762465d306cb479"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
W20260709 13:03:21.966081  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 43850.6us
I20260709 13:03:21.935827  8453 raft_consensus.cc:1240] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:21.936561  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:21.929889 13372 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:21.980396  8458 raft_consensus.cc:606] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:03:21.981542 13662 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:21.983451  8427 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:21.938246  9288 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:21.913700 13909 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:21.962956  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.910496 13590 consensus_queue.cc:1059] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:03:21.942013  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:21.966468  9291 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.902601 13896 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:03:21.881682  8279 catalog_manager.cc:5697] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 8 to 9, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 9 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:21.967679  8459 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:21.986470 13882 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:21.974138 13926 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:21.964293 13607 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:22.004959 13607 raft_consensus.cc:697] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:22.001763 13882 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:22.006264 13882 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:21.962121 13883 consensus_queue.cc:237] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:21.923408 13559 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:22.009418 13559 raft_consensus.cc:697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:22.003492  8279 catalog_manager.cc:5697] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:22.010322 13559 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:22.011088  9291 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:03:22.011942  9293 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 16. Current term is 17. Ops: [13.10-16.12]
I20260709 13:03:21.933984  8381 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:03:21.985200  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.013576  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:22.013731 13746 raft_consensus.cc:3055] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:22.014189 13746 raft_consensus.cc:740] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:21.987162  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:22.014998  9288 raft_consensus.cc:2410] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 19 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:03:21.942008 13771 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.015784 13771 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:22.017470  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:22.018133  9295 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:22.010686  8279 catalog_manager.cc:5697] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:22.018913  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:22.019479  8279 catalog_manager.cc:5697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 10 to 11, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 11 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:22.015013 13746 consensus_queue.cc:260] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:22.021498  8279 catalog_manager.cc:5697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.979080  9290 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:21.985247 13630 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:22.024744  9294 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:21.997452  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:21.998312  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:21.973142 13934 consensus_queue.cc:237] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:21.999795  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:22.025942  9289 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 19: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:21.983480 13662 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:21.926682 13821 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:03:21.995159 13372 raft_consensus.cc:697] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:21.941012 13560 consensus_queue.cc:1059] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 13:03:22.005865 13607 consensus_queue.cc:237] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:21.974931  8384 raft_consensus.cc:2368] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 18. Current term is 19.
I20260709 13:03:21.993537 13612 raft_consensus.cc:697] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:22.022920 13746 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:22.034762 13823 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:21.962554  8454 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:22.036028  8453 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:22.037446  8456 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:03:22.037724 13372 consensus_queue.cc:237] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:22.038654  8271 connection.cc:573] client connection to 127.7.25.193:43631 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:03:22.041473  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:22.041817  8532 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:03:22.036047  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:22.060468  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.042495  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:22.062769  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 76735us
I20260709 13:03:22.036321 13771 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:21.993480 13871 consensus_queue.cc:1048] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:03:22.069272  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:22.070065  9287 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:22.225555  8452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53010 (request call id 1064) took 1513 ms. Trace:
I20260709 13:03:22.177469  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:22.243134  8454 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:22.199240 13821 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.171445  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:22.224040  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:22.010193 13868 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:03:22.173923  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:22.184854 13560 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:03:22.160983  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 95701.5us
W20260709 13:03:22.160457  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 95432.8us
I20260709 13:03:22.181763  8455 raft_consensus.cc:2368] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:22.244632  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:22.258665  8427 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:22.180161  9289 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 13. Current term is 14. Ops: []
W20260709 13:03:22.185859  8271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 146684us
I20260709 13:03:22.163738  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:22.242086  8452 rpcz_store.cc:276] 0709 13:03:20.709050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.716375 (+  7325us) service_pool.cc:224] Handling call
0709 13:03:22.218249 (+1501874us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540012bbd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:22.222255 (+  4006us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2915097984}
W20260709 13:03:22.252795  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.172262  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:22.259581  9294 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:03:22.258560  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:22.266665  8426 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:22.268056 13883 consensus_queue.cc:1048] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:03:22.271296 13888 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:22.274019  8454 raft_consensus.cc:2393] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 15: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:22.274863  8458 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:22.276844  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:22.276108 13559 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:22.279393 13888 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:22.279826  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:22.210557 13612 consensus_queue.cc:237] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:22.281026 13888 raft_consensus.cc:697] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:22.282015 13888 consensus_queue.cc:237] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:22.242779  8279 catalog_manager.cc:5697] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:22.285425  8279 catalog_manager.cc:5697] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 11 to 13, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 13 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:22.270331 13672 consensus_queue.cc:1048] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:03:22.290129  8279 catalog_manager.cc:5697] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:22.298589  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:22.272437 13560 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:22.266094 13856 raft_consensus.cc:476] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Not starting pre-election -- already a leader
I20260709 13:03:22.227031 13925 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:22.300621  8459 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:22.304459 13954 log.cc:927] Time spent T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:22.305774 13560 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:22.316218 13382 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.316843 13382 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:22.322387  8461 raft_consensus.cc:1275] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:03:22.325292  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.262030 13821 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:22.351711  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:22.366237  8381 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:22.367401  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:22.370702  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:22.371825  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:22.371925  8379 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:03:22.372089  8384 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:03:22.374424  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:22.386258  8459 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:22.371326  8381 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:22.322064 13882 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:22.388269  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:22.363992 13598 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:22.395423  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:22.374667 13382 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:22.396888  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:22.403339  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:22.404886  8456 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:22.405896  8386 raft_consensus.cc:2410] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:03:22.318379  8279 catalog_manager.cc:5697] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 9 to 13, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 13 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:22.429409 13882 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:22.431763 13821 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:22.431886  8279 catalog_manager.cc:5697] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:22.434312  8279 catalog_manager.cc:5697] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 9 to 10, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 10 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.437392 13925 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:22.443284  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:22.465886  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 198497us
I20260709 13:03:22.467308  8427 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:22.477434  8383 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:22.479482  8381 raft_consensus.cc:2393] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 15: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:22.486685  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:22.487461  8386 raft_consensus.cc:2393] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 15: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:22.394768 13598 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:22.484608 13950 log.cc:927] Time spent T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:03:22.496651  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:22.492722  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:22.484591 13946 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:03:22.520349  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:22.489337 13805 consensus_meta.cc:287] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.004s
W20260709 13:03:22.536125  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.488245 13857 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:22.560997  8383 raft_consensus.cc:2410] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:03:22.566715  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.535279  9294 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
I20260709 13:03:22.587806  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:22.483886 13882 consensus_queue.cc:1048] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:03:22.489790 13662 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 13:03:22.597421  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:22.601049  8381 raft_consensus.cc:2410] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:03:22.607566  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:22.610953  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:22.646582  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:22.654781  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:22.655619  8383 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:22.663858  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:22.665582  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:22.666369  8384 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:22.496027  8279 catalog_manager.cc:5697] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.700440  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:22.702172  8381 raft_consensus.cc:2368] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16.
I20260709 13:03:22.704944  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:22.677791 13560 consensus_queue.cc:1059] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:03:22.708411 13560 raft_consensus.cc:3055] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:22.708858 13560 raft_consensus.cc:740] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:03:22.709753 13964 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:22.709940 13560 consensus_queue.cc:260] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:22.711154 13560 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:22.712867 13598 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:22.493297 13821 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.706212  8351 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:22.719689  8351 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:22.714294  8279 catalog_manager.cc:5697] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.678272 13934 consensus_queue.cc:1059] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
W20260709 13:03:22.723951 13953 log.cc:927] Time spent T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.520s	user 0.006s	sys 0.000s
I20260709 13:03:22.720707 13598 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:22.733963  8386 raft_consensus.cc:2393] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 14: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:22.716615  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:22.722333 13821 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:22.801966  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 82338.2us
I20260709 13:03:22.802747  8351 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:22.803369  8381 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:22.806665  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:22.808887  8378 raft_consensus.cc:2368] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16.
I20260709 13:03:22.809442  8384 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:22.810925  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:22.811653  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:22.812462  8453 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:03:22.811092  8427 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:22.813099  8351 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:22.813346  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:22.804291  8383 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:22.893129  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:22.911270  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:22.912146  8383 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:03:22.913363  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 100356us
I20260709 13:03:22.821905  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:22.816228  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:22.914917  8386 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:22.915732  8381 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:22.834185  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:22.812147 13612 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:22.923166  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:22.924994  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:22.920801  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:22.926302  8453 raft_consensus.cc:2393] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 14: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:22.921583  8351 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:22.926442  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:22.927318  8378 raft_consensus.cc:2393] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 17: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:22.930615  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:22.931478  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:22.933446  8379 raft_consensus.cc:2393] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 14: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:22.929538 13934 consensus_queue.cc:1059] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:03:22.935317  8459 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:22.935756 13934 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:22.806419 13961 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:22.847065 13598 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.893265  8279 catalog_manager.cc:5697] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:22.805649 13911 raft_consensus.cc:3055] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:22.943105 13911 raft_consensus.cc:740] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:22.943609  8279 catalog_manager.cc:5697] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 9 to 10, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 10 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:22.944283 13911 consensus_queue.cc:260] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:22.945923 13911 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:22.922168 13805 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:22.950103  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.949399  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:22.951081 13926 consensus_queue.cc:1059] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:22.951946  8500 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:22.952637 13926 consensus_queue.cc:1243] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer 105d6581548546b98eddd4ee7083bb12 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:22.953310 13926 raft_consensus.cc:3055] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:22.953464 13899 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:22.953749 13926 raft_consensus.cc:740] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:22.954299 13899 raft_consensus.cc:697] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:22.954878 13926 consensus_queue.cc:260] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:22.955214 13899 consensus_queue.cc:237] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:22.956212 13926 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:22.959285 13881 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:22.959915 13881 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:22.961675  8527 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:22.962694  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:22.963559  8526 raft_consensus.cc:2393] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 14: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:22.879848 13382 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.965447 13382 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:22.967640 13382 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:22.843819 13882 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:22.968632 13882 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:22.968777  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:22.890072 13821 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:22.971163  8529 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:22.972376 13826 raft_consensus.cc:3055] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:22.972781 13826 raft_consensus.cc:740] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:22.973694 13826 consensus_queue.cc:260] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:22.904316 13597 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:22.884835 13949 raft_consensus.cc:3055] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:22.974910 13826 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:22.976260 13823 raft_consensus.cc:3055] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:22.976693 13823 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:03:22.978681  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 48179.9us
W20260709 13:03:22.979791  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.941802 13598 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:22.989249  8379 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:22.984124  8529 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:22.985167  8380 raft_consensus.cc:2393] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 14: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:22.977643 13823 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:22.991940  8379 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:22.976519  8279 catalog_manager.cc:5697] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 8 to 11, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 11 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
W20260709 13:03:22.992686  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 181626us
W20260709 13:03:22.995030  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 92645us
I20260709 13:03:22.975137 13949 raft_consensus.cc:740] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:23.012686  8500 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:03:23.013521  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.019878  8500 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:23.020432  8383 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
W20260709 13:03:23.025873  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.032351  8529 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:23.000221 13930 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:22.974910 13597 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:23.012308 13746 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.024463 13903 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.033453 13823 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:23.039083 13705 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:23.052866  8454 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:23.037528 13909 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:23.054957  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:22.999562 13925 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
W20260709 13:03:23.063158  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.063014  8381 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:23.013029 13630 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:03:23.062108 13888 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:23.069659 13888 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:23.070468 13597 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:23.045969 13662 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:23.071171 13662 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:23.071795 13888 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:23.073396 13662 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:23.074270  8271 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 455c5d2786974d92a3ee8b825edcfaa7 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d653e71832b7402b9a03b46249d3b885 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:23.076225 13672 raft_consensus.cc:993] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
W20260709 13:03:23.079006 13967 log.cc:927] Time spent T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.453s	user 0.009s	sys 0.010s
I20260709 13:03:23.051316 13949 consensus_queue.cc:260] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:23.080116 13705 raft_consensus.cc:697] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:23.081108 13949 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:23.061422 13746 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:23.082690  8460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36446 (request call id 2456) took 1149 ms. Trace:
I20260709 13:03:23.083068  8460 rpcz_store.cc:276] 0709 13:03:21.932915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.936274 (+  3359us) service_pool.cc:224] Handling call
0709 13:03:23.082518 (+1146244us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b540015a9d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:23.082636 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":586729216}
I20260709 13:03:23.084206 13746 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:23.051754 13930 raft_consensus.cc:697] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:23.085160  8279 catalog_manager.cc:5697] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 9 to 13, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 13 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.086120 13930 consensus_queue.cc:237] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:23.061630 13972 consensus_queue.cc:1059] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:03:23.087700  8279 catalog_manager.cc:5697] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 8 to 12, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 12 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.089155 13382 raft_consensus.cc:3055] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:23.051426 13504 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:03:23.045892 13560 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.081367  8377 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13. Ops: []
W20260709 13:03:23.092900  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:23.099814  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:23.100351  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.061650 13598 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:23.104918 13630 raft_consensus.cc:1081] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:03:23.114529 13612 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:23.115136 13612 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:23.081338 13705 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:23.118752 13612 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:23.089597 13382 raft_consensus.cc:740] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:23.123268  8455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36448 (request call id 2461) took 1220 ms. Trace:
I20260709 13:03:23.094872 13909 raft_consensus.cc:697] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:03:23.127368  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 107568us
I20260709 13:03:23.066414 13903 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:23.126025  8455 rpcz_store.cc:276] 0709 13:03:21.903333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.903444 (+   111us) service_pool.cc:224] Handling call
0709 13:03:23.123036 (+1219592us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b540015aed4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:23.123195 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637485952}
I20260709 13:03:23.131794  8532 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 9 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:23.147142  8533 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:23.105811 13932 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:23.104992 13805 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:23.150543  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:23.151871  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:23.152670  8534 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:23.097945 13560 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:23.162643  8529 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
W20260709 13:03:23.165406  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 243892us
I20260709 13:03:23.145313 13746 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.166363  8529 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:23.162678  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:23.170650  8532 raft_consensus.cc:2393] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 16: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:23.166173  8351 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:23.168900  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.172165  8377 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:03:23.176293  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 175210us
I20260709 13:03:23.177271  8424 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:23.154872 13597 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:23.163273 13881 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:23.182873  8380 raft_consensus.cc:3055] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:23.186959  8380 raft_consensus.cc:740] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:23.150240 13823 consensus_queue.cc:1059] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:03:23.190613 13978 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:23.190914 13885 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:23.187899 13630 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:23.192587 13630 raft_consensus.cc:697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:23.193533 13630 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:23.203316  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:23.206004  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:23.214434  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 150706us
I20260709 13:03:23.229779  9291 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:23.255704  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:23.230350  9287 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 16. (term mismatch)
I20260709 13:03:23.257920  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:23.258261  9287 pending_rounds.cc:85] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting all ops after (but not including) 15
W20260709 13:03:23.258481  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 77936.2us
I20260709 13:03:23.259171  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:23.182932 13880 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:23.268923  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 60672.1us
I20260709 13:03:23.261600  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:23.258539  9287 pending_rounds.cc:107] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting uncommitted NO_OP operation due to leader change: 18.16
W20260709 13:03:23.253172  8501 leader_election.cc:336] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.705s (SENT)
W20260709 13:03:23.323688  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 120841us
I20260709 13:03:23.323820  9287 raft_consensus.cc:2889] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:23.158542 13932 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:23.324462  8351 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:23.176182 13746 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:23.375885  8386 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:23.375022  8453 raft_consensus.cc:1275] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:23.324452  8427 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:03:23.373478  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 120331us
I20260709 13:03:23.180776 13805 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:23.379441  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:23.255733 13977 log.cc:927] Time spent T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:03:23.248736  9261 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:23.379544  8461 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:03:23.385641  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 136999us
I20260709 13:03:23.380746  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:23.374606 13949 consensus_queue.cc:1048] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:03:23.382882  8500 leader_election.cc:400] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:23.389832  8500 leader_election.cc:403] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:23.385841  8349 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:23.380482 13975 log.cc:927] Time spent T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:03:23.387224  9261 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:23.393225  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 69718.5us
I20260709 13:03:23.386437  8528 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:03:23.451885  8531 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:03:23.386016  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 61634.9us
I20260709 13:03:23.454344  8459 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:23.456175  8454 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:23.362039  8380 consensus_queue.cc:260] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:23.389107  8501 leader_election.cc:336] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.667s (SENT)
I20260709 13:03:23.322561 13823 consensus_queue.cc:1243] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer b8eb0ad4490645598004d862412f4e31 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:03:23.458161  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 69124.2us
W20260709 13:03:23.460050  8501 leader_election.cc:336] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.690s (SENT)
W20260709 13:03:23.460369  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 62925.1us
W20260709 13:03:23.466033  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 88444.8us
I20260709 13:03:23.467347  8377 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:23.469295 13705 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:23.469558  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:23.225574 13597 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:23.471189 13705 consensus_queue.cc:1048] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:23.475600  8530 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:23.479175  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:23.480685  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:23.481379  8386 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:03:23.357553 13925 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:03:23.485589  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 224569us
I20260709 13:03:23.390343 13911 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:23.452521 13883 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:23.496363  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:23.462102 13961 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:23.495554  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:23.480122 13862 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:23.497445  8380 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:23.509902  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:23.326023 13672 consensus_queue.cc:1059] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.155s
I20260709 13:03:23.222143 13382 consensus_queue.cc:260] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:23.393649 13612 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.105s
I20260709 13:03:23.389536 13899 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
W20260709 13:03:23.534133  8385 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48484 (request call id 940) took 1696 ms (client timeout 2037 ms). Trace:
I20260709 13:03:23.271219 13909 consensus_queue.cc:237] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:23.538084  8453 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:23.383776 13880 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:23.200860  8279 catalog_manager.cc:5697] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:23.542308  8385 rpcz_store.cc:269] 0709 13:03:21.828882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.832683 (+  3801us) service_pool.cc:224] Handling call
0709 13:03:23.506478 (+1673795us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b540013ced4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:23.524762 (+ 18284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1530851712}
I20260709 13:03:23.555611  8382 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:03:23.523011 13961 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:23.559181  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:23.498361 13925 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:23.548482 13821 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.570112  8386 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1663cf9302e8495c8762465d306cb479"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:03:23.548185 13771 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:23.578392  8461 raft_consensus.cc:1240] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:03:23.580210  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.577554  8386 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:23.581225  8386 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:23.578724  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:23.583940  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:23.585624  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:23.586179  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:23.586575  8460 raft_consensus.cc:2410] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:03:23.588074  8454 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:23.585719  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 85738.5us
W20260709 13:03:23.595772  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:23.575001 13826 consensus_meta.cc:287] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.006s
I20260709 13:03:23.571092 13597 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:23.602000  8459 raft_consensus.cc:1275] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:23.606736  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:23.573845 13961 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:23.578351 13560 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:23.562798 13980 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:03:23.591969 13708 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:03:23.633934  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.607182 13972 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:23.599498 13821 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:23.619335 13826 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.644060  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:03:23.673318  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.681875  8380 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:03:23.682479  8380 pending_rounds.cc:85] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 11
I20260709 13:03:23.682787  8380 pending_rounds.cc:107] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:03:23.683094  8380 raft_consensus.cc:2889] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:23.643103  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 129519us
I20260709 13:03:23.635495  8386 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:23.698742  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 54756.9us
I20260709 13:03:23.699038  8382 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:23.700445  8351 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:23.706447  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.708063 13705 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:23.645943 13746 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:23.719293  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.710705  8531 raft_consensus.cc:1275] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:23.640100 13826 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:23.721727 13989 log.cc:927] Time spent T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:03:23.723136 13826 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:23.641217 13805 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:23.712570  8386 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:23.704478 13883 raft_consensus.cc:697] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:23.723981 13805 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:23.709843 13899 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:03:23.724995 13883 consensus_queue.cc:237] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:23.725996 13986 log.cc:927] Time spent T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:03:23.727537 13991 log.cc:927] Time spent T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:03:23.727759 13882 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:23.723783 13826 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:23.712693  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:23.797359  8533 raft_consensus.cc:2410] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:03:23.705801 13979 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:23.787420 14001 log.cc:927] Time spent T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:03:23.800659  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:23.637609 13708 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:23.779247 13856 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:03:23.646956 13612 consensus_queue.cc:1059] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.140s
W20260709 13:03:23.727546 13984 log.cc:927] Time spent T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
I20260709 13:03:23.790211 13882 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:23.817704 13882 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:23.820104 13882 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:23.809178 13979 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:23.827430 13979 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:23.828215 13612 raft_consensus.cc:3055] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:23.828639 13612 raft_consensus.cc:740] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:23.829562 13870 raft_consensus.cc:3055] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:23.830013 13870 raft_consensus.cc:740] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:23.830790 13870 consensus_queue.cc:260] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:23.833544 13987 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.454s	user 0.000s	sys 0.002s
I20260709 13:03:23.835305 14003 consensus_queue.cc:1048] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:03:23.838279 13382 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:23.729955 13999 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:23.846954  8501 leader_election.cc:336] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.230s (SENT)
I20260709 13:03:23.842231 13862 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:23.848497  8501 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:23.849332  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 149000us
I20260709 13:03:23.856086  8351 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:23.861258  8533 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:03:23.863715  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 476540us
I20260709 13:03:23.866271  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:23.867018  8530 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:23.904006  9261 leader_election.cc:400] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 18. Current term is 19.
I20260709 13:03:23.904541  9261 leader_election.cc:403] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:03:23.868206  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:23.960462  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:23.962098  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 60765.5us
W20260709 13:03:23.963011  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:23.963593  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 98940.6us
I20260709 13:03:23.978338  9261 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:23.984879  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.967705 13883 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:03:23.992231  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 145296us
I20260709 13:03:23.990468 14013 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 18. Current term is 19.
I20260709 13:03:23.994307  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:23.958369 13826 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.973996 13805 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.967460 13821 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:23.979693 13746 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:23.710124  8279 catalog_manager.cc:5697] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 3 to 8, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 8 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.868546 13988 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.133s
I20260709 13:03:24.000789 13705 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:23.996419 13672 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
W20260709 13:03:24.048421  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 192602us
I20260709 13:03:24.000831 13597 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:23.829578 13612 consensus_queue.cc:260] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:24.055294  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:24.056054  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:24.057133  8384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3476) took 1565 ms. Trace:
I20260709 13:03:24.063527  8424 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:24.003715 13998 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 13:03:23.853566 13999 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:23.990688 13949 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:24.112828  8526 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 16. Current term is 17. Ops: []
W20260709 13:03:24.094753  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 116484us
I20260709 13:03:24.125259  9261 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:24.078102  8351 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:24.061103  8384 rpcz_store.cc:276] 0709 13:03:22.491749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.989432 (+497683us) service_pool.cc:224] Handling call
0709 13:03:22.989704 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:23.014497 (+ 24793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:23.014526 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:23.041882 (+ 27356us) log.cc:844] Serialized 26 byte log entry
0709 13:03:23.155166 (+113284us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:23.155206 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:23.155272 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:23.727001 (+571729us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:24.049376 (+322375us) raft_consensus.cc:1685] finished
0709 13:03:24.049408 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:24.057051 (+  7643us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27200,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":12696,"spinlock_wait_cycles":12575616,"thread_start_us":86150,"threads_started":1,"wal-append.queue_time_us":268763}
W20260709 13:03:24.067140  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:24.092378  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 183751us
W20260709 13:03:24.131491  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:24.131633  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 53650.4us
I20260709 13:03:24.065747 13821 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:24.047264 13805 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:24.080454 13708 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:24.047215 13826 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:24.137180  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:24.118924  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 55545us
I20260709 13:03:24.144003  8532 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:24.051963 14011 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:24.144874  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:24.001780 13883 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:24.140129 13997 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.169456  8382 raft_consensus.cc:1275] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:24.169628  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:24.170823  8380 raft_consensus.cc:2410] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:03:24.173563  8527 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:24.175086  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:24.176033  8381 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:03:24.175854  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:24.176414  8381 pending_rounds.cc:85] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 8
I20260709 13:03:24.176693  8381 pending_rounds.cc:107] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:03:24.176717  8380 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:03:24.177057  8381 raft_consensus.cc:2889] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:24.153002  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:24.158233 14005 log.cc:927] Time spent T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:03:24.179028  8379 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:24.146045 13598 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:03:24.159029 14014 log.cc:927] Time spent T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:03:24.181553  8384 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:03:24.181681  8386 raft_consensus.cc:3055] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:24.182902  8386 raft_consensus.cc:740] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:24.183055  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:24.163691 13961 consensus_meta.cc:287] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.535s	user 0.007s	sys 0.003s
I20260709 13:03:24.175685  8382 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:03:24.135221 13771 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:24.190696  8385 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:24.183642  8386 consensus_queue.cc:260] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:24.184731  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 59590.8us
W20260709 13:03:24.154925  8271 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 455c5d2786974d92a3ee8b825edcfaa7 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d653e71832b7402b9a03b46249d3b885 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:24.189747  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:24.190171  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:24.195359  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:24.198083  8377 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:03:24.198541  8380 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
W20260709 13:03:24.179919 14007 log.cc:927] Time spent T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:03:24.196696  8452 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:24.064716 13705 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:24.201151  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:24.203063  8382 raft_consensus.cc:2410] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:03:24.203765  8386 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:24.180784 13949 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:24.155136 14018 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:24.208204  8380 raft_consensus.cc:2368] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16.
I20260709 13:03:24.217605 13826 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:24.218053 14012 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:03:24.209053  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:24.222595  8279 catalog_manager.cc:5697] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 5 to 8, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 8 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:24.205484  9261 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:24.190924 13771 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:24.240089  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:24.262421  8377 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:24.244854  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:24.245886  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:24.077273 13597 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:24.181783 13997 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:24.264005  8382 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:24.135926 14010 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.108s
I20260709 13:03:24.270234  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 1233) took 1102 ms. Trace:
W20260709 13:03:24.270969  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:24.272396  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 67007.1us
W20260709 13:03:24.208689  8271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 59494.7us
I20260709 13:03:24.273917  8380 raft_consensus.cc:2393] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 15: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:24.193427 14006 consensus_queue.cc:1059] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.092s
I20260709 13:03:24.287673  9261 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:24.288895  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:24.278733  8535 rpcz_store.cc:276] 0709 13:03:23.168292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.467339 (+299047us) service_pool.cc:224] Handling call
0709 13:03:23.467679 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:23.468118 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:23.468153 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:23.468710 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:03:23.845791 (+377081us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:23.845834 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:23.845906 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:24.269998 (+424092us) raft_consensus.cc:1685] finished
0709 13:03:24.270021 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:24.270164 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4829,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":376576,"threads_started":1,"wal-append.queue_time_us":526427}
I20260709 13:03:24.197973 13961 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:24.273762 13746 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:03:24.293354  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:24.343310  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:24.344827  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:24.345528  8383 raft_consensus.cc:2376] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15. Re-sending same reply.
I20260709 13:03:24.326962  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:24.342602  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:24.348070  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 60489.6us
I20260709 13:03:24.341871  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:24.349531  9261 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:24.277622  8386 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:24.353591  9290 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:24.267248 13771 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:24.373711  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:24.358799  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 48455.6us
I20260709 13:03:24.364431  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:24.382311  8380 raft_consensus.cc:2368] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16.
I20260709 13:03:24.382740  8386 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
W20260709 13:03:24.329487 14016 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:03:24.330631 14021 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:03:24.341871 14020 log.cc:927] Time spent T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:03:24.342887 13705 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:24.418362  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:24.419255  8377 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:24.337188 13805 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:24.417683  8379 raft_consensus.cc:2393] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 14: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:03:24.434631  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.381768 13746 consensus_queue.cc:1059] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 13:03:24.292198 14013 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:24.331314 14008 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
W20260709 13:03:24.450287  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 65579.6us
I20260709 13:03:24.414166 13903 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:24.390456 13857 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:24.458817  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:24.442453  8501 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:24.419868 13994 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:24.454909 14032 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.448829  8381 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 9.
I20260709 13:03:24.317128 13930 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.462781  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:24.433799 13896 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:24.468704  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 119245us
I20260709 13:03:24.382490 13882 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:24.448132 14013 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:24.476265  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:24.481895  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:24.482532  8459 raft_consensus.cc:3055] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:24.482829  8459 raft_consensus.cc:740] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:24.483533  8459 consensus_queue.cc:260] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:24.484599  8459 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:24.485307 13971 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:24.485472 14010 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:24.486589 14017 log.cc:927] Time spent T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.169s	user 0.000s	sys 0.002s
I20260709 13:03:24.468323 13903 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:24.492792  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 93301.7us
I20260709 13:03:24.491423  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:24.487922 13805 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:24.496256 13805 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:24.497718 14026 log.cc:927] Time spent T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.170s	user 0.002s	sys 0.003s
I20260709 13:03:24.498476 13805 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:24.501443  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:24.503099 13978 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
W20260709 13:03:24.506081  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 63703.6us
W20260709 13:03:24.509624  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:24.510051  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.479733 14013 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:24.510928  8501 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:24.516259  8459 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:24.341725  8279 catalog_manager.cc:5697] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 4 to 9, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 9 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:24.463564 13857 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:24.531015  8351 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:24.533537  8385 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
W20260709 13:03:24.534101  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.471879 13930 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:24.474879 13896 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:24.536976  8351 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:24.539505  8501 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:24.541347 13705 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:24.541275 13805 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:24.543107 13903 consensus_queue.cc:1048] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:24.531709 13883 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:24.562341  8501 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:24.479610 13882 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:24.550112  8279 catalog_manager.cc:5697] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 11 to 12, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 12 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:24.577394  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 88558.4us
I20260709 13:03:24.501344 13880 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:24.551620 14034 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:24.504195 13997 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:24.520094 13978 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.470402 14032 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:24.558409  8351 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:24.559832 13899 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:24.561758 13980 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:24.506716 14010 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:24.619525 14032 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:24.621383 14010 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:24.565951 13857 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:24.622177 13857 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:24.622876  8427 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:24.566352 13560 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:24.624040 13771 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:24.624075 13560 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:24.570715 13896 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:24.626329 13888 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:24.626571 13771 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:24.626847 13888 raft_consensus.cc:697] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:24.627731 13771 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:24.627871 13888 consensus_queue.cc:237] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:24.630374 13826 raft_consensus.cc:3055] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:24.630795 13826 raft_consensus.cc:740] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:24.634328 13932 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:24.580747  8501 leader_election.cc:400] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16.
I20260709 13:03:24.550971 13930 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:24.638154  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.522923 13999 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:24.552156 14003 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:24.563185 13705 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:03:24.581194 13708 raft_consensus.cc:2764] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:03:24.614854 13961 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:24.615628 14030 log.cc:927] Time spent T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.299s	user 0.000s	sys 0.012s
I20260709 13:03:24.615773 13882 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:24.616259  9290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55734 (request call id 1192) took 1395 ms. Trace:
I20260709 13:03:24.564280 13949 consensus_queue.cc:1059] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:03:24.584672 14034 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:24.591497 13978 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:24.617497  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 59120.4us
I20260709 13:03:24.677594  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:24.644953 13823 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:24.642373  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.648582  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:24.651034  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:24.658877  9290 rpcz_store.cc:276] 0709 13:03:23.221066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.261322 (+ 40256us) service_pool.cc:224] Handling call
0709 13:03:24.604632 (+1343310us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b54005348d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:24.616197 (+ 11565us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2256525056}
I20260709 13:03:24.660420  8454 raft_consensus.cc:1240] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:24.662483  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 84358.3us
I20260709 13:03:24.689797  9261 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:24.691488  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:24.693061  9261 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:24.663808  8535 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:24.679420  8459 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:24.682616  8351 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:24.699421  8500 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:24.705669  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:24.709055  9261 leader_election.cc:400] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 18. Current term is 19.
I20260709 13:03:24.710305  9261 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:24.713769  8349 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:24.669252 14034 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:24.715204  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:24.697950 13869 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:24.700865 13992 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:24.712760 13911 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:24.745750  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 121547us
I20260709 13:03:24.700558 13823 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:24.651748 14003 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:24.700261 13949 consensus_queue.cc:1048] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:03:24.732223 13925 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:24.767128 13911 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:24.756472 13971 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:24.823237  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 109585us
I20260709 13:03:24.838668  8349 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:24.714490  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:24.636668  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 56063.9us
W20260709 13:03:24.818449 14024 log.cc:927] Time spent T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.471s	user 0.004s	sys 0.000s
I20260709 13:03:24.714826 13896 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:24.717938 13997 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:24.839838  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 72231.6us
W20260709 13:03:24.848469  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 92961.6us
I20260709 13:03:24.852557  8427 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:24.853142  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 142932us
I20260709 13:03:24.854013  9261 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:24.756075 13999 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:03:24.718227 14011 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.136s
I20260709 13:03:24.844027 13805 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:24.851085 13856 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:03:24.871824 14039 log.cc:927] Time spent T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:03:24.854849 13997 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:03:24.897157  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 44686.3us
I20260709 13:03:24.898211  8427 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:24.898316  8379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:57896
I20260709 13:03:24.899415  8427 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:24.901894 13597 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:24.886914 13504 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:03:24.904588 13805 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:24.905282 13805 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:24.907753 13805 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:24.908387 13805 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:24.909866 13911 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:24.910835 13978 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:24.912014 14013 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:24.912895 14003 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:24.913991 13823 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:24.914582 13930 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:24.915171 13999 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:24.914665 13856 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:24.915510 13930 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:24.915870 13999 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:24.857719 13992 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:24.919263  8379 raft_consensus.cc:606] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:24.927444  8379 raft_consensus.cc:614] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:24.919445  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:24.871429 13996 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:24.928887  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:24.845642 13560 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:24.936944  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:24.942713  8384 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 19.
W20260709 13:03:24.917727 14044 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:03:24.947978  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:24.953730  8457 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:24.954443  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:24.954629  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:24.959125  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:24.959472  9296 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:24.955379  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:24.955703  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:24.956447  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:24.961179  9293 raft_consensus.cc:2376] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17. Re-sending same reply.
I20260709 13:03:24.964398  8385 raft_consensus.cc:1275] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
W20260709 13:03:24.971865  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.974660  8453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36446 (request call id 2477) took 1406 ms. Trace:
W20260709 13:03:24.974978  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 45507.5us
I20260709 13:03:24.975678  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:24.977448  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:24.978220  9294 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:24.979071  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:24.871754 13708 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:03:24.926709 13997 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:24.984354  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:24.974771  9287 raft_consensus.cc:1240] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:24.987406  8385 raft_consensus.cc:1240] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:24.988588  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:24.918188 13896 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:24.975317  8453 rpcz_store.cc:276] 0709 13:03:23.567858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.568185 (+   327us) service_pool.cc:224] Handling call
0709 13:03:24.974471 (+1406286us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54001f9d54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:24.974603 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659961728}
I20260709 13:03:24.989991  9293 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:24.990505  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:24.994325  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:24.909004 13805 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:24.996053  9287 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:24.927163 13949 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:25.003672  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:24.998499  9296 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:25.013859  9291 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:25.013486  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:25.039390  9289 raft_consensus.cc:2368] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 16. Current term is 17.
W20260709 13:03:25.030633  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 54763.1us
I20260709 13:03:25.021541  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:25.041927  9290 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:25.042735  8501 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:24.933913 13925 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:03:24.984678 13856 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:25.047020  8501 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:25.022373 13896 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:24.979890 13560 raft_consensus.cc:697] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:03:25.049021  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.050048  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:24.966045 13672 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:03:24.980448 13869 consensus_queue.cc:1059] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:03:24.940495 13992 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:25.067061  8501 leader_election.cc:400] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16.
I20260709 13:03:25.074749  9292 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 20. Current term is 21. Ops: []
W20260709 13:03:25.079293  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.088264  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:25.089404  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:25.089596  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:25.090613  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:25.090948 13896 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:25.091737  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:25.088359  9291 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:25.093205  8501 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:25.095409  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:25.095991  8385 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:25.097579  9290 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:25.098001  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:25.099975  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:25.098096  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 140715us
I20260709 13:03:25.099522  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:25.054682 14040 log.cc:927] Time spent T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:03:25.122943  8378 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:25.122463  8385 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:03:25.128232  8381 raft_consensus.cc:1275] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:25.130131  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:25.052008 14050 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:25.130803  8381 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:25.131937  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:25.078959 13899 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:25.133054  8501 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:25.129498  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 95410.3us
I20260709 13:03:25.056617 13823 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.020267 13805 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:25.142931  8381 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:25.166613  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:25.134563 14055 consensus_queue.cc:1059] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:03:25.171957  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:25.172245 14013 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:25.172724  9290 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:25.173149 14054 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:25.177281  8386 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:25.126462 13856 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:25.181334  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:25.052634 13932 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:03:25.055371 13949 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:25.139957 13903 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:25.175942 14039 log.cc:927] Time spent T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:03:25.215951  8427 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:25.217281  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:25.227068  9290 raft_consensus.cc:2376] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14. Re-sending same reply.
I20260709 13:03:25.219492  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:25.228345  8378 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
W20260709 13:03:25.210897 14040 log.cc:927] Time spent T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:03:25.139375 13980 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:03:25.233022  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:25.236392  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:25.209928 13999 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:25.238404  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:25.212862 13903 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.179566 13823 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:25.141839 13560 consensus_queue.cc:237] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:25.249316  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:25.249946 13662 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:03:25.251478  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 412855us
I20260709 13:03:25.251425 13662 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:25.252307  8349 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:25.253530  8427 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:25.254225 13805 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:25.254680 14062 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:25.254899 13612 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:25.255034 13925 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:25.255261 14062 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:25.255595 13925 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:25.255733 14062 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:25.256093 13925 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:25.257196 14057 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.255692  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:25.258705  8427 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:25.261181  8382 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:25.267616  8426 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:25.269668  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:25.218236 13856 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:25.274081  8500 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:25.275362  8385 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:25.275682  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:25.276525  9295 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:25.278919  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:25.242579 13903 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:25.292403  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:25.294559  8427 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:25.295799  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:25.293481  8351 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:25.300243  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:25.304092  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:25.306978  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.259377 13980 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:25.296653 14058 log.cc:927] Time spent T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:03:25.312516  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:25.247695 13999 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:25.326682  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:25.299865 13911 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:25.292351 13978 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:25.341228 14051 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.341382 14073 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:25.341869 14051 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:25.342337 13992 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:25.343916 14064 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:25.344409 14064 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:25.344790 14064 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:25.330299  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:25.353789 14068 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:25.299997 13662 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:25.331081  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:25.356014 13856 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:25.356434 14049 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:25.356994 14049 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:25.359061 14049 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:25.361068 14050 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:25.334635 13597 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:25.336455  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.336943 14063 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:25.362353 13823 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:25.362558 14063 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:25.337250 13998 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:25.331956 13911 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:25.366591 13911 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:25.368695 14034 consensus_meta.cc:287] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.605s	user 0.005s	sys 0.003s
W20260709 13:03:25.342151  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 47659.2us
I20260709 13:03:25.345984 13999 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:25.346997 13949 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:25.339031 13981 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:25.280843 13926 consensus_queue.cc:1059] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:03:25.364977 14063 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:25.377910 14062 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:25.378268 13826 consensus_queue.cc:260] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:25.379534 13911 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:25.379906 14050 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:25.300868 13881 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:25.332508  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:25.318171  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:25.374328 14064 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:25.442795  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:03:25.328895 14061 log.cc:927] Time spent T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 13:03:25.453508  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 179483us
I20260709 13:03:25.270848 14057 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:25.464849  8528 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:25.331645 14055 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:25.468502 14063 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:03:25.469290 14048 log.cc:927] Time spent T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:03:25.462076  8535 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:25.302903 13880 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.130s
W20260709 13:03:25.480788  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.450649 13823 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:25.460711 13597 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:25.463757  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 150844us
W20260709 13:03:25.323998  8271 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 455c5d2786974d92a3ee8b825edcfaa7 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d653e71832b7402b9a03b46249d3b885 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:25.461848 13881 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:25.473412 13997 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:25.492973  8528 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
W20260709 13:03:25.499199  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.480777 13826 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:25.449398 14034 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:25.331076 13980 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:25.471055 13949 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:25.629350  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:25.465021 13746 raft_consensus.cc:3055] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:25.464793 14050 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:25.479950  8427 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:25.629938 13881 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:25.481024 13899 consensus_queue.cc:1059] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.153s
I20260709 13:03:25.634743  8534 raft_consensus.cc:2393] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 16: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:25.488974 14055 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:25.514235 13823 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:25.665517  8424 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:25.645195  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 165431us
I20260709 13:03:25.637447  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:25.491974  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:25.673342  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:25.649770 13999 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:25.660969  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:25.675995  8424 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:25.676196  8535 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
W20260709 13:03:25.627771  8271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 311099us
I20260709 13:03:25.633114  8529 raft_consensus.cc:2410] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 13:03:25.680872  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 43532.6us
I20260709 13:03:25.678946  8424 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:25.686214  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:25.687235 13805 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:25.689350  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:25.693609  8351 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:25.694914  8456 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:25.695437  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:25.695995  8535 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:25.643999 13949 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:25.644537 13746 raft_consensus.cc:740] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:25.705865  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:25.679215 13999 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.687897 13880 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:25.682255 13672 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:25.685962 13978 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:25.742008  8530 raft_consensus.cc:1240] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:25.714713  8351 leader_election.cc:400] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 16. Current term is 17.
I20260709 13:03:25.721446 13972 consensus_queue.cc:1059] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:25.722107 13911 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:25.674609 13926 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:03:25.755970  8384 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:03:25.722047 13746 consensus_queue.cc:260] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:25.723055 13856 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:25.724157 13980 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:25.704069 14062 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:25.725037 14081 log.cc:927] Time spent T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:03:25.710114 13949 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:25.686563 14010 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:25.725836 14064 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:25.640653 13925 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:25.727223 13805 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:25.727867  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:25.733124 14057 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:25.694285 13961 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:03:25.734628 14034 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:25.642058 13903 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:25.785876  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:25.742579  8351 leader_election.cc:403] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:25.786628  8535 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
W20260709 13:03:25.787283  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 72753.1us
I20260709 13:03:25.790297  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:25.747985  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:25.739590 13999 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:25.806598  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:25.772233 13997 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:25.759738 13612 consensus_meta.cc:287] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.004s
I20260709 13:03:25.774513 13823 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:25.745586 13880 raft_consensus.cc:697] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:25.814463  8532 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:03:25.793506  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2680) took 2660 ms. Trace:
I20260709 13:03:25.794811  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:25.800218  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:25.805616  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:25.805814  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:25.807595  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.778224 14010 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:03:25.809144  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 130268us
I20260709 13:03:25.809772  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:25.817785  8382 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:25.810254  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:25.811026  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:25.790974  8383 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 9.
I20260709 13:03:25.829946  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:25.830644  8383 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:25.824085  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:25.833213  8386 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:25.790197 13826 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 16. Current term is 17.
I20260709 13:03:25.814992  8526 rpcz_store.cc:276] 0709 13:03:23.132581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.141351 (+  8770us) service_pool.cc:224] Handling call
0709 13:03:23.141658 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:24.124214 (+982556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.793244 (+1669030us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b54000f78d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:25.793410 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2232853760}
I20260709 13:03:25.846261  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:25.832064  8427 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:25.853116  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:25.857714  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:25.809303 13911 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:25.784654 13805 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:25.859342  8381 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:25.814235 14052 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.824836 14010 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:25.851429 13961 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:25.877549 13961 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:25.879042 13896 raft_consensus.cc:3055] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:25.879664 13896 raft_consensus.cc:740] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:25.881783  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:25.881870 13925 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:25.870541 13911 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:25.885440 13911 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:25.889272 14055 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:25.889657  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:25.890375  8379 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:03:25.892223  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:25.892894  8533 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 20.
I20260709 13:03:25.861843 13930 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:25.894809 14052 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:25.894831  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:25.897765  8526 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
I20260709 13:03:25.895088 13930 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:25.898900 13930 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:25.902845  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:25.903743  8383 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:03:25.894455 13961 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:25.911602 13970 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.917819 13896 consensus_queue.cc:260] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:25.949167  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:25.950206  8377 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:25.960636  8382 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:25.922959 13998 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:03:25.968374  8386 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:25.966032  8427 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:25.953294 13896 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:25.976187  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:25.971372 14025 log.cc:927] Time spent T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 1.702s	user 0.000s	sys 0.006s
I20260709 13:03:25.986575  8427 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:25.987053  8381 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:25.986606  8386 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:03:25.937132 13970 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:25.991614 13970 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:25.992635  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:25.984921 14097 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:25.993964 14097 raft_consensus.cc:697] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:25.995051 14097 consensus_queue.cc:237] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:25.997826 13823 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.998519 13823 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:26.002333 14050 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:26.005378 14064 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:26.005977 14064 raft_consensus.cc:697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:26.007474 14064 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:26.018813  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:26.021744  8349 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:26.023788  8349 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:26.026262 13856 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:26.026106 13911 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:26.026106 13612 consensus_queue.cc:1059] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:26.031173  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:26.032055  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:26.045559  8377 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:26.047147  8427 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:26.054195  8377 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:26.058773  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:26.061308  8530 raft_consensus.cc:1240] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:26.061863  8349 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:26.062227  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:26.063089  8386 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:26.067693  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:26.074892  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:25.945451 13880 consensus_queue.cc:237] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:26.079329  9258 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:26.064963 14015 log.cc:927] Time spent T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 1.935s	user 0.007s	sys 0.006s
W20260709 13:03:26.064081 14086 log.cc:927] Time spent T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.430s	user 0.005s	sys 0.000s
W20260709 13:03:26.064196 14098 log.cc:927] Time spent T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.111s	user 0.003s	sys 0.000s
W20260709 13:03:26.099058  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.064463 13630 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:26.069989 13868 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.072048 14051 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:26.111680  8349 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:26.059862 13981 consensus_queue.cc:1059] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:03:26.112872 13981 raft_consensus.cc:3055] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:26.113358 13981 raft_consensus.cc:740] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:26.072834 14057 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:26.053555 13949 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:26.098625 13826 raft_consensus.cc:3055] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:26.106140 13903 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:26.102064 13961 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:26.105345 13994 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:26.159916  8378 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:03:26.078397 13970 consensus_queue.cc:1059] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:03:26.076102 14009 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:03:26.118510 13630 raft_consensus.cc:697] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:26.127478 13826 raft_consensus.cc:740] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:26.161298 14055 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:26.217331 14096 log.cc:927] Time spent T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:03:26.116297 13999 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:26.230822 13988 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:26.231515 13988 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:26.233884 13988 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:26.228819 13999 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:26.262601 13949 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:26.267792 13630 consensus_queue.cc:237] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:26.209574 13881 consensus_meta.cc:287] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.556s	user 0.007s	sys 0.004s
I20260709 13:03:26.170354 13805 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:26.118134 13868 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:26.123719 14057 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:26.282444  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3518) took 1066 ms. Trace:
W20260709 13:03:26.285480  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.160777 13981 consensus_queue.cc:260] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:26.300132  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2582) took 1076 ms. Trace:
I20260709 13:03:26.303179  8384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3520) took 1086 ms. Trace:
I20260709 13:03:26.305605  8528 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:03:26.310464  8528 pending_rounds.cc:85] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 10
I20260709 13:03:26.310719  8528 pending_rounds.cc:107] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:03:26.310967  8528 raft_consensus.cc:2889] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:26.309322  8384 rpcz_store.cc:276] 0709 13:03:25.216337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.893527 (+677190us) service_pool.cc:224] Handling call
0709 13:03:25.893816 (+   289us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:25.894196 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:25.894222 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:25.894791 (+   569us) log.cc:844] Serialized 52 byte log entry
0709 13:03:26.039760 (+144969us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:26.039811 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.039882 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.302864 (+262982us) raft_consensus.cc:1685] finished
0709 13:03:26.302894 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.303079 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10271,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":810,"thread_start_us":144572,"threads_started":1,"wal-append.queue_time_us":231848}
I20260709 13:03:26.332232  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:26.332973  8384 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:26.308610  8382 rpcz_store.cc:276] 0709 13:03:25.223983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.975016 (+751033us) service_pool.cc:224] Handling call
0709 13:03:25.975473 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:25.975912 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:25.975952 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:25.985451 (+  9499us) log.cc:844] Serialized 26 byte log entry
0709 13:03:26.123133 (+137682us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:26.123168 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.123213 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.299839 (+176626us) raft_consensus.cc:1685] finished
0709 13:03:26.299869 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.300042 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5628,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":8413,"thread_start_us":132045,"threads_started":1,"wal-append.queue_time_us":306669}
W20260709 13:03:26.306367 14101 log.cc:927] Time spent T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:03:26.345940  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2581) took 1125 ms. Trace:
I20260709 13:03:26.341877  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:26.338371  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 226767us
I20260709 13:03:26.350054  8349 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:26.304895  8379 rpcz_store.cc:276] 0709 13:03:25.215858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.891000 (+675142us) service_pool.cc:224] Handling call
0709 13:03:25.903077 (+ 12077us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:25.903259 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:03:25.918895 (+ 15636us) log.cc:844] Serialized 14 byte log entry
0709 13:03:26.072719 (+153824us) log.cc:844] Serialized 14 byte log entry
0709 13:03:26.281923 (+209204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:26.282009 (+    86us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:26.282077 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.282174 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.282358 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45684,"prepare.queue_time_us":15676,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":92,"raft.queue_time_us":57585,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":18138,"spinlock_wait_cycles":31104,"thread_start_us":315778,"threads_started":2,"wal-append.queue_time_us":386314}
I20260709 13:03:26.329753 13805 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.361824  8379 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:26.346493  8383 rpcz_store.cc:276] 0709 13:03:25.220985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.904559 (+683574us) service_pool.cc:224] Handling call
0709 13:03:25.927924 (+ 23365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:25.928196 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:25.962521 (+ 34325us) log.cc:844] Serialized 14 byte log entry
0709 13:03:26.339706 (+377185us) log.cc:844] Serialized 14 byte log entry
0709 13:03:26.345571 (+  5865us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:26.345624 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:26.345670 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.345750 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.345874 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54654,"prepare.queue_time_us":35599,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":45,"raft.queue_time_us":98129,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5439,"thread_start_us":324149,"threads_started":2,"wal-append.queue_time_us":255086}
I20260709 13:03:26.305107 13881 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:26.379415  8384 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:26.381913  8382 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:03:26.383334  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:26.381785  8349 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:26.388937  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:26.389146  8424 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:26.387877 13612 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:26.370669 13805 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:26.397727 13881 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:26.398365 13868 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:26.399783  8452 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:26.401351  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:26.373601 13981 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:26.428048  8455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 1109) took 2234 ms. Trace:
I20260709 13:03:26.438102  8455 rpcz_store.cc:276] 0709 13:03:24.193288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.499361 (+306073us) service_pool.cc:224] Handling call
0709 13:03:24.499665 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:24.553569 (+ 53904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:24.553599 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:24.553645 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:24.553682 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.425228 (+1871546us) spinlock_profiling.cc:243] Waited 53.7 ms on lock 0x7b540040d3d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:26.427832 (+  2604us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.427982 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123532544}
I20260709 13:03:26.410676 13612 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.388170 14006 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:26.351765 13826 consensus_queue.cc:260] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:26.367678 14010 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:26.434055  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:26.429508 14009 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:26.457705 13597 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:26.457971 13823 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:26.458389 13597 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:26.460574 13597 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:26.444686 13612 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:26.462157  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:26.471575  8458 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:03:26.474558 13746 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:26.477346 14052 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:26.479387 14010 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:26.443245 13930 consensus_meta.cc:287] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.544s	user 0.007s	sys 0.007s
I20260709 13:03:26.441926 14003 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:26.500852  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:03:26.435004  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 327868us
W20260709 13:03:26.434664  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 45801.9us
I20260709 13:03:26.443995  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:26.512887  9258 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:26.444453  8533 raft_consensus.cc:1275] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:26.446957  8530 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:26.434338  8529 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:26.447374  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:26.512905  8349 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:26.457768 13805 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:26.518571  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:26.522209  8453 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:26.496529 13826 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:26.490777 13930 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:26.542212  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:26.526222  9258 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:26.553408  8424 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.604s (SENT) [suppressed 42 similar messages]
I20260709 13:03:26.497008 14003 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:26.570217  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 57359.5us
I20260709 13:03:26.574312  8459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36448 (request call id 2488) took 1908 ms. Trace:
I20260709 13:03:26.533411 14023 raft_consensus.cc:3055] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:26.574312  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:26.571527  8349 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:26.531836 14122 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:26.590615  8456 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:26.534957 14035 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:03:26.584893  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 58753.3us
I20260709 13:03:26.585493  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:26.574753  8459 rpcz_store.cc:276] 0709 13:03:24.665826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.695792 (+ 29966us) service_pool.cc:224] Handling call
0709 13:03:24.696267 (+   475us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:03:24.725866 (+ 29599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:24.725908 (+    42us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:03:26.024285 (+1298377us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b2c0007a8e8. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2
0709 13:03:26.025049 (+   764us) log.cc:844] Serialized 78 byte log entry
0709 13:03:26.165790 (+140741us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:26.512524 (+346734us) log.cc:844] Serialized 14 byte log entry
0709 13:03:26.534008 (+ 21484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.534119 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.534179 (+    60us) raft_consensus.cc:1685] finished
0709 13:03:26.574093 (+ 39914us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.574248 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39452,"prepare.queue_time_us":47944,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":52113,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":46005,"spinlock_wait_cycles":7484288,"thread_start_us":481877,"threads_started":2,"wal-append.queue_time_us":271955}
I20260709 13:03:26.596104  8457 raft_consensus.cc:1240] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:26.573199 14003 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:26.603955  8534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38894 (request call id 2936) took 1323 ms (client timeout 1604 ms). Trace:
I20260709 13:03:26.575335 14019 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:26.576083 13805 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:26.605672  8534 rpcz_store.cc:269] 0709 13:03:25.273637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.275432 (+  1795us) service_pool.cc:224] Handling call
0709 13:03:26.596356 (+1320924us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b5400098154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:26.596528 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":767025536}
W20260709 13:03:26.588244 14112 log.cc:927] Time spent T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:26.606948  8349 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:26.599347 14121 log.cc:927] Time spent T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:03:26.594343 14057 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:26.610529  8349 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:26.586731 14023 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:26.600756 14035 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:26.628067  9261 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:26.630541 14035 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:26.633634 13988 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:26.633921 13862 raft_consensus.cc:3055] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:26.634459 13612 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:26.635165  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:26.636729 13612 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:26.640370  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:26.641348  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:26.634497 13862 raft_consensus.cc:740] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:26.654119 14118 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:26.655236 13862 consensus_queue.cc:260] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:26.656587 13862 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:26.658442 14107 log.cc:927] Time spent T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 13:03:26.659996  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3521) took 1443 ms. Trace:
I20260709 13:03:26.660444  8385 rpcz_store.cc:276] 0709 13:03:25.216602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.901023 (+684421us) service_pool.cc:224] Handling call
0709 13:03:25.901351 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:25.901665 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:25.901692 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:25.902140 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:03:26.036748 (+134608us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:26.036825 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.037236 (+   411us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.657837 (+620601us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:26.659605 (+  1768us) raft_consensus.cc:1685] finished
0709 13:03:26.659631 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.659914 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4420,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":2588,"spinlock_wait_cycles":6118144,"thread_start_us":102456,"threads_started":1,"wal-append.queue_time_us":300869}
I20260709 13:03:26.662467 14052 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:26.662925 14052 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:26.663506 14052 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:26.665099 13988 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:26.665746 13988 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:26.665946 14023 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:26.666971 14046 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 1.545s	user 0.002s	sys 0.000s
I20260709 13:03:26.667274 14023 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:26.669240 13988 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:26.641402  8501 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:26.644122  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:26.674767  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:26.644675 13930 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:26.644930 13978 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:26.676733 13978 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:26.679064 13978 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:26.647148 13869 raft_consensus.cc:3055] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:26.679822 13869 raft_consensus.cc:740] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:26.680789 13869 consensus_queue.cc:260] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:26.681813 13869 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:26.610368 14115 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:26.684664 14115 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:26.685176 14115 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:26.686954 14110 log.cc:927] Time spent T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:03:26.608755 14119 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:26.687963 14119 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.688357  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2584) took 1451 ms. Trace:
I20260709 13:03:26.688426 14119 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:26.688938  8381 rpcz_store.cc:276] 0709 13:03:25.236721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.989052 (+752331us) service_pool.cc:224] Handling call
0709 13:03:25.989383 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:25.991466 (+  2083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:25.991497 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:25.994070 (+  2573us) log.cc:844] Serialized 26 byte log entry
0709 13:03:26.122761 (+128691us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:26.122790 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.122837 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.686351 (+563514us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:26.688038 (+  1687us) raft_consensus.cc:1685] finished
0709 13:03:26.688064 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.688296 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1976,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":60,"spinlock_wait_cycles":6670208,"thread_start_us":128399,"threads_started":1,"wal-append.queue_time_us":407731}
I20260709 13:03:26.691097  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:26.691545 14124 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:03:26.692323  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:26.693759  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:26.641685 13870 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:26.692968  8381 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:26.661163  8526 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:03:26.703634  9261 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:26.716431  8455 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:26.718760  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:26.723237  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.724752  8351 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:26.726377  8528 raft_consensus.cc:1240] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:26.726388  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:26.728503  8351 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:26.729513  8529 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:26.735036  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:26.739293  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:26.741757  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2945) took 1283 ms. Trace:
W20260709 13:03:26.742882  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 101569us
I20260709 13:03:26.744158  8501 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:26.742355  8527 rpcz_store.cc:276] 0709 13:03:25.449844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.450014 (+   170us) service_pool.cc:224] Handling call
0709 13:03:25.450373 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:25.657720 (+207347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:25.657763 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:25.657818 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:25.657863 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.732740 (+1074877us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54000ac654. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:26.732811 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.732971 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":476352384}
I20260709 13:03:26.751590  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:26.752743  8529 raft_consensus.cc:2410] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 15 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 13:03:26.759007  8351 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:26.742642  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:26.760027  8501 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:26.767068  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 51561us
I20260709 13:03:26.768877  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:26.769804  8527 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:26.770967  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:26.772356  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:26.878397  8527 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:26.784950  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.790025  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:26.881034  8452 raft_consensus.cc:2393] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 12: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:26.792457  8381 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:26.725286 13994 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:26.722770 13911 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:26.774384  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 68883.5us
W20260709 13:03:26.737381 14106 log.cc:927] Time spent T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.377s	user 0.004s	sys 0.000s
I20260709 13:03:26.800745  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:26.768121  8427 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:26.757598 13909 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:26.826785  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:26.774268 14050 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:26.757814 13862 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.764467 13612 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:26.833834  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:26.935200  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:26.935637  9290 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:03:26.936084  9288 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:26.850893  8382 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:26.793987 14114 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:26.801446  8271 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 455c5d2786974d92a3ee8b825edcfaa7 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d653e71832b7402b9a03b46249d3b885 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:26.828328 13997 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:03:26.860328  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 960) took 1071 ms. Trace:
I20260709 13:03:26.941514  9291 raft_consensus.cc:2393] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 15: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:26.793918 14118 consensus_queue.cc:1048] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:03:26.863507  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3527) took 1137 ms. Trace:
I20260709 13:03:26.857566  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:26.736104 13805 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:26.773352  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:26.799954 14049 consensus_queue.cc:1059] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.132s
I20260709 13:03:26.964948  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:26.965974  9291 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 21.
W20260709 13:03:26.879818  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 144789us
I20260709 13:03:26.923631  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:26.828609 13903 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:03:26.801784 13705 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:26.793891 13988 consensus_queue.cc:1059] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
W20260709 13:03:26.929747  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 161852us
I20260709 13:03:26.930603  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:26.996361  9293 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:03:26.937739 14050 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:26.794076 13972 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:26.938216  9295 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:26.935127 13862 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:26.942713  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:26.943564  8383 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:26.922749 13994 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:26.756598  8500 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:26.943560  8377 rpcz_store.cc:276] 0709 13:03:25.725858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.056703 (+330845us) service_pool.cc:224] Handling call
0709 13:03:26.060347 (+  3644us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:26.336154 (+275807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:26.336188 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:26.336745 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:03:26.617751 (+281006us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:26.617813 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.617910 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.863249 (+245339us) raft_consensus.cc:1685] finished
0709 13:03:26.863269 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.863442 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54068,"raft.queue_time_us":154119,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":62444,"thread_start_us":475299,"threads_started":2,"wal-append.queue_time_us":505125}
I20260709 13:03:26.941735  8378 rpcz_store.cc:276] 0709 13:03:25.788721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.164876 (+376155us) service_pool.cc:224] Handling call
0709 13:03:26.165233 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:26.171567 (+  6334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:26.171599 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:26.172241 (+   642us) log.cc:844] Serialized 26 byte log entry
0709 13:03:26.486155 (+313914us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:26.509976 (+ 23821us) log.cc:844] Serialized 14 byte log entry
0709 13:03:26.543635 (+ 33659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.543734 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.860108 (+316374us) raft_consensus.cc:1685] finished
0709 13:03:26.860131 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.860269 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65944,"prepare.queue_time_us":22591,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":3169,"raft.queue_time_us":155345,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":48625,"thread_start_us":259960,"threads_started":1,"wal-append.queue_time_us":517696}
I20260709 13:03:27.011987  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:27.014328  8383 raft_consensus.cc:1240] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 13:03:26.947533  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 392602us
W20260709 13:03:26.976039  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.937434 14035 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:26.931283  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:27.018927  9294 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:27.005067  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:27.016584  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 260105us
W20260709 13:03:26.999617 14106 log.cc:927] Time spent T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:03:27.021263  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:26.946259  8271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 148999us
I20260709 13:03:26.937238 13909 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:27.019151  8427 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:27.037499  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:27.005467 14050 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:26.945001 13911 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:27.041574  9292 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:27.007894 13972 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:27.043604 13992 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.007s	sys 0.020s
I20260709 13:03:27.045318 14032 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:03:27.097543 13992 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.007s	sys 0.020s
I20260709 13:03:27.118649 14003 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:27.106905 13911 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:27.047765 13881 consensus_queue.cc:1059] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:27.127718  8377 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:27.110144 13909 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:27.108665  9288 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:27.130592  9294 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:27.105257  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:27.132817  9291 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
I20260709 13:03:27.135100  9292 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:27.056106 14064 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:03:27.061923  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 90103.2us
I20260709 13:03:27.135774 14064 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:27.136371  9258 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:27.136637 13869 consensus_queue.cc:1059] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:27.137346 13868 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:27.137504 14032 raft_consensus.cc:697] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:27.137890 13868 raft_consensus.cc:697] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:27.063884  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2594) took 1234 ms. Trace:
W20260709 13:03:27.142961  8532 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.009s	sys 0.041s
I20260709 13:03:27.020470 13903 raft_consensus.cc:3055] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:03:27.075439  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 248394us
I20260709 13:03:27.017200 14049 raft_consensus.cc:3055] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:03:27.015272 14082 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.012s	sys 0.013s
I20260709 13:03:27.097268  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:27.124290 13994 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:27.134815 14119 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:27.054242  8378 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:03:27.047170  8383 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:03:27.118250 14134 log.cc:927] Time spent T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:03:27.072078  8529 raft_consensus.cc:3055] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:27.168855  8529 raft_consensus.cc:740] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:27.168268  8461 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:27.098654 13972 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:27.138463  8380 rpcz_store.cc:276] 0709 13:03:25.829056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.437697 (+608641us) service_pool.cc:224] Handling call
0709 13:03:26.438026 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:26.482506 (+ 44480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:26.482542 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:26.483078 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:03:26.675338 (+192260us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b1800386b00. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c537ae07 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c80250d1 00007f36c8440a0f
0709 13:03:27.051392 (+376054us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:27.051446 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.051559 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:27.063437 (+ 11878us) raft_consensus.cc:1685] finished
0709 13:03:27.063467 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.063801 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65154,"raft.queue_time_us":50943,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":32297,"spinlock_wait_cycles":20375936,"thread_start_us":375800,"threads_started":1,"wal-append.queue_time_us":559214}
W20260709 13:03:27.151511  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 212616us
I20260709 13:03:27.066944 14147 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:27.177408 13705 raft_consensus.cc:697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:27.154841  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2590) took 1326 ms. Trace:
W20260709 13:03:27.163108 14082 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.012s	sys 0.014s
I20260709 13:03:27.035327 14035 raft_consensus.cc:697] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:03:27.143513  8532 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.009s	sys 0.042s
I20260709 13:03:27.153633 14049 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:03:27.143901  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 333470us
I20260709 13:03:27.159693  8527 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 16.
I20260709 13:03:27.175392 14066 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:27.208218 14131 log.cc:927] Time spent T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 13:03:27.208529  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:27.152292 14003 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:27.209925  8385 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:03:27.152046 13903 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:27.169842  8529 consensus_queue.cc:260] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:27.239977  8529 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:27.226318  8501 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:27.232965  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.179044  8379 rpcz_store.cc:276] 0709 13:03:25.828086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.371173 (+543087us) service_pool.cc:224] Handling call
0709 13:03:26.384380 (+ 13207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:26.386712 (+  2332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:26.386813 (+   101us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:26.402124 (+ 15311us) log.cc:844] Serialized 26 byte log entry
0709 13:03:26.818221 (+416097us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:27.090238 (+272017us) log.cc:844] Serialized 14 byte log entry
0709 13:03:27.090521 (+   283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.090625 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:27.154491 (+ 63866us) raft_consensus.cc:1685] finished
0709 13:03:27.154524 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.154753 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":389,"prepare.queue_time_us":42409,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":741,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":14684,"thread_start_us":607107,"threads_started":2,"wal-append.queue_time_us":583410}
I20260709 13:03:27.233455  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:27.234432  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:27.235222  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:27.138680 14032 consensus_queue.cc:237] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:27.138782 13868 consensus_queue.cc:237] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:27.257721  8351 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:27.178521 13705 consensus_queue.cc:237] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:27.272634  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 250197us
I20260709 13:03:27.275637  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:27.277202  9288 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:27.279074  8500 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:27.288444  8351 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:27.296756  8351 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:27.298600  8424 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:27.302394  8529 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:27.303397  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:27.305045  8380 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:03:27.305563  8377 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:03:27.270332 14068 raft_consensus.cc:2764] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:03:27.311164  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:27.312069  8457 raft_consensus.cc:2410] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:03:27.321231  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:27.322352  8380 raft_consensus.cc:2393] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 15: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:27.290876 14163 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:27.309219 14064 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:27.271152 13981 consensus_queue.cc:1059] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:03:27.268733 13607 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:03:27.298954 13911 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:27.242719 14066 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:27.310328 13560 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:27.268536 13870 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:03:27.314791 14003 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:27.318806 14057 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:03:27.333823 13826 consensus_meta.cc:287] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.779s	user 0.011s	sys 0.000s
I20260709 13:03:27.345177 14163 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:27.349059 13911 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:27.401162 13911 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:27.351469  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:27.289510 14049 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:27.411021 14049 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:27.415917 14163 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:27.417553  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:27.421873  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 157868us
W20260709 13:03:27.385185  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 86658.5us
I20260709 13:03:27.387467  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:27.426220  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:27.427623  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:27.433200  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:27.447479  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.335038 13903 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:27.334787 14156 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:27.463673  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 2952) took 1030 ms. Trace:
I20260709 13:03:27.384186 14003 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:27.516834  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 91920.6us
I20260709 13:03:27.315136 14035 consensus_queue.cc:237] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:27.464762 14169 log.cc:927] Time spent T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:03:27.526181  8532 rpcz_store.cc:276] 0709 13:03:26.433428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.434614 (+  1186us) service_pool.cc:224] Handling call
0709 13:03:26.434894 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:26.435090 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:27.220601 (+785511us) log.cc:844] Serialized 14 byte log entry
0709 13:03:27.463203 (+242602us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:27.463277 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:27.463340 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.463435 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.463600 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8806,"prepare.queue_time_us":13630,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":45,"thread_start_us":1011875,"threads_started":2}
I20260709 13:03:27.533960 14147 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:03:27.542150 13930 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:27.428467 13862 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:27.555202 14003 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:27.520026 14055 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:27.559706  8378 raft_consensus.cc:1240] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:27.563427 13882 raft_consensus.cc:3055] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:27.569973 14119 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:27.573276 13560 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:27.573416 14050 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:27.429805 13881 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:27.580441  9295 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:27.428936 13826 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:27.581487  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 262789us
I20260709 13:03:27.585355  8424 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:27.592850  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 169707us
I20260709 13:03:27.606590  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:27.600940  8457 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:03:27.593807 14052 consensus_meta.cc:287] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.930s	user 0.010s	sys 0.001s
W20260709 13:03:27.595732 14115 consensus_meta.cc:287] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.910s	user 0.007s	sys 0.005s
W20260709 13:03:27.609448  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 315971us
I20260709 13:03:27.614354  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:27.615199  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:27.597024 13988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.009s	sys 0.025s
I20260709 13:03:27.621219  9295 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:27.629375  8378 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:27.630606  9288 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88"
dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
mode: GRACEFUL
new_leader_uuid: "105d6581548546b98eddd4ee7083bb12"
 from {username='slave'} at 127.0.0.1:54044
I20260709 13:03:27.631404  9288 raft_consensus.cc:606] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Received request to transfer leadership to TS 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:27.631880  9288 raft_consensus.cc:614] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:27.602667 13992 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.633841  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:27.600764 13882 raft_consensus.cc:740] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:27.638576  9291 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
W20260709 13:03:27.639575  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.639601  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:03:27.624188 13988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.009s	sys 0.026s
I20260709 13:03:27.648942  8378 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:27.648712  9261 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:27.640939  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:27.641489  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:27.641007  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:27.636615  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:27.604079 13881 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:27.652961  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:27.653251  8351 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:27.651505  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:27.654889  9261 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:27.656426  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:27.657106  9261 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:27.604849 14055 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:27.662974  8378 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 15: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:27.664466  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:27.665063  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 79796.7us
I20260709 13:03:27.665882  8424 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:27.670898  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:27.669862  8384 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.015s	sys 0.004s
W20260709 13:03:27.672323  8384 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.015s	sys 0.004s
I20260709 13:03:27.672123  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:27.672839  9295 raft_consensus.cc:2376] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16. Re-sending same reply.
I20260709 13:03:27.676403  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:27.677006  9290 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:27.677496 13882 consensus_queue.cc:260] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:27.678561 13882 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:27.678757 14063 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:27.620126 14115 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:27.677511  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:27.682456 14162 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:27.682812 14115 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:27.652555 14180 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.683856 13705 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:27.684317 14180 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:27.651476 14122 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.686501 14122 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:27.688632 14122 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:27.655841 14009 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:27.647902 13992 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:27.650961 13881 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:27.619624 14052 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:27.660857 14172 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:27.656253 14171 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:27.660524 14119 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:27.616779 13826 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:27.680931 14063 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:27.748147  8530 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:03:27.689761 14023 consensus_meta.cc:287] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 1.022s	user 0.014s	sys 0.001s
I20260709 13:03:27.736377  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:27.787981  8532 raft_consensus.cc:2393] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 16: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:27.738998  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:27.749469  8529 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:27.726516  9292 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:27.763425  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:27.695935  9289 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:27.747449  9287 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:03:27.691576  8381 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:27.779824  9291 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:27.762524  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:27.763458 14148 log.cc:927] Time spent T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.431s	user 0.003s	sys 0.001s
I20260709 13:03:27.792318  9294 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:27.793068  8526 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:03:27.794607  8529 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:27.747628 13981 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:27.703176 14097 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.704674 14162 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:27.713835 14184 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:27.703464 13607 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:27.703316 14181 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:27.724175 13826 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:27.702100 14168 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:27.698143 14050 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:27.758919 14180 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:27.710485 14119 raft_consensus.cc:697] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:27.712632 14055 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:27.691426 13992 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:27.795827  8534 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 21.
I20260709 13:03:27.811565  9258 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:27.701159 13970 consensus_queue.cc:1059] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.128s
I20260709 13:03:27.784864 14115 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:27.803314  8424 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:27.721168 13630 consensus_queue.cc:1059] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 13:03:27.695416 14052 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:27.830518  8424 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:27.689249 13911 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:27.818226  8384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3542) took 1147 ms. Trace:
I20260709 13:03:27.818692 14122 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:27.815012 14171 consensus_queue.cc:1059] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:03:27.816783 14119 consensus_queue.cc:237] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:27.825065  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.696501 14163 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:27.689055 13972 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:27.855023  8384 rpcz_store.cc:276] 0709 13:03:26.670763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.726080 (+ 55317us) service_pool.cc:224] Handling call
0709 13:03:26.727587 (+  1507us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:26.728071 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:26.728109 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:26.774792 (+ 46683us) log.cc:844] Serialized 52 byte log entry
0709 13:03:26.865107 (+ 90315us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b48002dc558. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36cd3aeaa1 00007f36cd3a5b37 00007f36cd3a59ca 00007f36cd49d26f 00007f36cd49cf37 00007f36cd4b155c 00007f36cd4b1508 00007f36cd4b1488 00007f36cd4b1443 00007f36cd4b06ec 00007f36cc3daa96
0709 13:03:27.672695 (+807588us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:27.672734 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.672794 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:27.762835 (+ 90041us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:27.818019 (+ 55184us) raft_consensus.cc:1685] finished
0709 13:03:27.818037 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.818174 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5818,"raft.run_cpu_time_us":2280,"raft.run_wall_time_us":119582,"spinlock_wait_cycles":67788544,"thread_start_us":823292,"threads_started":1,"wal-append.queue_time_us":431238}
I20260709 13:03:27.874322  8379 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:27.875361  8526 raft_consensus.cc:1240] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:27.810932 14010 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:03:27.862528 14122 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.858062 13981 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:27.811928 14097 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:27.898231  9296 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
W20260709 13:03:27.893803  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 161864us
I20260709 13:03:27.813060 13607 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:27.899756  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 238288us
I20260709 13:03:27.881561 13870 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:27.908814  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 255726us
I20260709 13:03:27.915249  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:27.893971 14122 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:27.898448 14052 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:27.877701  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 214697us
I20260709 13:03:27.897373 14055 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:27.879280 14186 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:03:27.921423 14180 consensus_queue.cc:1059] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:03:27.689595 14009 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:27.815644 14168 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:27.917258 14172 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:27.930198  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 99789.1us
I20260709 13:03:27.821585 14162 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:27.921697 13805 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:27.921377 13826 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.939623 14172 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:27.941798 14066 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:27.966152 13607 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:27.943792 14162 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:27.922859 14023 consensus_queue.cc:1059] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 13:03:27.945055 14187 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:03:27.946539 14097 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:27.813870 14181 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:27.935751  8500 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:27.933132 14010 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:27.955413  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:27.921613 14055 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:27.961704  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.962158 14192 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:27.962899 14191 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:27.981930  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 46251.9us
I20260709 13:03:27.953400  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:27.994832  8535 raft_consensus.cc:2393] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 16: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:27.922214 14052 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:27.995687  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:27.997313  8500 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:28.005699  8426 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:27.985895  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3536) took 1995 ms. Trace:
I20260709 13:03:27.987443  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:28.007876  8385 rpcz_store.cc:276] 0709 13:03:25.990682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.662414 (+671732us) service_pool.cc:224] Handling call
0709 13:03:26.662778 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:27.239311 (+576533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.985633 (+746322us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b54003b7c54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:27.985837 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1257518336}
I20260709 13:03:28.015472  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:27.974345 13805 raft_consensus.cc:697] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:28.033061  8379 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:28.016930  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:28.040530  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:28.040818  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:28.042375  8385 raft_consensus.cc:2393] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 16: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:27.993151 14180 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:27.968812 13826 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:28.047626  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:28.050836  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:28.051909  8385 raft_consensus.cc:2410] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:03:28.032598 14193 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:28.054505 14180 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:03:28.056140 14195 log.cc:927] Time spent T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:03:28.058198 14118 raft_consensus.cc:3055] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:28.065636 14118 raft_consensus.cc:740] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:28.058799 14052 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:28.061015  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:28.063037  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:28.036494 13911 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:28.039414 14186 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:28.034924 14119 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:28.045375 13826 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:28.045919 13882 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:27.997614 14010 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:28.073065  8500 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:28.070506  8385 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:28.074218 14118 consensus_queue.cc:260] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:28.075814 14199 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:03:28.130681 13882 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:28.076234 13870 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:28.025959 14191 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:28.132210  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:28.133500 14118 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:28.134019 14191 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:28.077979 14172 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:28.060039 14009 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:28.080756 14119 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:28.139758 14119 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:28.060765 13972 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:28.140763 14055 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:28.027009 14192 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:28.077566 14168 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:28.145632 14192 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:28.053545 14156 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:28.146380 14156 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:28.082700 13911 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.149662 13911 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:28.152328 13911 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:28.049458 14163 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:28.088400  8384 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:28.153805 14003 consensus_meta.cc:287] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.000s
I20260709 13:03:28.088917  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:28.104276  8500 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:28.053789 13597 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:28.156363  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 52250.8us
I20260709 13:03:28.157176  8500 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:28.158695  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:28.130334 14193 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:28.159293  8529 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:28.129608  8426 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:28.130527 13805 consensus_queue.cc:237] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:28.080739 14122 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:28.249979  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 89086.9us
I20260709 13:03:28.332944 13597 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:28.333576 14184 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:28.334733 13911 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:28.416767 13911 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:28.417199 13597 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:28.417565 14115 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:28.418568 14115 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:28.419211 13911 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:28.336544 14179 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:28.343786  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 214279us
I20260709 13:03:28.154278 14003 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:28.426344 13881 consensus_meta.cc:287] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.734s	user 0.006s	sys 0.006s
I20260709 13:03:28.430239  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:28.430325 13881 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:28.148986 14156 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:28.393123  8500 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:28.431056  9287 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:28.432389  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:28.433223  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:28.433526  8380 raft_consensus.cc:2393] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 22: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:28.430672 14003 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:28.436637  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:28.437256  9294 raft_consensus.cc:2376] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15. Re-sending same reply.
W20260709 13:03:28.437879  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 44894.9us
I20260709 13:03:28.438639  8500 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:28.249670 14023 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:28.337803 14163 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:28.441841  8500 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:28.449527  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:28.450786  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:28.428416 14066 consensus_queue.cc:1059] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:03:28.453236  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:28.453585  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:28.453974  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:28.455427  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:28.455827  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:28.462468  8531 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:28.459031  8455 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:28.463259  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:28.464881  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:28.471141  8529 raft_consensus.cc:2393] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 16: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:28.471382  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:28.476572  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:28.482120  8452 raft_consensus.cc:2393] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 14: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:28.472646 14009 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.484561 14009 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:28.445948 14184 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:28.486305 14184 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:28.445551 14156 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:28.486866 14009 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:28.472630 13882 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:28.457664 14003 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:28.436896 14205 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:28.458550 14179 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:28.494268 14205 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.494900 14205 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:28.480924  8426 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:28.500370  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:28.499442 14003 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:28.482337  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:03:28.507350  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.507714  8532 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:28.508136  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48484 (request call id 966) took 1200 ms. Trace:
I20260709 13:03:28.508493  8380 rpcz_store.cc:276] 0709 13:03:27.307539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.427350 (+119811us) service_pool.cc:224] Handling call
0709 13:03:28.507954 (+1080604us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002c7754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:28.508079 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2311698816}
I20260709 13:03:28.459792 13881 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:28.508751  8424 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:28.508975  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:28.510131  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:28.513954  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:28.483618 14164 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:28.439983 13630 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 13:03:28.507647 14168 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:28.525938  8424 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:28.515040 14010 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:28.544559  8455 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:28.518064 14151 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.518702 14179 raft_consensus.cc:697] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:28.523427 13881 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:28.529037 14168 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.568249  9296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 1210) took 1572 ms. Trace:
I20260709 13:03:28.569830  8377 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:28.569885  9296 rpcz_store.cc:276] 0709 13:03:26.995435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.997663 (+  2228us) service_pool.cc:224] Handling call
0709 13:03:26.998136 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:27.912356 (+914220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.568007 (+655651us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b54007378d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:28.568193 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2069286272}
W20260709 13:03:28.568251  8534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47306 (request call id 1255) took 1845 ms (client timeout 2242 ms). Trace:
I20260709 13:03:28.571344  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3545) took 1899 ms. Trace:
I20260709 13:03:28.571678  8455 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:28.571743  8381 rpcz_store.cc:276] 0709 13:03:26.671642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.882482 (+210840us) service_pool.cc:224] Handling call
0709 13:03:26.882798 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:27.791551 (+908753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.571124 (+779573us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b54002c8654. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:28.571291 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1859530112}
W20260709 13:03:28.571578  8534 rpcz_store.cc:269] 0709 13:03:26.722759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.724639 (+  1880us) service_pool.cc:224] Handling call
0709 13:03:28.568089 (+1843450us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000f6ed4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:28.568181 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2457227520}
I20260709 13:03:28.563148  8532 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 21.
I20260709 13:03:28.574254  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:28.574651  8454 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:28.576072 14162 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:28.579267  8377 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:28.580724  8377 raft_consensus.cc:1240] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:28.582947  8500 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:28.583909 13746 raft_consensus.cc:3055] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:28.584348 13746 raft_consensus.cc:740] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:28.584482 14210 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:28.585340 13746 consensus_queue.cc:260] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:28.586722 14147 consensus_queue.cc:1059] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:28.587668 13746 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:28.588989  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.561829 14003 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:28.565116 14151 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:28.606509 14171 consensus_queue.cc:1059] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:28.610580 14179 consensus_queue.cc:237] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:28.614805  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.618948 14057 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:28.619583  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:28.573177  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:28.626246  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:28.629674  8385 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:03:28.650275  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.650075  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:28.604833 14151 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:28.654495  9258 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:28.619583 14057 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:28.621208 14168 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:28.667060  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:28.671026  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:28.660454 14068 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:28.674345 14023 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:28.663525 14184 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:28.671005 13597 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.531777 14115 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:28.691912  8378 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:28.670840 13994 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:28.674809 14118 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:28.633514 13705 consensus_queue.cc:1059] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:03:28.692680  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:28.677858 13560 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:28.695259  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:28.696190  8529 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:28.699359  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:28.699496  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:28.700615  8533 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:28.710999  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:28.709769 13705 consensus_queue.cc:1243] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer 105d6581548546b98eddd4ee7083bb12 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:28.702054 13994 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:28.717602 13994 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:28.692090 14122 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:28.721832  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:28.692804 14023 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:28.726468 14115 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:28.695511 14118 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.727383 14023 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:28.727629 14118 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:28.730209  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:28.707343 13560 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:28.735671 13560 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:28.736316  8535 raft_consensus.cc:3055] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:28.736752  8535 raft_consensus.cc:740] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:28.737596  8535 consensus_queue.cc:260] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:28.738826  8535 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:28.697309 13597 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:28.743059 13597 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:28.743587 14212 log.cc:927] Time spent T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:03:28.691473 14068 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:28.750463  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:28.751372  8377 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:28.765588 14068 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:28.765779 14211 log.cc:927] Time spent T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.106s	user 0.003s	sys 0.001s
I20260709 13:03:28.767831  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 969) took 1132 ms. Trace:
I20260709 13:03:28.768321  8382 rpcz_store.cc:276] 0709 13:03:27.635650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.948895 (+313245us) service_pool.cc:224] Handling call
0709 13:03:27.949251 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:27.949591 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:27.949630 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:27.950155 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:03:28.438270 (+488115us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:28.471188 (+ 32918us) log.cc:844] Serialized 14 byte log entry
0709 13:03:28.471733 (+   545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.471897 (+   164us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:28.616230 (+144333us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b18003494e0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:03:28.716992 (+100762us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:28.767617 (+ 50625us) raft_consensus.cc:1685] finished
0709 13:03:28.767638 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.767758 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34053,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":11259,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":212,"spinlock_wait_cycles":161331712,"thread_start_us":471112,"threads_started":1,"wal-append.queue_time_us":578541}
I20260709 13:03:28.770520  8535 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:28.806864  8532 raft_consensus.cc:1240] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:28.808349  8529 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:28.814380  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:28.814695  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:28.815182  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:28.815442  9294 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:03:28.815577  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:28.817494  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:28.817584 14068 raft_consensus.cc:476] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Not starting pre-election -- already a leader
I20260709 13:03:28.816161  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:28.818872  8534 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:28.820799  9294 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:28.821056  8424 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:28.823122 14066 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:28.823596 14066 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.824038 14066 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:28.824224  9294 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:28.826058 14068 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:28.826948 14068 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:28.830236 14068 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:28.833292 14032 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:28.833609 13882 consensus_queue.cc:1059] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:28.833871  8424 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:28.834596 13882 raft_consensus.cc:3055] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:28.835150 13882 raft_consensus.cc:740] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:28.817584  8533 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:28.839318 13882 consensus_queue.cc:260] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:28.836234 14063 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:28.863766  9258 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:28.869670  9258 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:28.870625  9258 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:28.883934 14057 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:28.874186 13896 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:28.885612 13896 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:28.886014 13896 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:28.889431 14161 raft_consensus.cc:3055] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:28.872522 14122 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:28.875217 13994 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:28.878356 13882 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:28.894848 14205 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:28.897059 14118 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:28.897848 13994 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:28.911981  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:28.900451  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:28.906057  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:28.907013 14230 log.cc:927] Time spent T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:03:28.912125  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:28.876013 14063 raft_consensus.cc:697] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:28.913712  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:28.918749  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:28.919528  8527 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:28.891685 14161 raft_consensus.cc:740] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:28.924151  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:28.924705  8349 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:28.928385  8527 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 22.
I20260709 13:03:28.928565  8349 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:28.929332  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:28.929966  8527 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:03:28.930727  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:28.930882  8349 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:28.932765  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:28.916651 13994 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:28.939287 14063 consensus_queue.cc:237] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:28.940214 14057 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:28.938485  8349 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:28.943100  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:03:28.944396  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.944850  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:28.924670 14068 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:28.936192 14115 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:28.935912 13560 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:28.934178 13805 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:28.953652  8461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36446 (request call id 2498) took 4027 ms (client timeout 1722 ms). Trace:
W20260709 13:03:28.957656  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.960022  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:28.921237 14066 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:28.960642  8381 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:28.960337  8461 rpcz_store.cc:269] 0709 13:03:24.921156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.955484 (+ 34328us) service_pool.cc:224] Handling call
0709 13:03:28.948336 (+3992852us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b540040ecd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:28.948479 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5076366720}
I20260709 13:03:28.966298  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3566) took 1282 ms. Trace:
W20260709 13:03:28.967654  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.966732  8380 rpcz_store.cc:276] 0709 13:03:27.683646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.565443 (+881797us) service_pool.cc:224] Handling call
0709 13:03:28.565930 (+   487us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:28.566696 (+   766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.566728 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:28.585926 (+ 19198us) log.cc:844] Serialized 52 byte log entry
0709 13:03:28.806663 (+220737us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:28.806731 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.806816 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:28.966085 (+159269us) raft_consensus.cc:1685] finished
0709 13:03:28.966104 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.966243 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":43908,"thread_start_us":220331,"threads_started":1,"wal-append.queue_time_us":300718}
W20260709 13:03:28.973533 14214 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.278s	user 0.002s	sys 0.000s
I20260709 13:03:28.977674  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 1260) took 2252 ms. Trace:
I20260709 13:03:28.978106  8528 rpcz_store.cc:276] 0709 13:03:26.725610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.745783 (+ 20173us) service_pool.cc:224] Handling call
0709 13:03:26.746279 (+   496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:26.758372 (+ 12093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:26.758411 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:26.758986 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:03:27.006299 (+247313us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:27.028210 (+ 21911us) log.cc:844] Serialized 14 byte log entry
0709 13:03:27.257348 (+229138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.257458 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:28.885702 (+1628244us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b1800400a20. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:03:28.974404 (+ 88702us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b1800400a20. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:03:28.977456 (+  3052us) raft_consensus.cc:1685] finished
0709 13:03:28.977477 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.977608 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11588,"prepare.queue_time_us":34453,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":58602,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":28127,"spinlock_wait_cycles":76951296,"thread_start_us":473460,"threads_started":2,"wal-append.queue_time_us":320819}
I20260709 13:03:28.970041 13911 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:28.958818 14068 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:28.981395  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:28.981916  8426 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:28.983743 13880 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:28.957273 14115 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:28.987697  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:28.993810  8380 raft_consensus.cc:2410] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:03:28.990147 13911 raft_consensus.cc:697] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 16 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:28.989198  8500 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:28.994995  8384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3564) took 1323 ms. Trace:
I20260709 13:03:28.995539  8384 rpcz_store.cc:276] 0709 13:03:27.671451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.154322 (+482871us) service_pool.cc:224] Handling call
0709 13:03:28.154748 (+   426us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:28.155136 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.155162 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:28.155719 (+   557us) log.cc:844] Serialized 52 byte log entry
0709 13:03:28.547351 (+391632us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:28.590601 (+ 43250us) log.cc:844] Serialized 14 byte log entry
0709 13:03:28.591131 (+   530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.591229 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:28.972667 (+381438us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:28.994602 (+ 21935us) raft_consensus.cc:1685] finished
0709 13:03:28.994743 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.994923 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":41778,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":37,"raft.queue_time_us":95599,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":65869,"spinlock_wait_cycles":26760960,"thread_start_us":391189,"threads_started":1,"wal-append.queue_time_us":499280}
I20260709 13:03:28.998062 14057 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:28.998519 14057 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:28.998874 14057 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:29.004189  8426 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:29.003958 13911 consensus_queue.cc:237] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:29.005594 14199 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:29.006417 14199 consensus_queue.cc:1059] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:29.007548 14199 raft_consensus.cc:3055] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:29.008028 14199 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:29.009204 14023 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:29.005744  8426 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:29.007436 14013 raft_consensus.cc:3055] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:29.014845 14013 raft_consensus.cc:740] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:29.015722 14013 consensus_queue.cc:260] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:28.961844 14161 consensus_queue.cc:260] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:29.018231 14161 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:29.001237 14115 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:29.020735 13903 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:29.022441 14118 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:29.024263 14205 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:29.026954  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 3570) took 1065 ms. Trace:
I20260709 13:03:29.027379  8379 rpcz_store.cc:276] 0709 13:03:27.961814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.987166 (+ 25352us) service_pool.cc:224] Handling call
0709 13:03:29.026737 (+1039571us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b5400188654. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:29.026890 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45496704}
I20260709 13:03:29.029453 14168 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.034507  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 968) took 1726 ms. Trace:
I20260709 13:03:29.035032  8386 rpcz_store.cc:276] 0709 13:03:27.310047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.570203 (+260156us) service_pool.cc:224] Handling call
0709 13:03:27.570509 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:27.725332 (+154823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:27.725377 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:27.725431 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:27.725484 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.034206 (+1308722us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400189054. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:29.034295 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:29.034438 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355493760}
I20260709 13:03:29.039618 14181 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:29.016810 14013 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:29.045356 13883 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:29.045610 14199 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.047061 14199 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:29.048919  8271 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 455c5d2786974d92a3ee8b825edcfaa7 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d653e71832b7402b9a03b46249d3b885 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:03:29.049882  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:29.051232  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 112792us
I20260709 13:03:29.052547  8349 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:29.026496 14066 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:29.062207  8349 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:29.063884  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:29.064239  8381 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:03:29.068423  8349 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:29.072481  8349 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:29.075488  8349 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:29.092319  8426 leader_election.cc:336] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Timed out: RequestConsensusVote RPC to 127.7.25.196:40669 timed out after 2.006s (SENT)
I20260709 13:03:29.069308 13560 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:29.069903 14192 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:29.074048 14003 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:29.107188 13896 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.110519  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:29.076711 13805 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:29.061549 14097 consensus_queue.cc:1059] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
W20260709 13:03:29.101478 14158 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.786s	user 0.014s	sys 0.041s
I20260709 13:03:29.112016 14168 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:29.104274 14192 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:29.121619 14158 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.813s	user 0.014s	sys 0.042s
W20260709 13:03:29.128890  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 53485us
I20260709 13:03:29.120198 13560 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:29.122117 14003 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:29.118659 13805 raft_consensus.cc:697] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 21 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:29.132751 13994 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.135871  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3562) took 1487 ms. Trace:
I20260709 13:03:29.136323  8378 rpcz_store.cc:276] 0709 13:03:27.648658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.086164 (+437506us) service_pool.cc:224] Handling call
0709 13:03:28.086392 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.693071 (+606679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.135631 (+442560us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b5400269b54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:29.135808 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1392009984}
I20260709 13:03:29.136905 13994 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:29.141965 14236 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.127815 14192 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:29.149799  8454 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:29.133556 14003 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:29.138235 13560 raft_consensus.cc:697] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 22 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:03:29.162695  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.160406 14023 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:29.170387 14023 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:29.171271 14115 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:29.154161 14236 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.177675 13805 consensus_queue.cc:237] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:29.183804  9289 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55734 (request call id 1219) took 1508 ms (client timeout 2006 ms). Trace:
W20260709 13:03:29.184371  9289 rpcz_store.cc:269] 0709 13:03:27.675753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.676098 (+   345us) service_pool.cc:224] Handling call
0709 13:03:29.183584 (+1507486us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b5400773154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:29.183730 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11444992}
I20260709 13:03:29.186043 14236 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:29.187310 14156 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.187824 14156 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:29.189929 13560 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.191561 14156 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:29.192480  8529 raft_consensus.cc:2410] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:03:29.188230  9295 raft_consensus.cc:1240] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:29.160519 14003 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:29.194028  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.202804  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:29.203226 14115 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:29.203624  8533 raft_consensus.cc:2393] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 22: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:03:29.207026 14190 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:03:29.211357  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:29.216532  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:29.217186 14023 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:29.154145 13896 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:29.225271  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:29.227147  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:29.228017  8452 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:29.217356  8533 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:29.233110  8500 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:29.235183  9292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 778) took 1621 ms. Trace:
I20260709 13:03:29.235589  9292 rpcz_store.cc:276] 0709 13:03:27.614399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.614515 (+   116us) service_pool.cc:224] Handling call
0709 13:03:27.614803 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:27.789738 (+174935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.234963 (+1445225us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b540030d754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:29.235128 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255903616}
I20260709 13:03:29.253162  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:29.255266  8531 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:29.261160  8526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 1271) took 1462 ms. Trace:
I20260709 13:03:29.261720  8526 rpcz_store.cc:276] 0709 13:03:27.799256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.799854 (+   598us) service_pool.cc:224] Handling call
0709 13:03:27.800223 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:27.875815 (+ 75592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.260848 (+1385033us) spinlock_profiling.cc:243] Waited 74.9 ms on lock 0x7b54002ea754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:29.261065 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172282624}
I20260709 13:03:29.254598 14023 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:29.282040 14221 log.cc:927] Time spent T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.396s	user 0.002s	sys 0.003s
W20260709 13:03:29.282963 14238 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:03:29.256480 13903 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:29.278055 14023 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:29.285046 13903 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:29.311378 13903 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:29.253737 14180 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:03:29.287176 14023 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:29.291541 14003 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:29.307735 14182 raft_consensus.cc:3055] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:29.405586 14182 raft_consensus.cc:740] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:29.300027 14064 raft_consensus.cc:3055] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:29.409165 14003 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:29.364699  8533 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:29.286815 14068 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:29.394506  8386 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:29.398006  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:29.398505  9295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 1218) took 1722 ms. Trace:
I20260709 13:03:29.398814  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:29.409307 14064 raft_consensus.cc:740] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:29.290534 14192 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:29.379372 14057 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:29.381779  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 116696us
I20260709 13:03:29.421396  9261 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:29.438289  8379 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:03:29.438524  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:29.453487  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:29.412026  9295 rpcz_store.cc:276] 0709 13:03:27.675458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.706873 (+ 31415us) service_pool.cc:224] Handling call
0709 13:03:29.188049 (+1481176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.193072 (+  5023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.397987 (+204915us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400773150. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:29.398250 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3405492608}
I20260709 13:03:29.469513  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:29.470857  8457 raft_consensus.cc:606] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:29.471625  8457 raft_consensus.cc:614] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:29.475324  8535 raft_consensus.cc:1240] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 16. Current term is 17. Ops: []
W20260709 13:03:29.484565  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 99734us
I20260709 13:03:29.484637 13868 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:29.489640  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:29.491186  8378 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:29.492393  8531 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:29.492506 14064 consensus_queue.cc:260] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.493232  8528 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:29.494879  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.518846  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:29.521008  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:29.521792  8532 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:29.522706  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:29.504824  8461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:29.525203  8461 raft_consensus.cc:606] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:29.477238  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:29.527040  8386 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:29.527786  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:29.530318  8424 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:29.530243 14186 consensus_queue.cc:1059] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:29.466967 14182 consensus_queue.cc:260] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.531803 14186 raft_consensus.cc:3055] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:29.532248 14186 raft_consensus.cc:740] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:29.494935 14064 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:29.534409 14213 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:29.535176 14213 raft_consensus.cc:697] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:29.535454  8532 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:29.492869 14192 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:29.537655 14057 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:29.533664 14186 consensus_queue.cc:260] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:29.538806  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:29.539390  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.539412 14186 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:29.543246  8528 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:29.545182 14199 consensus_queue.cc:1059] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:29.546406 13881 raft_consensus.cc:3055] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:29.546840 13881 raft_consensus.cc:740] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:29.548058 13881 consensus_queue.cc:260] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.549772 13881 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:29.550477  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:29.551225  8378 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:29.536518 14213 consensus_queue.cc:237] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:29.557299  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:29.561424 14192 consensus_queue.cc:1059] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:29.563203 14192 raft_consensus.cc:3055] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:29.563731 14192 raft_consensus.cc:740] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:29.566149 13994 consensus_queue.cc:1059] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:03:29.568127  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 48421.2us
I20260709 13:03:29.570086  9258 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:29.571386  8386 raft_consensus.cc:1240] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:29.573422 14013 consensus_queue.cc:1059] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:29.574118 14171 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:29.574741 14171 raft_consensus.cc:697] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:29.575949 14171 consensus_queue.cc:237] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.576664  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:29.576694 14172 raft_consensus.cc:3055] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:29.578447 14172 raft_consensus.cc:740] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:29.580044 14172 consensus_queue.cc:260] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.580843  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:29.581390  8453 raft_consensus.cc:1240] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:29.581548  8380 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:03:29.585433 14172 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:29.585952  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:29.592404  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:29.581552  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 82033.2us
I20260709 13:03:29.589830 14192 consensus_queue.cc:260] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.593861  8461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:29.561757  8349 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:29.622964  8461 raft_consensus.cc:606] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:03:29.604902  8385 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:03:29.590257  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.627561  8526 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:03:29.633279 13896 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:29.638113  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:29.634125 13896 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.638567 13868 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.640517  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:29.640663 13868 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.641517  8454 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 20.
I20260709 13:03:29.643108  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:29.644871 14064 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.646224 14064 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:29.639240  8452 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 19: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:29.650276 14064 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:29.651124  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:29.617761  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:29.659910  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 90042.8us
I20260709 13:03:29.662074  8501 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:29.663932  8501 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:29.666301 13909 consensus_queue.cc:1059] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:29.666709 14190 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:29.667726 13909 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:29.668483 13909 raft_consensus.cc:3055] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:03:29.670953  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 109506us
I20260709 13:03:29.672327 14013 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.673105 14013 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.677299  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:29.676499 13896 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:29.666329  8457 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 21.
I20260709 13:03:29.691113  8380 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:29.678736  8461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:29.699210  8526 raft_consensus.cc:1240] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14. Ops: []
W20260709 13:03:29.693652  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 206907us
I20260709 13:03:29.677506  8501 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:29.713126  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:29.703704  8461 raft_consensus.cc:606] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:29.717499 13560 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:29.668956 13909 raft_consensus.cc:740] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:29.723027 13909 consensus_queue.cc:260] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.696563 13868 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:29.725970  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.728050 14013 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:29.707103 14192 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:29.653153 14182 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:29.740411  8378 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
I20260709 13:03:29.741348 14003 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:29.764976  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 90839.9us
W20260709 13:03:29.766716  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 94763.9us
I20260709 13:03:29.767141  8427 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:29.768181 13881 consensus_queue.cc:1059] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:29.769028  8526 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:29.769040 14199 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:29.772197  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:29.773262 14010 raft_consensus.cc:3055] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:29.773706 14010 raft_consensus.cc:740] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:29.774624 14010 consensus_queue.cc:260] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:29.775229  8532 raft_consensus.cc:1240] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:29.775530  8349 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:29.776038 14010 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:29.745469 13560 raft_consensus.cc:697] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:29.787431  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:29.790166 14236 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:29.791392 13805 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:29.792076  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:03:29.793922 13981 raft_consensus.cc:993] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:03:29.794528 13981 raft_consensus.cc:1081] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:03:29.794402 13560 consensus_queue.cc:237] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:29.796140  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:29.791047 14236 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:29.797794 13930 consensus_queue.cc:1059] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:29.798944 14236 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:29.799242 13597 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:29.799695 13597 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.799775 13930 raft_consensus.cc:3055] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:29.800151 13597 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:29.800277 13930 raft_consensus.cc:740] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:29.792045 13805 raft_consensus.cc:697] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:29.801783 13805 consensus_queue.cc:237] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:29.802616  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:29.805269 14186 consensus_queue.cc:1059] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:29.806061 14003 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.801638 13930 consensus_queue.cc:260] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.808064 13930 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:29.808532 14003 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:29.809401 13883 raft_consensus.cc:3055] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:29.817265 13909 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:29.824795  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:29.830667  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 61515us
I20260709 13:03:29.842209  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:29.843058  8532 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:03:29.847245  8535 raft_consensus.cc:1240] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:29.857183 14023 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:29.857842  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:29.858495  9289 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:29.859797 14023 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:29.861064  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:29.832195 13883 raft_consensus.cc:740] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:29.872692 13597 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.875295 13597 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:29.881855  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:29.883200  8526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38894
I20260709 13:03:29.883827  8526 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:29.884189  8526 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:29.885381 14199 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:29.890580  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:29.892021  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:29.892819  8452 raft_consensus.cc:2393] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 10: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:29.897707  8534 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:03:29.898219  8534 pending_rounds.cc:85] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 10
I20260709 13:03:29.898439  8534 pending_rounds.cc:107] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:03:29.898690  8534 raft_consensus.cc:2889] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:29.847530 13868 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.900000 13868 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.904196  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:29.924973  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:29.931598  8532 raft_consensus.cc:1275] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:29.945981  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:29.947549 14035 consensus_queue.cc:1059] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:03:29.952315 13981 raft_consensus.cc:3055] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:29.952790 13981 raft_consensus.cc:740] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:29.953799 13981 consensus_queue.cc:260] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:29.955658 13981 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:29.964766  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.943766 14172 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:29.969820 14172 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:29.995621  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:29.972846 14172 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:30.007784  9296 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:30.003535 13868 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:30.030342  8461 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:30.033102  8500 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:30.034065 14023 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:30.034615 14023 raft_consensus.cc:697] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:30.038458  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:30.035944  8526 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:30.041047  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:30.045928  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.061185  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:30.065569  8380 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 16: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:30.080674  9289 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
I20260709 13:03:30.083110  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:30.090277  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:30.091241  8527 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
I20260709 13:03:30.094321 14180 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.095055 14180 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:30.100409  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:30.102716 14253 log.cc:927] Time spent T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.235s	user 0.004s	sys 0.003s
I20260709 13:03:30.104053  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:30.120226  8385 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:03:30.120836  8385 pending_rounds.cc:85] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 10
I20260709 13:03:30.125448  9258 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:30.125698  8385 pending_rounds.cc:107] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:03:30.126392  8385 raft_consensus.cc:2889] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:30.112890  9296 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:30.131007  8386 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
W20260709 13:03:30.132771  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.121126 14186 consensus_queue.cc:1059] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:03:30.138660 14186 raft_consensus.cc:3055] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:30.139063 14186 raft_consensus.cc:740] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:30.139902 14186 consensus_queue.cc:260] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:30.125221  8526 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:30.128580  8424 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:30.144137 14192 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:30.144840 14192 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:30.146524 13883 consensus_queue.cc:260] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:30.147101 14192 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:30.147578 14064 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:30.149720 14260 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:30.150382 14260 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:30.153683 14199 consensus_queue.cc:1048] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:30.155344  8381 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:30.170681  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:30.172230  8461 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:30.152674 14260 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:30.180734  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:30.181665  8457 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 19: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:30.188643  8427 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:30.142123 13868 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:30.158119 14186 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:30.144289 13870 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:30.195919  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:30.176831 14192 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:30.207512  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 432046us
I20260709 13:03:30.209314  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:30.211040  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:30.196794 13868 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.218070  8461 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
W20260709 13:03:30.220067  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.221427  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:30.221755  9293 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:30.198594 13870 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.222160  8455 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:03:30.171954 14023 consensus_queue.cc:237] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:30.224597 13868 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:30.234993 14180 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:30.237319 14162 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:30.245780 14259 log.cc:927] Time spent T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:03:30.246052 14162 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:30.246613 14162 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:30.226511 13870 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:30.253589 14261 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:30.254308 14261 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:30.232717  9261 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:30.259992  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.230095 14260 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.257761 14261 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:30.286361  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:30.287119  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:30.267855  8378 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
W20260709 13:03:30.288713  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 100211us
I20260709 13:03:30.291996  8532 raft_consensus.cc:1240] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:30.297187  8461 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:30.281387 13994 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:30.302861  8501 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:30.300084  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:03:30.309175  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.311797  8454 raft_consensus.cc:3055] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:30.313755  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:30.312230  8454 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:30.319756 14068 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:30.296005 14261 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:30.321688 14068 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:30.322091 14261 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:30.322312 14068 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:30.275744 13805 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:03:30.324555 14261 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:30.247745 14192 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:30.329300  8461 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 13:03:30.331466  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 53646.5us
I20260709 13:03:30.313962 14115 consensus_queue.cc:1059] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
W20260709 13:03:30.334599  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 102019us
W20260709 13:03:30.337211 14182 consensus_meta.cc:287] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.584s	user 0.012s	sys 0.000s
W20260709 13:03:30.341624  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 45594.5us
I20260709 13:03:30.347867  8454 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:30.358812  8351 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:30.359680  8501 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:30.361970  8501 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:30.363083  8533 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:30.386183  8454 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:30.390110  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:30.391067  8455 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:30.358812  9261 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:30.311930 14260 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:30.349238 14190 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:30.406042  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:30.406334  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:30.407992  8531 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:03:30.410557  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:30.411994  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 72904.3us
I20260709 13:03:30.396507 14057 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:30.412657 14057 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:30.412915  8351 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:30.413103 14057 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:30.404605  8500 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:30.375365 13883 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:30.417886  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 59186.4us
W20260709 13:03:30.411026 14256 log.cc:927] Time spent T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.213s	user 0.000s	sys 0.002s
W20260709 13:03:30.451267  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 56794.9us
I20260709 13:03:30.395407 13909 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:30.396236 13597 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
W20260709 13:03:30.418087 14258 log.cc:927] Time spent T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
W20260709 13:03:30.458278  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 45483.5us
W20260709 13:03:30.459095  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 46308.5us
I20260709 13:03:30.425664 14003 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:30.460155 14178 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:30.463336 14260 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:30.463765 13870 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:30.457283  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:30.460048  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 98183.2us
W20260709 13:03:30.467589  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.413713 14068 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:30.474085  8532 raft_consensus.cc:2393] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 14: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:30.464805 13560 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:30.479403 14175 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:30.479869  8452 raft_consensus.cc:2368] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 10. Current term is 11.
I20260709 13:03:30.469179 14178 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.484679  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:30.486251  8351 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:30.481949 13930 consensus_meta.cc:287] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.635s	user 0.005s	sys 0.007s
I20260709 13:03:30.468163 14064 consensus_queue.cc:1059] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:03:30.484165 14178 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:30.487927 14175 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:30.498813  8501 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:03:30.509564  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 227558us
I20260709 13:03:30.512220  8532 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:03:30.495522 13560 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:30.487805 13771 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:03:30.495739 14003 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:30.503564 14068 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:30.521584  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:30.505282 14199 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.516613  9260 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:30.528826  8454 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
W20260709 13:03:30.520344 14010 consensus_meta.cc:287] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.737s	user 0.012s	sys 0.003s
I20260709 13:03:30.514618 13909 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:30.534117  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:30.534533 13909 raft_consensus.cc:697] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:30.534756  8528 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:30.535256  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 68409.3us
I20260709 13:03:30.535512 13909 consensus_queue.cc:237] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:30.534401 14199 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:30.519183 14192 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:30.531219 14003 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:30.552170  9261 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:30.553280 14172 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:30.555451 14172 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:30.556475 14035 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:30.537544 13870 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:30.532433 14068 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:30.564411 14192 consensus_queue.cc:1059] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:30.576471 14192 consensus_queue.cc:1243] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer 105d6581548546b98eddd4ee7083bb12 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:30.577878 14068 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:30.579736  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 63158us
I20260709 13:03:30.568245 14057 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:30.569694  8427 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:30.544044 13560 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:03:30.571799 14199 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:30.562901  8501 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:30.572906 13930 raft_consensus.cc:3055] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:30.580657 14271 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:30.581251  8351 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:30.581918  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 43930.6us
I20260709 13:03:30.565186 13771 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:30.593066  8535 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 15. Current term is 16. Ops: []
W20260709 13:03:30.595616  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.617933  8383 raft_consensus.cc:1240] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:30.620733  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 68676.7us
I20260709 13:03:30.623028  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:30.623636  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 60819.4us
I20260709 13:03:30.608053 14035 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:30.622573 14262 raft_consensus.cc:3055] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:30.605604 13930 raft_consensus.cc:740] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:30.614791 14271 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.634636  8460 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:03:30.635103  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:30.636703  9261 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:30.638146 14003 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:30.615937 14057 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:30.642468 14277 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:03:30.644774 14274 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:30.628541 14023 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:30.609640 14162 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:30.649372  8381 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:30.633229 14192 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:30.649818  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.670001  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:30.632836 13881 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.661885  8500 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:03:30.645445  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 98747.5us
I20260709 13:03:30.665709  8385 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:30.667385  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:30.646727 14035 raft_consensus.cc:697] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:30.651690  8528 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:03:30.678141  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:30.678908 14275 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.679273  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:30.679438 14275 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:30.680012  8528 raft_consensus.cc:2393] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 15: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:30.682353 14162 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:30.683081 14010 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:30.683519 14162 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:30.671638  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:30.676340  8455 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:30.687203  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:30.648725 14262 raft_consensus.cc:740] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:30.659721 14271 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:30.623588 13771 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:30.710427  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:30.715528  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:30.719219  8381 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:30.708413  8424 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
W20260709 13:03:30.722432  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 75310us
I20260709 13:03:30.725668  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:30.728542  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 66721.2us
I20260709 13:03:30.734239 14190 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:30.735390  8351 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:30.726878 14172 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:03:30.743196 14186 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:30.743927 14186 raft_consensus.cc:697] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:03:30.749413  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 112870us
I20260709 13:03:30.752691  8527 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:03:30.686866 13881 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:30.725324 13560 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:03:30.772099  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 51391.6us
I20260709 13:03:30.746177 14118 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:03:30.762789  8270 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 56cc480ba6f642e08bb2e547a0ef50a1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 105d6581548546b98eddd4ee7083bb12 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:03:30.785367  8270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 57773.9us
I20260709 13:03:30.793292 13597 consensus_queue.cc:1059] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:30.796156 14275 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:30.801731  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.761027 14272 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:30.754582 13909 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:30.714908 13930 consensus_queue.cc:260] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:30.812548  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:30.772260 13560 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:30.753343 13868 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:30.813375  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:30.818977 14199 raft_consensus.cc:993] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:03:30.771685 14182 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:30.813891 13896 consensus_queue.cc:1059] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:03:30.762341 14262 consensus_queue.cc:260] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:30.816671 13994 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:30.756150 14190 raft_consensus.cc:697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:03:30.868260  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 52186.1us
W20260709 13:03:30.925611  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 60526.5us
I20260709 13:03:30.865412  8426 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:30.928932  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 228290us
I20260709 13:03:30.949111  8351 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:30.950476  8351 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:30.761957 14035 consensus_queue.cc:237] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:30.805859 13597 raft_consensus.cc:3055] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:30.952435 13597 raft_consensus.cc:740] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:30.953547 13597 consensus_queue.cc:260] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:30.955133 14260 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:30.958181  8351 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:30.959311 14115 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:30.960856  8351 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:30.963057 14115 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:30.745064 14186 consensus_queue.cc:237] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:30.928153 13560 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:30.998385  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:30.867594 13909 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:30.965736 14010 raft_consensus.cc:1081] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:03:30.978724 14175 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:03:31.031138 13883 consensus_meta.cc:287] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.004s
I20260709 13:03:31.032207  8453 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
W20260709 13:03:31.034070 14286 log.cc:927] Time spent T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:03:31.036152  8381 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
W20260709 13:03:31.024390 14178 consensus_meta.cc:287] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.001s
I20260709 13:03:30.938309 14272 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.015774 13981 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:31.053697  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 117815us
I20260709 13:03:31.014513 14275 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.966691 14182 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:31.059391  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 55490.4us
I20260709 13:03:31.007243 13994 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.061548 14275 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:31.063563 13994 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:31.063833 14275 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:31.065546  8351 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:31.038749 14068 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:31.083684 14292 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:31.084508  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:31.084388 14292 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.085356  8528 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:31.086937 14292 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:31.093997  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:31.103565 14293 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.104313 14293 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.106383 14304 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.106801 14293 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:31.107620 14293 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.108142 14293 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.108966  9291 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:31.109651  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:31.110597  9295 raft_consensus.cc:2393] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 18: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:31.107141 14304 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.115695  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:31.116755  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:31.117250  9296 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:31.117617  9289 raft_consensus.cc:2393] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 19: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:31.118268  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:31.118738  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:31.117278  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:31.119414  9293 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:31.118978  9294 raft_consensus.cc:1240] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:31.110599 14293 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:31.125594 14303 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:31.127471 14303 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:31.130493  9293 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:31.131124  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:31.131892  9287 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 16.
I20260709 13:03:31.134069 14304 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:31.134881  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:31.172006  9287 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 19: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:31.136065  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:31.137512  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:31.136870  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:31.151479  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 96170.4us
I20260709 13:03:31.179452  9294 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 20: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:31.069208 14171 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.058014 14178 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:31.154595  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 289262us
I20260709 13:03:31.057756 14260 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:31.156745 14272 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:31.181965  9289 raft_consensus.cc:2393] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 22: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
W20260709 13:03:31.151940  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 240630us
W20260709 13:03:31.184101  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 116676us
W20260709 13:03:31.193450  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 58041.3us
I20260709 13:03:31.067996 14172 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.114s
I20260709 13:03:31.197674  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:31.202787  8455 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:31.207834  8351 leader_election.cc:400] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 10 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 10. Current term is 11.
I20260709 13:03:31.209208  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:31.210327  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:31.190498 13881 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:31.225051  8529 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:03:31.073730 14175 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.185343 14274 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:03:31.181280 14303 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:03:31.207120 14010 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.242502  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:31.283769  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:31.188705 14171 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.284137  8532 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:31.243755  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:31.283031  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:31.076050 14190 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:31.281941  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:31.285418  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:31.286258  8381 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 19: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
W20260709 13:03:31.232254 14271 consensus_meta.cc:287] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.506s	user 0.005s	sys 0.006s
I20260709 13:03:31.294103  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:31.294116  8526 raft_consensus.cc:2393] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 15: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:03:31.289151  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.198287 13560 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.298848  8533 raft_consensus.cc:2410] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:03:31.298508  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:31.303191  9290 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:31.305508 14299 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:03:31.306785 13560 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:31.307410 14050 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.307550 14178 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:31.308192 14285 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:31.306905  9287 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:03:31.295501 14010 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.304165  8501 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:31.302688  8385 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 19.
I20260709 13:03:31.342932  9290 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:31.289438 13981 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.307969  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:31.353508  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 111981us
I20260709 13:03:31.355911  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:31.359272  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:31.359881 14316 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:31.360592 14316 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.361331  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:31.361553 14309 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.362036 14309 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:31.363505  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:31.364270 14309 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:31.364718  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:31.366024  8424 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:31.294727 13868 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:31.367347  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.355679  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:31.373473  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:31.374922  8455 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
I20260709 13:03:31.380342  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:31.381209  8533 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:31.378528  9258 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:31.308776 14285 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.385033  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:31.394595  9289 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 16.
I20260709 13:03:31.386854  8454 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:03:31.388356  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.400496  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:31.401232  8377 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:31.303138 14271 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.414985  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:31.409961  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:31.411638  9288 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:31.307930 14050 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.400945 14182 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:31.371124 13981 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:31.425032  9296 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:31.410591 13868 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:31.425521  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:31.427024  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 132405us
I20260709 13:03:31.410022 13909 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:31.424513  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:31.411643  8280 catalog_manager.cc:5697] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:31.431427  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:31.432106  8460 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:31.431983  8426 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:31.414597 14023 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:31.436553  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:31.424830 14309 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.438067 13909 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.449194 14296 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:31.449826 14296 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.449599 13909 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.450217 14296 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:31.452013 13909 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:31.455279 14050 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:31.428800 13868 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.459918  8533 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:31.466279  9261 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:31.452596 13909 consensus_queue.cc:1059] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:31.469730 14050 raft_consensus.cc:3055] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:31.470068 13981 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:31.470686 13981 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:31.471995  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:31.474643  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 104893us
I20260709 13:03:31.476477  8385 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 16: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:31.470126 14050 raft_consensus.cc:740] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:31.481310 13981 raft_consensus.cc:697] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:31.482343 13981 consensus_queue.cc:237] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.487627  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:31.488255  8385 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:31.489624  8377 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
W20260709 13:03:31.537618  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 46631.8us
I20260709 13:03:31.462271 13868 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:31.480604 14050 consensus_queue.cc:260] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:31.538527  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.441349 14023 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.557061  9258 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:31.539098 14312 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:31.539496  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:31.540009 14313 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:31.540347  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 74208.7us
I20260709 13:03:31.540836 13896 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:31.541667 14317 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:31.542524 14301 log.cc:927] Time spent T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:03:31.485853 14175 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:31.549320  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 77890.3us
I20260709 13:03:31.538769 14300 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:31.555240  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:31.562121  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 45592.2us
I20260709 13:03:31.564699  9261 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:31.473546 14309 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:31.570492  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:31.571923 14317 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.564652 14298 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:31.611235 13896 raft_consensus.cc:697] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:31.570350 14313 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:31.572109 14329 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:03:31.562145 14312 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:31.725039  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 297335us
W20260709 13:03:31.701320  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 136696us
I20260709 13:03:31.725667  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:31.726394  9261 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:31.726423  8526 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:31.716171  8460 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:31.718169  8351 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
W20260709 13:03:31.707939 14319 log.cc:927] Time spent T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.239s	user 0.000s	sys 0.004s
I20260709 13:03:31.699363  8532 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:31.707559 14010 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:31.716051 14175 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:31.748605 14333 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.724560 14298 raft_consensus.cc:697] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:31.759637  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3602) took 1042 ms. Trace:
I20260709 13:03:31.728261 14199 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.728260 14312 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:31.761931  8500 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.196:40669 timed out after 1.520s (SENT) [suppressed 9 similar messages]
I20260709 13:03:31.751355 14271 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:31.715866 14300 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:31.846585  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.851287 14331 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:31.851884 14331 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:31.853201 14325 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.251s	user 0.005s	sys 0.000s
I20260709 13:03:31.838636 14003 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:31.854333 14003 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.854756 14003 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:31.857565 14327 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.299s	user 0.000s	sys 0.006s
I20260709 13:03:31.858467 14323 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:31.858934 14323 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:31.859340 14323 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:31.861142 14311 consensus_queue.cc:1059] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.143s
I20260709 13:03:31.862082 14311 raft_consensus.cc:3055] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:31.862424 14311 raft_consensus.cc:740] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:31.863070 13930 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:31.863266 14311 consensus_queue.cc:260] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.863628 14003 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.864574 14311 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:31.865782 14003 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:31.865448 14298 consensus_queue.cc:237] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.868709 14316 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:31.870126 14330 log.cc:927] Time spent T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
W20260709 13:03:31.870549  8453 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36446 (request call id 2544) took 1584 ms (client timeout 1946 ms). Trace:
W20260709 13:03:31.871155  8453 rpcz_store.cc:269] 0709 13:03:30.286449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.286889 (+   440us) service_pool.cc:224] Handling call
0709 13:03:31.870244 (+1583355us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b540041b254. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:31.870416 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1710181632}
W20260709 13:03:31.881786  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.883760  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:31.884076 14162 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:31.884688 14162 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.885254  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:31.887867 14162 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:31.835417 14023 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:31.909955  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 183632us
I20260709 13:03:31.900207  8381 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:31.902465  8460 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:31.891160 13896 consensus_queue.cc:237] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.904533 14317 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:31.889904 13597 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:31.905202  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:31.906013  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 203702us
I20260709 13:03:31.773074 14333 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.768875  8383 rpcz_store.cc:276] 0709 13:03:30.717723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.717883 (+   160us) service_pool.cc:224] Handling call
0709 13:03:30.739224 (+ 21341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:30.751446 (+ 12222us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:30.751478 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:30.767514 (+ 16036us) log.cc:844] Serialized 26 byte log entry
0709 13:03:31.149977 (+382463us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:31.150017 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:31.150102 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:31.759320 (+609218us) raft_consensus.cc:1685] finished
0709 13:03:31.759351 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:31.759554 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11814,"raft.queue_time_us":12361,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6759,"thread_start_us":335131,"threads_started":1,"wal-append.queue_time_us":456549}
I20260709 13:03:31.840059 14213 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:31.848984 14285 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:31.911976  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:31.781752 14199 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:31.917340  8453 raft_consensus.cc:1240] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:03:31.910843  9261 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:31.834543  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 72640.6us
I20260709 13:03:31.920466  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:31.924413  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 178438us
I20260709 13:03:31.927892  8533 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:31.927736  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:31.935189  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:31.947695 13868 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.948024 14335 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:03:31.958729 14317 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.959020  8385 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:03:31.959353 14317 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:31.963910  8452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 1176) took 1356 ms. Trace:
I20260709 13:03:31.922683 14213 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:31.966760 14213 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:31.969280 14199 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:31.970734 14300 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:31.972462  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2755) took 1447 ms. Trace:
I20260709 13:03:31.972965  8529 rpcz_store.cc:276] 0709 13:03:30.525464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.525597 (+   133us) service_pool.cc:224] Handling call
0709 13:03:30.533438 (+  7841us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:31.225573 (+692135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:31.972182 (+746609us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54002ae4d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:31.972378 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1560272768}
I20260709 13:03:31.974129 14337 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:31.974810  8460 raft_consensus.cc:1240] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:31.975471 14313 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:31.976176  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3597) took 1307 ms. Trace:
I20260709 13:03:31.976332  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:31.976543  8382 rpcz_store.cc:276] 0709 13:03:30.668922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.678359 (+  9437us) service_pool.cc:224] Handling call
0709 13:03:30.678713 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:30.727074 (+ 48361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.727121 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:30.782292 (+ 55171us) log.cc:844] Serialized 26 byte log entry
0709 13:03:31.043695 (+261403us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:31.044083 (+   388us) log.cc:844] Serialized 14 byte log entry
0709 13:03:31.207061 (+162978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:31.975693 (+768632us) spinlock_profiling.cc:243] Waited 9.06 ms on lock 0x7b5400269154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:31.975739 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:31.975785 (+    46us) raft_consensus.cc:1685] finished
0709 13:03:31.975881 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:31.975998 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3373,"prepare.queue_time_us":32466,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":5304,"raft.queue_time_us":55382,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":84848,"spinlock_wait_cycles":20843392,"thread_start_us":375955,"threads_started":2,"wal-append.queue_time_us":274889}
W20260709 13:03:31.978682  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 46354.6us
I20260709 13:03:31.979517  8461 raft_consensus.cc:1275] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:31.979977 14171 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:31.980285  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:31.980487  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:31.982553  8351 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:31.983484  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:31.985064 14317 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:31.986121  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:31.986968  8455 raft_consensus.cc:2410] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:03:31.988449  8454 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 20.
I20260709 13:03:31.990301 13868 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:31.991312  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 80543.8us
I20260709 13:03:31.964370  8452 rpcz_store.cc:276] 0709 13:03:30.607452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.607613 (+   161us) service_pool.cc:224] Handling call
0709 13:03:30.620805 (+ 13192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.763920 (+143115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.763951 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:30.763999 (+    48us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:30.764045 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:31.963630 (+1199585us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400278154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:31.963683 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:31.963819 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298209536}
W20260709 13:03:31.993043  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:31.997359  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 59368.7us
W20260709 13:03:31.992906 14284 log.cc:927] Time spent T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 1.052s	user 0.024s	sys 0.009s
W20260709 13:03:32.015862 14296 consensus_meta.cc:287] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.565s	user 0.005s	sys 0.006s
I20260709 13:03:32.001959 14316 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:32.030149  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 47650.9us
I20260709 13:03:32.033049  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:32.006181 14300 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:03:32.038892  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:32.039273  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:32.040030  9288 raft_consensus.cc:2368] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16.
I20260709 13:03:32.040899  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:32.042093  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:32.042778  9287 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 20: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:32.039835  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:32.044023  9289 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:32.044592  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:32.045461 13771 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:32.046104  8500 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:32.026448 14285 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:32.050278  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:32.055254  8500 leader_election.cc:400] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16.
I20260709 13:03:32.055626  8500 leader_election.cc:403] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:32.056854  8351 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:32.051141  9288 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
I20260709 13:03:32.058619  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:32.059188  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:32.059371  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:32.060163  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:32.060894  9289 raft_consensus.cc:2393] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 16: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:32.064774  8500 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:32.053369 14192 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:32.070088  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:32.071098  9287 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
I20260709 13:03:32.072511  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:32.073774 13771 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:32.074141 14314 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:32.074481 13771 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.051499 13896 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:32.079027  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:32.077772 13771 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:32.081409  8426 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:32.079775  9288 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 20.
I20260709 13:03:32.086356  8500 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:32.090040 14199 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:32.090894 14023 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:03:32.091923 14333 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:32.079892 14260 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 13:03:32.057924 13909 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:32.087255 14331 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:32.094110 14180 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:32.094950 14050 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:32.135735 14180 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.136188 14180 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:32.097841 14312 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.056609 14285 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.037392 14296 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.101742 14338 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:32.129706  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 71165.6us
I20260709 13:03:32.084702 14003 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:32.139757  8426 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:32.139810 14308 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:32.128801 14199 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.130658 13597 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:32.145234  8351 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:32.165499  8457 raft_consensus.cc:2393] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 16: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:32.141459  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:32.144099 14068 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:32.152349 14118 raft_consensus.cc:3055] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:32.155927  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:32.148893 14331 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:32.168708  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:32.169323  8454 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:32.079631 13896 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.164027  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:32.167850  9291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55720 (request call id 851) took 1031 ms. Trace:
I20260709 13:03:32.171233  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:32.174305  8351 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:32.166217  9287 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:32.181422 13909 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.182082 13909 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.182435 14296 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:32.184346 13909 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:32.184789 14285 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:32.188716  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:32.171247  9291 rpcz_store.cc:276] 0709 13:03:31.136111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.136539 (+   428us) service_pool.cc:224] Handling call
0709 13:03:32.155806 (+1019267us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b5800220e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360eee 0000000000375939 00007f36cd3d41e0 00007f36cd49d0c4 00007f36cd49d131 00007f36cd44b0a0 00007f36cd44a984 00007f36c69c56d4 00007f36c69c5662
0709 13:03:32.167760 (+ 11954us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2828672}
I20260709 13:03:32.189352  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:32.189865  9287 raft_consensus.cc:2393] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 16: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:32.190490  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:32.191244  8532 raft_consensus.cc:2393] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 15: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:32.191145 14274 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:32.191828 14274 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:32.192206  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:32.192231 14274 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:32.196082  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:32.196942  8455 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:32.198347  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:32.198585  8460 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:32.200490  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:32.201610 14323 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.203769 14323 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:32.204010  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:32.205641 14312 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:32.206316 14312 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:32.206825 14312 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.207680 14308 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:32.208602 14308 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:32.207397  8351 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:32.215108  8454 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:03:32.210726  8456 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:32.223060  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:32.223631  9291 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:32.147969 14338 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.166651 14199 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:32.226290  8500 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:32.172765 14314 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.173120 13597 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:32.218111 14312 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:32.237478 14023 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16.
I20260709 13:03:32.227978 13909 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:32.242642 14274 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.229364  8500 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:32.210525 13896 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:32.176169 14118 raft_consensus.cc:740] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:32.220299 14285 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:32.269341 14285 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:32.269935 14285 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:32.234239  8453 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:32.231850 14311 consensus_queue.cc:1059] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:03:32.236583 14338 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:32.231423 14292 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:32.272078 14311 raft_consensus.cc:3055] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:32.248697 14312 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:32.272485 14311 raft_consensus.cc:740] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:32.249778 14274 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:32.250200  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:32.274442  9290 raft_consensus.cc:2376] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15. Re-sending same reply.
I20260709 13:03:32.250473  8280 catalog_manager.cc:5697] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 7 to 14, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 14 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:32.275694  8280 catalog_manager.cc:5697] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:32.277273  8280 catalog_manager.cc:5697] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 10 to 15, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 15 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:32.278771 14293 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:32.278743  8280 catalog_manager.cc:5697] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 10 to 13, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 13 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:32.279361 14293 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.280295  9260 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:32.280179  8280 catalog_manager.cc:5697] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 6 to 14, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 14 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:32.228250 14316 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:32.288691 14316 raft_consensus.cc:697] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:32.288910  8280 catalog_manager.cc:5697] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 8 to 10, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 10 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:32.289686 14316 consensus_queue.cc:237] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.291170  8280 catalog_manager.cc:5697] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 7 to 14, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 14 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:32.292898  8280 catalog_manager.cc:5697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 12 to 18, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 18 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:32.294312  8378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:03:32.294927  8378 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:32.295289  8378 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:32.294561  8280 catalog_manager.cc:5697] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 9 to 10, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 10 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:32.297458 13560 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.297804  9258 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:32.297966 13560 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.299419 14304 raft_consensus.cc:2764] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:03:32.300099 13560 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:32.300846 13560 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.244879 14314 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.297101  8280 catalog_manager.cc:5697] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 9 to 15, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 15 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:32.305230 14314 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:32.258121  9293 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 806) took 1142 ms (client timeout 1520 ms). Trace:
W20260709 13:03:32.305804  9293 rpcz_store.cc:269] 0709 13:03:31.115319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.115465 (+   146us) service_pool.cc:224] Handling call
0709 13:03:32.257927 (+1142462us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b5400533c54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:32.258040 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7071104}
I20260709 13:03:32.307473  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:32.306028  8280 catalog_manager.cc:5697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 7 to 13, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 13 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:32.308065  8529 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
I20260709 13:03:32.309443 14262 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:32.310611  8280 catalog_manager.cc:5697] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 12 to 14, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 14 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:32.312413  8280 catalog_manager.cc:5697] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:32.238775 13597 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:32.314034  8349 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:32.315925 14274 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:32.316340 14274 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.316692 14274 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:32.316923  8426 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
W20260709 13:03:32.317633  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.223117 14308 consensus_queue.cc:1059] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:03:32.262715 13909 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:32.266386  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 59187.3us
I20260709 13:03:32.248171  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:32.273347 14311 consensus_queue.cc:260] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.281934  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3593) took 1666 ms. Trace:
I20260709 13:03:32.318657  8500 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:03:32.254587  8279 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53486 (request call id 347) took 39637 ms (client timeout 15000 ms). Trace:
I20260709 13:03:32.282752 14293 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:32.284130  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:32.349642  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.284646  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:32.350026  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:32.285336  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:32.350524  8385 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:32.287055  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:32.288082 14309 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:32.300971  9292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 808) took 1185 ms. Trace:
I20260709 13:03:32.358017  8378 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.356837  9292 rpcz_store.cc:276] 0709 13:03:31.115940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.116398 (+   458us) service_pool.cc:224] Handling call
0709 13:03:31.116682 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:31.146654 (+ 29972us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:03:31.355046 (+208392us) log.cc:844] Serialized 14 byte log entry
0709 13:03:31.856889 (+501843us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:32.043904 (+187015us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b1800069220. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c802d4bc 00007f36c537b48b 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c802523a
0709 13:03:32.056260 (+ 12356us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:32.056316 (+    56us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:32.056366 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.284477 (+228111us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b4800251358. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36cd3aeaa1 00007f36cd3a5b37 00007f36cd3a59ca 00007f36cd49d26f 00007f36cd49cf37 00007f36cd4b155c 00007f36cd4b1508 00007f36cd4b1488 00007f36cd4b1443 00007f36cd4b06ec 00007f36cc3daa96
0709 13:03:32.300661 (+ 16184us) spinlock_profiling.cc:243] Waited 29.7 ms on lock 0x7b54004b8cd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:32.300705 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:32.300818 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7127,"prepare.queue_time_us":272033,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":7295,"raft.run_cpu_time_us":2351,"raft.run_wall_time_us":231748,"spinlock_wait_cycles":90572032,"thread_start_us":240608,"threads_started":2,"wal-append.queue_time_us":118667}
I20260709 13:03:32.359054  8380 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:32.302542  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:32.359992  8378 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:32.360561  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:32.361966  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:32.363186  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:32.261655 14118 consensus_queue.cc:260] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.321982  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:32.323935  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:32.323885  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 43686.1us
I20260709 13:03:32.345351  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:32.366204  8533 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
W20260709 13:03:32.345458  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 204867us
I20260709 13:03:32.343346  8527 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:32.343994  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:32.345942  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.343272  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:32.344209  8280 catalog_manager.cc:5697] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 13 to 15, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 15 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:32.355050  8459 raft_consensus.cc:2393] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 16: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:32.373955  9260 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:32.340749  8379 rpcz_store.cc:276] 0709 13:03:30.615303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.615433 (+   130us) service_pool.cc:224] Handling call
0709 13:03:30.625822 (+ 10389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.714175 (+ 88353us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:30.738260 (+ 24085us) log.cc:844] Serialized 14 byte log entry
0709 13:03:31.189349 (+451089us) log.cc:844] Serialized 14 byte log entry
0709 13:03:31.189919 (+   570us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:31.189971 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:31.190026 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.281709 (+1091683us) spinlock_profiling.cc:243] Waited 73.8 ms on lock 0x7b5400351454. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:32.281756 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:32.281879 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26112,"prepare.queue_time_us":7562,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":6962,"raft.queue_time_us":210450,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":17148,"spinlock_wait_cycles":169825024,"thread_start_us":395036,"threads_started":2,"wal-append.queue_time_us":404447,"wal-append.run_cpu_time_us":2229,"wal-append.run_wall_time_us":1127868}
I20260709 13:03:32.377226  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.377537  8427 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:32.378031  8378 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 20.
I20260709 13:03:32.337265 13909 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.340155 14171 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:32.392139  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.392319 14338 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:32.393807 14180 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.395309 14317 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.395813 14317 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.396415 14180 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:32.398114 14317 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:32.399765 14317 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:32.400308 14334 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:32.344535  8279 rpcz_store.cc:269] 0709 13:02:52.617366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.617692 (+   326us) service_pool.cc:224] Handling call
0709 13:03:32.254364 (+39636672us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:25.657284 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:25.738419 (+ 81135us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:25.738454 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:03:25.738472 (+    18us) tablet.cc:662] Decoding operations
0709 13:03:25.907610 (+169138us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:25.907709 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:25.907744 (+    35us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:03:26.398249 (+490505us) tablet.cc:701] Row locks acquired
0709 13:03:26.398273 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:03:26.398464 (+   191us) write_op.cc:270] Start()
0709 13:03:26.398578 (+   114us) write_op.cc:276] Timestamp: P: 1783602206398408 usec, L: 0
0709 13:03:26.398601 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:03:26.480252 (+ 81651us) log.cc:844] Serialized 9726 byte log entry
0709 13:03:27.269137 (+788885us) op_driver.cc:464] REPLICATION: finished
0709 13:03:29.009541 (+1740404us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c537b0ac 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36cbebbef0
0709 13:03:29.135291 (+125750us) write_op.cc:301] APPLY: starting
0709 13:03:29.135403 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:29.288967 (+153564us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:29.289006 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:29.307221 (+ 18215us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540014ebd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c848232a 00007f36c8407f14 00007f36c8407ec3 00007f36c8407e38 00007f36c8407df3 00007f36c84070dc 00007f36c8430e16 00007f36c8418cbb 00007f36c840339d 00007f36c8406d75
0709 13:03:29.309369 (+  2148us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:29.309969 (+   600us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 13:03:29.310047 (+    78us) write_op.cc:312] APPLY: finished
0709 13:03:29.310770 (+   723us) log.cc:844] Serialized 220 byte log entry
0709 13:03:29.627461 (+316691us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:29.717458 (+ 89997us) write_op.cc:454] Released schema lock
0709 13:03:29.717610 (+   152us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:29.718286 (+   676us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:29.718336 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11611,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":1851197,"apply.run_cpu_time_us":56453,"apply.run_wall_time_us":584883,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108727,"num_ops":25,"prepare.queue_time_us":360010,"prepare.run_cpu_time_us":37977,"prepare.run_wall_time_us":1576745,"raft.queue_time_us":38396,"raft.run_cpu_time_us":60927,"raft.run_wall_time_us":2221415,"replication_time_us":837392,"spinlock_wait_cycles":387904384,"thread_start_us":2986304,"threads_started":5,"wal-append.queue_time_us":1017083,"wal-append.run_cpu_time_us":18664,"wal-append.run_wall_time_us":2437132}]]}
I20260709 13:03:32.392856 14338 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.407572 14338 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:32.348776 14292 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:32.409482 14292 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.410162  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:32.411690 14292 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:32.400897 14334 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.412174  8532 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:03:32.366390 13771 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:32.412869 14317 raft_consensus.cc:697] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:32.412963 13771 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.413556 13771 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:32.413882 14317 consensus_queue.cc:237] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.418910  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:32.419061  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 67882.8us
I20260709 13:03:32.419569  8378 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:32.420533 14323 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:32.421198  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.422107  8385 raft_consensus.cc:2393] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 18: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:03:32.423024  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 50973.3us
I20260709 13:03:32.422472 13981 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:32.424779  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.424825 13981 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.431335 13981 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:32.371268 14275 consensus_queue.cc:1059] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:03:32.432096 14338 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.433048 14275 raft_consensus.cc:3055] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:32.433553 14275 raft_consensus.cc:740] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:32.433980 14306 raft_consensus.cc:3055] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:32.434401 14306 raft_consensus.cc:740] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:32.434583 14275 consensus_queue.cc:260] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.435314 14306 consensus_queue.cc:260] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.436429 14275 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:32.436662 14306 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:32.369998  8500 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:03:32.452262  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 82337.7us
I20260709 13:03:32.392872  8379 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
W20260709 13:03:32.454598  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 71243us
I20260709 13:03:32.375137  8424 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:32.456525  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:03:32.457041  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 81954.2us
I20260709 13:03:32.371006 13881 consensus_queue.cc:1059] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.066s
I20260709 13:03:32.442317  8533 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:32.443698  8528 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:32.450526  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:32.340301 13560 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.457180  9293 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:32.437551  8378 raft_consensus.cc:2393] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 15: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:32.380966  8280 catalog_manager.cc:5697] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 11 to 13, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 13 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:32.421298 14311 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:32.390473 13909 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:32.461381  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:32.477537  9289 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:32.469420  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.470168  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.479462  8383 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:32.472123  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.481148  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:32.482107  8531 raft_consensus.cc:2393] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 16: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:32.461498  9260 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:32.483960  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:32.486268  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 106490us
I20260709 13:03:32.486845  8424 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:32.486372  8280 catalog_manager.cc:5697] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:32.487888  8280 catalog_manager.cc:5697] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 12 to 17, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 17 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:32.491773  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.434656 14338 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:32.499547  9293 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
W20260709 13:03:32.504390  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.465869 14296 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:32.466063 14178 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:32.517143  8424 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:32.513017  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:32.513051  8280 catalog_manager.cc:5697] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 9 to 13, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 13 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:32.517143  8500 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:32.541214  8280 catalog_manager.cc:5697] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:32.543027  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.543749  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.543807 14180 raft_consensus.cc:2804] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:32.546082 13597 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.615489 14295 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:32.557437  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:32.563584 14064 raft_consensus.cc:3055] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:32.563766 13560 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:32.566010 14118 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:32.509660 14274 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.491973 14260 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.491046 13868 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:32.585675 14186 consensus_queue.cc:1059] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:32.587085  8427 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:32.646332  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 59311.5us
I20260709 13:03:32.648053  8427 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:32.516495 14296 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.654160  8280 catalog_manager.cc:5697] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:32.507899 14298 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.495193 14304 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 13:03:32.593261 14172 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:32.593894  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 44268.8us
I20260709 13:03:32.477344 14285 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.538576 14318 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:32.595432  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:32.596028 14178 raft_consensus.cc:697] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:03:32.598932  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 81879.2us
I20260709 13:03:32.687865  8454 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:03:32.689368  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.661489 14296 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:32.660223 14035 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:32.697643  8526 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
I20260709 13:03:32.610076  8379 raft_consensus.cc:2410] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:03:32.620280  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.624400  8385 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:03:32.698930  8385 pending_rounds.cc:85] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 9
I20260709 13:03:32.699179  8385 pending_rounds.cc:107] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:03:32.699431  8385 raft_consensus.cc:2889] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:32.624321  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:32.624903  8383 raft_consensus.cc:1275] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:03:32.625415  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.539994 14335 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:32.700065  8531 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 18.
I20260709 13:03:32.670077 13930 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.711952  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:32.551994 14334 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:32.640740  8271 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 455c5d2786974d92a3ee8b825edcfaa7 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d653e71832b7402b9a03b46249d3b885 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:32.655542  8280 catalog_manager.cc:5697] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 17 to 20, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 20 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:32.658231  9289 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:32.635387 14295 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.665061  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.739439  8377 raft_consensus.cc:2393] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 15: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:32.666527  8427 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:32.636850 14064 raft_consensus.cc:740] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:32.662671 13870 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:32.638996 14180 raft_consensus.cc:697] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:32.678031  8382 raft_consensus.cc:2393] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 19: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:32.700402  8380 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:32.677248 14199 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.677547 13771 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.717260  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:32.717483 14178 consensus_queue.cc:237] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.721577 13881 raft_consensus.cc:3055] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:32.727037 14213 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:32.728010 14275 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:32.702953 14035 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:32.728374  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:32.732026 14306 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:32.704908 14023 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:03:32.712246 14335 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.666458 14298 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.656783 14260 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:32.737550  8271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 126590us
I20260709 13:03:32.737798  8424 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:32.735204  8351 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:32.712795 13930 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.744284  8531 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:32.771965  8351 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:32.744678 13597 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:32.774073  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:32.774686  8527 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:03:32.744910  8280 catalog_manager.cc:5697] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:32.746120 14295 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:32.777297  8351 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:32.746904  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2767) took 1516 ms. Trace:
W20260709 13:03:32.746793  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 80352.3us
I20260709 13:03:32.747393 13981 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:32.748674 14274 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:32.748876  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:32.785817 14298 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:32.786839  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.779594  8427 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:32.769116 14275 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.753111 14285 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:32.700076  8383 pending_rounds.cc:85] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 6
I20260709 13:03:32.788718  8383 pending_rounds.cc:107] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:03:32.757794  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.788520 13909 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.789021  8383 raft_consensus.cc:2889] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:32.700601  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.791404  8381 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:03:32.760317  8452 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 16.
I20260709 13:03:32.681308 14172 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.763715  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:32.773525  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.762527 13881 raft_consensus.cc:740] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:32.769430 14035 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:32.805243 13881 consensus_queue.cc:260] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.782711 13930 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:32.783156 14335 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:32.783941  8386 raft_consensus.cc:1275] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:32.788203  8527 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 19.
W20260709 13:03:32.759418  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 130774us
I20260709 13:03:32.795315  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:32.840051  8461 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:03:32.795977  8378 raft_consensus.cc:2376] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15. Re-sending same reply.
I20260709 13:03:32.780527  8424 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:32.795457  8349 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:32.799439 14309 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:32.772792 13870 raft_consensus.cc:3055] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:32.799762 14064 consensus_queue.cc:260] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:32.850483  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.851748  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.852048  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:32.809199 14318 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:32.798938 14213 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:03:32.810302 13981 consensus_queue.cc:1048] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:32.810489  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.781559 14308 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:32.812253 14180 consensus_queue.cc:237] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:32.813073  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:32.875059  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:32.875551  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:32.875744  8383 raft_consensus.cc:3060] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:03:32.815074 14172 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:32.884406  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.815259 14260 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:32.815842  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:32.888875  8380 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:32.776530 14262 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.776799 13560 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:32.891479 13560 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:32.891995 13560 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:32.778301  8534 rpcz_store.cc:276] 0709 13:03:31.230794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.230932 (+   138us) service_pool.cc:224] Handling call
0709 13:03:31.283579 (+ 52647us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:31.283822 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:31.283849 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:32.263642 (+979793us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b2c0003cae8. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2
0709 13:03:32.264177 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 13:03:32.457629 (+193452us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:32.457663 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.457726 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:32.746628 (+288902us) raft_consensus.cc:1685] finished
0709 13:03:32.746649 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:32.746845 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9412352,"thread_start_us":192979,"threads_started":1,"wal-append.queue_time_us":406405}
I20260709 13:03:32.789319 14275 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:32.801756  8351 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:32.805011 13909 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:32.843360  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:32.847234  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.807083 14303 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:32.853802  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:03:32.855576  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 75149.8us
I20260709 13:03:32.858418  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:32.908938  9293 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:32.817307 14274 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:32.878087  8452 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:32.861459  8500 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:03:32.913957  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 52594.7us
I20260709 13:03:32.875191  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:32.924726  9294 raft_consensus.cc:2393] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 19: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:32.881392  9261 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:32.883895  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:32.888576  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.826262 14336 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:32.771082 14306 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.894048  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:32.856727 14318 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.890965  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:32.943528  9287 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:32.850617 13870 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:32.889883 14316 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:03:32.895761  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 94111.4us
I20260709 13:03:32.871171 13930 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:32.896220 14260 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:32.898499  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:32.800149 14298 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.086s
I20260709 13:03:32.902705  8427 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:32.909754  8424 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:32.958750  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.930431 13909 raft_consensus.cc:2804] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:32.929652  8385 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 11.
W20260709 13:03:32.930361  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 49284us
I20260709 13:03:32.961601  9261 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:32.933004  9260 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:32.912987 13881 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:32.942711  9295 raft_consensus.cc:2368] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16.
I20260709 13:03:32.951673  8351 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:32.915671 14064 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:32.910953  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 115542us
I20260709 13:03:32.963055  8380 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
W20260709 13:03:32.965867  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 63305.4us
I20260709 13:03:32.970346  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:32.966868  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 57222.6us
I20260709 13:03:32.900514 14262 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.979375  9293 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 18.
I20260709 13:03:32.979796  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:32.980657  8384 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 16: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:32.981775  8377 raft_consensus.cc:2410] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:03:32.982290  8351 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:32.983167  8380 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:32.946609 14318 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:32.985904 13560 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:32.987068 14317 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:32.974059  8500 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:32.988395  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:32.990988  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:32.992311  8530 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:32.992663  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:32.992972  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:32.949550 14316 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.009891  8532 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:33.006983  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:33.010393  8529 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:32.953009 13930 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:33.015241 13560 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:32.995173  8381 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:33.014187  8500 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:33.019366  8378 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:33.021957  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:33.022590  8351 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:33.023355  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:33.024281  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:33.025108  8382 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:33.028837 13560 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:33.029578  8351 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:32.974844 13981 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:33.030570  8380 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 21.
I20260709 13:03:32.996485 14275 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:33.017472 13994 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:33.043537 13560 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:33.044282  8532 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 20.
I20260709 13:03:33.047012  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:33.009400 14199 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:33.016206 14316 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:33.037395  8351 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:33.013219 13883 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:32.952986 14035 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:33.019477 13930 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:33.055936  8385 raft_consensus.cc:2393] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 16: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:33.058943  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:33.022527 13597 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:33.007488 13909 raft_consensus.cc:697] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:03:33.061437  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 128665us
I20260709 13:03:32.999179  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:33.061983  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:33.025573 13771 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:33.031195 14334 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:33.074031  8385 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:03:33.076761  8382 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:33.032267 14260 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:33.078092  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 81328.1us
W20260709 13:03:33.082517  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 45195.9us
I20260709 13:03:33.084776  8384 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:33.083992  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:33.087592 13560 raft_consensus.cc:2764] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader election decision vote started in defunct term 20: won
I20260709 13:03:33.079283  8349 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:33.060952 14274 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:33.054563 14372 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:32.944953 14336 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:33.071079 14293 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:33.134199  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 45265.2us
I20260709 13:03:33.023628 13870 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:33.080476 14275 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:33.078576 14334 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:33.147523 14262 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:33.147933 14334 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:33.084614 13597 raft_consensus.cc:697] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:33.153561 13597 consensus_queue.cc:237] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:33.136997  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3590) took 2511 ms. Trace:
W20260709 13:03:33.144043 14365 log.cc:927] Time spent T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:03:33.156562  8386 rpcz_store.cc:276] 0709 13:03:30.596993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.607693 (+ 10700us) service_pool.cc:224] Handling call
0709 13:03:30.626303 (+ 18610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:32.838114 (+2211811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.091431 (+253317us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b54002cb354. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:33.108774 (+ 17343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4961304320}
W20260709 13:03:33.158177 14367 log.cc:927] Time spent T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:03:33.157523 14334 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:33.159917 14363 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:03:33.160813 13870 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:33.162103 14334 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:33.135254 14366 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:33.164856 14366 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:33.144985 14298 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:33.145397 14035 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:33.170823  8351 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:33.146426 14306 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:33.146678 14336 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:33.080183 13883 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:33.136616 14372 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:33.134310 14368 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:33.183082  8501 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:33.190052  8501 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:33.107906 14317 raft_consensus.cc:697] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:33.192636  8501 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:33.187737 14372 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:33.192934  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:33.194357  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:33.220459  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:33.220044  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:33.219913  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:33.224749  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:33.188663 14362 log.cc:927] Time spent T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.137s	user 0.001s	sys 0.001s
I20260709 13:03:33.233736  8383 raft_consensus.cc:2468] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:33.221318  8458 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:33.167995 14295 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:33.186045 14377 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:33.211239 14313 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:33.211411 14336 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:33.160965 13909 consensus_queue.cc:237] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:33.217187 14368 raft_consensus.cc:697] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 19 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:33.230556 14334 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:33.248837 14366 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:33.248742  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:33.250156 14368 consensus_queue.cc:237] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:33.245167 14313 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:33.252061 14295 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:33.240684 14377 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.255348  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:33.253855 14369 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:03:33.250073 13883 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:33.238093 14285 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.286828 14285 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:33.287065  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:33.288061  8456 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:33.263746 14336 raft_consensus.cc:697] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:33.290098 14336 consensus_queue.cc:237] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:33.270056 13930 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:33.276372  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:33.277064  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:03:33.267719 14296 consensus_meta.cc:287] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.003s
I20260709 13:03:33.279001  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:33.302524  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:33.303300  8529 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:33.303679  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:33.304392  8460 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:33.279666  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:33.281404 14317 consensus_queue.cc:237] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:33.263233 14313 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:33.254432 14334 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.295481  8458 raft_consensus.cc:2368] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17.
I20260709 13:03:33.295729  8461 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:33.312852  8500 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:33.296518  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:33.301641  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:33.319038  8452 raft_consensus.cc:2368] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 19. Current term is 20.
I20260709 13:03:33.305954  9287 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:33.306960  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:03:33.320093  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 55354.6us
I20260709 13:03:33.272692 14316 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:33.295457 14377 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:33.316438  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 354924us
I20260709 13:03:33.288944 14285 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:33.315457  8427 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:33.354166  9261 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:33.368238  8529 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:33.356694  8500 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:33.320991  8501 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:33.372206  8383 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:33.372747  8459 raft_consensus.cc:1240] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:33.330762 14334 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:33.312697 14296 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:33.331288 13981 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:33.379114  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:33.379980  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 79079.4us
W20260709 13:03:33.382090  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 61163.6us
I20260709 13:03:33.381227  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:33.361685 13597 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:33.407105 13597 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:33.408160 14366 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:33.409678  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:33.410609  8454 raft_consensus.cc:2393] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 19: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:33.384162  8500 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:33.317219 14318 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:33.350252 14178 consensus_queue.cc:1059] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:03:33.392867  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:33.392042  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 76670us
I20260709 13:03:33.598635  8377 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
W20260709 13:03:33.376461  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 289077us
I20260709 13:03:33.390988 14335 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:33.399183  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:33.400516 13930 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:33.382923 14285 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:33.402669 14296 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:33.403398 14380 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:33.403898 13981 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:33.628667  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:33.406085  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:33.629390  8456 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:33.629660  8386 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:33.427089 14366 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:33.433315 14371 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.363s	user 0.003s	sys 0.000s
I20260709 13:03:33.434113  8460 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:33.438015 14272 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:33.438663  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 45050.2us
I20260709 13:03:33.441140  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:33.638868  8461 raft_consensus.cc:2368] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 14. Current term is 15.
I20260709 13:03:33.442804  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:33.444564  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:33.586472  8455 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:33.422816 14308 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:33.648588  8459 raft_consensus.cc:2393] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 19: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:33.592346  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:33.423216  8453 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:33.598912  8427 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:33.620558  8384 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:33.540891 14372 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:33.593750 14322 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.630861  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:33.659898  8385 raft_consensus.cc:2393] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 16: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:33.637106  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:33.660472  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 306407us
I20260709 13:03:33.660636  8424 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:33.642992  8351 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:33.632786 14311 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.585642 14199 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:33.609660 14335 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:33.658394  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 59581.8us
I20260709 13:03:33.667606  8424 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:33.661243  9261 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:33.669016  8351 leader_election.cc:400] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 14. Current term is 15.
I20260709 13:03:33.640286 14380 raft_consensus.cc:697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 21 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:03:33.741904  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 90625.3us
I20260709 13:03:33.704259  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:33.665839 13771 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:33.670434 14274 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:33.665271 14335 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:33.711081  8424 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:33.688481 14199 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:33.690311 14295 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:33.716735  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 321738us
W20260709 13:03:33.729959  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 68770.4us
I20260709 13:03:33.696650 14323 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:33.661733 14308 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:33.732872  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:33.671263 13881 consensus_queue.cc:1059] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:03:33.716674 14035 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:33.664395 14311 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:33.672690 14322 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:33.692674  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:33.743330  8385 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:33.743762  8351 leader_election.cc:403] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:03:33.749485  8500 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:33.775810 14274 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.744817 13771 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.731914 14318 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:33.840204 14399 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:03:33.842160  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:33.878224  8377 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:33.840332 14395 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:33.883463 14396 log.cc:927] Time spent T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.141s	user 0.005s	sys 0.002s
I20260709 13:03:33.844245 14381 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:03:33.842859 14370 log.cc:927] Time spent T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.684s	user 0.000s	sys 0.003s
I20260709 13:03:33.845070 14380 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:33.885445  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3629) took 1089 ms. Trace:
W20260709 13:03:33.848749 14397 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.182s	user 0.002s	sys 0.006s
I20260709 13:03:33.857968 14323 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:33.886930  9288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 871) took 1029 ms. Trace:
I20260709 13:03:33.870273 14404 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:33.887603 14404 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:33.888447 14323 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:33.707288 14186 consensus_queue.cc:1048] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:03:33.854550  8386 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:33.889847 14404 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:33.890479  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:33.891141  8386 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:33.891739 14308 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:33.891981 14381 raft_consensus.cc:697] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 20 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:33.892887 14381 consensus_queue.cc:237] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:33.847010 14392 log.cc:927] Time spent T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:03:33.894861 13981 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:33.873451 13771 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:33.885838  8379 rpcz_store.cc:276] 0709 13:03:32.796533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.077593 (+281060us) service_pool.cc:224] Handling call
0709 13:03:33.089837 (+ 12244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:33.090032 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:33.090055 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:33.166529 (+ 76474us) log.cc:844] Serialized 26 byte log entry
0709 13:03:33.445936 (+279407us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:33.445991 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.446084 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:33.883164 (+437080us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b240013dac8. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c521e9c4 00007f36c521cacb 00007f36c53d7dc9 00007f36c53d7a55 00007f36c53d709d 00007f36c800910e 00007f36c802088c 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221
0709 13:03:33.885146 (+  1982us) raft_consensus.cc:1685] finished
0709 13:03:33.885166 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:33.885385 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4399488,"thread_start_us":278443,"threads_started":1,"wal-append.queue_time_us":535657}
I20260709 13:03:33.865605  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:33.867331  8384 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:33.870095  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 206980us
W20260709 13:03:33.905267  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 44134.8us
W20260709 13:03:33.872371  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 122962us
I20260709 13:03:33.907337  8500 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:33.868871  9261 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:33.850310 14394 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.108s	user 0.003s	sys 0.003s
I20260709 13:03:33.880334 14057 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:33.882467 14311 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:33.883050 14395 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:33.915418 14057 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:33.929021  8500 leader_election.cc:400] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17.
I20260709 13:03:33.929211 14057 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:33.929412  8500 leader_election.cc:403] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:03:33.930493  8500 leader_election.cc:400] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 19. Current term is 20.
I20260709 13:03:33.930739  8500 leader_election.cc:403] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:03:33.931620  8500 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:33.932647  8500 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:33.933305 14412 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:03:33.936067 14334 consensus_meta.cc:287] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.543s	user 0.005s	sys 0.002s
I20260709 13:03:33.937072 14057 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:33.937575  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:33.938170  8382 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:33.939225 14057 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:33.939426  8382 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:33.939854 14057 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:33.940464 14057 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17.
I20260709 13:03:33.941027 14057 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 19. Current term is 20.
I20260709 13:03:33.942483 14336 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:33.942099 14057 consensus_queue.cc:1059] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:33.943277 14316 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:33.943627 14057 raft_consensus.cc:3055] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:33.926877  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:33.944904  8457 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
W20260709 13:03:33.855711 14313 consensus_meta.cc:287] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.546s	user 0.003s	sys 0.016s
I20260709 13:03:33.740510 14401 raft_consensus.cc:2764] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:03:33.867031 14393 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:33.887311  9288 rpcz_store.cc:276] 0709 13:03:32.857717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.857827 (+   110us) service_pool.cc:224] Handling call
0709 13:03:32.858127 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:32.896728 (+ 38601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:32.896758 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:32.897314 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:03:32.930928 (+ 33614us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:32.930972 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.931041 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:33.648813 (+717772us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:33.886643 (+237830us) raft_consensus.cc:1685] finished
0709 13:03:33.886665 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:33.886871 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18585,"raft.queue_time_us":19059,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"spinlock_wait_cycles":25862400,"thread_start_us":33266,"threads_started":1,"wal-append.queue_time_us":212309}
I20260709 13:03:33.849439 14372 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:33.873678 14274 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:33.907737  8458 raft_consensus.cc:1240] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:33.904649  8427 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:33.912039  8385 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
W20260709 13:03:33.973217  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 68639.6us
I20260709 13:03:33.886020 14199 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:33.863407 14172 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:33.923801  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:33.879423 14335 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:33.961179  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:33.902369 14322 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:33.944006 14057 raft_consensus.cc:740] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:33.936538 14334 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:33.968035  8351 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:33.917601 14366 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:33.974284  8385 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:03:33.975591  8427 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:33.915982  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 47162us
I20260709 13:03:33.999716  9261 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:33.982688  8377 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:33.961537 14260 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 14. Current term is 15.
I20260709 13:03:33.960906 14304 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:34.006330  8427 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:33.976509 13881 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:33.943300 14336 raft_consensus.cc:697] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:34.013034  9261 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:33.964811 14313 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:34.050590  8534 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:34.009960 14316 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:34.061708 14285 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:34.062816 14374 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:34.061069  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 48136.9us
I20260709 13:03:34.012732 14318 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:34.074076  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:34.074935  8527 raft_consensus.cc:2393] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 19: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:33.979393 13771 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:33.972573 14393 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:34.012461 13881 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:34.024809 14401 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:34.075911  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:34.087724  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:34.014166 14118 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:34.076800  9261 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:34.077265  8529 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:03:34.014222 14303 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:34.076179  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:34.009774 14023 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:33.996412 14172 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.083352  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:34.014441 14322 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:34.068359 14302 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:34.063210 14377 consensus_meta.cc:287] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.686s	user 0.017s	sys 0.000s
I20260709 13:03:34.098510  8533 raft_consensus.cc:2393] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 12: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:34.012549 14308 consensus_queue.cc:1059] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:03:34.101274  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:34.069591 14316 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.106179  9261 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:34.010751 14366 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.107594  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:34.014115 14304 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.086885 13881 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:34.090068 14180 raft_consensus.cc:3055] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:34.087982 14318 raft_consensus.cc:697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:34.154408  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:34.159087  8385 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:03:34.112463 14410 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:34.160382  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:34.107172 14302 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:34.161870  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:34.077118 14374 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.174523  8349 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:34.175266  8531 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:34.077448 14285 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.114387 14316 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:34.180181 14308 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:34.184708  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 78584.8us
I20260709 13:03:34.121182 14322 raft_consensus.cc:697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:34.185679  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:34.187408  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:34.188328  8454 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 20.
I20260709 13:03:34.138747 14180 raft_consensus.cc:740] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:34.157759 14403 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:34.204320  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:34.205215  9296 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:34.112166 14023 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.209779  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:34.181437 14302 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:34.181464 14413 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:34.111286 14377 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:34.106292 14401 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.221596  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:34.223434  9287 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:34.211051 14412 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:34.236157  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:34.236312  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:34.110916 14303 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.180945 14308 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:34.248296  8380 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:03:34.171322 14336 consensus_queue.cc:237] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:34.260203  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 96174.8us
I20260709 13:03:34.262081  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:34.236650 14412 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.220207 14410 consensus_queue.cc:1059] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:03:34.272130  8501 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:34.237541 14431 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:34.247886 14334 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:34.291172 14313 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:34.295006  8453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36446 (request call id 2568) took 1583 ms. Trace:
I20260709 13:03:34.295518  8453 rpcz_store.cc:276] 0709 13:03:32.711310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.711483 (+   173us) service_pool.cc:224] Handling call
0709 13:03:34.294772 (+1583289us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b540019dcd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:34.294930 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1279109888}
I20260709 13:03:34.285529  8384 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:34.296875  8382 raft_consensus.cc:1240] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:03:34.291512  9287 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 21.
I20260709 13:03:34.283073  9296 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 20.
I20260709 13:03:34.265607 14420 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:34.275094 14412 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:34.318964  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 123416us
I20260709 13:03:34.317888  9296 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:34.291731 13771 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:34.236781 14318 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:34.261675 14322 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:34.322897  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:34.335577  9287 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:34.337060  8452 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:34.340911  9296 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:34.343902  9296 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:34.345355  8532 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:34.345793  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:34.316298 14403 raft_consensus.cc:697] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:34.352160 14374 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:34.351931 14403 consensus_queue.cc:237] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:34.347882  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:34.369513  9287 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:34.380609  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:03:34.382961 14409 log.cc:927] Time spent T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:03:34.383167  8455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36448 (request call id 2572) took 1187 ms. Trace:
I20260709 13:03:34.383558 14308 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:34.384034 14377 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:34.384348 14422 log.cc:927] Time spent T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
W20260709 13:03:34.385061 14414 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 13:03:34.385567 14366 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:34.386366 14426 log.cc:927] Time spent T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.180s	user 0.001s	sys 0.001s
I20260709 13:03:34.342658 14172 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:34.387567 14415 log.cc:927] Time spent T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:03:34.387799  8535 raft_consensus.cc:1240] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:34.388495 14433 consensus_queue.cc:1059] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.125s
I20260709 13:03:34.388875 14023 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:34.390635 14424 log.cc:927] Time spent T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:03:34.393258 14419 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:03:34.392841 14023 raft_consensus.cc:3055] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:34.395020 14023 raft_consensus.cc:740] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:03:34.395226 14427 log.cc:927] Time spent T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:03:34.341768 14432 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:34.281468 14180 consensus_queue.cc:260] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.383627  8455 rpcz_store.cc:276] 0709 13:03:33.195938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.196090 (+   152us) service_pool.cc:224] Handling call
0709 13:03:33.196429 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.641303 (+444874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.382921 (+741618us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b540019d2d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:34.383106 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578792832}
I20260709 13:03:34.417488 14180 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:34.421511  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 86460.8us
W20260709 13:03:34.422225  8351 leader_election.cc:336] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Timed out: RequestConsensusVote RPC to 127.7.25.196:40669 timed out after 1.558s (SENT)
I20260709 13:03:34.422855  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:34.404311  8456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 2574) took 1019 ms. Trace:
I20260709 13:03:34.406370  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:34.426369  9287 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 20: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:34.323529 14420 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.381484 14334 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:34.421254 13896 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:34.425767  8456 rpcz_store.cc:276] 0709 13:03:33.384778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.636556 (+251778us) service_pool.cc:224] Handling call
0709 13:03:33.636862 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:33.658007 (+ 21145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:33.658035 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:33.658597 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:03:33.744412 (+ 85815us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:33.744451 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.744513 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:34.404011 (+659498us) raft_consensus.cc:1685] finished
0709 13:03:34.404039 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.404233 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9139,"raft.queue_time_us":21819,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":8073,"thread_start_us":18005,"threads_started":1,"wal-append.queue_time_us":336703}
I20260709 13:03:34.421455 14432 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.416589 14302 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.396631 14393 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:34.452282  8349 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:34.444494 14381 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.027s	sys 0.033s
W20260709 13:03:34.446861  8351 leader_election.cc:336] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Timed out: RequestConsensusVote RPC to 127.7.25.196:40669 timed out after 1.572s (SENT)
I20260709 13:03:34.440277 14304 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:34.459468  8351 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:34.440248 14377 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:34.458181  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:34.468474  9296 raft_consensus.cc:2393] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 16: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:34.470172  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:34.472030  8500 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:03:34.460497 14381 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.028s	sys 0.034s
I20260709 13:03:34.454493 14432 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:34.457769 14308 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:34.440248 14334 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:34.477288  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 205213us
I20260709 13:03:34.445982 13896 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.481523  8501 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:34.488168  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:34.492594  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:34.509409  8384 raft_consensus.cc:2393] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 17: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:34.442219 14023 consensus_queue.cc:260] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.489912  8351 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:34.512526 14441 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:34.488499  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:34.487550  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:34.517500  8383 raft_consensus.cc:2393] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 17: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:34.517450  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:34.515095  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:34.523137  8384 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
I20260709 13:03:34.524868  8384 raft_consensus.cc:1240] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:03:34.474488 14313 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:34.500133 14377 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:03:34.483475 14391 log.cc:927] Time spent T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.697s	user 0.000s	sys 0.010s
I20260709 13:03:34.525494  8379 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:34.535015  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:34.485424 14434 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:34.517012 14308 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:34.543875 14308 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:34.544278 14308 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:34.556025  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.498339 14366 consensus_queue.cc:1059] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:03:34.577549  8349 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:34.492471 14403 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:03:34.544649 14308 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:34.585693  8349 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:34.579674 14418 log.cc:927] Time spent T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
W20260709 13:03:34.592514  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 57589.2us
I20260709 13:03:34.600288  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:34.600677  9261 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:34.601778  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3633) took 1630 ms. Trace:
I20260709 13:03:34.602537  9261 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:34.581326 14023 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:34.540830 14313 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.602349  8381 rpcz_store.cc:276] 0709 13:03:32.971834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.137455 (+165621us) service_pool.cc:224] Handling call
0709 13:03:33.165439 (+ 27984us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:33.174955 (+  9516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:33.174985 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:33.175427 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:03:33.644447 (+469020us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:33.644507 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.644601 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:34.483032 (+838431us) spinlock_profiling.cc:243] Waited 5.16 ms on lock 0x7b240013dac8. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c521e9c4 00007f36c521cacb 00007f36c53d7dc9 00007f36c53d7a55 00007f36c53d709d 00007f36c800910e 00007f36c802088c 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221
0709 13:03:34.587929 (+104897us) raft_consensus.cc:1685] finished
0709 13:03:34.587952 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.601698 (+ 13746us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9151,"raft.queue_time_us":10090,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":11083,"spinlock_wait_cycles":11867520,"thread_start_us":468688,"threads_started":1,"wal-append.queue_time_us":556838}
I20260709 13:03:34.584059 14393 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:34.607329  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.601882  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:34.610169  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:34.607050  8456 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 18: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:34.616842  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:34.617276  8461 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:34.617668  8379 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:34.539165 14377 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.596408 14434 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:34.584439 14447 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:34.623502  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2668) took 1242 ms. Trace:
I20260709 13:03:34.625852  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:34.626838  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:34.602705 13881 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:34.629777 14445 log.cc:927] Time spent T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:03:34.541944 14441 consensus_queue.cc:1175] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "446d9310dce14ff4afff2dc2d64f68d8" responder_term: 16 status { last_received { term: 16 index: 14 } last_committed_idx: 14 last_received_current_leader { term: 16 index: 14 } }
I20260709 13:03:34.632200 14456 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:03:34.612779 14366 raft_consensus.cc:3055] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:34.595937 14413 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.635823  8380 rpcz_store.cc:276] 0709 13:03:33.381034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.410750 (+ 29716us) service_pool.cc:224] Handling call
0709 13:03:33.411130 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:34.250644 (+839514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.623262 (+372618us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b54003b6354. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:34.623447 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1924700544}
W20260709 13:03:34.630620 14448 log.cc:927] Time spent T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:03:34.612218 14410 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:34.639248 14423 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:34.639495 14450 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:03:34.592622 14316 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:34.641156  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:34.639964 14373 raft_consensus.cc:3055] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:34.612587 14429 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:34.641846  8427 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:34.655150  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:34.655405 13870 raft_consensus.cc:3055] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:34.665448 13870 raft_consensus.cc:740] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:34.666594 13870 consensus_queue.cc:260] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.657723  8381 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:03:34.610813 14336 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 13:03:34.645713  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 60099.5us
I20260709 13:03:34.642508 14366 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:34.626104 14393 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:34.680609 14457 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:34.622804 14430 consensus_queue.cc:1059] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:03:34.689117 14435 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:34.694250 14454 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:34.640440 14447 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.652568 14434 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:34.695039 13896 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:34.689831 14438 consensus_queue.cc:1059] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.151s
I20260709 13:03:34.710582 14186 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:34.696499  8383 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:34.718056  8377 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:34.644826 13909 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
W20260709 13:03:34.722373  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 115939us
W20260709 13:03:34.745314  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 93052us
I20260709 13:03:34.675034 14429 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:34.750663  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 85627us
I20260709 13:03:34.768913  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:34.748524 14454 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:34.664004 14373 raft_consensus.cc:740] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:03:34.716981 14274 consensus_meta.cc:287] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.715s	user 0.013s	sys 0.000s
I20260709 13:03:34.776110  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:34.697351 14420 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:34.715250 14302 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:34.773805  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:34.652907 14413 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.772188  9261 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:34.750970 14434 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:34.779726  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:34.748062 14433 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:34.761111 14455 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.102s
W20260709 13:03:34.782481  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 111480us
I20260709 13:03:34.782912  9290 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:34.783565  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:34.760277  8379 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:34.773039 14429 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:34.777287 14401 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:34.797942  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:34.798894  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:34.799276  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:34.800758  8351 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:34.775878 14186 raft_consensus.cc:697] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:34.806528  8530 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:34.818946  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:34.812902  9294 raft_consensus.cc:2368] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16.
I20260709 13:03:34.819864  8380 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:34.799857 13896 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:34.822630 13896 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:34.823058 13896 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:34.825937  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:34.827231  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:34.827957 14308 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.831310 14285 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:34.832759  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:34.832965  8380 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
W20260709 13:03:34.835477 14453 log.cc:927] Time spent T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:03:34.839864 14434 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:34.843313  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3643) took 1144 ms. Trace:
I20260709 13:03:34.843730  8386 rpcz_store.cc:276] 0709 13:03:33.698555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.892782 (+194227us) service_pool.cc:224] Handling call
0709 13:03:33.893041 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:34.104833 (+211792us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:34.104887 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:34.104943 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:34.104989 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.843080 (+738091us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b540013d3d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:34.843127 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.843254 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486603008}
I20260709 13:03:34.828284  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:34.805141 14433 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.847177  8533 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:34.848660 14433 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:34.779330 14274 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:34.849852  8378 raft_consensus.cc:2393] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 15: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:34.851689 14274 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:34.852568 14443 log.cc:927] Time spent T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:03:34.853507 14308 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:34.855500 14186 consensus_queue.cc:237] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:34.862236 14293 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.862684 14454 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:34.862823 14293 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.864651 14447 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:34.865306 14293 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:34.869357  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:34.876217  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:34.870043  9291 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 22.
I20260709 13:03:34.879134  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:34.881232  8385 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
W20260709 13:03:34.885355  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 82994.9us
I20260709 13:03:34.886863  8349 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:03:34.893922  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 93246.2us
I20260709 13:03:34.894088  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:34.901600  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:34.904942  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:34.906082  8455 raft_consensus.cc:2393] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 15: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:34.899139  9261 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:34.916726  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:34.915932  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:34.880412 14293 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.920622  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:34.932690  8459 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:34.886207 14317 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:34.935714  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:34.922483 14412 consensus_meta.cc:287] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.589s	user 0.003s	sys 0.008s
W20260709 13:03:34.939823  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 45822.5us
I20260709 13:03:34.915771 14457 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:34.919869 14386 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:34.911545 14274 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:34.893023 14368 consensus_queue.cc:1059] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:03:34.966619  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:34.969800  9258 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:34.921427 13881 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:34.929558  8461 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 20.
I20260709 13:03:34.971170  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:34.975473  8535 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
I20260709 13:03:34.947535 14335 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:34.953415 14308 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:34.980823  8349 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:34.947852 14434 consensus_queue.cc:1059] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:03:34.972731 14274 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:34.937182 14293 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.992173  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:34.998889  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:35.000185  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:35.000852  8529 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:34.978050 14386 raft_consensus.cc:697] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:34.948423 14317 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:35.011492 14317 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:35.012013  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:35.012615  8526 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:35.013172 14461 raft_consensus.cc:3055] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:35.013590 14461 raft_consensus.cc:740] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:34.983355 14316 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:35.024341  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.029461  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:35.030476  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:35.031977  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:35.034217  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:35.035302  9294 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 20: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:35.041898 14413 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:35.042021 14313 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:34.983884 14393 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:35.042675  8382 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:35.045838 14410 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:35.046689 14394 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:34.991056 14432 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:35.049757 14416 log.cc:927] Time spent T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c: Append to log took a long time: real 0.814s	user 0.004s	sys 0.000s
I20260709 13:03:35.052049 14334 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:35.053184 14432 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:35.054319  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:35.055238  9296 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:35.056974  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 3084) took 1759 ms. Trace:
I20260709 13:03:35.057446  8534 rpcz_store.cc:276] 0709 13:03:33.298051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.298186 (+   135us) service_pool.cc:224] Handling call
0709 13:03:33.298487 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:34.065896 (+767409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.056670 (+990774us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54002adfd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:35.056892 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1727923072}
I20260709 13:03:35.014950 14377 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:35.009066  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:35.061630  8535 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
I20260709 13:03:34.880800 14373 consensus_queue.cc:260] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.062812 13560 raft_consensus.cc:3055] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:35.063239 13560 raft_consensus.cc:740] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:34.987928 14368 consensus_queue.cc:1243] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer b8eb0ad4490645598004d862412f4e31 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:03:35.015892  8349 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:35.064046 13560 consensus_queue.cc:260] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:35.064747  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 48943us
I20260709 13:03:35.065259  8528 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:35.065899  8349 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:35.066291  8460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 1202) took 1440 ms. Trace:
I20260709 13:03:35.066045 14057 consensus_queue.cc:260] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:35.067366 14057 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:35.067596 14368 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:35.068337 14368 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:35.068691 14368 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:35.069128 14368 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:35.069401  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.985886 14262 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.087s
I20260709 13:03:35.021338 14462 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.021796 14436 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:35.074149 14462 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:34.996192 14438 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:35.075335 13870 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:35.076470 14462 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:35.077008 13896 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.079484 13896 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:35.081909 14180 consensus_meta.cc:287] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.664s	user 0.011s	sys 0.000s
I20260709 13:03:35.066636  8460 rpcz_store.cc:276] 0709 13:03:33.625496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.662233 (+ 36737us) service_pool.cc:224] Handling call
0709 13:03:33.662474 (+   241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:33.901372 (+238898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:33.901401 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:33.901845 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:03:34.050806 (+148961us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:34.174632 (+123826us) log.cc:844] Serialized 14 byte log entry
0709 13:03:34.175173 (+   541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.065897 (+890724us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54000d34d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:35.065948 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:35.065993 (+    45us) raft_consensus.cc:1685] finished
0709 13:03:35.066092 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:35.066221 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1948,"prepare.queue_time_us":210388,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":1930,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":10487,"spinlock_wait_cycles":548549504,"thread_start_us":198680,"threads_started":2,"wal-append.queue_time_us":274902}
I20260709 13:03:35.084187  8383 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:35.024718 14395 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:35.086831 14303 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:35.089391  8383 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:35.088703  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:35.091508  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:35.091895  8461 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:35.092801  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:35.072346 14366 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:35.093842 14366 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:35.094063  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:35.094915  9288 raft_consensus.cc:2393] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 16: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:35.095527  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:35.095712  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:35.096119  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:35.096692  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:35.097419  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:35.103077  8427 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:35.103619 14311 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:35.104130 14311 raft_consensus.cc:697] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 20 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:35.104632 14318 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:03:35.105963  8349 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:35.106506 13981 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:35.106730 14456 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:35.107020 13981 raft_consensus.cc:697] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:35.106914 14318 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:35.108067 13981 consensus_queue.cc:237] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.110675 14381 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:35.111965  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:35.111213  8426 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:35.119554  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:35.017031  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:35.124012  9288 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:35.129974  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:35.132349  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:35.137322  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:35.139142  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:35.154765  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:35.175087  8382 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:03:35.149423  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:35.169919 14311 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.203313  8424 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:35.156309  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:35.203765  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:35.204499  8452 raft_consensus.cc:2368] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:35.160902  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:35.176061  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:35.204603  8460 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:03:35.142632 14293 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:35.161557  8529 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:03:35.214747  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:35.214155  9296 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
I20260709 13:03:35.215396  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:35.216271  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:35.225867  9296 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 21.
I20260709 13:03:35.113250 14456 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:35.001452 14274 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:35.177109  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:35.155680 14317 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:35.136198 14380 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:35.153281 14318 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:35.151014  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 45030.2us
I20260709 13:03:35.146086  8526 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:35.149838 14429 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.268186 14429 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:35.173055  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:35.190253  8459 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 18.
W20260709 13:03:35.195137  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.269213 14317 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.270046  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:35.271333  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:35.272264 14317 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:35.272475  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:35.273466  8454 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:35.274654  9287 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:03:35.201129  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:35.277840  8456 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
W20260709 13:03:35.103138 14417 log.cc:927] Time spent T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.875s	user 0.005s	sys 0.000s
I20260709 13:03:35.249752 14456 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:35.145980  9288 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:35.206017  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:35.213264  8379 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:35.217197  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:35.217409  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:35.217643  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:35.277096  8351 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:35.261925  9260 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
W20260709 13:03:35.286201  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 84396.5us
I20260709 13:03:35.292289  8500 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:35.286381  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 68395.9us
I20260709 13:03:35.236159  9296 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:03:35.256736  8458 raft_consensus.cc:1240] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:35.259080  8424 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:34.970608 14412 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.261112  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:35.299937  8461 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:03:35.111235 14381 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.201884 14064 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:35.246140 13771 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:35.264530  8531 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:35.283274  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:35.332939  8382 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:35.108769 14386 consensus_queue.cc:237] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:35.289544  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.295038  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:35.333645  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:35.290591  9291 raft_consensus.cc:2393] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 16: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:35.297015  9260 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:35.299005  8530 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:35.218256 14303 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:35.335558  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:35.335788  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 43565.4us
W20260709 13:03:35.261898  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 282614us
I20260709 13:03:35.301553  8501 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:35.304790  8535 raft_consensus.cc:2393] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 15: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:35.305229  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:35.315908  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:35.278115 14435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.000s	sys 0.011s
I20260709 13:03:35.340428 14435 raft_consensus.cc:697] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:35.326444  8456 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:35.308290 14429 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:03:35.345752  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 48828.4us
I20260709 13:03:35.330085  9289 raft_consensus.cc:1240] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:35.346575  9291 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:35.339988 14057 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:35.340503 14285 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:35.328130 14368 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:35.336748  8500 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:35.329447 14412 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:35.294757 14378 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:35.352246 13868 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:35.357190 14460 raft_consensus.cc:3055] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:35.358099  9258 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:35.376571  9258 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:35.354388  8527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2782) took 1275 ms (client timeout 1523 ms). Trace:
I20260709 13:03:35.365926  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:35.287299 14468 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 13:03:35.345538 14429 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:35.296499 14403 consensus_queue.cc:1059] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:03:35.286046 14199 consensus_queue.cc:1059] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
W20260709 13:03:35.380894  8527 rpcz_store.cc:269] 0709 13:03:34.078939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.083004 (+  4065us) service_pool.cc:224] Handling call
0709 13:03:35.354038 (+1271034us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54000ac654. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:35.354238 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820889472}
I20260709 13:03:35.389864  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:35.390098  8351 leader_election.cc:400] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16.
I20260709 13:03:35.391426  8452 raft_consensus.cc:1240] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12. Ops: []
W20260709 13:03:35.392395  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.287475 14487 consensus_queue.cc:1059] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.082s
I20260709 13:03:35.394902  8378 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:35.397514 14466 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:03:35.402382  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 107438us
I20260709 13:03:35.398029 14470 consensus_queue.cc:1059] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:03:35.398792 13771 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:35.403841  8351 leader_election.cc:403] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:35.293829 14380 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.408890  8424 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:35.414656  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.306216 14317 consensus_queue.cc:1059] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:03:35.390736 13994 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:35.391707 14372 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:35.341109 14064 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:35.435114  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 45152.7us
W20260709 13:03:35.454636  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 68510.6us
I20260709 13:03:35.393739 14429 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:35.361307 14303 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:35.401211 14463 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.390134 14460 raft_consensus.cc:740] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:35.434609 14466 raft_consensus.cc:697] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 18 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:35.449291 14482 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16.
I20260709 13:03:35.456738  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:35.440968 13881 raft_consensus.cc:3055] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:35.461614 14379 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:03:35.441818 14318 consensus_queue.cc:1059] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:03:35.464273 13881 raft_consensus.cc:740] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:35.465265 14438 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:35.407369 14395 consensus_queue.cc:1059] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:03:35.468041 14368 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:35.470245 14380 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:35.474592 14470 consensus_queue.cc:1243] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer d653e71832b7402b9a03b46249d3b885 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:03:35.475317 14470 raft_consensus.cc:3055] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:35.475690 14470 raft_consensus.cc:740] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:35.477691  8380 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:35.454084 14199 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.025s
W20260709 13:03:35.478977  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 142290us
I20260709 13:03:35.480408  8500 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:35.433506 14285 raft_consensus.cc:697] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:35.483556  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:35.484043  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:35.485463  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:35.448063 13994 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:35.486126  8379 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:35.489393  8382 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
I20260709 13:03:35.490705  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:35.486502  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:35.491609  9261 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:35.487356  8500 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:35.495159  9261 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:35.496639  8501 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:35.476658 14470 consensus_queue.cc:260] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:35.498063 14469 log.cc:927] Time spent T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:03:35.446341 14477 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:03:35.498775 14470 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:35.493144 13909 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:03:35.482610 14462 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:35.465328 14064 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:35.486627 14459 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:35.516795  8500 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:35.487442 14336 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:35.491878 13994 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:35.532497  8349 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:35.526775  8379 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:35.446566 14435 consensus_queue.cc:237] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.539911  8349 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:35.511902 14372 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:35.515780 14293 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:35.514003 14379 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:35.556401  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 147616us
I20260709 13:03:35.480454 14463 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:35.518427 14462 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:35.523182 14432 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:35.561242  8424 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:35.523931 14459 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:35.473062 14274 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:35.541826 14441 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:35.551275 14395 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:35.551303 14381 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:35.551559 14335 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:35.580689  8424 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:35.558490 14434 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:35.571233 14462 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:35.574398 14459 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:35.538722 14482 consensus_queue.cc:1059] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:03:35.578668 14050 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:35.582954 14064 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:35.532845 14460 consensus_queue.cc:260] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:35.588431 14441 raft_consensus.cc:697] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:35.592442 14317 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:35.634269 14335 raft_consensus.cc:3055] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:35.639407 14274 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:35.568032 14285 consensus_queue.cc:237] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:35.613240 14050 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:35.642865  8456 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:35.644783  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:35.602851 14434 raft_consensus.cc:697] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:35.668949 14373 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:35.594548 14432 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:35.674005  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:35.612802 14482 consensus_queue.cc:1243] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer b8eb0ad4490645598004d862412f4e31 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:03:35.569049 14466 consensus_queue.cc:237] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:35.692546  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:35.697252  8384 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:03:35.686889  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:35.700033  8386 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 17: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:35.689914  8385 raft_consensus.cc:1240] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:35.686471 14064 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.691455 14432 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:35.703485 14064 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.708118 14064 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:35.709590 14432 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:35.711167 14463 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:35.712610 13560 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:35.714386 14438 raft_consensus.cc:3055] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:35.715039 14438 raft_consensus.cc:740] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:35.716881 14438 consensus_queue.cc:260] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.718750 14438 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:35.730751 14434 consensus_queue.cc:237] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:35.738354  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.741286 14303 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:35.741883  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:35.743363  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:35.744618  9258 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:35.749346 14465 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.748740 14272 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:35.679968 14460 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:35.676833 14335 raft_consensus.cc:740] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:35.684103 14379 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.762784  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:35.764514  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:35.768131  8527 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:35.765380  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:35.770085  9287 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:35.695792 14403 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:35.772852  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:35.769380  8533 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:35.772626  8527 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:35.765620 14432 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.755422 14465 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.773581  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:35.795493  8533 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:03:35.796202  8533 pending_rounds.cc:85] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 10
I20260709 13:03:35.796571  8533 pending_rounds.cc:107] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:03:35.763051 14118 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:35.796931  8533 raft_consensus.cc:2889] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:35.789922 13981 raft_consensus.cc:3055] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:35.766665 14442 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:35.806182 14118 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:35.815340 14118 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:35.758072 14272 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.770999 14379 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:35.825976  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.790299 14403 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:35.810405  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:35.815939 13981 raft_consensus.cc:740] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:35.792173 14432 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:35.818336 14436 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:35.790149 14441 consensus_queue.cc:237] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:35.840902  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.848107  8424 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:35.828691 14366 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:35.854888  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.855713  8500 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:35.855597  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:35.819792 14442 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.858012 13981 consensus_queue.cc:260] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:35.859148 13981 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:35.859894 14313 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.860440 14313 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:35.862519 14470 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:35.863027 14470 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:35.863481 14470 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:35.865715 14050 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:35.868322 14465 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:35.875108  8385 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:03:35.876766  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:35.876690  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:35.878937 14461 consensus_queue.cc:260] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.880538 14461 raft_consensus.cc:3060] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:35.890400 13881 consensus_queue.cc:260] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:35.891937 13881 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:35.893931 14171 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:35.895288 14272 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:35.896777  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:35.899075 14476 log.cc:927] Time spent T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.451s	user 0.002s	sys 0.000s
I20260709 13:03:35.900204 14379 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:35.901144 14491 log.cc:927] Time spent T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.340s	user 0.002s	sys 0.000s
I20260709 13:03:35.902287 14186 raft_consensus.cc:3055] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:35.902710 14186 raft_consensus.cc:740] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:35.902998 14459 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.903616 14186 consensus_queue.cc:260] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.904284  8527 raft_consensus.cc:1240] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:35.907756  8530 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:35.908592  8535 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:03:35.911192  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:35.911995  8455 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 20.
I20260709 13:03:35.817032 14335 consensus_queue.cc:260] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:35.924407  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 67364.9us
I20260709 13:03:35.932104  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:35.923740  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:35.921707  8426 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:35.953051  9260 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
W20260709 13:03:35.853685 14494 log.cc:927] Time spent T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:03:35.919034  9295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 836) took 1052 ms. Trace:
I20260709 13:03:35.941367  8454 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:35.920588  9261 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:35.841588 14436 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.914319 14493 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:35.941764 14057 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:03:35.951262 14334 consensus_queue.cc:1059] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:03:35.956272 14497 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:35.979837 14497 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:35.980368 14497 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:35.981274 14334 raft_consensus.cc:3055] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:35.981810 14334 raft_consensus.cc:740] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:35.982780 14334 consensus_queue.cc:260] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.984337 14334 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:35.956825 14303 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.985430 14303 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:35.987224 14459 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:35.987725 14303 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:35.957352 14438 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.988665 14438 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:35.990870 14438 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:35.958539 14432 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:35.931536  8500 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:35.992133 14432 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:35.993172  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 61725.5us
W20260709 13:03:35.993913 14456 consensus_meta.cc:287] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.707s	user 0.004s	sys 0.008s
I20260709 13:03:35.994419 14456 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:35.997725  8500 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:35.998662 14459 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:36.003371 14462 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.004772  8381 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 13:03:35.904974 14186 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:35.913341 14366 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:35.960805  9295 rpcz_store.cc:276] 0709 13:03:34.866573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.866759 (+   186us) service_pool.cc:224] Handling call
0709 13:03:34.867115 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:34.867481 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:34.867509 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:34.867971 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:03:35.211229 (+343258us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:35.211290 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.211387 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:35.898488 (+687101us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:35.908593 (+ 10105us) raft_consensus.cc:1685] finished
0709 13:03:35.908618 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:35.918962 (+ 10344us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4291,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":11906,"spinlock_wait_cycles":13778688,"thread_start_us":342803,"threads_started":1,"wal-append.queue_time_us":477370}
I20260709 13:03:35.971681 14272 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:35.970283 14293 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:36.024412  8527 raft_consensus.cc:1240] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:36.028777  9258 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:36.030421  8424 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:36.031734  8424 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:36.022079  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.022801  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:36.019678 14272 raft_consensus.cc:697] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:36.023573  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:36.040609  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:36.041524  8528 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
W20260709 13:03:36.013643 14429 consensus_meta.cc:287] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.003s
W20260709 13:03:36.048615  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 81511.8us
I20260709 13:03:36.049827  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:36.013049 14322 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:03:36.050956 14379 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:36.051491 14303 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:36.039507 14293 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.065446  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:36.074503  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:36.077682  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:36.092692  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:36.040138 14456 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:36.084185  8378 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:03:36.084688  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.086364  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:36.086800  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:36.089447  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:36.090927  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.064798 14171 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:36.039952 14493 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:36.149874  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.185233  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:36.092859  8528 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 18.
W20260709 13:03:36.169384  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 88249.9us
I20260709 13:03:36.169920  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:36.181754  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:36.200814  8378 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:36.201807  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:36.203801  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:36.170840  9295 raft_consensus.cc:1240] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:36.174609  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:36.091468  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:36.178648  8500 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:36.207404  8385 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:36.179272  8381 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:36.179840  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 95005.6us
I20260709 13:03:36.210044  8427 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:36.166177 14293 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:36.181717  8349 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:36.182914  9293 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:36.184273  8382 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:36.092569 14438 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:36.216231  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:36.219643  8500 leader_election.cc:400] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:36.230517  8500 leader_election.cc:403] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:03:36.063563 14429 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.072389 14479 consensus_queue.cc:1059] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.133s
I20260709 13:03:36.071935 14318 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.129s
I20260709 13:03:36.231305  8532 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:03:36.233651  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:36.234525  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 52897.1us
I20260709 13:03:36.080708 14495 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.165s
I20260709 13:03:36.233654  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:36.227669  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:36.239795 14466 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:36.246672  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:36.180630  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 92483.1us
I20260709 13:03:36.185328 14493 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:36.248574  8349 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:36.072237 14490 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.133s
I20260709 13:03:36.205097 14432 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.265341 14432 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:36.267596 14432 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:36.268923 14421 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:36.269189 14497 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.269769 14421 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:36.270921 14442 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:36.271646 14497 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:36.272244  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:36.272632 14493 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:36.275077  9290 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:36.276355  9290 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:36.219426 14459 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.277472 14459 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.247314 14462 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:36.227705 14456 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:36.280398  8383 raft_consensus.cc:1275] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:03:36.286569  8383 pending_rounds.cc:85] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 11
I20260709 13:03:36.246054 14379 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:36.286865  8383 pending_rounds.cc:107] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:03:36.290387  8383 raft_consensus.cc:2889] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:36.281606  8349 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:36.255281 13994 consensus_meta.cc:287] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.001s
W20260709 13:03:36.294831  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.256248 14057 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:36.227784 14336 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:36.288841 14462 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:36.310530 13560 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:36.350773 13560 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.293064 14410 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.295980 14303 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:36.356900 13560 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:36.228969 14272 consensus_queue.cc:237] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.284528 14496 consensus_queue.cc:1059] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:03:36.301748 14466 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:36.305069 14460 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.307531 14431 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:36.292073 14456 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:36.352006 14462 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:36.347999 14461 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:36.349664 14421 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:36.298460 13994 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.354362 14459 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:36.363435 14436 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:36.391004  9289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 1268) took 2162 ms. Trace:
I20260709 13:03:36.394089  9296 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:03:36.391448  9289 rpcz_store.cc:276] 0709 13:03:34.223359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.223545 (+   186us) service_pool.cc:224] Handling call
0709 13:03:34.223831 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:35.346675 (+1122844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.385631 (+1038956us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400720e54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:36.385819 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2543589120}
W20260709 13:03:36.402257  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.378618 14462 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:36.408229 13994 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:36.377187 14431 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.362334 14410 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.422416 14410 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:36.376652 14366 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:36.440410 14506 log.cc:927] Time spent T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:03:36.441478 14502 log.cc:927] Time spent T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:03:36.441888 14403 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:36.442531 14504 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:03:36.444644 14483 log.cc:927] Time spent T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.986s	user 0.003s	sys 0.000s
I20260709 13:03:36.446482  9294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 840) took 1573 ms. Trace:
I20260709 13:03:36.446659  9288 raft_consensus.cc:1240] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:03:36.446930  9294 rpcz_store.cc:276] 0709 13:03:34.873475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.036013 (+162538us) service_pool.cc:224] Handling call
0709 13:03:35.036390 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:35.040348 (+  3958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:35.040380 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:35.040894 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:03:35.329324 (+288430us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:35.329366 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.329430 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:36.444126 (+1114696us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:36.446171 (+  2045us) raft_consensus.cc:1685] finished
0709 13:03:36.446189 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.446420 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3384,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":42615552,"thread_start_us":288012,"threads_started":1,"wal-append.queue_time_us":331058}
I20260709 13:03:36.456199 14456 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:36.373093 14460 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.471300  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:36.471544  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:36.471984  8533 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:36.472064  8534 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:03:36.372102 14466 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:36.478601  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:36.381023 14461 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:36.490383  8460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:36.494351  8460 raft_consensus.cc:606] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:36.494838  8460 raft_consensus.cc:614] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:36.452955 13881 consensus_meta.cc:287] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.560s	user 0.011s	sys 0.000s
W20260709 13:03:36.507265  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 280585us
W20260709 13:03:36.509279  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 262242us
I20260709 13:03:36.513660  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:36.512316 14456 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:36.512393 14463 consensus_queue.cc:1059] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:03:36.515177 14456 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:36.516176 14303 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:36.516899 14463 raft_consensus.cc:3055] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:36.516723 14303 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.517300 14463 raft_consensus.cc:740] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:36.518743 14303 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:36.520421 14317 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:03:36.511049 14118 consensus_meta.cc:287] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.687s	user 0.012s	sys 0.000s
W20260709 13:03:36.549180  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 331315us
I20260709 13:03:36.550519  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:36.528587 14429 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:36.545171 14463 consensus_queue.cc:260] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:36.545775  8460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:36.604975  8460 raft_consensus.cc:606] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:03:36.548380 14118 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:36.604440  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 52447us
I20260709 13:03:36.606492  8533 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:36.607470  8500 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:36.551894 14456 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:36.612466 14463 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:36.614384 14403 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:36.615015  8460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:36.619040  8460 raft_consensus.cc:606] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:36.619508  8460 raft_consensus.cc:614] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:36.599342 14421 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:36.616230 14118 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:36.623858  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 382739us
I20260709 13:03:36.626399  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:36.627036  9295 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:36.630224  9288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55720 (request call id 888) took 1378 ms. Trace:
I20260709 13:03:36.630642  9288 rpcz_store.cc:276] 0709 13:03:35.251625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.287254 (+ 35629us) service_pool.cc:224] Handling call
0709 13:03:36.446346 (+1159092us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.447218 (+   872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.630007 (+182789us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540053d750. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:36.630161 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2664804096}
I20260709 13:03:36.632130 14293 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.543887 14462 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:36.633270  9290 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 20. Current term is 21. Ops: []
W20260709 13:03:36.628921 14503 log.cc:927] Time spent T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:03:36.610070 14442 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:03:36.620736 14403 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:36.649706  8385 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:36.650990  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:36.646420 14403 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:36.656378  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:36.656769  9261 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:36.657616  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:36.659778  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:36.660197  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:36.661830 14118 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:36.665243 13560 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:36.665764 13560 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:36.667188  9288 raft_consensus.cc:2393] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 16: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:36.667697 13560 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:36.668469  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:36.669415  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:36.670109  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:36.670753  8377 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:36.674144  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:36.674904  8452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:36.675765  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:36.677001  8452 raft_consensus.cc:606] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:36.677374  8452 raft_consensus.cc:614] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:36.677211  8379 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:36.624387 14432 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:03:36.676327  9291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 1283) took 1085 ms. Trace:
I20260709 13:03:36.680523  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:36.683966  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:36.684780  8379 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:03:36.646092 14514 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:36.690760  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:36.660347 14456 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.658800 14303 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.695573  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:36.696661  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:36.698843  8453 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:03:36.678814  9291 rpcz_store.cc:276] 0709 13:03:35.591237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.887436 (+296199us) service_pool.cc:224] Handling call
0709 13:03:35.887800 (+   364us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:35.888213 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:35.888253 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:35.888901 (+   648us) log.cc:844] Serialized 52 byte log entry
0709 13:03:36.280132 (+391231us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:36.625902 (+345770us) log.cc:844] Serialized 14 byte log entry
0709 13:03:36.633715 (+  7813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.633823 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:36.676125 (+ 42302us) raft_consensus.cc:1685] finished
0709 13:03:36.676143 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.676266 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31146,"prepare.queue_time_us":158399,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":16249,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":5015,"thread_start_us":637956,"threads_started":2,"wal-append.queue_time_us":516069}
I20260709 13:03:36.710533  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:36.727581  9287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 1282) took 1137 ms. Trace:
I20260709 13:03:36.731209  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:36.732681  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.733232  8385 raft_consensus.cc:2393] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 14: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:36.728058  9287 rpcz_store.cc:276] 0709 13:03:35.590442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.773783 (+183341us) service_pool.cc:224] Handling call
0709 13:03:35.774133 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:35.774908 (+   775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:35.774952 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:35.790950 (+ 15998us) log.cc:844] Serialized 52 byte log entry
0709 13:03:36.239949 (+448999us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:03:36.303806 (+ 63857us) log.cc:844] Serialized 14 byte log entry
0709 13:03:36.304159 (+   353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.304267 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:36.438319 (+134052us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b18003999a0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:03:36.462105 (+ 23786us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b18003999a0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:03:36.628348 (+166243us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:36.717360 (+ 89012us) raft_consensus.cc:1685] finished
0709 13:03:36.717390 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.727522 (+ 10132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":109461,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":1078,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":49517,"spinlock_wait_cycles":49337728,"thread_start_us":422323,"threads_started":1,"wal-append.queue_time_us":555579}
I20260709 13:03:36.685134 14199 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:03:36.691143 14318 consensus_queue.cc:1059] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:03:36.725449  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:36.711124 14460 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:36.744233  9295 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
W20260709 13:03:36.748227 13981 consensus_meta.cc:287] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.889s	user 0.008s	sys 0.005s
I20260709 13:03:36.703540 14456 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.750634 14456 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:36.700881 14514 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.752990 14514 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:36.758108  8455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:36.758908  8455 raft_consensus.cc:606] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 21 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
W20260709 13:03:36.759383 14470 consensus_meta.cc:287] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.895s	user 0.011s	sys 0.000s
I20260709 13:03:36.759913 14470 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.761276  8529 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:36.761652  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:36.761986 14460 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:36.763470  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:36.763360  8379 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:03:36.705471 14303 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.766014 14303 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:36.766983  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2698) took 1593 ms. Trace:
I20260709 13:03:36.767381  8383 rpcz_store.cc:276] 0709 13:03:35.173468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.174866 (+  1398us) service_pool.cc:224] Handling call
0709 13:03:35.175108 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.290920 (+1115812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.766744 (+475824us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540026aa54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:36.766915 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2541083520}
I20260709 13:03:36.772051 14403 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:36.775282 14511 log.cc:927] Time spent T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
W20260709 13:03:36.776088 14493 consensus_meta.cc:287] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.503s	user 0.004s	sys 0.004s
I20260709 13:03:36.778864 14171 raft_consensus.cc:3055] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:36.779291 14171 raft_consensus.cc:740] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:36.780215 14171 consensus_queue.cc:260] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.781555  9292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 1280) took 1192 ms. Trace:
I20260709 13:03:36.781965  9292 rpcz_store.cc:276] 0709 13:03:35.588797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.589039 (+   242us) service_pool.cc:224] Handling call
0709 13:03:35.604142 (+ 15103us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:35.610176 (+  6034us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:03:35.950209 (+340033us) log.cc:844] Serialized 14 byte log entry
0709 13:03:36.309729 (+359520us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:36.359965 (+ 50236us) log.cc:844] Serialized 26 byte log entry
0709 13:03:36.360144 (+   179us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:36.638047 (+277903us) log.cc:844] Serialized 14 byte log entry
0709 13:03:36.638272 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.638346 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:36.774697 (+136351us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:36.781295 (+  6598us) raft_consensus.cc:1685] finished
0709 13:03:36.781318 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.781484 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":538017,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":74657,"raft.queue_time_us":36745,"raft.run_cpu_time_us":426,"raft.run_wall_time_us":34704,"spinlock_wait_cycles":42837760,"thread_start_us":822187,"threads_started":3,"wal-append.queue_time_us":448088}
I20260709 13:03:36.737429 14293 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:36.743702 13560 consensus_queue.cc:1059] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:36.784574  9293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 1273) took 1690 ms. Trace:
I20260709 13:03:36.784827 13560 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.784950  9293 rpcz_store.cc:276] 0709 13:03:35.094083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.097625 (+  3542us) service_pool.cc:224] Handling call
0709 13:03:35.097940 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.223181 (+1125241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.784356 (+561175us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400047754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:36.784522 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2494685440}
I20260709 13:03:36.785394 13560 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.787475 13560 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:36.787940 13560 raft_consensus.cc:3055] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:36.788210 13560 raft_consensus.cc:740] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:36.776504 14493 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.789060 13560 consensus_queue.cc:260] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.807974 13560 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:36.804911 14403 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:36.805912 14493 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:36.806387  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.792116  9296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 1279) took 1204 ms. Trace:
I20260709 13:03:36.791708 14470 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:36.797567  8458 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 1224) took 1058 ms. Trace:
I20260709 13:03:36.821635  9296 rpcz_store.cc:276] 0709 13:03:35.588077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.588194 (+   117us) service_pool.cc:224] Handling call
0709 13:03:35.588527 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.394992 (+806465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.791762 (+396770us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b54004b9954. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:36.792045 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1851809536}
W20260709 13:03:36.824281  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.825027  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:36.822852  8458 rpcz_store.cc:276] 0709 13:03:35.739060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.739590 (+   530us) service_pool.cc:224] Handling call
0709 13:03:35.739898 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.373992 (+634094us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.374021 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:36.374085 (+    64us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:36.374114 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.797239 (+423125us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b54000d34d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:36.797313 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.797489 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1457831168}
I20260709 13:03:36.797387 14171 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:36.829975  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:36.831907  8385 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 19.
I20260709 13:03:36.801309 14462 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:36.796294 14313 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:36.846743  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 222887us
I20260709 13:03:36.848858  8500 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:36.849895 14313 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:36.851267  8500 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:36.852051 14313 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:36.856178  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:36.856415  8500 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:36.857468  8386 raft_consensus.cc:2393] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 17: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:36.857504 14050 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:03:36.858253  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.859678  9258 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:36.860989 14479 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:36.861030  9258 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:36.861526 14479 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.861937 14479 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:36.862087 14118 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:36.862701 14118 raft_consensus.cc:697] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:36.863648 14118 consensus_queue.cc:237] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.865957  8533 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:03:36.867271  9260 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:36.870344 14465 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:36.871064 14465 raft_consensus.cc:697] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:36.872130 14465 consensus_queue.cc:237] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.874470  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:36.915084  9287 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 16: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:36.875396  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:36.874173 14479 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.876047  8349 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:36.917297  8349 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:36.917505  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:36.918111  8456 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:36.918452  8349 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:36.919461 14303 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:36.919520  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:36.920225 14303 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:36.920603 14303 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.920989 14303 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:36.921613 13881 raft_consensus.cc:3055] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:36.922009 13881 raft_consensus.cc:740] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:36.922780 13881 consensus_queue.cc:260] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.923938 13881 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:36.852066 14495 raft_consensus.cc:3055] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:36.925491 14495 raft_consensus.cc:740] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:36.925611 14466 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:36.926215 14466 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:36.928092  8501 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:36.879168  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:36.881925  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:36.884802  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:36.885159 14335 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:36.958096  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:36.887553  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:36.958680  8501 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:36.960278  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:36.887974  8427 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:36.890138 14386 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.893419  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:36.894366  9290 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:36.897423  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:36.898391  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:36.969365  8383 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:36.902796 14462 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.903811  8453 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:03:36.967737  8501 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:36.907284  8271 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 455c5d2786974d92a3ee8b825edcfaa7 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d653e71832b7402b9a03b46249d3b885 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:36.907325  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 1366) took 1078 ms. Trace:
I20260709 13:03:36.907640  8452 raft_consensus.cc:1275] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:03:36.909124 14521 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.170s	user 0.004s	sys 0.000s
I20260709 13:03:36.941692  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:36.951323  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:36.951303  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.963164  8385 raft_consensus.cc:2410] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 21 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
W20260709 13:03:36.963208  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 75346.2us
I20260709 13:03:36.976492  9289 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
I20260709 13:03:36.978395  8427 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:36.979205  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:36.979560  8427 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:36.965655  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:36.848449 14285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.011s	sys 0.004s
I20260709 13:03:36.967058  8461 raft_consensus.cc:2393] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 12: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:36.982877  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:36.965166  9261 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:36.905378 14461 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:36.972741  8271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 65510.4us
I20260709 13:03:36.972733  8531 rpcz_store.cc:276] 0709 13:03:35.828506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.828675 (+   169us) service_pool.cc:224] Handling call
0709 13:03:36.445666 (+616991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.445863 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.445890 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:36.445935 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:36.445966 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.446019 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.907147 (+461128us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b5400097750. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:36.907270 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1390816512}
I20260709 13:03:36.983983  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:36.984308  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:36.984304  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:36.988104  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:36.997834  9293 raft_consensus.cc:2393] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 20: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:36.988505 14513 consensus_queue.cc:1048] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:03:36.989059 14479 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:36.989212 14379 consensus_queue.cc:1059] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:37.001201  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:03:36.992565 14523 log.cc:927] Time spent T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:03:36.993461 14303 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:36.994105 14463 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:37.020315  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:37.020682  8455 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:03:36.926362 14495 consensus_queue.cc:260] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.994608 14493 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:36.995078 14373 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:36.978030 14462 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:36.997917  8351 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:37.001365  8533 raft_consensus.cc:1240] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:37.058552 14434 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:37.058669  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 60835us
I20260709 13:03:36.991695 14064 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:37.059643 14462 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:36.970158 14186 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:37.064985  8427 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:37.066044 14317 consensus_queue.cc:1059] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:37.059706  8351 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:37.068338 14435 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:37.068776 14435 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:37.069290 14435 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:37.074302 14438 consensus_queue.cc:1048] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:37.075826 14438 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:37.079612 14516 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:37.080219 14516 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:37.080315 14496 raft_consensus.cc:3055] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:37.017784  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:37.019055  9292 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:37.019055  8453 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:36.981256 13909 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:36.994303 13560 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.023732  8529 raft_consensus.cc:1240] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:37.031386  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:37.082824 13560 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:37.032114  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:37.027424 14318 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:03:37.027496 14514 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:03:36.995754 14378 consensus_queue.cc:1059] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.042s
I20260709 13:03:37.000499 14461 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:37.023309 14366 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:37.038462 14303 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:37.038954 14495 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:37.023860 13870 consensus_queue.cc:1059] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:03:37.040753  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:37.041844 14493 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.975674 14386 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:37.053319 14431 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:37.088750 13909 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:37.123884  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:37.057669 14199 raft_consensus.cc:993] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:03:37.003998  8527 raft_consensus.cc:2393] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 12: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:03:36.982714 14285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.011s	sys 0.004s
W20260709 13:03:37.081205  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:37.136847  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.088129  8453 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:37.089274  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:37.087342  8501 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:37.090142  8531 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:37.080720 14516 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:37.094611 13560 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:37.142814  9291 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:03:37.143254  8527 raft_consensus.cc:1275] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:37.098500  8351 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:37.110374  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:37.080819 14496 raft_consensus.cc:740] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:37.114178  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:37.115249  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:37.145568 13560 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:37.146070 13560 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.146437 13560 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:37.119922  8528 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:03:37.121392  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:37.125535  8426 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:37.084578  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:37.148051  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 49629.7us
W20260709 13:03:37.138870  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 51561.9us
I20260709 13:03:37.140214  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:37.149677  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:37.150076  8533 raft_consensus.cc:2393] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 12: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:37.150333  8526 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
I20260709 13:03:37.150388  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:37.151167  8531 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:03:37.113356 14493 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:37.210858  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 50667.5us
I20260709 13:03:37.113272 14373 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:37.218092  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 52051.4us
I20260709 13:03:37.220432  8526 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:03:37.220932  8526 pending_rounds.cc:85] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 12
I20260709 13:03:37.221269  8526 pending_rounds.cc:107] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:03:37.221568  8526 raft_consensus.cc:2889] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:37.214792  8383 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:37.216388  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:37.217345  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:37.133116 13909 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:37.228423  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:37.237915  8531 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 20.
I20260709 13:03:37.239848  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:37.240872  8526 raft_consensus.cc:2393] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 20: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:37.149322 14057 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:03:37.212337 14507 log.cc:927] Time spent T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:03:37.151983 14441 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.244918  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:37.245380  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:37.258631  8377 raft_consensus.cc:3060] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:37.211740 14050 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:03:37.266104  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 201180us
I20260709 13:03:37.229230 14303 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:37.250140 14483 log.cc:927] Time spent T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:03:37.262635 14057 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.228922 14461 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:37.288324  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:37.295917  8386 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:03:37.299701  8377 raft_consensus.cc:2468] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 20.
W20260709 13:03:37.281106  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 126929us
I20260709 13:03:37.289180 13560 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:37.301451  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:37.228819 14431 consensus_queue.cc:1059] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:03:37.281807 14442 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.250154 14512 consensus_queue.cc:1059] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:03:37.285812 14318 raft_consensus.cc:1081] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:03:37.303136 14057 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:37.241391 14373 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:37.314635 13560 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:37.315328  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 160859us
I20260709 13:03:37.326148  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:03:37.330090  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 103302us
I20260709 13:03:37.267235 14441 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:37.316613 14514 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:03:37.354967 14531 log.cc:927] Time spent T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:03:37.357435  9288 raft_consensus.cc:1240] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:37.313309 14461 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:37.383993  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:37.409950  9288 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:37.360210 14186 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:37.352955 14366 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:37.324267 14442 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:37.318559 14463 consensus_queue.cc:1059] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:03:37.411739  8386 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:37.286196 14496 consensus_queue.cc:260] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:37.427284  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:37.384584  9261 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:37.332394 14460 consensus_queue.cc:1059] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 13:03:37.436077  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:37.445468  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 60949us
I20260709 13:03:37.467444  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:37.468248  8377 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:37.430756 14541 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:37.432884 14366 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:37.477114  8534 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 16.
W20260709 13:03:37.435276  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 196170us
I20260709 13:03:37.473909 14171 raft_consensus.cc:2804] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:03:37.492252 14529 log.cc:927] Time spent T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:03:37.493031 14533 log.cc:927] Time spent T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:03:37.407253 14118 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:03:37.498939  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:37.504673  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 177844us
I20260709 13:03:37.550212 14496 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:37.750335 14515 consensus_queue.cc:1059] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:37.751185 14118 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.751892 14118 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:37.753612  8424 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:37.711314 14513 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.478452 14386 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:37.476158 14514 raft_consensus.cc:697] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:37.733991 14421 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:37.606199  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:37.652619 14537 log.cc:927] Time spent T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 13:03:37.736287  8457 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
W20260709 13:03:37.743602 13870 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.007s	sys 0.035s
W20260709 13:03:37.647466  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 149622us
I20260709 13:03:37.500499 14547 consensus_queue.cc:1059] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.266s
I20260709 13:03:37.499012 14541 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:37.731391  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:37.817101  8532 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:37.808441  9258 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:37.805825 14118 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:37.771981 14545 log.cc:927] Time spent T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:03:37.766417 14379 raft_consensus.cc:3055] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:03:37.829885  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 117491us
W20260709 13:03:37.803120 14335 consensus_meta.cc:287] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.819s	user 0.005s	sys 0.006s
W20260709 13:03:37.802325 14535 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:03:37.838881  8500 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:37.844892  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:37.816483 13870 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.007s	sys 0.035s
I20260709 13:03:37.807873 14542 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:37.865792  8526 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:03:37.842850 14057 consensus_meta.cc:287] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.519s	user 0.013s	sys 0.000s
I20260709 13:03:37.849659 14470 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:37.871668 14057 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:37.849516 14313 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:37.873410  8528 raft_consensus.cc:2393] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 18: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:37.863708  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 3125) took 1007 ms. Trace:
W20260709 13:03:37.848953 13909 consensus_meta.cc:287] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.001s
I20260709 13:03:37.831943 14459 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.779042 14513 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:37.885736  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:37.839550 14379 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:37.850034 14336 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.850455 14373 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:37.875149  8535 rpcz_store.cc:276] 0709 13:03:36.855925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.895256 (+ 39331us) service_pool.cc:224] Handling call
0709 13:03:36.895612 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.895971 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.895996 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:36.896527 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:03:37.085233 (+188706us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:37.085272 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.085335 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:37.863456 (+778121us) raft_consensus.cc:1685] finished
0709 13:03:37.863484 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:37.863637 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2881,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":185816,"threads_started":1,"wal-append.queue_time_us":392109}
W20260709 13:03:37.880419 14434 consensus_meta.cc:287] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.821s	user 0.010s	sys 0.009s
I20260709 13:03:37.816486 14421 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:37.904819  8532 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 18.
I20260709 13:03:37.885653 13896 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:37.908667 14564 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:03:37.916579 14057 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:37.891413 14514 consensus_queue.cc:237] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:37.918938  8530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 3122) took 1063 ms. Trace:
I20260709 13:03:37.919335  8530 rpcz_store.cc:276] 0709 13:03:36.855060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.862284 (+  7224us) service_pool.cc:224] Handling call
0709 13:03:36.862655 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.862980 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.863012 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:36.863437 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:03:37.186110 (+322673us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:37.186152 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.186220 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:37.918714 (+732494us) raft_consensus.cc:1685] finished
0709 13:03:37.918736 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:37.918866 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1405,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":322263,"threads_started":1,"wal-append.queue_time_us":980958}
I20260709 13:03:37.898468 14461 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:37.921211 14434 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:37.902275  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 55537.1us
W20260709 13:03:37.917573 14516 consensus_meta.cc:287] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.000s
I20260709 13:03:37.866112 14171 raft_consensus.cc:697] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:03:37.915282  9288 consensus_meta.cc:287] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.003s
I20260709 13:03:37.925293  9288 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 18.
I20260709 13:03:37.921898 14541 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:37.923699  8500 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:37.934983  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:37.884900 14465 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:03:37.885603 13909 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:37.891239 14459 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:37.927673 14386 raft_consensus.cc:2764] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 13:03:37.926414 14442 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:37.946997 13981 raft_consensus.cc:3055] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:37.943854  8500 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:37.902933 14336 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:37.909250 13896 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:37.943390 14495 consensus_meta.cc:287] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.834s	user 0.011s	sys 0.000s
I20260709 13:03:37.942219 14335 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:37.934816 14403 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:37.990233  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 47891.4us
I20260709 13:03:37.988802  9260 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:37.925725 14516 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:37.996668 14057 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:38.006431 14513 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:37.985841 14171 consensus_queue.cc:237] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.014688 14575 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
W20260709 13:03:38.017364 14555 log.cc:927] Time spent T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:03:38.018201 13909 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:38.019730 14479 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:38.021441 13896 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:38.022202 14571 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.022781 14571 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.030642 14516 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:38.025036 14571 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:38.031749 14435 consensus_meta.cc:287] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.962s	user 0.008s	sys 0.003s
I20260709 13:03:38.032240 14435 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.034592 14435 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:37.994221 13981 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:38.037846 13981 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.040164 13981 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:38.051607 14493 consensus_meta.cc:287] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.821s	user 0.007s	sys 0.006s
W20260709 13:03:38.221220  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 232473us
I20260709 13:03:38.050565 14366 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:38.253276  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 253977us
W20260709 13:03:38.288098  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:38.294888  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 47824.3us
I20260709 13:03:38.246106 14515 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.255849 14313 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:38.219550 14493 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.325911  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:03:38.327608  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 373146us
I20260709 13:03:38.256922 14578 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.328469  9288 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:38.333180  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:38.334504  8460 pending_rounds.cc:85] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: Aborting all ops after (but not including) 8
I20260709 13:03:38.334837  8460 pending_rounds.cc:107] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:03:38.335067  8460 raft_consensus.cc:2889] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:38.336876  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:38.337293  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:38.337530  8457 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:38.337918  8453 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:03:38.339329  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:38.340636  9288 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:38.254347 14118 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
I20260709 13:03:38.302205 14552 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:38.348253 14577 log.cc:927] Time spent T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:03:38.322206 14575 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.299906 14571 consensus_queue.cc:1059] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:03:38.354527  8500 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:38.355494  8458 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:03:38.364326  8500 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:38.431114 14442 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:38.434484 14442 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.434952 14442 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:38.438277 14366 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:38.366468 14552 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.334300 14578 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.332798 14373 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.100s
I20260709 13:03:38.431638 14513 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:38.446260 14513 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.446636 14513 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:38.425207 14575 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.451560 14575 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:38.452348  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:38.452873  8453 raft_consensus.cc:2393] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 12: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:38.433444 14317 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:03:38.455704  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.462442  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:38.463193  8459 raft_consensus.cc:2410] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:03:38.431476 14064 raft_consensus.cc:3055] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:38.445752 14582 raft_consensus.cc:3055] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:38.464424 14064 raft_consensus.cc:740] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:38.486233 14064 consensus_queue.cc:260] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.487675 14064 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:38.328045 14515 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.445693 14552 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:38.489617 14313 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:38.493974 14313 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.497545 14313 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:38.466602 14575 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:38.457336 14317 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.478663 14582 raft_consensus.cc:740] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:38.500535 14442 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.517169 14442 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:38.517782 14515 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:38.524602 14578 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:38.504096 14575 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.525604 14493 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:38.537844  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:38.538738 14575 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:38.540489 14493 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:38.541229 14493 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.543444 14493 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:38.544842 14493 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:38.545441 14493 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.547637 14493 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:38.545812 14317 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:38.549877 14118 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.550516  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:38.550877  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:38.550808 14118 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.551149  8459 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:03:38.521404 14582 consensus_queue.cc:260] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.554386 14118 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:38.557927 14582 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:38.560247  8459 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
W20260709 13:03:38.551914 13981 consensus_meta.cc:287] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.510s	user 0.005s	sys 0.006s
I20260709 13:03:38.567468 14199 raft_consensus.cc:3055] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:38.575246  8500 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:38.572053  8458 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36448 (request call id 2621) took 1558 ms. Trace:
I20260709 13:03:38.578636  8458 rpcz_store.cc:276] 0709 13:03:37.014162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.014334 (+   172us) service_pool.cc:224] Handling call
0709 13:03:37.017046 (+  2712us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:38.363959 (+1346913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.571766 (+207807us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540015b8d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:38.571985 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3073622400}
W20260709 13:03:38.574540  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.584370  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:38.584957  8461 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:03:38.586115  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:38.586577  8452 raft_consensus.cc:3055] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:38.562999 14050 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:38.587000  8452 raft_consensus.cc:740] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:38.587653  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:38.590030  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:38.591037  8461 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
I20260709 13:03:38.590306  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:38.592065  8458 raft_consensus.cc:2410] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:03:38.591689  8455 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 22.
I20260709 13:03:38.589002  8452 consensus_queue.cc:260] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.595388  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:38.595839  8452 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:38.562183 14493 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:38.577912 14199 raft_consensus.cc:740] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:38.587334 14432 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:38.588622 14050 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:38.587340 13981 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:38.629375  8383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3694) took 1353 ms. Trace:
I20260709 13:03:38.630349  9260 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:38.601279 14199 consensus_queue.cc:260] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.603505 14552 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:38.586925 14575 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:03:38.601928 14118 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:38.633879 14580 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:38.634868 14571 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.635540 14373 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:03:38.640070  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.656071 14293 raft_consensus.cc:3055] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:38.664034 14118 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.666981  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:38.667423  8501 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:38.668092  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2737) took 1277 ms. Trace:
I20260709 13:03:38.664621  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:38.665336 14293 raft_consensus.cc:740] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:03:38.671111 14534 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.371s	user 0.004s	sys 0.000s
I20260709 13:03:38.670838 14293 consensus_queue.cc:260] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.671195 14462 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:38.672072 14293 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:38.671815 14462 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.672623  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2832) took 1237 ms. Trace:
I20260709 13:03:38.672886  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:38.675189 14441 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:38.675750 14441 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:38.665349  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:38.665835  9292 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:38.673025  8534 rpcz_store.cc:276] 0709 13:03:37.435451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.435714 (+   263us) service_pool.cc:224] Handling call
0709 13:03:38.672469 (+1236755us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b540024c554. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:38.672570 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25544576}
I20260709 13:03:38.666028  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:38.658401 14582 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:38.693646  9296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 1290) took 1825 ms. Trace:
I20260709 13:03:38.643988 14459 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:38.666093 14541 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:38.677291 14571 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.660055 14552 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.645982  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3695) took 1366 ms. Trace:
I20260709 13:03:38.646353 14513 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.666523 14580 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.715533 14562 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:38.720453 14513 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:38.720978 14562 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.721964 14580 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:38.662988 14373 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.653724  8383 rpcz_store.cc:276] 0709 13:03:37.276341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.276519 (+   178us) service_pool.cc:224] Handling call
0709 13:03:37.276968 (+   449us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:37.410095 (+133127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:37.410127 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:37.428290 (+ 18163us) log.cc:844] Serialized 52 byte log entry
0709 13:03:38.611288 (+1182998us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b180036e500. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c802d4bc 00007f36c537b48b 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b 00007f36c8024d23 00007f36c80250d1
0709 13:03:38.611536 (+   248us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:38.611592 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.611694 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:38.628994 (+ 17300us) raft_consensus.cc:1685] finished
0709 13:03:38.629010 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.629284 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6108,"raft.queue_time_us":34627,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":4138,"spinlock_wait_cycles":10476416,"thread_start_us":456745,"threads_started":2,"wal-append.queue_time_us":351880}
I20260709 13:03:38.649058  8452 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:03:38.657793  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:38.725997  9288 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 16: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:38.668452  8380 rpcz_store.cc:276] 0709 13:03:37.391182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.391336 (+   154us) service_pool.cc:224] Handling call
0709 13:03:37.391669 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.391884 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:03:37.392140 (+   256us) log.cc:844] Serialized 14 byte log entry
0709 13:03:38.667603 (+1275463us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b180039f9a0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c5312c0a 00007f36cea52219 00007f36c539aa40 00007f36c53954e4 00007f36c5395455 00007f36c847d060 00007f36c848f716 00007f36c84a0287 00007f36c84a0208
0709 13:03:38.667750 (+   147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:38.667795 (+    45us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:38.667859 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.667934 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.668043 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16202,"prepare.queue_time_us":15653,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":1277756,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":7204224}
W20260709 13:03:38.665596  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:38.663229  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.641251 14547 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:38.689728  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 1035) took 1333 ms. Trace:
I20260709 13:03:38.690712 13560 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.650933 14336 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:38.720008  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3696) took 1437 ms. Trace:
W20260709 13:03:38.742933  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.714609 14582 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.641891 14432 raft_consensus.cc:697] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:38.753803  8532 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:38.675670 14460 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:38.680652 14548 raft_consensus.cc:3055] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:38.712003  8500 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:38.693537 14466 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.703815 14435 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.705454 14461 consensus_queue.cc:1059] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.013s
I20260709 13:03:38.686599 14496 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:38.668809 14118 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:38.789376 14589 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:38.790060 14589 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.790560  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:38.778499 14462 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:38.782743 14591 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:38.793291 14591 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.794507 14549 consensus_queue.cc:1059] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:38.719429 14571 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:38.727860 13560 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.720166  9289 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:38.718737  8379 rpcz_store.cc:276] 0709 13:03:37.279960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.280142 (+   182us) service_pool.cc:224] Handling call
0709 13:03:37.280516 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:37.330736 (+ 50220us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:37.330767 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:37.349844 (+ 19077us) log.cc:844] Serialized 26 byte log entry
0709 13:03:37.499745 (+149901us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:37.499795 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.645578 (+1145783us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b54003dd1d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:38.645622 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:38.645680 (+    58us) raft_consensus.cc:1685] finished
0709 13:03:38.645694 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.645918 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27216,"raft.queue_time_us":18525,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":20951,"spinlock_wait_cycles":73118464,"thread_start_us":72707,"threads_started":1,"wal-append.queue_time_us":364857}
I20260709 13:03:38.750890 13881 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.715291  9296 rpcz_store.cc:276] 0709 13:03:36.868683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.878331 (+  9648us) service_pool.cc:224] Handling call
0709 13:03:36.878656 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:36.879046 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.879072 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:36.879669 (+   597us) log.cc:844] Serialized 52 byte log entry
0709 13:03:37.143780 (+264111us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:37.143815 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.143873 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:38.670802 (+1526929us) spinlock_profiling.cc:243] Waited 6.57 ms on lock 0x7b24002e5608. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c521e9c4 00007f36c521cacb 00007f36c53d7dc9 00007f36c53d7a55 00007f36c53d709d 00007f36c800910e 00007f36c802088c 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221
0709 13:03:38.678795 (+  7993us) raft_consensus.cc:1685] finished
0709 13:03:38.678817 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.693583 (+ 14766us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1531,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"spinlock_wait_cycles":15100800,"thread_start_us":263735,"threads_started":1,"wal-append.queue_time_us":1210194}
I20260709 13:03:38.727680  8381 rpcz_store.cc:276] 0709 13:03:37.356079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.373699 (+ 17620us) service_pool.cc:224] Handling call
0709 13:03:37.399907 (+ 26208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.400147 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:03:37.538783 (+138636us) log.cc:844] Serialized 14 byte log entry
0709 13:03:38.689343 (+1150560us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:38.689397 (+    54us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:38.689443 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.689527 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.689657 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":990751,"prepare.queue_time_us":41760,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":1847,"raft.queue_time_us":980723,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":7000,"thread_start_us":130399,"threads_started":1}
I20260709 13:03:38.797453 13881 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.744660  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:38.798245 13560 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:38.761369 14515 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:38.799153 14515 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.799564  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:38.799887 13881 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:38.749785  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:38.604550 13981 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.801666  8533 raft_consensus.cc:2393] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 15: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:38.796690 14496 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.802516  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:38.802968  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:38.803591 13981 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:38.803674  8461 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 18.
I20260709 13:03:38.727478  8452 pending_rounds.cc:85] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12: Aborting all ops after (but not including) 11
I20260709 13:03:38.741735  8385 rpcz_store.cc:276] 0709 13:03:37.283051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.283224 (+   173us) service_pool.cc:224] Handling call
0709 13:03:37.311907 (+ 28683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.442620 (+130713us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:03:37.442879 (+   259us) log.cc:844] Serialized 14 byte log entry
0709 13:03:38.673247 (+1230368us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:38.673299 (+    52us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:38.673343 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.719776 (+ 46433us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54003b7c54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:38.719831 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.719945 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1255007,"prepare.queue_time_us":42577,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":1242492,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":7827,"spinlock_wait_cycles":299801472}
I20260709 13:03:38.717559 14541 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.756047  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:38.806704 14541 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:38.759143 14057 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:38.807154  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:38.807458 14057 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.759931 14180 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:38.760470  9261 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:38.808473 14180 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:38.808904  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 48528.7us
I20260709 13:03:38.809589 14057 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:38.760397 14442 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:38.762538  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:38.810297 14442 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.770212  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:38.810900 14180 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:38.812011  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:38.812286 14442 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:38.762903  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 1.2831e+06us
I20260709 13:03:38.812647  8526 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:03:38.755563 14582 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:38.771124  8380 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:03:38.813985  8380 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:38.814366  8380 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:38.814949  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:38.695773 14199 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:38.770654  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:03:38.772827  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 60933.6us
I20260709 13:03:38.665974 14317 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.807955  8534 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:03:38.753847 14334 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.753352 14064 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:03:38.774622 14495 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:38.774952 14578 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:38.775475 14466 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.775933 14590 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.777865  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:38.832887 14461 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.781806  8378 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:38.719458 14552 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:38.716997 14366 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.835610 14462 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:38.784919  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:38.826305 14571 raft_consensus.cc:2764] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:03:38.603093 14493 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.857923  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:38.750692 14547 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.858556  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:38.859156  8379 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:38.743960  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:38.803234  8533 raft_consensus.cc:2393] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 23: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:38.804388  8452 pending_rounds.cc:107] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:03:38.714376 14441 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:38.860575  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:38.861611  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:38.862035  8533 raft_consensus.cc:2393] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 12: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:38.862998  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:38.863045  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:38.840543 14435 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.836246 14432 consensus_queue.cc:237] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.844650 14334 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.863880  8379 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:03:38.866067 14334 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:38.773447 14336 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:38.800891  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:38.818961  9258 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:38.819164  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:38.867071  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 48191.3us
I20260709 13:03:38.867154  9296 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:38.867194  8530 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:03:38.770547  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:38.740522 14556 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:38.868125  8531 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:38.826403  8424 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:38.868652  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:38.827600 14317 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.870342  8426 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:38.829638 14379 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.831274 14588 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.877400 14588 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.878942 14549 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:38.879432 14549 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.879787 14549 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:38.832571 14421 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:38.833263 14434 raft_consensus.cc:3055] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:38.881698 14434 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:38.882809 14434 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.884130 14434 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:38.834692 13560 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.885324 13560 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.835522 14373 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:38.850708 14495 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.871529 14441 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.888267 14495 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:38.835966 14431 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:38.889328 14441 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:38.861436 14462 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.858446 14366 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.760596 14335 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:38.835163 14554 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:38.761731 14548 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:38.847497 14578 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.893252 14335 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.894876 14554 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.872032 14541 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:38.896807 14515 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:38.898051 14548 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.899333 14548 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:38.899171 14050 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.843461  9260 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:38.846360  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:38.900709  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2826) took 1675 ms. Trace:
I20260709 13:03:38.900727  8535 raft_consensus.cc:1240] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:38.901608  8385 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:38.808010 14591 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:38.847862  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:38.778785  8383 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 13:03:38.846108  8380 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.773874 14285 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:03:38.848759  8458 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:03:38.804064 14496 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:38.852177  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:38.792405 14589 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:38.855011  8382 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:38.896765 14335 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:38.855576  8377 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:03:38.792327 14562 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:38.717257 14403 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:38.836395 14437 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:38.853137  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:38.925709  8378 raft_consensus.cc:2410] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 17 because replica has last-logged OpId of term: 16 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 14.
I20260709 13:03:38.860662  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:38.894438 14366 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:38.900689 14336 raft_consensus.cc:697] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:38.855907 14461 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.844228 14438 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:38.776834 14460 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.866218 14466 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:38.872155  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:38.873333  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:38.874547  8424 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:38.875082 14556 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.875872  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:38.876446 14571 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:38.908990 14386 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:38.853581 14590 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.976606  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:38.889056 14431 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:38.839567  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:38.892494 14303 raft_consensus.cc:3055] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:38.902575  8532 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:38.843075  8460 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
W20260709 13:03:38.984895  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 110389us
W20260709 13:03:38.901441  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 58077.7us
I20260709 13:03:38.870711  8349 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:38.904660  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:38.901638  8528 rpcz_store.cc:276] 0709 13:03:37.224997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.228135 (+  3138us) service_pool.cc:224] Handling call
0709 13:03:38.900524 (+1672389us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54000aad54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:38.900654 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481292672}
I20260709 13:03:38.907806 13560 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:38.907819  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:38.910354  8386 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:38.918586  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:38.915411  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:38.924125  8380 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:38.860989  8452 raft_consensus.cc:2889] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:38.926810  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:38.928867  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:38.910203 14552 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:38.915464 14582 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.933878 14462 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:38.934408 14554 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:38.911027 14580 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:03:38.937999  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.941323  8533 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:38.881769 14379 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:38.979807  8382 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:39.033011  8531 raft_consensus.cc:1240] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:38.846370  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:38.977325 14571 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.981221 14588 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:39.036242  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.018852  8500 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:03:39.020010  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 149372us
I20260709 13:03:38.944195 14589 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:39.022356  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:39.048583  8460 raft_consensus.cc:2410] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:03:38.984573 14303 raft_consensus.cc:740] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:39.017776  8377 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:39.023572 14495 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.016073  8381 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 21.
I20260709 13:03:39.022720 13560 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:39.024283  8529 raft_consensus.cc:2410] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:03:39.018793  8383 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:03:39.025832  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:38.978025 14595 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.034462  9291 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:39.017715  9294 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 21: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:39.060743  8456 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:03:39.020290  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:39.062074  8455 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:38.931772 14403 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.043440  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.021775  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.053776  8452 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:03:39.016309 14541 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:38.985848  9260 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
W20260709 13:03:39.033835 14546 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:03:39.057686  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:39.038447  8349 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:39.022392 14466 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:39.075225 13560 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:39.075729  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 89981.9us
I20260709 13:03:39.071235  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.078368  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.079205  8529 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:39.079850  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:39.080420  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.032706 14580 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.038618 14571 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:38.976902 14438 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:39.095793  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 57475.9us
I20260709 13:03:38.985113 14386 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:38.935495 14437 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.086246 13560 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:39.104914  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:39.104498 13560 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.105610  8459 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:39.108917  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:39.057518 14588 consensus_queue.cc:1048] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:03:39.093192  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.112437  8526 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
I20260709 13:03:39.091135  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.097712  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:39.113369  8531 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:39.113560  8452 raft_consensus.cc:2393] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 15: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:39.077998  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:39.097819  8349 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:39.082433  8529 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:39.109596  8459 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:03:39.100049  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:39.100376  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:39.115617  8458 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:39.091113 14580 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:39.092988 14171 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:39.084424 14335 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:39.033911 14552 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:39.116948  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 61810.6us
I20260709 13:03:39.117656  8349 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:39.118734  8379 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:39.068795 14589 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.125604  9260 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:39.142182 13560 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:39.144163  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:39.070483 14495 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.151111  8384 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:39.162122 13560 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:39.163376  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 45853.8us
I20260709 13:03:39.165036  8349 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:39.090246 14466 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.170871  8349 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:39.170192 14554 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:39.172595 14431 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:39.167203 14432 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:39.173462 14432 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.175503 14582 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:39.176463 14403 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:39.177862 14552 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:39.178179 14461 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:39.170082 14118 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:39.075349 14595 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.178855 14432 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:39.179590 14590 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:39.180642 14595 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:39.181663  8526 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:39.182331 14437 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:39.182652  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.187135 14556 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:39.122258 14171 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:39.188995 14591 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:39.189356 14171 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:39.195240  8427 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:39.198132 14541 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:39.195281 14386 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:39.205245 14495 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:39.206636 14589 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:39.205283  8460 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
W20260709 13:03:39.207819  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.110798 14435 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:39.116532 14462 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:39.210290  8452 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:39.206475  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.210812  8349 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:39.196941  8427 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:39.212518  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:39.215086  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:39.215835  8460 raft_consensus.cc:2410] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:03:39.213847  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:39.216112  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:39.216441  8461 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:39.064033 14336 consensus_queue.cc:237] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.107594 14293 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:03:39.124153 14180 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:39.238814  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:39.109508 14599 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.118s
I20260709 13:03:39.236888 14495 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:39.246021  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:39.235253  8461 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 19.
I20260709 13:03:39.233490  8427 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:39.249521 14317 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:39.110843 14303 consensus_queue.cc:260] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.238503 14462 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:39.255724  9260 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:39.261651 14303 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:39.262109 14596 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:03:39.235044  8349 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:39.255735 14317 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:39.262727 14317 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.263147 14317 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:39.254750  8427 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:39.265810 14462 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:39.266355 14462 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.266884 14050 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:39.267153  8455 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:03:39.268468 14462 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:39.269934  8458 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:39.277436  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.278223  8381 raft_consensus.cc:2393] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 15: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:39.278337  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.278945  8380 raft_consensus.cc:2468] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:39.281454  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:39.282114  8383 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:39.282327  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 47412.2us
I20260709 13:03:39.275444 14588 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:39.283490 14588 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.273242 14512 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:39.284673 14512 raft_consensus.cc:697] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:39.285568 14466 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:39.282891 14462 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:39.285574 14588 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:39.285871 14512 consensus_queue.cc:237] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.287215  8349 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:39.290437 14462 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:39.291689 14493 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:39.242856 14599 consensus_queue.cc:1243] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer b8eb0ad4490645598004d862412f4e31 log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:03:39.292141  8349 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:39.289305 14317 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.247885 14495 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:39.296077 14495 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:39.296566 14599 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:39.297108 14599 raft_consensus.cc:697] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 18 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:39.297950 14599 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.301735 14438 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:37.764958  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:39.238165 14180 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:39.320679  8349 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:39.338948  8349 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:39.317986  8383 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:39.319160  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:39.340396 14438 raft_consensus.cc:2804] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:39.341012 14438 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.341465 14438 raft_consensus.cc:3060] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:39.319711  8424 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:39.322516  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:39.349339  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 94736.6us
I20260709 13:03:39.350270  8427 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:39.352859  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.355435  8349 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:39.356482  8379 raft_consensus.cc:2393] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 19: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:39.356658  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:39.361279  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 91651.9us
W20260709 13:03:39.362613  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.363076  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.372248  8381 raft_consensus.cc:2410] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:03:39.364548  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.365474  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:39.345741 14180 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:39.379323  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.368742  8427 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:39.394706  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.395480  8385 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:03:39.352027 14547 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:39.357854 14462 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:39.422788  8500 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:39.401544  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.423753  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.423959  8379 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:03:39.424476  8377 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:03:39.432168  8384 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:03:39.401343  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.398742 14386 consensus_queue.cc:1059] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:03:39.436156 14386 raft_consensus.cc:3055] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:39.436512 14386 raft_consensus.cc:740] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:39.363329 14603 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:39.364404 14557 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:39.435497 14597 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:03:39.440932  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.444918  8530 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:39.439157  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:39.441740  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:39.445832  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 77178.8us
I20260709 13:03:39.447096  8427 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:39.452755  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.453405  8427 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:03:39.454721  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.455799  8455 raft_consensus.cc:1275] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:39.358260 14549 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.442905  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.393693 14588 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:39.399296 14318 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:39.455093  8500 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:39.469722  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:39.463301  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.443334  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.462468  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.470816  8378 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:39.442523  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.472136  8384 raft_consensus.cc:2393] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 13: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:39.473711  8427 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:39.442416 14435 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.476053  8500 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:39.441906 14603 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:39.478998  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.454842 14432 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:39.477596  8427 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:39.479995  8380 raft_consensus.cc:2410] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:03:39.453251 14431 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:39.484697 14050 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:39.464418 14336 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:39.454566 14438 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.467020 14541 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:39.404412 14171 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.466892 14588 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:39.501359  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:39.501650  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.501778  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.502192  8386 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:39.502313  8380 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:39.467185 14515 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:39.494705  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.493340  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.488893 14432 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:39.470803 14578 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:39.512032  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.503275  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:39.477933 14575 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:39.479103 14493 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:39.482448 13881 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:39.509727  8383 raft_consensus.cc:2393] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 17: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:39.481863 14603 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:39.483318 14435 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.510286  8385 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
I20260709 13:03:39.503088  8384 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 22: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:39.519349  8457 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
I20260709 13:03:39.520555  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.543987  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.513296 14432 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:39.521692  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.522047  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.496325 14541 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.531769  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.548853  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.532617  8386 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:39.493618 14336 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:39.505342 14588 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:39.534507  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.507328 14546 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:39.507135 14515 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:39.561100 14515 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:39.563330 14438 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:39.505211 14050 raft_consensus.cc:697] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:39.565891 14050 consensus_queue.cc:237] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.543648 14547 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.569433 14547 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.570914 14571 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.555630 14546 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:39.572870 14546 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:39.496403 14431 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.540599  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.574849  8530 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:39.461935 14386 consensus_queue.cc:260] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.544837  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.590293  8529 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 19: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:39.545116  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.521375  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.550246  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:03:39.550580  9261 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.626s (SENT) [suppressed 11 similar messages]
I20260709 13:03:39.592655  8528 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:39.531190 14575 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:39.504932 14403 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:03:39.533301 14493 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:39.556330  8535 pending_rounds.cc:85] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 8
I20260709 13:03:39.599576  8535 pending_rounds.cc:107] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:03:39.599963  8535 raft_consensus.cc:2889] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:39.593672  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:39.601794  8531 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:39.548300 14317 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:39.554179 14541 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:39.555934 14336 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:39.576617 14571 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:39.615564  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.626417 14336 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.627530 14495 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.628788 14336 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:39.630081 14171 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:39.630800 14431 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:39.597430 14575 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:39.634155  8528 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
W20260709 13:03:39.635924  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 85360.6us
I20260709 13:03:39.605240 14493 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:39.640872 14580 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.635637 13881 raft_consensus.cc:697] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:39.645531 14495 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:39.644208 14435 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:39.650995 14180 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.655527 14180 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:39.655953 14541 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.657429 14575 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.658010 14432 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.658831 14546 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.634550 14603 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.662037 14432 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:39.661999 14575 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:39.659017 14493 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.662680 14580 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:39.668376 14493 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:39.665185 14603 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:39.664301 14546 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:39.665963 14515 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.669739 14588 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.671419 14588 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:39.671523 14515 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:39.673679 13881 consensus_queue.cc:237] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.674315 14541 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:39.719291  8377 raft_consensus.cc:2393] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 18: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:39.513916  8380 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:39.722424  8378 raft_consensus.cc:2410] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:03:39.720141  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.724519  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.725646  8381 raft_consensus.cc:2468] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:03:39.542645  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.727909  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:39.722002  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.730141  8384 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 23.
I20260709 13:03:39.731714  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.733351  8385 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 22: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:39.734719  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:39.735584  8426 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:39.736375  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:39.740375  8385 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:03:39.743059  8427 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:39.739429  8381 raft_consensus.cc:1275] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:39.744949  8427 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:39.746742  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:39.753005  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.763533  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:39.765420  8526 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:39.767900  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:39.769508  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:39.771154  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.772044  8526 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 19.
I20260709 13:03:39.773175  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:39.773803  8526 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:39.761024  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:39.778136  8379 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:39.778838  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:39.780421  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:39.780689  8385 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 19.
I20260709 13:03:39.781967  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:39.783334  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:39.784080  8527 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
I20260709 13:03:39.785916  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:39.784797  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:39.796314  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:39.801815 14171 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:39.802915  8457 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36448 (request call id 2633) took 1359 ms (client timeout 1540 ms). Trace:
W20260709 13:03:39.803665  8457 rpcz_store.cc:269] 0709 13:03:38.443837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.452100 (+  8263us) service_pool.cc:224] Handling call
0709 13:03:39.802392 (+1350292us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540019d2d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:39.802659 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2389680512}
I20260709 13:03:39.807236  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:39.815613  8381 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 21.
I20260709 13:03:39.818958  8379 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
I20260709 13:03:39.824043  8500 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:39.826246  8427 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:39.828403 14432 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.854923  8526 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:39.863354  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:39.866048  8385 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:39.869287  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:39.873963  8380 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
W20260709 13:03:39.877600  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 55934.6us
I20260709 13:03:39.878964  8427 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:39.879297 14620 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:39.879983 14620 raft_consensus.cc:697] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:03:39.878978  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 133723us
I20260709 13:03:39.881820  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:39.882827 14466 raft_consensus.cc:2764] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:03:39.883132  8351 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:39.884346 14557 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.885625 13981 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:39.886374 13981 raft_consensus.cc:697] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 21 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:39.885195 14557 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.889600  8457 raft_consensus.cc:1240] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:39.890588  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:39.891672 14557 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:39.891896  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:39.893270  8427 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:39.895030 14546 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:39.895685 14546 raft_consensus.cc:697] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:39.897635  8380 raft_consensus.cc:1240] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:39.895768 14557 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:39.900315 14588 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:39.901746  8351 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:39.902837 14588 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:39.903520 14588 raft_consensus.cc:697] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 12 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:39.905325 14578 consensus_queue.cc:1059] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:39.905830  8453 raft_consensus.cc:1217] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Deduplicated request from leader. Original: 14.12->[15.13-15.13]   Dedup: 15.13->[]
I20260709 13:03:39.906440  8453 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:03:39.906906 14515 raft_consensus.cc:3055] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:39.907342 14515 raft_consensus.cc:740] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:39.893630  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:39.887959 13981 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.894234 14575 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.913662  8385 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:39.910390 14557 raft_consensus.cc:697] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:39.904834 14588 consensus_queue.cc:237] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.916685 14515 consensus_queue.cc:260] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.916937 14557 consensus_queue.cc:237] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.918058 14515 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:39.921367  8379 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:39.923244  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:39.924373  8457 raft_consensus.cc:2410] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:03:39.929463  8427 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:39.802908 14171 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.939396  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:39.829458 14432 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.931484  8349 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:39.939355  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:39.948871  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.949122 14603 consensus_queue.cc:1059] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 13:03:39.949807  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:39.950601 14603 raft_consensus.cc:3055] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:39.950956 14180 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:39.951570 14180 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:39.951980 14180 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:39.957156  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.960687 14493 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:39.961287 14493 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.961661 14493 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:39.964708 14575 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:39.967549 14575 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:39.970203 14620 consensus_queue.cc:237] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:39.951056 14603 raft_consensus.cc:740] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:39.976111  9258 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:39.986059  8424 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:39.951571 14541 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:40.001427 14541 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:40.002043 14541 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:39.995144  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:40.012085 14432 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:39.999204 14460 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:40.021657 14334 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.017264  8379 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:40.029274  8424 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:40.031081  8424 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:39.911581 14546 consensus_queue.cc:237] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:40.012550 14171 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:40.033907  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 160689us
I20260709 13:03:40.037827  8455 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 22.
I20260709 13:03:40.041774  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:40.049144 14604 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:40.049784 14604 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:40.050196 14604 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:40.050565  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:40.051043  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:40.053217 14199 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:40.053751 14199 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:40.054152 14199 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:40.056131 14619 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:40.056681 14619 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:40.057062 14619 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:40.060767  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:40.061790  9294 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:40.062135  8384 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:03:40.062543  8384 pending_rounds.cc:85] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 12
I20260709 13:03:40.062793  8384 pending_rounds.cc:107] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:03:40.063083  8384 raft_consensus.cc:2889] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:40.064150  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:40.065410  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 1400) took 1305 ms. Trace:
I20260709 13:03:40.068188  9287 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:03:40.060873  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:40.071676 14180 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:40.052649  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:40.065896  8534 rpcz_store.cc:276] 0709 13:03:38.759872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.096553 (+336681us) service_pool.cc:224] Handling call
0709 13:03:39.258113 (+161560us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:39.303911 (+ 45798us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.304036 (+   125us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:39.304637 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 13:03:39.425460 (+120823us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:39.425551 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.425646 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:39.788587 (+362941us) raft_consensus.cc:1685] finished
0709 13:03:39.788637 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.064875 (+276238us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54002b8c50. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:40.065182 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45280,"raft.queue_time_us":52608,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":370818304,"thread_start_us":117526,"threads_started":1,"wal-append.queue_time_us":228133}
I20260709 13:03:40.084756 14463 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:40.085798 14463 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:40.088599 13881 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:40.089452 13881 raft_consensus.cc:697] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:40.090821 13881 consensus_queue.cc:237] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:40.093187  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:40.096101 14386 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:40.098193 14603 consensus_queue.cc:260] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:40.099689 14603 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:40.100205 14462 raft_consensus.cc:2764] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:03:40.100057 13981 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:40.103470 13981 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:40.104904  8455 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:40.079056 14334 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:40.109059 13981 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:40.100754  8531 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
I20260709 13:03:40.114938  8424 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:40.115447  8349 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:40.116478 14462 raft_consensus.cc:2764] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:03:40.114703 14199 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:40.117432 14542 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:40.120539  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:40.120858  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:40.116955  8349 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:40.125577  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:40.076839 14171 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:40.125494  8454 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:40.140465  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:40.108947 14334 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:40.088619 14463 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:40.143539  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:40.141310  8424 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:40.146723  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:40.147361  9287 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:40.153614  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 23 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:40.154513  8460 raft_consensus.cc:2410] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 23 because replica has last-logged OpId of term: 21 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 16.
I20260709 13:03:40.154759  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:40.153016  9294 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 20.
I20260709 13:03:40.158136  9289 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:03:40.158584  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 182811us
I20260709 13:03:40.157176  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:40.168757  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:40.170768  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:40.170177  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:40.173542  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 23 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:40.174523  9291 raft_consensus.cc:2410] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 23 because replica has last-logged OpId of term: 21 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 16.
I20260709 13:03:40.172808  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:40.164948 14460 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:40.174525 14064 consensus_queue.cc:1059] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:03:40.181268 14050 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.181838 14549 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:40.181948 14050 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:40.182643 14549 raft_consensus.cc:3055] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:40.183051 14549 raft_consensus.cc:740] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:40.180999  9293 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 17: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
W20260709 13:03:40.184409  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 55458.7us
I20260709 13:03:40.178460  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:40.174983 14199 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:40.167769 14463 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:40.189950  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:40.194766  9287 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 21.
I20260709 13:03:40.202248 14050 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:40.203540 14547 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:40.205894 14629 log.cc:927] Time spent T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:03:40.208585  9292 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:40.209051 14604 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:40.301560  8501 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:40.302040 14604 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:40.212225 14636 log.cc:927] Time spent T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:03:40.215847  9287 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:40.302826  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:40.216542  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:40.304117  9293 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 21: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:40.303923  8501 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:40.212261 14493 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:40.218109  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:40.191262 14180 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:40.223855  9258 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:40.184116 14460 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:40.227599  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:40.193503 14541 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:40.232995 14335 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.233332  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:40.236358  9260 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:40.236497  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:40.236382 14293 consensus_queue.cc:1059] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:03:40.238222  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:40.193849  8349 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:40.250545  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 108186us
I20260709 13:03:40.255313 14619 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:40.259425 14318 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:40.259749  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:40.261986  8383 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:40.270813  8457 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 20.
I20260709 13:03:40.249480  8424 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:40.273167  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:40.274514  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:40.277683  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:40.283456 14632 log.cc:927] Time spent T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:03:40.286331  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:40.265396 14549 consensus_queue.cc:260] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:40.296962  8456 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:40.302599 14334 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:40.215847  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:40.323339  9291 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:40.317576  9295 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
W20260709 13:03:40.332655  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 108914us
W20260709 13:03:40.332198  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 146006us
W20260709 13:03:40.333937  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 148887us
I20260709 13:03:40.335143  8500 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:40.317445 14460 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:40.334199  9289 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:40.340273  8452 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:40.342212  8378 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
I20260709 13:03:40.330230 14335 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:40.355433  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 119227us
I20260709 13:03:40.347174 14546 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:40.341876 14432 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:40.360883  8427 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:40.359153  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:03:40.365612  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 61839.8us
I20260709 13:03:40.353145 14171 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:40.371913 14403 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:40.372486 14403 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:40.373050 14403 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:40.375934  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:40.376150 14619 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:40.378721 14495 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:40.379194 14495 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.379542 14495 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:40.381260 14580 raft_consensus.cc:3055] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:40.381718 14580 raft_consensus.cc:740] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:40.371758 14572 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:03:40.385733  8452 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
I20260709 13:03:40.350077 14603 consensus_queue.cc:1059] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
W20260709 13:03:40.390847  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.363269 14293 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:40.389410  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:40.344193 14180 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:03:40.387952  8426 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
W20260709 13:03:40.405993  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.407047  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:40.407543 14434 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:40.407761  9290 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:03:40.408064 14434 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.408528 14434 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:40.413211 14293 raft_consensus.cc:697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:40.414502 14293 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:40.416078  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:40.419433  8280 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59480 (request call id 205) took 20171 ms (client timeout 15000 ms). Trace:
I20260709 13:03:40.421105  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:40.424165  9291 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
W20260709 13:03:40.430238  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.431628  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:40.398836 14432 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:40.432596 14432 raft_consensus.cc:697] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:40.433943 14432 consensus_queue.cc:237] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:40.438064  8283 catalog_manager.cc:5697] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:40.443326 14493 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:40.447890  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:40.448695  8532 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
I20260709 13:03:40.450958  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:40.452075  8501 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:40.387403 14171 raft_consensus.cc:697] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:40.453884 14171 consensus_queue.cc:237] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:40.382781 14549 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:40.430334  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:40.470148  8527 raft_consensus.cc:2393] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 13: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:03:40.471073  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 83178.1us
I20260709 13:03:40.471997  8426 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:40.471161 14603 raft_consensus.cc:3055] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:40.471208  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:40.403483 14637 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:03:40.440850  8283 catalog_manager.cc:5697] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 11 to 13, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 13 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:03:40.472740 14546 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:40.478257  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:40.488977  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 74933.7us
I20260709 13:03:40.492751  8377 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:40.493686  8501 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:03:40.538758  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 45213.4us
I20260709 13:03:40.539644  8501 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:40.494061 14541 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:40.541687 14285 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:40.542110 14285 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:40.542516 14285 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:40.545274 14334 raft_consensus.cc:2764] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:03:40.494197  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:40.494793 14580 consensus_queue.cc:260] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:40.495512 13981 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.496035  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:40.546710 13981 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:40.547593  8501 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:40.497925  9291 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 22.
I20260709 13:03:40.506302  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:40.475221 14619 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:40.514662  8500 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:40.550305 14619 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.550787 14619 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:40.551553 14057 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:40.551955 14057 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.552286 14057 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:40.554365  8529 raft_consensus.cc:1275] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:40.497754 13881 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.487594 14546 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:03:40.510280 14599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.008s	sys 0.011s
W20260709 13:03:40.525632  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 52706.6us
I20260709 13:03:40.526719  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:40.481835 14603 raft_consensus.cc:740] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:40.534127  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:40.534629  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:40.569152  8383 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:40.569921  8454 raft_consensus.cc:2368] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14.
I20260709 13:03:40.570118  8501 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:40.582365  8382 raft_consensus.cc:1275] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:40.582844  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:40.583623  8384 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
W20260709 13:03:40.585558  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 74875.6us
I20260709 13:03:40.586972 14118 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.587512 14118 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:40.578258 13881 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:40.589540  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:40.591569 13881 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:40.592675  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:40.593418  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:40.593920  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:40.594079  8452 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 18.
I20260709 13:03:40.594683  8457 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 19: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:40.595122 14335 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:40.597366 14379 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:40.564328 14546 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:40.597420  8283 catalog_manager.cc:5697] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 8 to 14, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 14 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:40.563951 14599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.198s	user 0.008s	sys 0.011s
I20260709 13:03:40.605533  8501 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:40.489931 14495 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:40.606328  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:40.610596  8377 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:40.612596  8500 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:40.617681  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:40.618388  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:40.591722 14118 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:40.615124  8427 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:40.633158  9287 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:03:40.621297  8283 catalog_manager.cc:5697] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 11 to 14, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 14 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:40.633653  9287 pending_rounds.cc:85] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting all ops after (but not including) 10
I20260709 13:03:40.641180  9287 pending_rounds.cc:107] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:03:40.641492  9287 raft_consensus.cc:2889] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:40.651371  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 64901.6us
I20260709 13:03:40.611963 13981 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:40.615234 14180 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:40.655416  8453 raft_consensus.cc:1240] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:40.624966 14050 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:40.661463  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 48675.5us
I20260709 13:03:40.617549 14547 consensus_queue.cc:1048] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 13:03:40.419958  8280 rpcz_store.cc:269] 0709 13:03:20.247830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.265122 (+ 17292us) service_pool.cc:224] Handling call
0709 13:03:40.419162 (+20154040us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:33.694342 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:33.785636 (+ 91294us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:33.785698 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:03:33.785714 (+    16us) tablet.cc:662] Decoding operations
0709 13:03:33.787856 (+  2142us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:33.787975 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:33.788004 (+    29us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:03:33.876274 (+ 88270us) tablet.cc:701] Row locks acquired
0709 13:03:33.876332 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:03:33.876504 (+   172us) write_op.cc:270] Start()
0709 13:03:33.876651 (+   147us) write_op.cc:276] Timestamp: P: 1783602213876439 usec, L: 0
0709 13:03:33.876686 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:03:33.877671 (+   985us) log.cc:844] Serialized 9014 byte log entry
0709 13:03:35.047773 (+1170102us) spinlock_profiling.cc:243] Waited 7.62 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:35.479967 (+432194us) op_driver.cc:464] REPLICATION: finished
0709 13:03:35.840532 (+360565us) write_op.cc:301] APPLY: starting
0709 13:03:35.861369 (+ 20837us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:36.663560 (+802191us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:36.663602 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:36.856134 (+192532us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:36.856965 (+   831us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:03:36.857071 (+   106us) write_op.cc:312] APPLY: finished
0709 13:03:36.857829 (+   758us) log.cc:844] Serialized 204 byte log entry
0709 13:03:37.280817 (+422988us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:37.311798 (+ 30981us) write_op.cc:454] Released schema lock
0709 13:03:37.319976 (+  8178us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:37.323026 (+  3050us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:37.323060 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2106250,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":353288,"apply.run_cpu_time_us":107735,"apply.run_wall_time_us":1489426,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100359,"num_ops":23,"prepare.queue_time_us":553962,"prepare.run_cpu_time_us":38319,"prepare.run_wall_time_us":437791,"raft.queue_time_us":428494,"raft.run_cpu_time_us":74397,"raft.run_wall_time_us":308659,"replication_time_us":1603090,"spinlock_wait_cycles":17522944,"thread_start_us":1347746,"threads_started":5,"wal-append.queue_time_us":789377,"wal-append.run_cpu_time_us":28364,"wal-append.run_wall_time_us":3520739}]]}
I20260709 13:03:40.640640 14335 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:40.672394 14335 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:40.672784 14335 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.673740  8454 raft_consensus.cc:1240] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:40.673969  8453 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:40.675005  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:40.675324  8453 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:40.675745  8454 raft_consensus.cc:2368] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 19. Current term is 20.
I20260709 13:03:40.676182 14335 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:40.677313 14604 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:40.677788 14604 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.678135 14604 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:40.610321 14434 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:40.683033  8452 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:40.685935  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:40.612313 14599 consensus_queue.cc:1048] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:03:40.612071 14603 consensus_queue.cc:260] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:40.702999  8427 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:40.702694  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:40.697781  8283 catalog_manager.cc:5697] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:40.709769  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 97266.3us
I20260709 13:03:40.693819 14575 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:40.715205  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:40.715535  8424 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:40.719936  8454 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:40.721556  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:40.713551 14547 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:40.725534 14603 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:40.726886 14495 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:40.727701  8452 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:40.746446  8424 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:40.752519  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:40.756024  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:40.757758  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:40.758600  8385 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:40.759647  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:40.763768  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:40.771951  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:40.772670  8528 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:40.773325  8380 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:40.775359  8526 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:40.775496  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:40.774917  8424 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:40.784125  8534 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:40.752251 14547 raft_consensus.cc:697] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:40.786278  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:40.787081  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 71970.1us
I20260709 13:03:40.789017  8379 raft_consensus.cc:2368] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14.
W20260709 13:03:40.790149  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 100041us
I20260709 13:03:40.790829  8424 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:40.797434  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:40.766850 14050 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:40.807122  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:40.807013 14546 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:40.808108  8533 raft_consensus.cc:2368] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16.
I20260709 13:03:40.809391  8533 raft_consensus.cc:1275] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:40.811565  8533 raft_consensus.cc:3055] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:40.811880  8533 raft_consensus.cc:740] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:40.813485  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:40.784283 14620 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:03:40.814407  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.807044  8386 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:40.816372  8526 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:40.784816 14495 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:40.812682  8533 consensus_queue.cc:260] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:40.755811 14285 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:40.827152  8385 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 20.
I20260709 13:03:40.807013  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:40.832873  8527 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:40.834087  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:40.813370  8461 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 13.
I20260709 13:03:40.838354  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:40.839026  8381 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 23.
I20260709 13:03:40.840248  8381 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:40.841233  8427 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:40.800947 14515 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:40.842057  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:40.842761 14515 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:40.771224 14403 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:40.848039  8459 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:40.842787  8379 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:40.844549  8384 raft_consensus.cc:2368] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 18. Current term is 19.
I20260709 13:03:40.802521 14432 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:03:40.852128  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 246675us
I20260709 13:03:40.843336 14515 raft_consensus.cc:697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 20 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:40.858955  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:40.813198 14570 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:40.850790 14496 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:40.861496  8500 leader_election.cc:400] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14.
I20260709 13:03:40.862048  8500 leader_election.cc:403] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:03:40.796741 14578 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:03:40.866051  8533 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:40.861392  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:40.870291  9261 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:40.871232  8386 raft_consensus.cc:2368] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 19. Current term is 20.
I20260709 13:03:40.872782  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:40.882090  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 93758.5us
I20260709 13:03:40.853152 14599 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:40.916123  8384 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:03:40.917814  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 58105.4us
I20260709 13:03:40.858115 14317 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:40.925772  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:40.923926  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 93524.6us
I20260709 13:03:40.924945  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:40.947856  8453 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:40.922008 14496 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:40.919585 14334 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:40.951002 14373 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:40.951608 14373 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:40.944766  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:40.919596 14293 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:40.953827  8380 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 22: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:40.954186  8381 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 20: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:40.958029 14373 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:40.925271 14599 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:40.960475 14575 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:40.960879 14599 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:40.961107 14575 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:40.869963 14050 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:40.965481  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.967139  8535 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
W20260709 13:03:40.967935 14653 log.cc:927] Time spent T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:03:40.968271 14496 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:40.968353 14285 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:40.968535  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 132191us
W20260709 13:03:40.971788  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 47183.4us
I20260709 13:03:40.972312  8533 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:40.972641  8385 raft_consensus.cc:1275] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:40.917575 14434 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:40.944734 14658 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14.
I20260709 13:03:41.013127  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:41.020684  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:41.023204 14652 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:03:41.030148  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.030771 14050 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:41.031230 14580 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:41.032271  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:40.964361 14293 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:41.032902  8531 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:41.033015 14293 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:41.033459  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:41.020768 14515 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:41.037501 14650 log.cc:927] Time spent T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:03:41.038911 14460 consensus_meta.cc:287] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.679s	user 0.009s	sys 0.002s
I20260709 13:03:41.039422 14460 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:41.040306  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:41.040477  8531 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 20.
I20260709 13:03:41.040716 14546 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:41.041772  8533 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:03:41.046139  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.014448 14665 consensus_queue.cc:1059] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:03:41.051173  9261 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:41.051587 14549 consensus_meta.cc:287] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.000s
I20260709 13:03:41.041011  8385 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:03:41.018294  8383 raft_consensus.cc:2376] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17. Re-sending same reply.
I20260709 13:03:41.053833  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:41.056450  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:41.056823  8386 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:03:40.926069 14547 consensus_queue.cc:237] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:41.032549  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:41.057418  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:41.058112  8381 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:41.059978  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:41.102496  8459 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:41.102543  8454 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:41.105336  8379 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:03:41.105656 14512 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:41.111825  8455 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 19.
I20260709 13:03:41.113052  8459 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 19.
W20260709 13:03:41.068050 14619 consensus_meta.cc:287] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.000s
W20260709 13:03:41.072444  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 97337us
I20260709 13:03:41.075573 14660 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:41.085894  8452 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:03:41.087782 14571 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:41.088328  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:41.087814  9261 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:41.092121 14057 consensus_meta.cc:287] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.000s
I20260709 13:03:41.092403 14661 consensus_queue.cc:1059] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:41.093705 14599 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:41.094916 14462 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:41.053323 14335 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:41.100287  8453 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
W20260709 13:03:41.129391  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.129479  8456 raft_consensus.cc:2393] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 9: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:41.133450  8351 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:41.135810  8500 leader_election.cc:400] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 19. Current term is 20.
I20260709 13:03:41.136368  8500 leader_election.cc:403] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:03:41.147457 14647 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:41.127394 14619 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:41.151954  8500 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:41.132246 14057 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:41.150519 14434 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:41.191054  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 103310us
I20260709 13:03:41.195062  8501 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:41.195935 14057 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:41.141016 14462 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:41.196584 14057 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:41.197479  8527 raft_consensus.cc:2368] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14.
I20260709 13:03:41.198570 14619 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:41.199898  8458 raft_consensus.cc:2368] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16.
I20260709 13:03:41.153499 14460 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:41.154330 14661 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 19. Current term is 20.
I20260709 13:03:41.198828 14462 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:41.208127 14180 raft_consensus.cc:3055] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:41.205255 14335 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 24 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:41.207962 14050 raft_consensus.cc:3055] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:41.220173  8351 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:41.151985 14604 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:41.225651 14580 consensus_queue.cc:1048] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:03:41.218313 14050 raft_consensus.cc:740] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:41.236608 14460 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.237411 14460 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:41.239995 14460 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:41.243333 14050 consensus_queue.cc:260] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:41.245026 14050 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:41.245898 14673 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:41.246521 14673 raft_consensus.cc:697] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:41.247430 14673 consensus_queue.cc:237] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:41.218549 14180 raft_consensus.cc:740] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:41.259269  8533 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:41.228219 14434 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:41.262385  8533 raft_consensus.cc:1240] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:41.189471 14599 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:41.265645  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:41.266155  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:41.268503  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:41.269441  8460 raft_consensus.cc:2393] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 15: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:41.269507 14604 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:41.271090  8384 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:41.271431  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:41.271584  9261 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:41.275521  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:41.274360  9261 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:41.277261 14571 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:41.277959 14571 raft_consensus.cc:697] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:41.278307  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:41.278868 14571 consensus_queue.cc:237] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:41.285357  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 65305.3us
I20260709 13:03:41.286322  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:41.286983 14512 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:41.287724  8351 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:41.287742 14512 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:41.289114  8351 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:41.289320 14434 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:41.289884 14434 raft_consensus.cc:697] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 20 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:41.289918 14575 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:41.290984 14434 consensus_queue.cc:237] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:41.292410 14575 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:41.292745 14591 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:41.296734  8533 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 19.
I20260709 13:03:41.287859  9261 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:41.298667 14460 consensus_queue.cc:1059] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:41.299806  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:41.301287  8349 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:41.303375 14591 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:41.278409 14599 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:41.313900  8500 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:41.302758 14647 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:41.316686  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:41.317452  8456 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:41.316802  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:41.317791  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:41.319275  8453 raft_consensus.cc:1240] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:41.319334  8384 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:41.300158 14293 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:41.350554  8500 leader_election.cc:400] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16.
I20260709 13:03:41.351728  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:41.305442 14462 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:03:41.354547  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 51420.7us
I20260709 13:03:41.355587  9261 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:41.357609  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 68582.5us
I20260709 13:03:41.365985  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:41.366652  8526 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:41.352785 14575 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:41.377595  8351 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:41.376463  8427 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:41.367216 14462 raft_consensus.cc:697] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 19 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:41.370980 14386 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:41.387324  8457 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:41.379096 14575 raft_consensus.cc:697] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:41.373306 14578 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 13:03:41.372017 14546 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.021s
W20260709 13:03:41.397641  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 202642us
I20260709 13:03:41.376341 14335 consensus_queue.cc:1059] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:03:41.392251 13981 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:41.400430  8526 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:41.401333  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:41.416384 14460 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:41.416836 14460 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.417279 14460 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:41.417896  8351 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:41.413117  8535 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
W20260709 13:03:41.424494  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 69005.4us
I20260709 13:03:41.425910  8501 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:41.426813 14496 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:41.420145 14318 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.427192 14591 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:41.427847 14318 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:41.427465  9291 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:03:41.430208 14318 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:41.427459 14496 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:41.399076 14599 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:41.437227 14496 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:41.443672  9290 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:41.449781  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:41.450095  9291 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:41.453672  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:41.463621 14403 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:41.438159 13981 raft_consensus.cc:697] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:41.510792  8456 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:41.478652 14180 consensus_queue.cc:260] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:41.480898  8455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36446 (request call id 2655) took 1213 ms. Trace:
I20260709 13:03:41.442018 14334 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:41.483423 14435 raft_consensus.cc:3055] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:03:41.493920 14681 log.cc:927] Time spent T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.002s
I20260709 13:03:41.454851 14462 consensus_queue.cc:237] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:41.480825 14678 log.cc:927] Time spent T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:03:41.466711 14575 consensus_queue.cc:237] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:41.497123  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:41.498868  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:41.544061  8529 raft_consensus.cc:2410] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:03:41.500905 14293 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 23 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:41.502198  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:41.545557  9291 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:41.502604  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:41.503700  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:41.505921 14403 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:41.513262  8455 rpcz_store.cc:276] 0709 13:03:40.267972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.272442 (+  4470us) service_pool.cc:224] Handling call
0709 13:03:41.465471 (+1193029us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b54001e78d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:41.480841 (+ 15370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1799485312}
I20260709 13:03:41.512219  8500 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:41.538028  8424 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:41.541863  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:41.533540 14171 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.574394  8532 raft_consensus.cc:2368] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 23. Current term is 24.
I20260709 13:03:41.576838  8424 leader_election.cc:400] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16.
I20260709 13:03:41.577338  8424 leader_election.cc:403] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:03:41.578516  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:41.579140  9293 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:41.531697 14435 raft_consensus.cc:740] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:41.582016  8533 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:03:41.582911  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:41.518648 14578 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.063s
I20260709 13:03:41.597180  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:41.596552  8424 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:41.612222  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 194444us
I20260709 13:03:41.575395 14334 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:41.613166  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:41.613528  9296 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:03:41.616106  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 201302us
I20260709 13:03:41.616353  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:41.617681  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:41.578390 14434 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:41.545444 14512 consensus_queue.cc:1059] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:03:41.540670 14379 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:03:41.581100 14180 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:41.588650 14496 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:41.597856 14620 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16.
W20260709 13:03:41.660081  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 47012.8us
I20260709 13:03:41.662643 14118 raft_consensus.cc:3055] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:41.663166 14118 raft_consensus.cc:740] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:03:41.663374 14683 log.cc:927] Time spent T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:03:41.596258 14293 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:03:41.626245 14334 raft_consensus.cc:697] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:41.593359 14599 consensus_queue.cc:1059] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
W20260709 13:03:41.671516  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 75029.8us
I20260709 13:03:41.634043  8501 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:41.610399 14603 consensus_queue.cc:1048] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:03:41.618634  9287 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:41.660926 14546 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:41.585549 14171 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:41.615798 14495 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:03:41.666839 14496 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.665513 13981 consensus_queue.cc:237] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:41.685412 14547 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:41.699688  9293 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
I20260709 13:03:41.700438  9288 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:41.700316  8351 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:41.675113 14512 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.024s
I20260709 13:03:41.678917 14599 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:41.662724 14434 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:41.694589 14496 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:41.709547 14334 consensus_queue.cc:237] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:41.722620  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 105389us
W20260709 13:03:41.710901 14688 log.cc:927] Time spent T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:41.716084  8382 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:03:41.716246  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.696985 14673 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:41.725263  8501 leader_election.cc:400] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14.
W20260709 13:03:41.728863  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:41.731616 14684 log.cc:927] Time spent T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.251s	user 0.000s	sys 0.002s
I20260709 13:03:41.738018 14118 consensus_queue.cc:260] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:41.739054  9296 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 24.
I20260709 13:03:41.739545 14118 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:41.750331  9291 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:41.751111  9292 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:41.757932 14493 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:41.764762  8382 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:41.769234  9258 leader_election.cc:400] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 23 election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 23. Current term is 24.
I20260709 13:03:41.769613  9258 leader_election.cc:403] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
W20260709 13:03:41.773238  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 49585.8us
W20260709 13:03:41.826956  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 97975.6us
W20260709 13:03:41.767434 14682 log.cc:927] Time spent T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
W20260709 13:03:41.830282  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 134524us
W20260709 13:03:41.831820  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 62735.7us
I20260709 13:03:41.832017  8501 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:41.837632  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:41.723637 14591 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:41.839236 14603 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.842554 14603 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:41.841228 14386 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 23. Current term is 24.
I20260709 13:03:41.845186 14546 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.845765 14546 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:41.846163 14462 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:41.844678  8351 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:41.847855  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:41.849119  8351 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:41.850944  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:41.852430 14462 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:41.852846 14462 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:41.853257 14462 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:41.853706  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:41.854067  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:41.854420  8377 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:41.854763  8380 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 8.
I20260709 13:03:41.856729 14603 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:41.848157 14546 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:41.858080 14693 log.cc:927] Time spent T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:03:41.804292 14460 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:41.860687  8378 raft_consensus.cc:1240] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 13:03:41.861321 14460 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:41.862044 14460 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:41.862620  8351 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:41.864184 14512 consensus_queue.cc:1059] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:41.865183 14689 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.865902 14512 raft_consensus.cc:3055] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:41.865741 14689 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:41.866964  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:41.867803 14689 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:41.868355 14689 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:41.864393  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:41.862694 14460 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:41.881357  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 49370.2us
I20260709 13:03:41.840081 14670 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.866289 14512 raft_consensus.cc:740] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:41.921267 14460 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.922338 14460 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:41.886669 14599 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:41.881294 14403 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:41.929822 14285 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:41.940168  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 75838.1us
W20260709 13:03:41.941045 14680 log.cc:927] Time spent T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.445s	user 0.013s	sys 0.005s
W20260709 13:03:41.942101 14691 log.cc:927] Time spent T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.263s	user 0.000s	sys 0.000s
W20260709 13:03:41.942524 14675 log.cc:927] Time spent T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:03:41.958761  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:41.955488  8501 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:41.915395 14591 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:41.839638 14696 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:03:41.975395  8532 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:41.977727  8501 leader_election.cc:400] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 18. Current term is 19.
I20260709 13:03:41.913878 14670 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:41.981938  8424 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:41.943994 14434 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:41.972417 14603 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.983577 14603 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:41.986877 14603 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:41.987520  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:41.990464 14460 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:41.991158  8501 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:41.994029 14403 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:41.994030  8501 leader_election.cc:400] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 19. Current term is 20.
I20260709 13:03:41.998287 14334 consensus_queue.cc:1048] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:41.979218 14335 raft_consensus.cc:2764] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:03:41.931681 14575 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:03:42.010362  8424 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:41.979285 14557 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.930763 14462 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:41.963214 14285 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:42.040736  8424 leader_election.cc:400] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14.
I20260709 13:03:42.041144  8424 leader_election.cc:403] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:03:42.012192 14549 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:42.043578 14546 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:03:42.048564  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 102641us
I20260709 13:03:42.049654  8351 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:42.045709 14546 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:42.052119 14064 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14.
I20260709 13:03:42.039314 14619 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:42.037521 14698 log.cc:927] Time spent T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:03:42.055488 14318 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:42.056114 14546 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:42.057796  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:42.029610 14557 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:42.037441 14386 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.078081 14285 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:42.077785 14386 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:42.039354 14462 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:42.081599  8349 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:42.030531 14512 consensus_queue.cc:260] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:42.100062 14335 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:42.100728 14335 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:42.101246 14512 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:42.103873 14335 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:42.070386  8455 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:03:42.105288  8455 pending_rounds.cc:85] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: Aborting all ops after (but not including) 12
I20260709 13:03:42.105641  8455 pending_rounds.cc:107] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:03:42.105980  8455 raft_consensus.cc:2889] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:42.068910 14701 log.cc:927] Time spent T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:03:42.085538  8452 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:42.086840  8535 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:42.086972 14435 consensus_queue.cc:260] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:42.088339  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:42.089656  8457 raft_consensus.cc:1240] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:42.067211 14171 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:42.111591  8456 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:03:42.111783 14171 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:42.080904 14386 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:42.114705 14702 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.133s	user 0.000s	sys 0.002s
I20260709 13:03:42.118427 14435 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:42.126838  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 45358.7us
I20260709 13:03:42.127553  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:42.169727  8384 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:42.186133  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:42.188791  8426 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:42.190668  8427 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:42.209785  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:42.210820  9292 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 20.
W20260709 13:03:42.212949  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 163408us
I20260709 13:03:42.215170  8427 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:42.216756  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.165266 14706 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:42.164762 14546 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 13:03:42.225263 14180 consensus_meta.cc:287] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.004s
I20260709 13:03:42.225929  8530 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 9.
W20260709 13:03:42.226526  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.226722  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:42.218427 14706 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:42.207741 14496 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:42.208032 14690 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:42.227452 14706 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:42.211915 14620 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:42.236956  8426 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:42.229343 14496 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:42.249961  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.205017 14379 consensus_queue.cc:1059] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 13:03:42.220021 14619 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:42.261296  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:03:42.263631  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 49196.7us
I20260709 13:03:42.261099 14619 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.264012 14496 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:42.276441 14694 raft_consensus.cc:3055] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:42.277215 14620 raft_consensus.cc:697] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:42.285476  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:42.291471  8351 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:42.293494  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:42.294234  8527 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:03:42.288825 14619 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:42.289073 14496 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.292438 14694 raft_consensus.cc:740] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:42.307477 14575 consensus_queue.cc:1059] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:42.308257 14403 consensus_queue.cc:1059] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:42.308876 14689 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:42.305804 14496 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:42.305774  8500 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:42.315685 14620 consensus_queue.cc:237] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:42.316638  9258 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:42.316982  8535 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:42.328995 14557 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:42.340719  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 49298.8us
I20260709 13:03:42.342255  8351 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:42.343837 14462 consensus_queue.cc:1059] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:42.344794 14599 consensus_queue.cc:1059] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:42.345909 14710 consensus_queue.cc:1059] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:42.347122 14460 raft_consensus.cc:3055] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:42.347549 14460 raft_consensus.cc:740] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:42.348510 14460 consensus_queue.cc:260] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:42.349733 14460 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:42.353525  9261 leader_election.cc:336] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.625s (SENT)
I20260709 13:03:42.355026 14571 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:42.355487 14571 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.355827 14571 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:42.333195 14064 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:42.353133 14694 consensus_queue.cc:260] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:42.320744 14690 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:03:42.368021  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 62429.8us
W20260709 13:03:42.364611 14658 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.012s	sys 0.006s
I20260709 13:03:42.345882 14599 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:42.339334 14689 raft_consensus.cc:697] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:42.359444 14673 raft_consensus.cc:3055] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:42.364066 14603 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:42.411278  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 67746.3us
I20260709 13:03:42.412762  8351 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:42.408085 14694 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:42.417815 14591 raft_consensus.cc:3055] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:42.418215 14591 raft_consensus.cc:740] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:42.419098 14591 consensus_queue.cc:260] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:42.421222 14718 raft_consensus.cc:3055] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:42.421659 14718 raft_consensus.cc:740] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:42.422464 14718 consensus_queue.cc:260] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:42.403868 14658 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.012s	sys 0.006s
I20260709 13:03:42.374110 14679 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:03:42.430433  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 61707us
I20260709 13:03:42.403224 14334 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:42.410722 14673 raft_consensus.cc:740] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:03:42.453197  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 98517.6us
I20260709 13:03:42.459492 14670 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:42.415293 14599 raft_consensus.cc:697] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 19 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:42.370214 14690 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:42.504746  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:42.504626  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 48858us
I20260709 13:03:42.434907 14591 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:42.506415  9261 leader_election.cc:336] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.693s (SENT)
W20260709 13:03:42.505963  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 93198.5us
I20260709 13:03:42.513001  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:42.517494  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:42.423956 14603 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:42.518220  8377 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:42.510356  8500 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:03:42.520951 14716 log.cc:927] Time spent T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:03:42.521863 14719 log.cc:927] Time spent T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:03:42.509574 14334 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:42.523391 14689 consensus_queue.cc:237] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:42.522238 14599 consensus_queue.cc:237] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:42.531286  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:42.530876  8500 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:42.538033  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:42.538954  8384 raft_consensus.cc:2410] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
W20260709 13:03:42.557904  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.540091  8379 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:42.539794  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:42.539121  9261 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:42.570418 14730 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:42.571082 14730 raft_consensus.cc:697] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 24 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:42.572008 14730 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:42.574712 14403 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:42.575333 14403 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:42.580269  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:42.582778  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:42.580905  8384 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:42.588934  8382 raft_consensus.cc:2410] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:03:42.590584  8377 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:42.594061  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:42.586889  9258 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:42.598064  8456 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 19: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:42.596431  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:42.600080  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:42.601155  8452 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 11: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:42.605679  8381 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:42.533377 14335 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:03:42.637907  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 51107.9us
I20260709 13:03:42.647727  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:42.655194  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:42.656167  8457 raft_consensus.cc:2393] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 13: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
W20260709 13:03:42.658697  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:42.636920 14716 log.cc:927] Time spent T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:03:42.739604  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:42.539686 14619 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:42.810706  8378 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:03:42.808584  8379 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:42.815496 14731 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:42.816192 14731 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:42.816658 14731 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:42.706763 14512 consensus_meta.cc:287] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.003s
I20260709 13:03:42.823081  8384 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 24.
I20260709 13:03:42.830000 13881 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:42.830602 13881 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:42.838551 13881 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:42.839367  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:03:42.845963 14724 log.cc:927] Time spent T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
W20260709 13:03:42.874082 14728 log.cc:927] Time spent T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:03:42.829972 14546 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.882030 14546 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:42.888796 14334 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:42.891089 14733 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:03:42.598524 14673 consensus_queue.cc:260] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:42.895152 14690 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:42.901403 14603 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:42.905412 14546 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:42.810737 14335 raft_consensus.cc:697] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:42.907207 14335 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:42.910305 14706 consensus_meta.cc:287] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.650s	user 0.010s	sys 0.000s
I20260709 13:03:42.910969 14706 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:42.799697 14403 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:42.918468  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.919220  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:42.920064  8527 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
W20260709 13:03:42.921875  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 391045us
I20260709 13:03:42.649529 14496 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:42.827100 14580 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:42.931448  8378 raft_consensus.cc:1240] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:42.914130 14512 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:42.959996  8501 leader_election.cc:336] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.568s (SENT)
I20260709 13:03:42.960529  8501 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:42.963995  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:42.965432  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:42.961225  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 252565us
I20260709 13:03:42.966326  8351 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:42.966817  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:42.961308  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 305410us
I20260709 13:03:42.968370  8452 raft_consensus.cc:2393] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 21: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:42.967621  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:42.962864  8427 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:42.970253  8384 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 19.
W20260709 13:03:42.972136  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.985061  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:42.985776  8378 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 22.
I20260709 13:03:42.986616  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:42.990589  8378 raft_consensus.cc:2368] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 23. Current term is 24.
I20260709 13:03:42.989039  8381 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:42.960167 14546 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.990136  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:03:42.995522  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.959388 14285 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:42.996780 14729 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:42.991887 14571 consensus_meta.cc:287] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.633s	user 0.011s	sys 0.000s
I20260709 13:03:43.008978  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:42.984581 14549 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:43.011981  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:03:43.010915  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 372032us
W20260709 13:03:43.014606  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 560654us
I20260709 13:03:43.015022  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:43.033730  9261 leader_election.cc:336] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.727s (SENT)
I20260709 13:03:43.033876  8381 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:03:43.024992  8427 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:43.013016  8351 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:43.010332  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:42.997303 14435 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:43.036137  8378 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:03:43.045156  8427 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:43.046023  8530 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38892 (request call id 2869) took 1763 ms (client timeout 1696 ms). Trace:
I20260709 13:03:43.049139  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:43.046471  8530 rpcz_store.cc:269] 0709 13:03:41.270745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.271170 (+   425us) service_pool.cc:224] Handling call
0709 13:03:43.033549 (+1762379us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b54001699d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:43.033655 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2193714432}
W20260709 13:03:43.018904 14734 log.cc:927] Time spent T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
W20260709 13:03:43.025560 14707 log.cc:927] Time spent T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 1.036s	user 0.004s	sys 0.009s
W20260709 13:03:43.016263 14694 consensus_meta.cc:287] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.000s
I20260709 13:03:43.063926  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:43.057539  8454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 1298) took 1182 ms. Trace:
I20260709 13:03:43.084571  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:43.027647 14496 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:43.008914 14738 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:43.033152 14549 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:43.015697 14575 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:43.089515  8456 raft_consensus.cc:2410] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 22 because replica has last-logged OpId of term: 21 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 13:03:43.049568 14690 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:43.090541  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 160336us
I20260709 13:03:43.065516  8454 rpcz_store.cc:276] 0709 13:03:41.866284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.866399 (+   115us) service_pool.cc:224] Handling call
0709 13:03:41.866759 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:42.028883 (+162124us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:03:42.044160 (+ 15277us) log.cc:844] Serialized 14 byte log entry
0709 13:03:42.261658 (+217498us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:42.262213 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:03:42.262368 (+   155us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:03:42.262412 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.048646 (+786234us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b540015a9d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:43.048698 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:43.048749 (+    51us) raft_consensus.cc:1685] finished
0709 13:03:43.048867 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:43.049008 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2770,"prepare.queue_time_us":15109,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":7449,"raft.queue_time_us":12346,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":3974,"spinlock_wait_cycles":333721344,"thread_start_us":209566,"threads_started":1,"wal-append.queue_time_us":286550}
W20260709 13:03:43.102069  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 68361.2us
W20260709 13:03:43.103160  9261 leader_election.cc:336] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.805s (SENT)
I20260709 13:03:43.103690  9261 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:43.058182 14706 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:43.009985 14546 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:43.111052  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:43.014446 14285 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:43.025776 14729 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:43.084245 14710 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:43.130949  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 1432) took 1358 ms. Trace:
I20260709 13:03:43.134831 14541 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.096885 14549 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:43.099900 14694 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:43.038408 14571 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:43.145716  8501 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:43.151638  8455 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:43.152644  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:43.153479  8453 raft_consensus.cc:2393] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 13: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:43.113065 14496 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:43.140551  8528 rpcz_store.cc:276] 0709 13:03:41.772642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.772780 (+   138us) service_pool.cc:224] Handling call
0709 13:03:41.773144 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:41.830748 (+ 57604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:41.830781 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:41.842869 (+ 12088us) log.cc:844] Serialized 26 byte log entry
0709 13:03:41.978521 (+135652us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:41.978566 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.978634 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:42.741945 (+763311us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:43.130479 (+388534us) raft_consensus.cc:1685] finished
0709 13:03:43.130512 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:43.130835 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22194,"raft.queue_time_us":27460,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":34290,"spinlock_wait_cycles":33446656,"thread_start_us":135245,"threads_started":1,"wal-append.queue_time_us":146495}
I20260709 13:03:43.151085 14050 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:43.105760 14575 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:43.175297  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 72188.9us
I20260709 13:03:43.154212 14694 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:43.177870  8531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 3201) took 1093 ms. Trace:
I20260709 13:03:43.161284 14619 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:43.174738  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:43.147614 14710 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:43.146996 14541 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:43.189677  8531 rpcz_store.cc:276] 0709 13:03:42.084079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.084252 (+   173us) service_pool.cc:224] Handling call
0709 13:03:42.084619 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:42.098607 (+ 13988us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:42.098659 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:42.465486 (+366827us) spinlock_profiling.cc:243] Waited 47 ms on lock 0x7b2c0003cae8. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2
0709 13:03:42.465972 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:03:42.639886 (+173914us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:42.639922 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.639997 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:43.177467 (+537470us) raft_consensus.cc:1685] finished
0709 13:03:43.177493 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:43.177768 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13437,"raft.queue_time_us":14673,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":108176640,"thread_start_us":173483,"threads_started":1,"wal-append.queue_time_us":331755}
W20260709 13:03:43.197005  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.175348 14706 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.208577  9296 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:43.194764 14694 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:43.208127 14670 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:43.226413  8427 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:43.224522  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:43.218357  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:43.233739  9289 raft_consensus.cc:2368] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12.
I20260709 13:03:43.203720 14619 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:43.235117 14729 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:43.246723  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:43.209355 14735 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.247589  9293 raft_consensus.cc:2368] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12.
I20260709 13:03:43.209066 14655 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:43.245630  9296 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:43.208503 14386 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:43.256315  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:43.254043  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:43.211262 14705 raft_consensus.cc:3055] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:43.209131 14745 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:43.253347  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:43.263218  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:43.262014  9296 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:43.265548  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:43.209543 14737 consensus_queue.cc:1059] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:03:43.210335 14706 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:43.271574  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:43.224126 14713 consensus_queue.cc:1059] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.218s
I20260709 13:03:43.275832  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:43.260704 14750 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:43.249984 14619 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:43.223625 14670 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:43.294633  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.213454 14731 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:43.266220 14705 raft_consensus.cc:740] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:43.309357  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:43.309238 14705 consensus_queue.cc:260] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:43.310240 14705 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:43.306826 14746 log.cc:927] Time spent T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:03:43.264254 14386 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:43.327808  8378 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:43.327824 14285 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:43.332319 14743 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:03:43.334084 14541 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:43.334925  8385 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:03:43.335824 14571 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:43.336027  8385 raft_consensus.cc:1240] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:43.325948 14710 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:43.327395  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:43.341342  8533 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:43.261312 14735 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:43.299752 14750 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.350781 14760 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:43.356701  8385 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:43.359292  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:43.360088  8533 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:03:43.274789 14745 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:43.368144  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:43.347152 14541 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.370601  8532 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:43.372946  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:43.353955 14603 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:43.375097  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:43.382781  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.388000  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:43.355139 14750 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:43.369066 14591 consensus_meta.cc:287] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.857s	user 0.008s	sys 0.005s
I20260709 13:03:43.393574 14571 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:43.390513  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.366170 14546 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:43.394232 14571 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:43.407821  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 240269us
I20260709 13:03:43.410521  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:43.411238  8530 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:43.407583  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 140921us
I20260709 13:03:43.381209 14541 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:43.548173 14541 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:43.548759 14541 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:43.391691 14603 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:43.498476 14575 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:43.508764 14748 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:43.545295  8533 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:03:43.410331  8501 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:43.368992 14760 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:43.550947 14769 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:43.544580  9261 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:43.560777  8530 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
W20260709 13:03:43.570621  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 158123us
I20260709 13:03:43.574009  9261 leader_election.cc:400] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 23 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 23. Current term is 24.
I20260709 13:03:43.575610  9261 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:43.577203 14767 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.577708 14760 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:43.577850 14767 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:43.580242 14767 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:43.580729 14723 log.cc:927] Time spent T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 1.058s	user 0.004s	sys 0.000s
W20260709 13:03:43.591929  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 181663us
I20260709 13:03:43.608877  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:43.586949 14760 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:43.615578  8527 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:03:43.616843 14731 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:43.619022  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.619832 14670 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:43.620400 14670 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:43.620723 14318 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:43.629503  9292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 901) took 1411 ms. Trace:
I20260709 13:03:43.629362 14318 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:43.630323 14603 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:43.620860 14670 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:43.632133 14318 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:43.581642 14748 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:43.633517 14670 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:43.634164 14670 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:43.634855 14748 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:43.621425 14740 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:43.635511 14740 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:43.636018 14740 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:43.607828 14769 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:43.629933  9292 rpcz_store.cc:276] 0709 13:03:42.217970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.218106 (+   136us) service_pool.cc:224] Handling call
0709 13:03:42.222989 (+  4883us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:42.232199 (+  9210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.232251 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:42.240833 (+  8582us) log.cc:844] Serialized 26 byte log entry
0709 13:03:42.367543 (+126710us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:42.367591 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.367673 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:43.579994 (+1212321us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:43.629160 (+ 49166us) raft_consensus.cc:1685] finished
0709 13:03:43.629182 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:43.629416 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3924,"raft.queue_time_us":114,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":8298,"spinlock_wait_cycles":7758592,"thread_start_us":97628,"threads_started":1,"wal-append.queue_time_us":189324}
I20260709 13:03:43.639153 14769 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:43.622202 14735 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:43.621985 14739 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:43.627290 14690 consensus_meta.cc:287] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.001s
I20260709 13:03:43.634641 14670 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:43.639648 14769 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:43.615605 14760 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:43.586520 14745 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:43.827883  8385 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:43.587512 14619 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:43.911098  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:43.911747  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:43.915059  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:43.566130 14541 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:43.916218  8455 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:43.599493 14767 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:43.922775 14758 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.956491  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:43.957005 14758 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:43.960383  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:43.797740 14690 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:43.951439 14705 consensus_meta.cc:287] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.641s	user 0.011s	sys 0.002s
I20260709 13:03:43.958302 14725 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:43.987663  9294 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:03:44.006119  8424 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.042s	sys 0.110s
W20260709 13:03:44.006665  8424 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.042s	sys 0.110s
I20260709 13:03:43.890908 14731 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 13:03:44.009752  8381 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:43.995687  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:44.013276  8385 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
I20260709 13:03:44.014595  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:44.015215  8385 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
I20260709 13:03:44.016659  8453 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:43.914366 14769 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:44.024993  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:44.032029  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:43.978355 14767 raft_consensus.cc:697] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:44.034473  8453 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 11: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:44.035162  8500 leader_election.cc:400] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12.
I20260709 13:03:44.035801  8500 leader_election.cc:403] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:44.039518  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:44.040201  9292 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:44.012547 14619 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.045547 14738 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:44.024706 14318 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:44.026650 14756 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.066926  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2880) took 1075 ms. Trace:
W20260709 13:03:44.057045 14694 consensus_meta.cc:287] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.826s	user 0.005s	sys 0.003s
I20260709 13:03:44.072182  8527 rpcz_store.cc:276] 0709 13:03:42.991331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.991482 (+   151us) service_pool.cc:224] Handling call
0709 13:03:42.991795 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:43.616084 (+624289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.066472 (+450388us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b540024cf54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:44.066834 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1433947904}
W20260709 13:03:44.064322 14549 consensus_meta.cc:287] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.903s	user 0.013s	sys 0.000s
I20260709 13:03:44.059019 14769 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:44.043746 14755 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 11. Current term is 12.
I20260709 13:03:44.087510  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:44.061236 14541 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:44.088470  9289 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
I20260709 13:03:44.035126 14705 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:03:44.063359 14760 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:44.081393 14739 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.033263 14725 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:44.081866 14571 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:44.061360 14318 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:44.095788  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:44.071305 14619 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:44.100347 14760 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:03:44.107388  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 89167.8us
I20260709 13:03:44.117527  9294 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 19.
I20260709 13:03:44.104770  9292 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 21.
I20260709 13:03:44.119658  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 1067) took 1155 ms. Trace:
I20260709 13:03:44.111943  8461 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 19.
I20260709 13:03:44.116362  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:44.086503 14694 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.084967 14603 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:03:44.094291 14731 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:44.076424 14756 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:44.122131  8351 leader_election.cc:400] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 11. Current term is 12.
I20260709 13:03:44.121440  8426 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:44.124101  8458 raft_consensus.cc:2393] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 15: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:44.123598  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:44.087863 14549 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:44.093436 14745 consensus_queue.cc:1059] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:03:44.120060  8386 rpcz_store.cc:276] 0709 13:03:42.963943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.311268 (+347325us) service_pool.cc:224] Handling call
0709 13:03:43.311571 (+   303us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:43.413487 (+101916us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.544755 (+131268us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:43.547070 (+  2315us) log.cc:844] Serialized 52 byte log entry
0709 13:03:43.971487 (+424417us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:44.088624 (+117137us) log.cc:844] Serialized 14 byte log entry
0709 13:03:44.116366 (+ 27742us) log.cc:844] Serialized 14 byte log entry
0709 13:03:44.119367 (+  3001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.119443 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.119482 (+    39us) raft_consensus.cc:1685] finished
0709 13:03:44.119491 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.119607 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5351,"prepare.queue_time_us":127796,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":67233,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":4849,"spinlock_wait_cycles":35584,"thread_start_us":647478,"threads_started":4,"wal-append.queue_time_us":498845}
I20260709 13:03:44.095595 14713 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:03:44.093691 14512 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 13:03:44.143157  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:44.121414 14783 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:44.155180  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 2802) took 1115 ms. Trace:
I20260709 13:03:44.157331 14064 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:44.157883  8453 raft_consensus.cc:1240] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:44.158687 14549 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:44.160158 14318 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:44.161273 14777 log.cc:927] Time spent T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:03:44.161798  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:44.162711  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:44.163791 14779 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:44.125135 14760 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.166337 14694 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 23 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:44.170214  8381 rpcz_store.cc:276] 0709 13:03:43.040094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.300217 (+260123us) service_pool.cc:224] Handling call
0709 13:03:44.154990 (+854773us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b54003dccd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:44.155115 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1525626112}
I20260709 13:03:44.180140  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3804) took 1158 ms. Trace:
I20260709 13:03:44.180137  8461 raft_consensus.cc:2393] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 16: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:44.142208 14771 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:44.113039 14739 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.170048 14670 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:44.188413  8458 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:44.137972 14731 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:44.182260 14705 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:44.192834  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 49758.4us
I20260709 13:03:44.184369 14619 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:44.174273 14064 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:44.117189 14767 consensus_queue.cc:237] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.187621  8385 rpcz_store.cc:276] 0709 13:03:43.021507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.038819 (+1017312us) service_pool.cc:224] Handling call
0709 13:03:44.040755 (+  1936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.041019 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:03:44.123316 (+ 82297us) log.cc:844] Serialized 14 byte log entry
0709 13:03:44.179827 (+ 56511us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:44.179877 (+    50us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:44.179918 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.179981 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.180090 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1123,"prepare.queue_time_us":58586,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"thread_start_us":100276,"threads_started":2}
W20260709 13:03:44.188484 14740 consensus_meta.cc:287] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.552s	user 0.012s	sys 0.000s
I20260709 13:03:44.194994  8351 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:03:44.196244  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 51934.7us
I20260709 13:03:44.197894  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:44.200249  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:44.200863  8385 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:44.201552  8458 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:44.171252 14783 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:44.205962  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.207171  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:44.203631 14750 consensus_meta.cc:287] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.793s	user 0.014s	sys 0.000s
I20260709 13:03:44.212399 14750 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:44.214215 14725 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:44.214653 14750 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:44.216718 14731 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:44.216857  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.217247  8452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36446 (request call id 2669) took 1570 ms. Trace:
I20260709 13:03:44.217628  8452 rpcz_store.cc:276] 0709 13:03:42.647222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.647413 (+   191us) service_pool.cc:224] Handling call
0709 13:03:44.217015 (+1569602us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b540019d7d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:44.217191 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":735212288}
I20260709 13:03:44.218266  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48484 (request call id 1069) took 1253 ms. Trace:
I20260709 13:03:44.218861 14739 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:44.219148  8530 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 14: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:44.220230 14756 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:44.191900 14771 raft_consensus.cc:697] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 21 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:44.208732  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.210409 14705 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:44.203883 14740 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.221841 14760 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:44.223678 14740 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:44.226125  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:44.228062  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.226778  8527 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:44.234663  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3805) took 1212 ms. Trace:
I20260709 13:03:44.235150  8386 rpcz_store.cc:276] 0709 13:03:43.021949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.206749 (+1184800us) service_pool.cc:224] Handling call
0709 13:03:44.234003 (+ 27254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.234246 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.234284 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:44.234349 (+    65us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:44.234395 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.234462 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.234602 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:44.244437  8385 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:03:44.247233  8500 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:44.249289  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3808) took 1226 ms. Trace:
I20260709 13:03:44.218672  8378 rpcz_store.cc:276] 0709 13:03:42.964490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.328787 (+364297us) service_pool.cc:224] Handling call
0709 13:03:43.344957 (+ 16170us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:43.560429 (+215472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.560474 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:43.586103 (+ 25629us) log.cc:844] Serialized 26 byte log entry
0709 13:03:44.024619 (+438516us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:44.106727 (+ 82108us) log.cc:844] Serialized 14 byte log entry
0709 13:03:44.107002 (+   275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.107220 (+   218us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.218069 (+110849us) raft_consensus.cc:1685] finished
0709 13:03:44.218091 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.218213 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":74871,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":31838,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":11261,"thread_start_us":682278,"threads_started":3,"wal-append.queue_time_us":450181}
I20260709 13:03:44.249564  8500 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:44.249697  8385 rpcz_store.cc:276] 0709 13:03:43.022997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.248515 (+1225518us) service_pool.cc:224] Handling call
0709 13:03:44.248808 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.248985 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.249008 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:44.249046 (+    38us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:44.249096 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.249146 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.249237 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:44.251191  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3811) took 1227 ms. Trace:
I20260709 13:03:44.251507  8385 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:44.251735  8378 rpcz_store.cc:276] 0709 13:03:43.024065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.250182 (+1226117us) service_pool.cc:224] Handling call
0709 13:03:44.250546 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.250754 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.250793 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:44.250849 (+    56us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:44.250896 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.250982 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.251119 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:44.252363  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2801) took 1212 ms. Trace:
I20260709 13:03:44.253218  8385 rpcz_store.cc:276] 0709 13:03:43.039774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.250762 (+1210988us) service_pool.cc:224] Handling call
0709 13:03:44.251100 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.252074 (+   974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.252302 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:44.254992  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3815) took 1006 ms. Trace:
I20260709 13:03:44.255558  8385 rpcz_store.cc:276] 0709 13:03:43.248290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.254142 (+1005852us) service_pool.cc:224] Handling call
0709 13:03:44.254439 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.254593 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.254617 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:44.254653 (+    36us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:44.254696 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.254782 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.254913 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:44.258226  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.258913  8527 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
I20260709 13:03:44.221917 14705 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:44.262302  8386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3806) took 1240 ms. Trace:
I20260709 13:03:44.264434  8386 rpcz_store.cc:276] 0709 13:03:43.022273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.235907 (+1213634us) service_pool.cc:224] Handling call
0709 13:03:44.261673 (+ 25766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.261899 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.261924 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:44.261986 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:44.262032 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.262104 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.262234 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:44.281208 14738 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:44.285548  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.286718  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.287123  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:44.288058  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.284767  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.289645  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.289979  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.290822  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.221637 14771 consensus_queue.cc:237] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.289661  8530 raft_consensus.cc:2393] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 18: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:44.260094 14755 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:44.255921 14737 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:44.308703  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 113774us
I20260709 13:03:44.267881 14705 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:44.309511  8351 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:44.311383  8386 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:03:44.318215  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:44.326232  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:44.326995  9294 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:03:44.327493  9289 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:03:44.328599  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:44.328851  8457 raft_consensus.cc:1240] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 21 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:44.309732 14549 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:44.329232  8452 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 19.
I20260709 13:03:44.331698  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:44.316378 14785 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:03:44.334511 14720 log.cc:927] Time spent T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 1.809s	user 0.000s	sys 0.017s
I20260709 13:03:44.318780 14689 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:44.346254  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:44.325569 14793 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:03:44.355576 14064 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.357201  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3814) took 1125 ms. Trace:
I20260709 13:03:44.378187  8378 rpcz_store.cc:276] 0709 13:03:43.231967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.253254 (+1021287us) service_pool.cc:224] Handling call
0709 13:03:44.253588 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.253818 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:03:44.266148 (+ 12330us) log.cc:844] Serialized 14 byte log entry
0709 13:03:44.353929 (+ 87781us) log.cc:844] Serialized 14 byte log entry
0709 13:03:44.354151 (+   222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:44.356665 (+  2514us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:44.356742 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.356844 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.357042 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20350,"prepare.queue_time_us":13090,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":75,"raft.queue_time_us":21021,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":200,"thread_start_us":34962,"threads_started":1}
I20260709 13:03:44.370445  9291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55724 (request call id 905) took 1162 ms. Trace:
I20260709 13:03:44.315527 14738 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:03:44.373673 14673 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:44.380000  9291 rpcz_store.cc:276] 0709 13:03:43.207672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.233168 (+ 25496us) service_pool.cc:224] Handling call
0709 13:03:43.260689 (+ 27521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.330064 (+ 69375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.330103 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:43.330158 (+    55us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:43.330212 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.370179 (+1039967us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b5400708fd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:44.370225 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.370385 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158988544}
I20260709 13:03:44.372159 14689 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.401592 14064 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:44.407115 14747 log.cc:927] Time spent T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 1.139s	user 0.011s	sys 0.000s
I20260709 13:03:44.408936  8379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2797) took 1827 ms. Trace:
W20260709 13:03:44.410336  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 84487.1us
W20260709 13:03:44.411399  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.350500 14549 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:44.415504  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.409370  8379 rpcz_store.cc:276] 0709 13:03:42.581701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.813519 (+231818us) service_pool.cc:224] Handling call
0709 13:03:42.813899 (+   380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:42.932256 (+118357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.932309 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:42.960672 (+ 28363us) log.cc:844] Serialized 52 byte log entry
0709 13:03:43.061826 (+101154us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:43.260263 (+198437us) log.cc:844] Serialized 14 byte log entry
0709 13:03:43.406286 (+146023us) log.cc:844] Serialized 14 byte log entry
0709 13:03:43.545492 (+139206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.545591 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.406445 (+860854us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:44.408665 (+  2220us) raft_consensus.cc:1685] finished
0709 13:03:44.408690 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.408835 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85328,"prepare.queue_time_us":58126,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":81,"raft.queue_time_us":242974,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":7480,"spinlock_wait_cycles":5694336,"thread_start_us":367266,"threads_started":3,"wal-append.queue_time_us":225284}
W20260709 13:03:44.416011  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.412154  8351 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:44.423038  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:44.410058 14689 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:44.424260  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:44.424618  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.428370  8526 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:44.428596  8527 raft_consensus.cc:2368] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 9. Current term is 10.
I20260709 13:03:44.382218 14705 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.427343  8351 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:44.431785  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:44.371836 14785 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.434469  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.436990  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:44.428960 14690 raft_consensus.cc:3055] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:44.443543  8527 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 19: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:44.428721 14791 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:44.453307 14791 raft_consensus.cc:697] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 19 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:44.454370 14791 consensus_queue.cc:237] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:44.455670 14785 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:44.435505 14760 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:44.460825 14760 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.461282 14760 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:44.467180  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.469468  8526 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:44.445565  8349 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:44.447569  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:44.447824  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.448555 14460 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:44.448760  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:44.449182 14782 consensus_queue.cc:1059] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:44.475517  8386 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:44.479116  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.479843  8526 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:44.484575  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.445999 14690 raft_consensus.cc:740] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:44.473981 14755 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:44.488900  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.441984 14783 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:44.497529  8460 raft_consensus.cc:1240] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:44.490522  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.445484 14731 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:44.494730  8529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2879) took 1524 ms. Trace:
I20260709 13:03:44.501286  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:44.501190  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:44.506738  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:44.507906 14779 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:44.508734  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.509236  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:44.505693  9288 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:03:44.514146  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:44.514953  9294 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:44.517349  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.514459  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:44.518533  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.514613 14731 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:44.514459  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:44.523474  9290 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:44.523512  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:44.504724  8529 rpcz_store.cc:276] 0709 13:03:42.970538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.970735 (+   197us) service_pool.cc:224] Handling call
0709 13:03:42.971045 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.154690 (+183645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.154723 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:43.154789 (+    66us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:43.154831 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.494469 (+1339638us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54002baa54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:44.494523 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.494666 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":421820672}
W20260709 13:03:44.505502 14795 log.cc:927] Time spent T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:03:44.525671  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:44.525105  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:44.535693 14705 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:44.522660 14779 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:44.536741  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:44.543711  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:44.548416  9291 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:44.483971 14460 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.558737  9291 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 18.
W20260709 13:03:44.562537 14721 log.cc:927] Time spent T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 2.040s	user 0.012s	sys 0.008s
I20260709 13:03:44.564208  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3794) took 2394 ms. Trace:
I20260709 13:03:44.551062 14755 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:03:44.566177 14765 log.cc:927] Time spent T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.943s	user 0.000s	sys 0.007s
I20260709 13:03:44.565822 14755 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:44.568125  9287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55734 (request call id 1335) took 2387 ms. Trace:
I20260709 13:03:44.568928 14755 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:44.570197  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:44.549733  8426 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:44.522749 14620 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:44.564622  8380 rpcz_store.cc:276] 0709 13:03:42.170181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.170623 (+   442us) service_pool.cc:224] Handling call
0709 13:03:42.171071 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:42.197443 (+ 26372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.197475 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:42.212645 (+ 15170us) log.cc:844] Serialized 26 byte log entry
0709 13:03:42.364422 (+151777us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:42.364468 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.364530 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.561946 (+2197416us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:44.563877 (+  1931us) raft_consensus.cc:1685] finished
0709 13:03:44.563898 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.564123 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8988,"raft.queue_time_us":26464,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":3054,"spinlock_wait_cycles":7546112,"thread_start_us":124118,"threads_started":1,"wal-append.queue_time_us":219972}
I20260709 13:03:44.575237 14730 consensus_queue.cc:1059] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:44.575933  8535 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 13:03:44.576328  8535 pending_rounds.cc:85] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 13
I20260709 13:03:44.576414 14730 raft_consensus.cc:3055] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:44.576725  8535 pending_rounds.cc:107] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 13:03:44.577158  8535 raft_consensus.cc:2889] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:44.576197  8382 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 2782) took 2063 ms (client timeout 1568 ms). Trace:
I20260709 13:03:44.578020 14575 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:44.577915  8382 rpcz_store.cc:269] 0709 13:03:42.512596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.512757 (+   161us) service_pool.cc:224] Handling call
0709 13:03:44.575960 (+2063203us) spinlock_profiling.cc:243] Waited 75.1 ms on lock 0x7b54003dc2d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:44.576099 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172638080}
I20260709 13:03:44.578667 14575 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.568501  9287 rpcz_store.cc:276] 0709 13:03:42.180990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.181136 (+   146us) service_pool.cc:224] Handling call
0709 13:03:42.350178 (+169042us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b5800220e98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd45efc0 00007f36cd449929 00007f36cd4493d2 00007f36c69c0bd4
0709 13:03:42.350368 (+   190us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:42.350778 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.350808 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:43.329739 (+978931us) spinlock_profiling.cc:243] Waited 8.92 ms on lock 0x7b2c00047b98. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6d7ea11 00007f36c6d8e372 00007f36c84c0a01 00007f36c848543a 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2
0709 13:03:43.330485 (+   746us) log.cc:844] Serialized 52 byte log entry
0709 13:03:43.560980 (+230495us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:43.561019 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.561168 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.565416 (+1004248us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:44.567867 (+  2451us) raft_consensus.cc:1685] finished
0709 13:03:44.567888 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.568044 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1370,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":78,"spinlock_wait_cycles":59509504,"thread_start_us":230101,"threads_started":1,"wal-append.queue_time_us":292566}
I20260709 13:03:44.576965 14730 raft_consensus.cc:740] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:44.564640 14731 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:44.573164 14785 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:44.558581 14736 raft_consensus.cc:3055] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:44.588397 14730 consensus_queue.cc:260] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:44.596395 14730 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:44.597289 14549 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:44.591926 14736 raft_consensus.cc:740] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:44.598475 14736 consensus_queue.cc:260] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:44.599681 14736 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:44.603729  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:44.591015 14785 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:44.584729 14620 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.611167 14690 consensus_queue.cc:260] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.612517 14690 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:44.603753 14725 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.613355  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.613828 14725 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.614589  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:44.615929 14725 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:44.617956  8382 raft_consensus.cc:1240] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:44.618999  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:44.620615  8501 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:44.572135 14760 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:44.625514  8501 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:44.606475 14785 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:44.626382  8501 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:44.612524 14620 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:44.627651  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:44.629895  9287 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 24.
I20260709 13:03:44.627246 14767 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:44.628348 14334 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:44.649484  8386 raft_consensus.cc:2468] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 20.
W20260709 13:03:44.657070  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.635912 14767 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.660008 14760 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:44.662354  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:44.663175  8461 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:44.656262  9261 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:44.675011 14647 raft_consensus.cc:2804] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:44.675587 14647 raft_consensus.cc:697] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:44.676469 14647 consensus_queue.cc:237] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.682899  8461 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 20.
I20260709 13:03:44.642586 14334 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:44.684971 14334 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:44.686867  8351 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:44.682209 14767 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:44.691421 14386 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:44.692283 14318 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:44.694386 14496 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:44.694988 14496 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.695384 14689 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.642642 14755 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:44.642381 14775 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:03:44.697367 14755 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:44.697839 14755 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:44.699411  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.700222  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:44.702008  8456 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36446 (request call id 2672) took 1865 ms (client timeout 1540 ms). Trace:
I20260709 13:03:44.702008  8460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 2677) took 1559 ms. Trace:
W20260709 13:03:44.702590  8456 rpcz_store.cc:269] 0709 13:03:42.836603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.839029 (+  2426us) service_pool.cc:224] Handling call
0709 13:03:44.701801 (+1862772us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b540012bbd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:44.701935 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":572493568}
I20260709 13:03:44.702696  8460 rpcz_store.cc:276] 0709 13:03:43.142346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.142464 (+   118us) service_pool.cc:224] Handling call
0709 13:03:43.151205 (+  8741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.508578 (+1357373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.701821 (+193243us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54003c6754. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:44.701957 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3095733120}
I20260709 13:03:44.692973 14318 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.714962 14575 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:44.715998  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.643369 14737 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.063s
I20260709 13:03:44.716758 14318 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:44.725220  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:44.728775  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.730896  8535 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
W20260709 13:03:44.726325  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 91866us
I20260709 13:03:44.737325  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:44.737912  8351 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:44.739954 14742 raft_consensus.cc:3055] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:44.726171 14809 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:44.740423 14742 raft_consensus.cc:740] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:44.741372 14742 consensus_queue.cc:260] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.742607 14742 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:44.743302 14737 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:44.743904 14737 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:44.747290  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:44.748070  8380 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 14: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:44.748833  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:44.749218  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:44.749469  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:44.749389  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:44.749926  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:44.750463  8384 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:44.750658  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:44.750965  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:44.751297  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:44.749984  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:44.754706  8378 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 20.
I20260709 13:03:44.755518  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:44.757267  8380 raft_consensus.cc:2393] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 16: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:44.751798  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:44.758880  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:44.759887  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:44.751298  8386 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:44.752238  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:44.756096  8378 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:44.763245 14064 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.764436  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:44.764974  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:44.733206 14460 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:44.761478 14809 raft_consensus.cc:697] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 20 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:44.770291  8535 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:44.772320  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:44.773252  8386 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:44.738598 14496 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:44.769479  8351 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:44.781800  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:44.782433  9295 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:44.763789 14064 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.787803  8380 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 19 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:44.789862 14064 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:44.791987  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:44.786091 14804 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:03:44.793568 14804 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.793944 14804 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:03:44.797741 14770 log.cc:927] Time spent T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 1.167s	user 0.000s	sys 0.004s
I20260709 13:03:44.782611 14750 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:44.778146 14710 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:44.822023  8378 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:44.810650  9287 raft_consensus.cc:1240] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:44.812958  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 367466us
I20260709 13:03:44.820439  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.824575  8386 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:44.825547  8535 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:44.827944  8349 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:44.768550 14689 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:44.830559  8349 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:44.832707  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.785372 14620 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.839184  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.856262  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.857514  8533 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:44.832046 14599 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:44.836015 14710 raft_consensus.cc:697] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 18 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:44.838315 14434 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:03:44.863545  8349 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.195:40767 timed out after 1.551s (SENT) [suppressed 12 similar messages]
I20260709 13:03:44.877514  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.877868  8529 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:44.878847  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:44.880112  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:44.880862  8530 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:03:44.835441 14736 consensus_queue.cc:1059] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:03:44.880024  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.883558  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.843468 14603 consensus_queue.cc:1059] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:03:44.830641 14750 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.891602 14736 consensus_queue.cc:1243] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Peer d653e71832b7402b9a03b46249d3b885 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:03:44.892218 14710 consensus_queue.cc:237] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.893565  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:44.894299  8386 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 22.
I20260709 13:03:44.894451  9295 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 20.
I20260709 13:03:44.894142 14804 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.895534  8382 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 25 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 24. Current term is 25. Ops: [24.17-24.17]
I20260709 13:03:44.897902 14318 raft_consensus.cc:3055] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:44.898376 14318 raft_consensus.cc:740] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:44.899216 14318 consensus_queue.cc:260] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.900533 14318 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:44.906396  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:44.907797  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:44.908497  8461 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
I20260709 13:03:44.914089  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:44.914726  9295 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:03:44.914129  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:44.914786  9289 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:44.916975  9295 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:03:44.917519  8530 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 20.
I20260709 13:03:44.915397  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:44.890750 14805 log.cc:927] Time spent T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.192s	user 0.002s	sys 0.000s
I20260709 13:03:44.935757 14767 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:44.923234 14804 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 25 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:44.951612 14706 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:44.959666  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:44.960940  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.927491 14750 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:44.930517 14334 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:44.850999 14620 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:44.937295  8381 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:44.938885  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 1444) took 1634 ms. Trace:
I20260709 13:03:44.940042  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:44.942193  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:44.859629 14809 consensus_queue.cc:237] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:44.923290  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:44.945137  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:44.947813  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:44.948105 14718 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:44.950672 14787 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:44.948909  9291 raft_consensus.cc:1240] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:44.961858  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:44.971072  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:44.980028  8454 raft_consensus.cc:2393] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 20: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:44.982266  8453 raft_consensus.cc:2393] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 13: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:44.982982  8459 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:44.991389  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:44.982649  8528 rpcz_store.cc:276] 0709 13:03:43.304037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.304783 (+   746us) service_pool.cc:224] Handling call
0709 13:03:43.305176 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.305430 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:43.541803 (+236373us) log.cc:844] Serialized 14 byte log entry
0709 13:03:44.938441 (+1396638us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b1800483700. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c802d4bc 00007f36c537b48b 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5395455 00007f36c847d060 00007f36c848f716 00007f36c84a0287
0709 13:03:44.938541 (+   100us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:44.938593 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:44.938640 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.938706 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.938829 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24387,"prepare.queue_time_us":684019,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":33644,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":11344,"spinlock_wait_cycles":2556288,"thread_start_us":656709,"threads_started":2}
I20260709 13:03:45.000531  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:44.973763 14737 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:45.008100  8500 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:45.008356  9258 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:45.012439 14811 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:45.014320 14767 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:45.002447 14403 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:45.018172 14403 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.018635 14403 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:45.007825 14736 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.018s
I20260709 13:03:45.028147 14755 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:45.029476  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.030830 14758 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:45.037351  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:45.038520  8460 raft_consensus.cc:2368] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 19. Current term is 20.
I20260709 13:03:45.043355 14785 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:45.044752  8458 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:45.047868  9258 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:45.051927  9258 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:45.055342 14580 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:45.055840 14580 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.056245 14580 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:45.060940 14619 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:45.061794 14737 consensus_queue.cc:1059] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:45.062855  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:45.063632  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:45.064742  8424 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:45.066347  8459 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
W20260709 13:03:45.067198  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.068075  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:45.069939  9261 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:45.072698  9288 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:45.056811 14620 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:45.088979  8424 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:45.091410  8424 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:45.093051  8459 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:45.097625  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:45.098913  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.099596  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.057405 14759 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:45.058727 14776 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:45.065614 14386 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:45.107663  8351 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:45.104365  8424 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:45.085573 14754 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:45.125329  8424 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:45.132926  8349 leader_election.cc:400] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 9. Current term is 10.
I20260709 13:03:45.133394  8349 leader_election.cc:403] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:45.136667  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:45.137351  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:45.137686  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:45.138862  8460 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:45.070525 14738 consensus_queue.cc:1059] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.054s
I20260709 13:03:45.145821  8349 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:45.147650  8349 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:45.100945 14736 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:45.105939 14737 raft_consensus.cc:3055] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:45.122748 14603 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:45.122959 14620 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:45.150465  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:45.109575 14679 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:45.112576 14334 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:45.153192  8381 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:45.135860 14756 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:45.101202 14807 consensus_queue.cc:1059] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 13:03:45.214396  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 66816us
I20260709 13:03:45.149883 14814 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:45.232980  8349 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:45.234505  8349 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:45.154512 14435 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:03:45.235714  8349 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:45.236627 14779 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:45.237344 14779 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:45.237761 14689 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:45.240955 14620 raft_consensus.cc:697] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:45.255321 14620 consensus_queue.cc:237] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:45.237056  8349 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:45.258499 14689 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:45.260358  8349 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:45.142524 14759 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:45.133956 14783 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:45.130843 14496 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:03:45.224076  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 315427us
I20260709 13:03:45.223956 14758 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:45.152163 14755 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:45.143827 14786 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:45.131331 14754 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:45.266510  8349 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:45.152734 14512 consensus_queue.cc:1059] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.132s
I20260709 13:03:45.129762 14776 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:45.270612  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 169524us
I20260709 13:03:45.152390 14737 raft_consensus.cc:740] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:45.153647 14434 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:45.150211 14386 raft_consensus.cc:697] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:45.267338  8379 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:45.291038  8349 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:03:45.279188 14690 consensus_meta.cc:287] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.004s
I20260709 13:03:45.279779 14496 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.317500  8349 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:45.275496 14689 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:45.222821 14603 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.220897 14736 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:45.281150 14779 raft_consensus.cc:3055] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:45.223635 14679 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:45.309902 14460 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:45.282893 14758 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:45.269423 14759 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:45.266412 14756 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:45.294442 14754 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:45.321750 14496 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:45.325560 14293 raft_consensus.cc:3055] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:45.309190 14786 raft_consensus.cc:697] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 20 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:45.332372 14807 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:45.332871 14779 raft_consensus.cc:740] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:45.318871 14658 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.362707 14658 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:45.363714 14679 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:45.319093 14690 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:45.321557 14806 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:45.368801 14806 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:45.369392 14806 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:45.369509  8532 raft_consensus.cc:2410] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:03:45.369643 14779 consensus_queue.cc:260] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:45.371040 14779 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:45.287094 14783 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:45.374657 14783 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:45.377436 14658 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:45.328861  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 268326us
I20260709 13:03:45.328186 14603 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:45.382737 14737 consensus_queue.cc:260] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:45.384064 14737 raft_consensus.cc:3060] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:45.323417 14785 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:45.358623  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.386487 14403 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:45.388671 14403 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:45.353641  8349 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:45.391722  8386 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:03:45.392140  8386 pending_rounds.cc:85] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 15
I20260709 13:03:45.392367  8386 pending_rounds.cc:107] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:03:45.392609  8386 raft_consensus.cc:2889] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:45.345223 14758 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:45.348222 14759 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:45.397179  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 43660.7us
I20260709 13:03:45.350677 14736 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:45.334942 14434 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:03:45.357975 14293 raft_consensus.cc:740] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:03:45.407964  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 338125us
I20260709 13:03:45.390614 14735 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.402045 14783 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:45.433632 14826 log.cc:927] Time spent T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:03:45.421037 14735 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:45.435458  8382 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
I20260709 13:03:45.441665 14496 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:45.449720 14776 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:45.451412 14786 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:45.403883 14827 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:45.466770 14756 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:45.467419 14293 consensus_queue.cc:260] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:45.455969 14754 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:45.477469  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 352196us
I20260709 13:03:45.482477  8424 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:45.448274 14580 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:45.484211  8424 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:45.484021  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 158733us
I20260709 13:03:45.414837 14386 consensus_queue.cc:237] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:45.486423 14756 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:45.487017 14756 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:45.492168  8424 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:45.474370 14827 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:45.488724 14620 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:45.491242 14434 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.493458 14785 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:45.508581  8424 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:45.516716 14827 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:45.490830 14806 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:45.520311  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.512714 14619 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:03:45.525382  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:45.527149 14580 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:45.510473 14434 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:45.497406 14814 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:03:45.531911 14754 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:45.505311 14756 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:45.535254  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:45.535826 14620 raft_consensus.cc:697] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:45.536135  8531 raft_consensus.cc:2393] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 19: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:45.536816 14620 consensus_queue.cc:237] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:45.538381 14434 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:45.541460 14758 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:45.527482  8530 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:45.563158  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2805) took 1959 ms. Trace:
I20260709 13:03:45.563582  8385 rpcz_store.cc:276] 0709 13:03:43.603811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.260535 (+656724us) service_pool.cc:224] Handling call
0709 13:03:45.041559 (+781024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:45.041739 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:45.041764 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:45.041804 (+    40us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:45.041844 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:45.041901 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:45.562993 (+521092us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b540013e2d0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:45.563103 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1794471168}
I20260709 13:03:45.567282 14647 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:45.504397 14828 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:45.545886 14496 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:45.519801 14806 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:45.547807 14435 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 9. Current term is 10.
I20260709 13:03:45.549182  8424 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:45.549738 14064 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:45.554109 14804 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:45.489316 14603 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:45.543829 14759 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:45.562062  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:45.611228  9296 raft_consensus.cc:2368] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 18. Current term is 19.
I20260709 13:03:45.579864  8461 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:45.584478  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:45.570822 14758 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:45.604130 14064 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:45.614013 14064 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:45.615296 14759 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:45.617362 14804 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:45.619390  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:45.620014 14804 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:45.620913 14603 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:45.611299 14785 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:45.623121  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 127515us
I20260709 13:03:45.623315  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:45.573654  9260 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:45.605311  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 56226us
W20260709 13:03:45.625047  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 51514.8us
I20260709 13:03:45.608340  9293 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:45.625824  8424 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:45.603964  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:45.604019 14776 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.614034  9295 raft_consensus.cc:2393] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 19: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:45.601202 14737 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:45.631950 14403 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:45.630860 14759 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:45.654301  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:45.654987  8531 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:45.655886  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:45.656607  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:45.657217  8529 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:45.658022  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:45.658596  8529 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:45.660107  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:45.657523  8427 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:45.667737  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:45.659186 14334 consensus_queue.cc:1059] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
W20260709 13:03:45.673573  8532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38894 (request call id 3215) took 2329 ms (client timeout 2107 ms). Trace:
W20260709 13:03:45.674037  8532 rpcz_store.cc:269] 0709 13:03:43.344254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.380697 (+ 36443us) service_pool.cc:224] Handling call
0709 13:03:45.673351 (+2292654us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54002ea254. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:45.673487 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4554553216}
I20260709 13:03:45.675447  8535 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:03:45.675890  8535 pending_rounds.cc:85] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 11
I20260709 13:03:45.676108  8535 pending_rounds.cc:107] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:03:45.629701 14776 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:45.676328  8535 raft_consensus.cc:2889] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:45.678447 14776 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:45.633483 14679 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:03:45.686496 14735 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:45.638602 14737 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:45.689160 14737 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:45.689543  8457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36446 (request call id 2671) took 2974 ms. Trace:
I20260709 13:03:45.689965  8457 rpcz_store.cc:276] 0709 13:03:42.715240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.715436 (+   196us) service_pool.cc:224] Handling call
0709 13:03:44.217771 (+1502335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.329245 (+111474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.913309 (+584064us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b540019d7d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:45.689323 (+776014us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540019d7d0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:45.689465 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3709074432}
I20260709 13:03:45.654389 14620 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:45.701177  8533 raft_consensus.cc:1240] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 19. Current term is 20. Ops: []
W20260709 13:03:45.707115  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 49672us
I20260709 13:03:45.708519  8427 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:45.709362  8528 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:45.636462 14839 consensus_queue.cc:1059] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.069s
I20260709 13:03:45.720932  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:45.722245  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:45.723209  8533 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:45.730064  8349 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:45.730546  8427 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:45.734261  9293 raft_consensus.cc:1240] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:45.734889  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:45.735658  9295 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:45.736546  8427 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:45.737232  8349 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:45.738837 14841 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:45.720857 14814 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:45.738245  8349 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:45.753189  8349 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:45.754271 14435 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:45.754686 14435 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:45.755954  8427 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:45.726945 14603 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:03:45.757324  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 131573us
I20260709 13:03:45.768226  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:45.755091 14435 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:45.770949 14850 consensus_queue.cc:1059] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:45.771708 14841 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:45.772182 14850 raft_consensus.cc:3055] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:45.772562 14850 raft_consensus.cc:740] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:45.773370 14050 raft_consensus.cc:3055] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:03:45.773783 14050 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:45.773878  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:45.751484 14764 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:45.751754 14776 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:45.774691 14050 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:45.775945 14050 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:45.774653 14764 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.776808 14764 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:45.775437 14776 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:45.782444  8427 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:45.785549  8500 leader_election.cc:400] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 19. Current term is 20.
I20260709 13:03:45.783951  8349 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:45.786010  8500 leader_election.cc:403] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:03:45.787355  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.787446  8500 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:45.790220  8427 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:45.727141 14755 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:45.792151  8427 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:45.795691  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:45.751673 14786 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:45.798075  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:45.802264  8529 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 20: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:45.803462  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:45.808424  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:45.808903  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:45.809418  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:45.810108  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:45.811784  8427 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:45.812817  8534 raft_consensus.cc:2368] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 18. Current term is 19.
I20260709 13:03:45.813066  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:45.796947 14841 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:45.813970  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:45.814425 14776 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:45.815742  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:45.809859 14755 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:45.816571  8454 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 20: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:45.762688 14804 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:45.818321 14755 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:45.799600 14729 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:45.814107 14841 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.821882  8460 raft_consensus.cc:2368] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17.
I20260709 13:03:45.783165 14603 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:45.786248 14833 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:45.796061 14730 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 19. Current term is 20.
I20260709 13:03:45.796226 14434 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:45.827271 14434 raft_consensus.cc:697] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:45.797222 14806 consensus_queue.cc:1059] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:03:45.828392 14806 raft_consensus.cc:3055] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:45.828224 14434 consensus_queue.cc:237] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:45.828780 14806 raft_consensus.cc:740] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:45.829630 14806 consensus_queue.cc:260] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:45.830801 14806 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:45.785547 14758 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:03:45.835870 14737 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:45.836514 14737 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:45.838755 14737 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:45.840917 14850 consensus_queue.cc:260] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:45.842324 14850 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:45.825232 14841 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:45.847339  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59332 (request call id 3816) took 1101 ms. Trace:
I20260709 13:03:45.847795  8377 rpcz_store.cc:276] 0709 13:03:44.745628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.748902 (+  3274us) service_pool.cc:224] Handling call
0709 13:03:45.847112 (+1098210us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54003dc2d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:45.847276 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2402081664}
I20260709 13:03:45.849411  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:45.850123  8456 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:45.801643 14786 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:45.854575  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:45.855243  9260 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:45.855265  9293 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:45.858368  8456 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
I20260709 13:03:45.825505  8427 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:45.799055 14619 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:45.862761  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:45.863026  8351 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:45.866798  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:45.867180  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:45.868553  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:45.869361  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:45.870626  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 59953.3us
I20260709 13:03:45.874976  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:45.875869  8385 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:45.877660 14689 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:03:45.879532  9261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.880564  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:45.882108  8426 leader_election.cc:400] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 18. Current term is 19.
I20260709 13:03:45.882161  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:45.882604  8426 leader_election.cc:403] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:03:45.882320  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:45.883633  8386 raft_consensus.cc:1275] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:45.823976 14835 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:03:45.886277  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 60896.8us
I20260709 13:03:45.853770 14828 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:45.889366  8377 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 25 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 24. Current term is 25. Ops: [24.17-24.17]
I20260709 13:03:45.890255  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:45.890183  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:45.887602  8427 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:45.888615  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:45.891654  8379 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
I20260709 13:03:45.853439 14786 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:45.893517 14619 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 18. Current term is 19.
I20260709 13:03:45.886698 14575 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.895206 14064 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:45.895375 14764 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:45.886474 14835 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:03:46.056573  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.878783 14386 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:45.881834 14750 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.898586  8501 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:46.061115  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:45.899240 14658 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:45.902211 14318 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:45.891862  8383 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:45.907315  8427 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:45.907935 14787 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:45.908011 14180 raft_consensus.cc:3055] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:46.071283 14180 raft_consensus.cc:740] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:45.909703  8384 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 20 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:46.037956 14599 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:45.915031  8460 raft_consensus.cc:1240] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:45.915844  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:45.916815  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:46.007200  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.947181  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.044147  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:46.065340  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 166829us
I20260709 13:03:46.080700  8501 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:46.082055  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:46.083407 14776 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:46.083976 14776 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.085690 14689 consensus_queue.cc:1059] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:46.086274 14776 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:46.086913 14689 raft_consensus.cc:3055] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:46.087421 14689 raft_consensus.cc:740] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:46.088501 14689 consensus_queue.cc:260] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.092685  8351 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:46.059216 14835 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:45.913709  8459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:46.100184  8459 raft_consensus.cc:606] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:46.100606  8459 raft_consensus.cc:614] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:46.070504  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:46.101194  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:46.043258 14807 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:46.101455  8386 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:03:46.049450 14775 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:46.069115  8382 raft_consensus.cc:2393] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 16: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:46.090449 14689 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:46.090751 14804 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.098964  8351 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:46.102240  8456 raft_consensus.cc:2393] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 15: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:46.102742  8501 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:46.062542 14434 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:46.106469  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.107475  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.078979 14334 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:46.050769 14575 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.097383 14706 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:46.072448 14180 consensus_queue.cc:260] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.090859 14787 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:46.099071 14735 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:46.104974 14758 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:46.117115  8501 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:46.139582  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.142644  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:46.066226 14750 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.124950 14118 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:46.158836  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 251577us
I20260709 13:03:46.128304 14811 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.157433  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.097554 14599 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.125658 14736 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:46.161674  8427 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:46.156767  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.127570 14804 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.140225 14806 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:46.144070 14758 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.145112 14787 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:46.141103 14434 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.174572  9291 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:46.175258 14599 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:46.175446 14435 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.175943  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.148906 14334 raft_consensus.cc:697] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:46.146674 14706 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.176621  8381 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
I20260709 13:03:46.178201  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.170471 14180 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:46.197530  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 48660.1us
I20260709 13:03:46.199196  8501 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:46.172214  8427 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:46.124275 14807 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.166565 14738 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.151048  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.204980  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:46.205644  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:46.205909 14852 log.cc:927] Time spent T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:03:46.206566  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:46.180145 14729 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:46.170017 14736 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:46.201915  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:46.180999 14549 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:46.202432  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:46.206007  8380 raft_consensus.cc:2410] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:03:46.179127  9261 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:46.213631  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:46.214267  8380 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:46.119459 14775 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.183732 14758 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:46.210412  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.191529 14787 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:46.211863  8385 raft_consensus.cc:2393] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 16: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:46.214305 14841 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:46.212222  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 113534us
I20260709 13:03:46.168540 14118 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:46.237572  8270 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 455c5d2786974d92a3ee8b825edcfaa7 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:46.238883 14118 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:46.170195 14811 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:46.241642 14858 log.cc:927] Time spent T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:03:46.242722 14811 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:46.218953  8427 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:46.243168 14064 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:46.243821 14064 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:46.244107  8427 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:46.215929  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:46.220059  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.183986 14848 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:03:46.229449  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:46.211575 14736 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:46.250183  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.230273 14435 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:46.230530  8457 raft_consensus.cc:2368] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 20. Current term is 21.
I20260709 13:03:46.230681 14841 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:46.230885 14334 consensus_queue.cc:237] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:46.231489 14860 log.cc:927] Time spent T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:03:46.231688  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 58952.9us
I20260709 13:03:46.234737 14293 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:46.235421 14775 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:46.236189 14386 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:46.251772  8459 raft_consensus.cc:1240] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:46.253244  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:46.288977  9261 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:46.289204  8384 raft_consensus.cc:2410] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:03:46.215488 14549 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:46.290015  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 69345.6us
I20260709 13:03:46.290205 14549 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:46.276258  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.290856 14862 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:46.286580 14868 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:46.298768 14868 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.286765 14710 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.301571 14710 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.220939 14432 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:46.306599  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:46.215731 14863 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:46.312335  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:46.317991  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:46.318626  8379 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:46.249637 14750 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:46.249964 14754 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:46.320055  8424 leader_election.cc:400] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 18. Current term is 19.
I20260709 13:03:46.342612  8424 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:46.318665  8501 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:46.301012 14868 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:46.288614 14764 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:46.328070 14599 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.331416 14549 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.309993 14432 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.333801 14804 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:46.335268 14434 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:46.264798  8386 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 21.
I20260709 13:03:46.335640 14706 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:46.336735 14575 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:46.371726 14599 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.365518 14841 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:46.345618  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 55141.4us
I20260709 13:03:46.380228 14599 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:46.382520  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:46.383519  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:46.384164  9296 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 18.
I20260709 13:03:46.385038  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:46.385913  9290 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:46.386955  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:46.386978  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:46.388718  8386 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 10.
I20260709 13:03:46.388864  8427 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:46.389778  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:46.392707  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:46.394412  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:46.374693 14432 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:46.352102  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:46.349208  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 235087us
I20260709 13:03:46.289834 14647 consensus_queue.cc:1048] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.066s
I20260709 13:03:46.400499  8383 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:46.370796  8379 raft_consensus.cc:2468] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 21.
I20260709 13:03:46.372536  8380 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:46.338017 14807 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:46.358413 14050 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:03:46.378152 14872 log.cc:927] Time spent T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:03:46.212352 14738 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.374154 14870 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.345487  8501 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:46.404467  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:46.410728  8379 raft_consensus.cc:2393] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 22: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:03:46.410611  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 65254.9us
I20260709 13:03:46.395607 14118 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:46.411592  8501 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:46.401587 14064 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:46.401117 14804 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:46.417589 14118 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.425760 14118 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:46.436489 14118 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:46.409035 14050 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:46.400907 14706 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:03:46.437045 14118 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.416487 14870 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.449867 14118 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:46.451300 14870 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:46.455904 14828 consensus_meta.cc:287] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.000s
I20260709 13:03:46.456424 14828 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:46.456086 14758 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.416317 14775 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:46.457387 14775 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:46.457823 14775 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:46.424839 14831 raft_consensus.cc:3055] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:46.459334 14831 raft_consensus.cc:740] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:46.460237 14831 consensus_queue.cc:260] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.461338 14831 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:46.461745 14876 log.cc:927] Time spent T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:03:46.467825 14874 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.468532 14874 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.418188 14575 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:46.469949 14575 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.470359 14575 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:46.470927 14874 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:46.474742 14738 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:46.475292 14758 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:46.477028 14549 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 23 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:46.420323 14730 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:46.477839 14730 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.420651 14804 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:46.479354 14804 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:46.482416 14814 consensus_meta.cc:287] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.724s	user 0.011s	sys 0.000s
I20260709 13:03:46.482887 14814 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:46.483598  8453 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
W20260709 13:03:46.485807 14838 log.cc:927] Time spent T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.968s	user 0.008s	sys 0.004s
I20260709 13:03:46.486600  8377 raft_consensus.cc:2468] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:46.489022  8501 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:46.497970  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:46.498917  9295 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:03:46.447021 14050 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:46.468868 14835 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.509718 14432 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.511085 14835 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:46.512290 14706 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:46.515056  8461 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:46.497812 14870 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:46.517524 14870 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:46.517890 14870 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:46.518249 14775 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.520354 14775 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:46.504532 14736 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.512526 14432 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:46.456729 14786 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.527590  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:46.528462  9292 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:46.538869  9295 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 23.
I20260709 13:03:46.540234  8426 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:46.568531  9292 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:46.546736 14758 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.491945 14787 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.525367 14804 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.547014 14434 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:46.550081 14835 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:46.577365 14434 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.583563 14434 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:46.577350 14735 raft_consensus.cc:697] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 20 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:46.585028 14735 consensus_queue.cc:237] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.586790  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:46.587421  8380 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
I20260709 13:03:46.588307  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:46.578724  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:46.589375  8379 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 15: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:46.589597  8531 raft_consensus.cc:1240] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:46.591320  8456 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:46.595501  8530 raft_consensus.cc:1275] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:46.598004  8530 raft_consensus.cc:1240] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:46.599287  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:46.600104  9292 raft_consensus.cc:2393] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 15: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:46.600425  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:46.601679  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:46.603367  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:46.604203  8529 raft_consensus.cc:2410] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:03:46.604988  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:46.592352  9261 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:46.606827 14874 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:46.607208 14874 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:46.607779 14874 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:46.610339 14736 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:46.611444 14730 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:46.615335  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:46.616004  8382 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:46.617509  8378 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:03:46.616876  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:46.619199  8382 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:03:46.607127  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.621186  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:46.656615  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.670387  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:46.684767  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:46.685889 14050 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.685935  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:46.686794 14855 log.cc:927] Time spent T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.813s	user 0.003s	sys 0.000s
I20260709 13:03:46.687016  8380 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:46.686134  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.671751  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:46.689618  8379 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:46.690112  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.691219  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.580462 14786 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:46.683404 14706 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:46.680096 14575 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.693828  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.694077  8533 raft_consensus.cc:1240] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:46.694523  8453 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:46.695479  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.696218  8453 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 18: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:46.697782 14575 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:46.680960 14874 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.699968 14874 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:46.703619 14787 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:46.703824  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:46.704661  8381 raft_consensus.cc:2393] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 14: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:46.592489 14835 raft_consensus.cc:697] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 23 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:46.705749 14835 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.709622 14804 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:46.693647 14706 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.711146  8380 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:03:46.712316 14706 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:46.713923  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:46.715124  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:46.715657  8455 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:46.717423  8379 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 23.
I20260709 13:03:46.692381  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.720893  8461 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:46.722410  8461 raft_consensus.cc:1240] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:46.723039  9260 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:46.682539 14870 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.726078  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:46.730821  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.575520 14758 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.734053  9260 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:46.692301  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.617291  8501 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:46.779177 14710 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:46.791335  8381 raft_consensus.cc:1240] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:46.741587 14831 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:03:46.741698  8461 raft_consensus.cc:1240] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:46.688249 14050 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:46.787444 14758 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:46.745740 14828 consensus_queue.cc:1059] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:03:46.809023 14828 raft_consensus.cc:3055] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:46.809537 14828 raft_consensus.cc:740] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:46.809175  8280 catalog_manager.cc:5697] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 8 to 16. New cstate: current_term: 16 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:46.810750  8280 catalog_manager.cc:5697] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 17 to 20, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 20 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:46.810472 14828 consensus_queue.cc:260] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.732105 14679 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:46.761231 14549 consensus_queue.cc:1059] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
W20260709 13:03:46.760623 14880 log.cc:927] Time spent T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:03:46.812846 14828 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:46.780848 14847 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.991s	user 0.000s	sys 0.004s
I20260709 13:03:46.814267  8456 raft_consensus.cc:1275] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:46.812373  8280 catalog_manager.cc:5697] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 12 to 19, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 19 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:46.755048  8382 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:46.751045  8424 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:46.818045 14679 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:46.818544 14679 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:46.744743  8535 raft_consensus.cc:1240] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:46.784782  8459 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:46.739041 14874 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:46.743361 14318 consensus_queue.cc:1048] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:03:46.819300 14750 raft_consensus.cc:3055] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:46.821316 14750 raft_consensus.cc:740] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:46.821436  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2913) took 1165 ms. Trace:
I20260709 13:03:46.742337 14862 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:46.822304 14862 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:46.822939 14862 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:46.821851  8527 rpcz_store.cc:276] 0709 13:03:45.655987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.656130 (+   143us) service_pool.cc:224] Handling call
0709 13:03:45.656432 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:45.666144 (+  9712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:45.666192 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:45.679148 (+ 12956us) log.cc:844] Serialized 26 byte log entry
0709 13:03:45.753685 (+ 74537us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:45.754082 (+   397us) log.cc:844] Serialized 14 byte log entry
0709 13:03:45.754289 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:45.754360 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:46.780148 (+1025788us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:46.815890 (+ 35742us) raft_consensus.cc:1685] finished
0709 13:03:46.821224 (+  5334us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:46.821379 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32561,"prepare.queue_time_us":1057,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":13837,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":52894,"spinlock_wait_cycles":4791040,"thread_start_us":74151,"threads_started":1,"wal-append.queue_time_us":110638}
I20260709 13:03:46.823179 14750 consensus_queue.cc:260] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.755626  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:46.738191  9260 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:46.800499  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 78308.4us
I20260709 13:03:46.801558  8455 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
W20260709 13:03:46.802232  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 185058us
I20260709 13:03:46.734588  8380 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:46.803666 14658 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:46.730480 14706 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.829003  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:03:46.841939  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 90982.5us
I20260709 13:03:46.831295  8459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b3df375d584465c8712d996256828cf"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:46.842937  8459 raft_consensus.cc:606] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:46.843291  8459 raft_consensus.cc:614] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:46.832406  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:46.836669  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:46.833492  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.833845  8427 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:46.842340  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 104212us
I20260709 13:03:46.845454  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:46.847461  8461 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 18: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
W20260709 13:03:46.851137  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.854696  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:46.861573 14874 consensus_queue.cc:1059] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:46.862684 14874 raft_consensus.cc:3055] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:46.862776  8456 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 16.
I20260709 13:03:46.863106 14874 raft_consensus.cc:740] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:46.863912 14874 consensus_queue.cc:260] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:46.849524 14541 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:46.871271  8427 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:46.845999 14831 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:46.873126 14318 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:46.841817 14658 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.874639 14658 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:46.877318  8349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.850219 14706 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.884294  8427 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:46.885648  8427 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:46.890826  9291 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 18.
I20260709 13:03:46.898428  8381 raft_consensus.cc:1240] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:46.879670 14750 raft_consensus.cc:3060] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:46.921319  8454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53010 (request call id 1329) took 1041 ms. Trace:
I20260709 13:03:46.921772  8454 rpcz_store.cc:276] 0709 13:03:45.879690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.880481 (+   791us) service_pool.cc:224] Handling call
0709 13:03:45.890707 (+ 10226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:46.444435 (+553728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:46.444466 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:46.444509 (+    43us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:46.444555 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.921047 (+476492us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b54001e69d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:46.921118 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:46.921261 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1272962304}
I20260709 13:03:46.894423 14541 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:46.927846  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.865851 14840 consensus_queue.cc:1059] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:03:46.909785 14874 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:46.893914 14873 raft_consensus.cc:2804] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:46.930473  8453 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:46.895407 14549 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:46.933804  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.942106  8459 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:46.934432  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.942770  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:46.939719  8453 raft_consensus.cc:606] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:46.943440  8453 raft_consensus.cc:614] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:46.941133  8427 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:46.935894  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.943819  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.944550  8456 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 12.
I20260709 13:03:46.926875 14870 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:46.948304  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:46.948460  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:46.951697  9291 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 15: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:46.952093  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:46.904987 14679 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.955108  8381 raft_consensus.cc:1275] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:46.957320  8384 raft_consensus.cc:1275] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:46.957875 14658 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:46.959234  8456 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 15: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:46.957010  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:46.964818  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:46.965104  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:46.945005 14541 raft_consensus.cc:697] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:46.947415 14620 raft_consensus.cc:3055] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:46.969300  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:46.964267  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:46.971841 14754 consensus_queue.cc:1048] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:46.976075  8459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c80796a5190345179ad066af334e5bae"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:46.954064 14840 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:46.947753 14873 raft_consensus.cc:697] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 21 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:46.977519  8500 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:46.978860  8459 raft_consensus.cc:606] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:46.984398  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:46.984404  8459 raft_consensus.cc:614] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:46.985950  8500 leader_election.cc:400] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17.
I20260709 13:03:46.987411  8533 raft_consensus.cc:1240] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:03:46.955767 14730 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:46.996505  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:46.998404  8500 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:47.006284 14706 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:46.978119 14620 raft_consensus.cc:740] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:46.960529 14549 consensus_queue.cc:1059] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:03:47.008772  8500 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:46.978920 14050 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:46.991300 14718 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:46.978684 14787 consensus_queue.cc:1048] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:03:47.006858 14334 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:47.009963 14736 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:47.030588 14334 raft_consensus.cc:697] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:47.031347 14848 consensus_queue.cc:1059] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:47.031651 14334 consensus_queue.cc:237] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:47.034265 14679 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:47.035681 14549 raft_consensus.cc:3055] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:47.036163 14549 raft_consensus.cc:740] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:47.039855  8453 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:47.040539  8453 raft_consensus.cc:606] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:47.042037  8500 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:47.011910 14730 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:47.044075 14718 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:47.044453  8500 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:47.040865 14679 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:47.023512 14050 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:47.061964 14883 consensus_queue.cc:1059] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:03:47.066978 14730 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:47.067659 14730 consensus_queue.cc:1059] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:47.069873  8385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 2831) took 1193 ms. Trace:
I20260709 13:03:47.070307  8385 rpcz_store.cc:276] 0709 13:03:45.877000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.877160 (+   160us) service_pool.cc:224] Handling call
0709 13:03:47.069659 (+1192499us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400350054. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:47.069817 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":755591424}
I20260709 13:03:47.072381  8384 raft_consensus.cc:1240] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:47.053937 14718 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:47.074453  8452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36448 (request call id 2725) took 1029 ms. Trace:
I20260709 13:03:47.075034 14718 raft_consensus.cc:3055] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:47.074927  8452 rpcz_store.cc:276] 0709 13:03:46.045280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.308789 (+263509us) service_pool.cc:224] Handling call
0709 13:03:46.309212 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:46.361807 (+ 52595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:46.361852 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:46.361907 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:46.361954 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.074217 (+712263us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b54001590d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:47.074265 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:47.074395 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120536832}
I20260709 13:03:47.075716 14718 raft_consensus.cc:740] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:47.078539 14050 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:47.042062 14541 consensus_queue.cc:237] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.078856 14718 consensus_queue.cc:260] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.082763 14549 consensus_queue.cc:260] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.095515  8427 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:47.096316 14603 consensus_queue.cc:1059] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:47.097666 14603 raft_consensus.cc:3055] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:47.098024 14603 raft_consensus.cc:740] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:47.098872 14603 consensus_queue.cc:260] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.100214 14603 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:47.105279  8461 raft_consensus.cc:2468] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
I20260709 13:03:47.116760  8457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36448 (request call id 2717) took 1309 ms. Trace:
I20260709 13:03:47.117314  8457 rpcz_store.cc:276] 0709 13:03:45.807843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.808046 (+   203us) service_pool.cc:224] Handling call
0709 13:03:47.116564 (+1308518us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b540041ad54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:47.116698 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":968268672}
I20260709 13:03:47.038617 14873 consensus_queue.cc:237] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:47.133664  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 114345us
I20260709 13:03:47.139005  8377 raft_consensus.cc:1240] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:47.139484 14862 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:47.140686  9292 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:47.147723 14679 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.114001 14787 raft_consensus.cc:2804] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:47.152503  8501 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:47.172808 14064 consensus_queue.cc:1059] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:47.175015 14787 raft_consensus.cc:697] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:47.175940 14787 consensus_queue.cc:237] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.061347 14620 consensus_queue.cc:260] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.148593 14679 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:47.122143 14828 consensus_queue.cc:1059] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
W20260709 13:03:47.204257  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.205425  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:47.205765  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:47.185642 14809 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.185817 14849 raft_consensus.cc:2804] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:47.209142  8351 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:47.209723  9289 raft_consensus.cc:1240] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:47.208086  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:47.213204 14706 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:47.191212 14658 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:47.222605  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:47.220718 14620 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:47.226822 14806 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:47.230345 14849 raft_consensus.cc:697] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:47.238240 14293 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:03:47.264832  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 204743us
I20260709 13:03:47.260608 14874 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:47.279290 14862 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:47.281018  8528 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:47.283856  8500 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:47.248974 14706 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:47.286408  8526 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:47.221240 14809 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.295099  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:47.252311 14883 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.298761  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:47.301644 14892 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:47.309144 14892 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.309562 14892 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:47.313143 14809 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:47.307017 14849 consensus_queue.cc:237] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.320521 14736 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:47.321074 14750 consensus_queue.cc:1059] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:47.330650 14750 raft_consensus.cc:3055] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:47.331043 14750 raft_consensus.cc:740] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:47.288977 14293 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:47.331923 14750 consensus_queue.cc:260] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:47.333194 14293 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:47.333758 14679 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:47.340188 14318 raft_consensus.cc:3055] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:47.340833 14318 raft_consensus.cc:740] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:47.341750 14318 consensus_queue.cc:260] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.340157  8454 raft_consensus.cc:2468] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:03:47.354940 14882 raft_consensus.cc:3055] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:47.355413 14882 raft_consensus.cc:740] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:47.356451 14882 consensus_queue.cc:260] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:47.355406 14893 log.cc:927] Time spent T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:03:47.358412 14883 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:47.360613 14883 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:47.364188  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 69168.5us
I20260709 13:03:47.365803  8500 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:47.373755 14735 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:47.374229 14735 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.374581 14735 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:47.393483  8500 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:47.371371 14899 log.cc:927] Time spent T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.093s	user 0.003s	sys 0.000s
I20260709 13:03:47.399696  8379 raft_consensus.cc:1240] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:47.402232  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:47.398190  8500 leader_election.cc:400] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 20. Current term is 21.
I20260709 13:03:47.294452 14874 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:47.381357 14679 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:47.406973  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 184459us
W20260709 13:03:47.419030  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.397598  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 75303.4us
I20260709 13:03:47.413725  8500 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:47.383564 14862 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:47.400343 14658 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:47.396358 14050 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:47.406725 14806 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:47.426800  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:47.427218  8500 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:47.433003  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:47.412961 14892 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.429482 14891 raft_consensus.cc:2804] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:47.443511 14863 consensus_queue.cc:1059] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:47.435495 14050 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:47.444527 14496 raft_consensus.cc:3055] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:47.445073 14496 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:47.445937 14496 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.447364 14496 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:47.439622 14871 consensus_queue.cc:1059] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:03:47.454370 14871 raft_consensus.cc:3055] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:47.454782 14871 raft_consensus.cc:740] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:47.455648 14871 consensus_queue.cc:260] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.434804 14318 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:47.428987 14862 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:47.459190 14862 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:47.435631 14758 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:47.428045 14902 consensus_queue.cc:1059] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:03:47.460412 14496 raft_consensus.cc:3055] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:47.460886 14903 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:47.460880 14496 raft_consensus.cc:740] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:47.420228 14679 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:47.464113 14787 consensus_queue.cc:1175] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d653e71832b7402b9a03b46249d3b885" responder_term: 17 status { last_received { term: 17 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 17 index: 12 } }
I20260709 13:03:47.468111 14706 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:47.444662 14809 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:03:47.471120 14549 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:47.456885 14871 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:47.471997  8351 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:47.475108  8351 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:47.479367  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:47.479796  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:47.479975  8457 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 20.
I20260709 13:03:47.480401  8461 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:47.481909  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:47.483287  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:47.483875  9260 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:47.484735  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:47.485875  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:47.486425  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:47.487239  8386 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:47.488605  8382 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:47.490847  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:47.491725  8530 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:47.492931  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:47.493157  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:47.494614  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:47.494797  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:47.495693  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:47.496512  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.497745 14293 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:47.498054  8527 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:47.499003  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:47.499979  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:47.500509  8527 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:47.500612 14658 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:47.501683  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:47.502347  9261 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:47.488274  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:47.503703  8381 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 25.
I20260709 13:03:47.505473  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:47.505790  8501 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:47.432690 14806 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.506668  8460 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:47.510756  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:47.511839 14894 log.cc:927] Time spent T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:03:47.511905 14883 consensus_queue.cc:1059] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:47.513451  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:47.514132 14883 raft_consensus.cc:3055] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:47.514467 14825 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:47.516111 14891 raft_consensus.cc:697] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 20 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:47.517627  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:47.520339  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:47.520936  9292 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 24.
I20260709 13:03:47.521874  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:47.522660  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:47.523697  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:47.524360  9291 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:47.488972  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:47.508754  8527 raft_consensus.cc:2393] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 17: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:47.533257  8534 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 15: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:47.521391  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:47.542465  8386 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:47.543810 14496 consensus_queue.cc:260] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.501556 14809 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:47.556203  8531 raft_consensus.cc:1275] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:03:47.556738  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 51030.7us
I20260709 13:03:47.556789  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:47.558584  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:47.505689 14758 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:47.555805  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:47.562278  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:47.566746  8382 raft_consensus.cc:2393] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 25: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:47.556604  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:47.519405 14759 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:47.578433  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:47.517006 14891 consensus_queue.cc:237] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.579530 14575 raft_consensus.cc:3055] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:47.580010 14575 raft_consensus.cc:740] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:47.567674  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:47.564882 14870 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:47.585390 14718 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:47.569263 14882 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:47.549599 14736 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:47.544556 14334 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.550405 14754 consensus_queue.cc:1059] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:03:47.574185 14892 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:47.575523 14898 log.cc:927] Time spent T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.254s	user 0.001s	sys 0.001s
I20260709 13:03:47.514503 14883 raft_consensus.cc:740] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:03:47.597617  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.546777 14706 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:47.549110 14496 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:47.565959 14758 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.624624  8351 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:47.636351  8453 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 21.
I20260709 13:03:47.637163  8351 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:47.616742 14759 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.661803  8500 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:47.665097  8501 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:47.621289 14874 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:47.625311 14758 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:47.611665 14736 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.635139 14706 raft_consensus.cc:697] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 18 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:47.599646 14575 consensus_queue.cc:260] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.614310 14334 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.691200  8382 raft_consensus.cc:1275] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:47.669662 14759 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:47.668092 14814 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.624562 14735 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:47.704095  8456 raft_consensus.cc:2410] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 13:03:47.709618  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.714229 14679 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:47.714879 14334 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:47.715701 14706 consensus_queue.cc:237] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:47.718220 14806 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:47.730283  8526 raft_consensus.cc:1240] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:47.712409 14814 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:47.733845 14914 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:47.734912 14814 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:47.697893 14849 consensus_queue.cc:1059] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:03:47.735807 14849 consensus_queue.cc:1243] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer 105d6581548546b98eddd4ee7083bb12 log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:47.736070 14759 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:47.736364 14849 raft_consensus.cc:3055] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:47.736773 14849 raft_consensus.cc:740] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:47.737668 14849 consensus_queue.cc:260] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.739714 14849 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:47.738812 14575 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:47.732777 14913 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:47.757681 14913 raft_consensus.cc:697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 21 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:47.759035 14913 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.738588 14735 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:47.779996 14809 raft_consensus.cc:697] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:47.780385 14915 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:47.780881 14915 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.781270 14915 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:47.781963 14809 consensus_queue.cc:237] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:47.790036  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 205608us
I20260709 13:03:47.791162  8349 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:47.752200 14806 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:47.706718 14710 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:03:47.803807  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:47.804512  8531 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 25.
I20260709 13:03:47.802254 14806 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.814450 14806 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:47.805651 14735 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.821609 14735 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:47.823808 14735 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:47.827211 14806 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.831202  8535 raft_consensus.cc:3055] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:03:47.831966  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 174215us
I20260709 13:03:47.852545  9261 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:47.854789  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:47.851243  8535 raft_consensus.cc:740] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:03:47.834084  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 169069us
I20260709 13:03:47.831480  9258 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:47.858665  8501 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:47.862485  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 200767us
I20260709 13:03:47.867774  9261 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:47.869655  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 76244.7us
I20260709 13:03:47.871884  8527 raft_consensus.cc:1275] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:03:47.872396  8527 pending_rounds.cc:85] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 8
I20260709 13:03:47.872620  8527 pending_rounds.cc:107] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:03:47.857275  8535 consensus_queue.cc:260] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.872967  8527 raft_consensus.cc:2889] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:47.873350  8535 raft_consensus.cc:3060] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:47.870899 14866 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:03:47.868834 14293 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:47.883665  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:47.886744  8501 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:47.884219  9289 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:03:47.895732  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:47.873342 14917 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:47.878160 14849 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:47.912292  9293 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 23.
I20260709 13:03:47.917656 14828 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:47.905933  8280 catalog_manager.cc:5697] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 14 to 17, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 17 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:47.923612 14907 log.cc:927] Time spent T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.375s	user 0.007s	sys 0.000s
I20260709 13:03:47.891008  8461 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 23.
I20260709 13:03:47.873458 14831 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:47.904203  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:47.896118 14736 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:47.947590  9260 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:47.880151  8349 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:47.951730  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:47.944820  8426 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:47.953907  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:47.961582  8461 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:47.916505 14863 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:47.964241  9292 raft_consensus.cc:1240] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 13. Current term is 14. Ops: []
W20260709 13:03:47.955308  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 68654.7us
I20260709 13:03:47.891611 14866 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:47.945838  8526 raft_consensus.cc:3060] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:47.968240  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 70685.4us
I20260709 13:03:47.972309  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:47.973893 14917 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:47.967430 14863 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:47.975049 14806 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:47.946736 14828 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:47.979017  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:47.898079 14922 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.065s
I20260709 13:03:47.959383 14923 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:03:48.010488 14863 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:48.010612 14923 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.011126 14923 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:48.011251 14828 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.013581 14828 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:48.014684 14915 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:48.017248 14922 consensus_queue.cc:1243] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer b8eb0ad4490645598004d862412f4e31 log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 13:03:48.018242 14905 log.cc:927] Time spent T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.311s	user 0.003s	sys 0.000s
I20260709 13:03:48.016829 14915 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:47.987509  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 107589us
I20260709 13:03:47.949793 14742 consensus_queue.cc:1059] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:03:47.967621 14549 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:48.008534  8532 raft_consensus.cc:1240] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:47.970145 14647 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:48.033774  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:48.027308  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:48.035130  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:48.038111 14883 consensus_queue.cc:260] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.039013 14870 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:48.039225 14883 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:47.973191  8501 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:48.041468  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 55941.1us
I20260709 13:03:48.010066  8535 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 13:03:48.043183  8535 pending_rounds.cc:85] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 13
I20260709 13:03:48.028343  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:48.043422  8535 pending_rounds.cc:107] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:03:48.043702  8535 raft_consensus.cc:2889] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:48.030315  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:48.044275  8528 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:48.032054  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:47.979943 14866 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:48.032743  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:48.059862  8530 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 20.
I20260709 13:03:48.031448 14549 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.033959 14647 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.069300 14647 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:48.070570 14932 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.071161 14932 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:48.073172 14932 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:48.075362 14549 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:48.077759 14318 consensus_queue.cc:1059] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:48.046727  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:48.063905 14875 raft_consensus.cc:3055] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:48.087898  8533 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:48.088140 14875 raft_consensus.cc:740] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:48.047387  8526 raft_consensus.cc:1275] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:48.090523 14934 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.045383  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:48.093366  8528 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:48.047791  8529 pending_rounds.cc:85] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 14
I20260709 13:03:48.060361  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:48.094714  8529 pending_rounds.cc:107] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:03:48.094895  8452 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:48.095049  8529 raft_consensus.cc:2889] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:48.061005  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:48.095847  8453 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:48.029460  8349 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:48.065497  8460 raft_consensus.cc:1240] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 21 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:48.062325 14870 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:03:48.085553  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 112482us
I20260709 13:03:48.097741 14848 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:48.098800  8461 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:03:48.099215  8501 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:48.030931 14873 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.100708 14848 consensus_queue.cc:1048] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:48.100652 14873 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.104249 14873 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:48.086557  8500 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:48.105690  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:48.118357  8500 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:48.123257  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:48.124722  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 95371.8us
I20260709 13:03:48.125530  8349 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:48.127768  8453 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:48.073163 14750 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:48.150432  8349 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:48.132370  8351 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:48.161970  8533 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:48.164340  8452 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 21.
I20260709 13:03:48.132318 14870 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:48.131927 14891 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:48.130436 14849 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:48.173626  8349 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:48.144236 14903 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:48.175247  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:48.176064  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:48.176254  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:48.176813  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:48.195407  8378 raft_consensus.cc:2393] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 16: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:48.086578 14758 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:48.179198  8528 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 21.
I20260709 13:03:48.181859  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:48.091101 14934 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.176759  8351 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:48.198134  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:48.196786  8500 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:48.229053  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 55501.6us
I20260709 13:03:48.165226 14718 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:48.163998 14806 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:48.163563 14873 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.177302 14931 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:48.148061 14923 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.245618  8501 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:48.181001 14917 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:48.248068  8385 raft_consensus.cc:2393] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 17: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:48.248410  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:48.178406 14891 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:48.250582  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 69555.2us
I20260709 13:03:48.250849  8349 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:48.247797  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:48.255383  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.200511 14903 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:48.237893 14940 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.239773 14804 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:48.270541  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:48.259785 14718 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.266566 14873 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.259122 14915 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:48.269618  9293 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
I20260709 13:03:48.307134  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:48.258807 14905 log.cc:927] Time spent T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:03:48.243763 14809 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:03:48.297395  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 46692.7us
I20260709 13:03:48.322613  8349 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:48.324600 14933 log.cc:927] Time spent T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:03:48.329717 14923 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 26 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:48.331296 14934 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:48.332966  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:48.298098  8500 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:48.256903 14849 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:48.298839  8501 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:48.299870 14575 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:48.344345  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.346650  9290 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:48.315541 14647 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.353184 14923 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:48.354750 14647 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:48.301602 14903 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:48.357857 14549 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.360622 14549 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 24 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:48.362660 14718 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:48.362879  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:48.363745  8454 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 24: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:48.343731 14809 raft_consensus.cc:697] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 21 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:48.365272 14809 consensus_queue.cc:237] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:48.369268 14866 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.372288 14866 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:48.378973  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:48.379663  9293 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:48.382079  8349 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:48.383797  8349 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:48.384102  8426 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:48.385291  8426 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:48.386032 14787 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:48.386650 14787 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:48.386965 14787 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.387270 14787 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:48.296478 14891 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:48.390604  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:48.391376  8535 raft_consensus.cc:2368] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 25. Current term is 26.
I20260709 13:03:48.340246 14771 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:48.392282 14771 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:48.394388 14771 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:48.395401  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 96634.2us
I20260709 13:03:48.348420 14848 consensus_queue.cc:1048] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:48.396587 14658 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:48.299429 14917 raft_consensus.cc:697] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:48.394961  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:48.341777  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:48.397950 14718 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:48.397820 14917 consensus_queue.cc:237] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:48.398697 14804 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:48.398912  8500 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:48.400200 14932 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:48.400835 14932 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:48.305135 14806 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:48.309039 14940 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.403632 14940 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:48.319916 14915 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.408197  9258 leader_election.cc:400] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 25. Current term is 26.
I20260709 13:03:48.408660  9258 leader_election.cc:403] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
W20260709 13:03:48.354897 14936 log.cc:927] Time spent T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:03:48.350370 14873 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:48.412856 14825 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.412663 14875 consensus_queue.cc:260] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:48.413831 14875 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:48.413432 14825 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.414346 14647 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.414901 14647 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.416950 14647 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:48.419832  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:48.421491  8456 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:03:48.421586 14825 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:48.423508  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:48.424190  8535 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:03:48.425519  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:48.426194  8454 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:03:48.427543  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:48.428134  8454 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:03:48.429180  9260 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:48.429777 14334 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:48.430383 14825 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:48.430775 14825 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.431087 14787 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.431123 14825 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:48.405575  9293 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 26.
I20260709 13:03:48.437379  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:48.438881  8456 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:48.441124  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:48.441393  8382 raft_consensus.cc:1275] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:48.441771  9292 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:48.443325  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:48.443938  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:48.444530  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:48.445405  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:48.437335  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:48.447235  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:48.447842  8381 raft_consensus.cc:3060] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:03:48.408382 14903 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.449263  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:48.449796  8383 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
W20260709 13:03:48.451635  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.454898  9291 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:48.455685  9292 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 24: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:48.456499  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:48.448318  8500 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:48.460529  8459 raft_consensus.cc:2393] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 20: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:48.460632  8456 raft_consensus.cc:2393] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 18: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:48.461162  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:48.461908  8453 raft_consensus.cc:2393] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 17: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:48.462659  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:48.463267  8532 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:48.465230  8385 raft_consensus.cc:1275] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:03:48.445560  9260 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:48.472990  9260 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:48.453322 14827 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 25. Current term is 26.
I20260709 13:03:48.479760  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:48.482880  8454 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:48.493402  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:48.498956  8385 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:48.496578  8382 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:48.498396  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 50210.2us
I20260709 13:03:48.501219  8380 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:48.459915 14866 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:48.503698  8460 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:48.504040  8427 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:48.513919  8385 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 26.
I20260709 13:03:48.478271 14873 consensus_queue.cc:1048] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:03:48.518573 14866 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.453470 14758 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:48.520560  8500 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:48.524307  8381 raft_consensus.cc:2468] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 24.
I20260709 13:03:48.524516  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:48.526537  8386 raft_consensus.cc:2393] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 24: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:48.477386 14923 raft_consensus.cc:697] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:48.527110  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:48.498028 14940 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:48.537523 14940 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.538040 14940 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:48.533576 14949 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:48.541464 14949 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:48.544684 14658 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:48.546378  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:48.546684  8530 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:48.547655  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:48.523152 14919 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:48.526039 14913 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:03:48.549422  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:48.549777 14866 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:48.550752 14919 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.562629 14863 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.563349 14863 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:48.565850 14923 consensus_queue.cc:237] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:48.568463 14863 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:48.548868  8382 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:03:48.569962  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:48.573750 14293 raft_consensus.cc:3055] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:48.574214 14293 raft_consensus.cc:740] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:48.575124 14293 consensus_queue.cc:260] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.534125 14758 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.497880 14742 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:48.576521 14758 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:48.577107 14742 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.577669 14742 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:48.579694  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:48.579382  8280 catalog_manager.cc:5697] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:48.521860 14575 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:03:48.581421 14575 raft_consensus.cc:697] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 26 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:48.581003  8280 catalog_manager.cc:5697] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 13 to 16, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 16 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:48.581630 14891 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.582363 14575 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.582630  8280 catalog_manager.cc:5697] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:48.583346  8426 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:48.584692 14064 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.585275 14064 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:48.586292 14549 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:48.586690 14549 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.587044 14549 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:48.587368 14064 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:48.584671  8280 catalog_manager.cc:5697] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:48.588819  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 84867.5us
I20260709 13:03:48.591647  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:48.555872  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:48.594506  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:48.591652  8427 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:48.595502  8528 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:03:48.597030  8385 raft_consensus.cc:2368] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 25. Current term is 26.
I20260709 13:03:48.605041  8453 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:03:48.608943  8528 raft_consensus.cc:1240] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:03:48.608969  8349 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:48.615137  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:48.617410  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:48.618458  8528 raft_consensus.cc:2368] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16.
I20260709 13:03:48.588923 14318 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:48.631171  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:48.635033  8424 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:48.648564  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:48.633433  8349 leader_election.cc:400] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16.
I20260709 13:03:48.663132  8349 leader_election.cc:403] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:03:48.656108  8427 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:48.637493 14496 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:48.649214 14863 consensus_queue.cc:1048] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:03:48.649374 14603 consensus_queue.cc:1048] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:03:48.672816  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:48.676821  8379 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:48.677798 14871 raft_consensus.cc:2804] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:48.678511 14871 raft_consensus.cc:697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 24 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:48.665589 14848 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 13:03:48.679154  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:48.679833  8386 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:03:48.643095 14925 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:48.647190 14835 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:48.679448 14871 consensus_queue.cc:237] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:48.681671  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 48423.4us
I20260709 13:03:48.630010 14883 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 13:03:48.682987  8351 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:48.632515 14922 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:03:48.685143 14930 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:48.649377 14825 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.740686 14825 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:48.733922 14950 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.737980 14891 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:48.698462 14736 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:03:48.741441  9293 raft_consensus.cc:2368] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 18. Current term is 19.
I20260709 13:03:48.742249  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:48.767086  8454 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:48.741457 14940 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.686141 14913 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.745869 14903 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:48.686406 14835 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.747867  8452 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:48.748101 14949 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:48.699586 14848 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.749933  9260 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:48.756796  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:48.803788  8534 raft_consensus.cc:3060] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:03:48.746471 14549 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:48.726974 14809 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:48.760234  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:48.896174  9289 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:48.757472 14911 log.cc:927] Time spent T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:03:48.768311  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:48.781102  8427 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
W20260709 13:03:48.934653  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 131232us
W20260709 13:03:48.935072  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 154088us
I20260709 13:03:48.798988 14771 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.825932  8454 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 19.
W20260709 13:03:48.938479  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 188594us
I20260709 13:03:48.940168  9260 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:48.725333 14918 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 13:03:48.778313 14806 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:48.983057  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.799777 14835 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:49.006680 14809 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:49.007364 14809 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:48.766161 14950 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:49.034487  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 351703us
I20260709 13:03:48.800428 14913 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:48.999308 14064 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:48.995168 14891 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:49.013374 14945 log.cc:927] Time spent T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 13:03:49.052951  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:49.053212  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:49.004796 14758 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:49.010317 14620 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.796295 14931 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:49.043007  8352 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.026s	sys 0.065s
W20260709 13:03:49.141790  8352 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.027s	sys 0.065s
I20260709 13:03:48.953016 14742 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:49.123893  8528 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 19.
I20260709 13:03:48.950615 14771 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:49.010679 14867 raft_consensus.cc:2804] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:49.028581 14900 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.954648 14938 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:48.948774 14903 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:49.028604 14883 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.226933  8459 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 19: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:48.934345 14848 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:49.216207 14902 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.093176 14949 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:49.092288 14914 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:03:49.202354 14948 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:49.062448 14064 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.214190 14787 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:49.224452  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 280929us
I20260709 13:03:49.140545 14575 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.089s
I20260709 13:03:49.221019 14870 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.139562 14620 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:49.261061  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:49.222497 14867 raft_consensus.cc:697] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:49.180123 14758 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
I20260709 13:03:49.158926 14891 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:49.277689 14871 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.281297 14064 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:49.301064  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 253713us
I20260709 13:03:49.241622 14883 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:49.281430 14919 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:49.237351 14903 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:49.288542 14967 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:49.290881 14915 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:49.326483  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:49.327333  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:49.252650 14949 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:49.324697  9261 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:49.399931  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 75344.5us
I20260709 13:03:49.402144  9261 leader_election.cc:400] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 25. Current term is 26.
I20260709 13:03:49.325623  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:49.246332 14900 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:49.291594 14970 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.293766 14809 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:49.299814 14968 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:49.299428 14940 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:49.299808 14549 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:49.283864 14948 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:49.333643 14953 log.cc:927] Time spent T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.386s	user 0.000s	sys 0.001s
I20260709 13:03:49.416577  8379 raft_consensus.cc:3060] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:49.420145  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:49.328871 14875 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.293524 14870 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:49.423590  9289 consensus_meta.cc:287] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.000s
I20260709 13:03:49.493014  9289 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:49.414240 14975 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.248090 14902 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:49.418323 14961 log.cc:927] Time spent T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.340s	user 0.001s	sys 0.000s
W20260709 13:03:49.441385  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.324292 14871 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:49.487958  9261 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:49.418628 14915 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:49.441207 14958 log.cc:927] Time spent T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.389s	user 0.001s	sys 0.001s
W20260709 13:03:49.519089  8534 consensus_meta.cc:287] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.715s	user 0.010s	sys 0.000s
I20260709 13:03:49.541520  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:49.543210  8534 raft_consensus.cc:2468] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 19.
W20260709 13:03:49.543006  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 55504.7us
I20260709 13:03:49.493331 14940 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:03:49.494819 14950 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:49.511448 14549 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.585033  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:49.585749  8383 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:49.586756  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:49.587112 14742 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:49.407925 14967 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:49.431348 14970 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:49.535127 14981 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:49.580235 14964 log.cc:927] Time spent T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.439s	user 0.000s	sys 0.001s
I20260709 13:03:49.437597 14968 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:49.505540 14875 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:49.550447 14913 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:49.617520  8378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3887) took 1176 ms. Trace:
I20260709 13:03:49.580705 14718 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:49.624699  8378 rpcz_store.cc:276] 0709 13:03:48.440633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.452513 (+ 11880us) service_pool.cc:224] Handling call
0709 13:03:48.452917 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:48.470231 (+ 17314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:48.470276 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:48.481715 (+ 11439us) log.cc:844] Serialized 26 byte log entry
0709 13:03:48.777027 (+295312us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:48.777105 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.777195 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:49.617281 (+840086us) raft_consensus.cc:1685] finished
0709 13:03:49.617304 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:49.617455 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":24192,"thread_start_us":294914,"threads_started":1,"wal-append.queue_time_us":461872}
I20260709 13:03:49.607026 14771 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:49.550318 14915 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:49.632392  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 85543.6us
I20260709 13:03:49.491765 14867 consensus_queue.cc:237] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:49.637001  8351 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:49.627609 14959 log.cc:927] Time spent T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.394s	user 0.000s	sys 0.001s
I20260709 13:03:49.601173 14549 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:49.611529 14962 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.543s	user 0.008s	sys 0.002s
I20260709 13:03:49.655182  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:49.655707  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:49.629428 14960 log.cc:927] Time spent T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.373s	user 0.000s	sys 0.001s
I20260709 13:03:49.662575  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:49.526234 14975 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:49.650517  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:49.668888  8378 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:49.644893  8527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 3291) took 1069 ms. Trace:
I20260709 13:03:49.670305  8527 rpcz_store.cc:276] 0709 13:03:48.575463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.591873 (+ 16410us) service_pool.cc:224] Handling call
0709 13:03:48.592219 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:48.592604 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:48.592638 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:48.593136 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:03:48.776040 (+182904us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:48.776094 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.776185 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:49.644587 (+868402us) raft_consensus.cc:1685] finished
0709 13:03:49.644618 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:49.644809 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1785,"raft.queue_time_us":921,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":10905,"thread_start_us":182569,"threads_started":1,"wal-append.queue_time_us":419476}
I20260709 13:03:49.640563  8351 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:49.665884  9290 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 19: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:49.656939  8427 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:49.665474  8383 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:49.629613 14866 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:49.673719 14866 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:49.674166  8427 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:49.675191  8453 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.008s	sys 0.008s
W20260709 13:03:49.675940  8453 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.008s	sys 0.008s
I20260709 13:03:49.677172 14998 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:49.554852  8379 raft_consensus.cc:1275] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:49.676678  8427 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:49.677717 14998 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.682924  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:49.684612  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 44116.5us
I20260709 13:03:49.687906  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:49.660758 14771 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.692615  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:49.693423  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:49.662225 14620 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:49.640885 14903 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:49.703452  8457 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 19: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:49.704274  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:49.704921  8461 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:49.706399 14620 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:49.706885 14620 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.707276 14620 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:49.707532 14986 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:49.708678 14985 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:49.709751 14974 log.cc:927] Time spent T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:03:49.710142 14973 log.cc:927] Time spent T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
W20260709 13:03:49.711347 14980 log.cc:927] Time spent T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
I20260709 13:03:49.712621 14915 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:49.712718 14977 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:49.713699 14987 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:49.713858 14902 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:49.715137 14921 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.631281 14718 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:49.719004  9258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.004s	sys 0.000s
W20260709 13:03:49.719338  9258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.004s	sys 0.000s
W20260709 13:03:49.719601  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 637814us
I20260709 13:03:49.721747  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:49.679529 14891 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:49.722427  8528 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:49.687969 14758 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:49.723425  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:49.723964  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:49.686512 14998 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:49.726528  8531 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 20.
I20260709 13:03:49.698501 14883 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:49.709257 14985 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:49.724431 14966 log.cc:927] Time spent T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
I20260709 13:03:49.724423 14994 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:49.715675 14948 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:49.746290  8460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36448 (request call id 2769) took 1143 ms. Trace:
I20260709 13:03:49.715684 14921 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:49.750813 14942 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.737s	user 0.004s	sys 0.000s
W20260709 13:03:49.737936 14971 log.cc:927] Time spent T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
W20260709 13:03:49.738863 14982 log.cc:927] Time spent T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:03:49.740022  9293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55724 (request call id 956) took 1295 ms. Trace:
I20260709 13:03:49.736426  8426 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:49.746665  8460 rpcz_store.cc:276] 0709 13:03:48.603436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.603575 (+   139us) service_pool.cc:224] Handling call
0709 13:03:48.603885 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:48.634075 (+ 30190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:48.634121 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:48.644611 (+ 10490us) log.cc:844] Serialized 26 byte log entry
0709 13:03:48.999214 (+354603us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:48.999255 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.999335 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:49.746078 (+746743us) raft_consensus.cc:1685] finished
0709 13:03:49.746098 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:49.746235 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42631,"raft.queue_time_us":30414,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5690,"thread_start_us":320465,"threads_started":1,"wal-append.queue_time_us":514386}
W20260709 13:03:49.737351 14969 log.cc:927] Time spent T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 13:03:49.762959  9293 rpcz_store.cc:276] 0709 13:03:48.444858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.448917 (+  4059us) service_pool.cc:224] Handling call
0709 13:03:49.739765 (+1290848us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b5400735854. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:49.739923 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669629312}
I20260709 13:03:49.714340 14987 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:49.764394 14750 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:49.765991 14987 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:49.766160 14993 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.766819 14993 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:49.751251 14549 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:49.617888 14981 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:49.769374  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.770236  8528 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
I20260709 13:03:49.799611  9258 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:49.800659 14825 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:49.801064 14825 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:49.801470 14825 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:49.802868 14968 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:49.804265  8535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 2949) took 1260 ms. Trace:
I20260709 13:03:49.804265  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:49.805493 14996 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:49.805969  8527 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:49.721444 14900 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:49.799754 14993 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:49.804687  8535 rpcz_store.cc:276] 0709 13:03:48.544159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.547386 (+  3227us) service_pool.cc:224] Handling call
0709 13:03:48.547724 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:48.548075 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:48.548102 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:48.548579 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:03:48.801434 (+252855us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:48.952582 (+151148us) log.cc:844] Serialized 14 byte log entry
0709 13:03:49.009349 (+ 56767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.009426 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:49.804069 (+794643us) raft_consensus.cc:1685] finished
0709 13:03:49.804090 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:49.804209 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56245,"prepare.queue_time_us":141510,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":61,"raft.queue_time_us":61033,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"spinlock_wait_cycles":50281728,"thread_start_us":252467,"threads_started":1,"wal-append.queue_time_us":521133}
I20260709 13:03:49.808786 14970 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:49.708141 14986 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:49.810708 14985 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:49.729928 14989 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:49.811640 14989 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:49.756938 14835 consensus_meta.cc:287] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.732s	user 0.009s	sys 0.001s
I20260709 13:03:49.813984 14989 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:49.813858 14835 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:49.815943 14835 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:49.816059 14875 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:49.817763 14718 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:49.816565 14620 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:49.818418 14871 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:49.819988 14620 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:49.824335 14064 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:49.811136 14986 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:49.806911 14967 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:49.748806 14870 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:49.830648 14975 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:49.832244 14930 consensus_meta.cc:287] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 1.077s	user 0.007s	sys 0.005s
I20260709 13:03:49.705690 14771 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:49.771202 14949 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:49.878468  8500 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:49.835855 14981 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:49.838052  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:49.838297  9291 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:49.839097  9294 raft_consensus.cc:1240] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:03:49.836203 14825 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:49.841183  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:49.843052  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:49.843941 14946 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:49.805990 14996 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.848647  9289 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:49.751329 14921 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:49.881975  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:49.853109  8425 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.010s	sys 0.000s
I20260709 13:03:49.798082  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:49.856698  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:49.859935  8426 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:49.859781  9258 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:49.868597  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:49.887459  8425 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.010s	sys 0.000s
I20260709 13:03:49.870769  8461 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
I20260709 13:03:49.874364  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:49.882818  9296 raft_consensus.cc:2393] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 14: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:49.893580  8500 leader_election.cc:400] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 18. Current term is 19.
I20260709 13:03:49.894888  8500 leader_election.cc:403] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:03:49.894122  8501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.005s	sys 0.009s
W20260709 13:03:49.895658  8501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.005s	sys 0.009s
W20260709 13:03:49.896093  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 825652us
I20260709 13:03:49.914248  8527 raft_consensus.cc:1275] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:49.926259  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:49.915120  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:49.869645 14929 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.859176 14914 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:49.914654  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:49.929236  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 252616us
I20260709 13:03:49.931334  8528 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
I20260709 13:03:49.915539  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:49.916952  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:49.934275  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:49.935022  8527 raft_consensus.cc:2393] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 15: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:49.936317  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:49.936888  8384 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:03:49.937716  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:49.938378  8386 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:49.938315  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:49.939320  8535 raft_consensus.cc:2393] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 18: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:49.939409  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:49.939724  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:49.940814  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:49.941335  8528 raft_consensus.cc:1240] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 13:03:49.941792  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 81955.2us
I20260709 13:03:49.941362  8385 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
W20260709 13:03:49.943536  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 207750us
I20260709 13:03:49.874516 14870 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.939424  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:49.879473 14930 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16.
I20260709 13:03:49.950767  8386 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:03:49.883083 14334 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:49.951687  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.952701  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:49.955570  8385 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:49.948972  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:49.949162  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:49.957508  8383 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:49.957729  8379 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:49.874297 14827 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:03:49.950181  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 272840us
I20260709 13:03:49.882941 14891 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:49.884114 14996 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:49.953183  9260 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:49.968497  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:49.969404  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:49.969578  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:49.976410  8534 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:03:49.970068  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:49.970680  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:49.979080  8528 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:49.967572  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:49.980203  8527 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:49.931032 14931 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:49.919701 14981 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:49.983793  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:49.978330  8531 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
I20260709 13:03:49.991322  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:49.905256 14990 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:49.992506  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:49.992885  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:49.993403  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:49.997609  8454 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:49.930094 14925 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 18. Current term is 19.
I20260709 13:03:49.997845  8459 raft_consensus.cc:2393] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 17: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:49.992960  8461 raft_consensus.cc:1240] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:50.004164  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:49.953012 14866 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:49.996132  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:50.008653  8456 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 21.
I20260709 13:03:50.004011  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:49.998766  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:50.009830  8454 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:50.004832  8531 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:50.007141  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:50.011807  8457 raft_consensus.cc:2368] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16.
I20260709 13:03:50.011533  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:49.977324 14975 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:49.920223 14949 consensus_queue.cc:1059] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:03:50.015601  9260 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:50.018908 14064 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:50.018692  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 51670.3us
I20260709 13:03:50.022452  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:50.026867  8527 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
W20260709 13:03:50.009694 14938 consensus_meta.cc:287] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.774s	user 0.011s	sys 0.000s
I20260709 13:03:49.992821 14981 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.032487  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:50.046725  8527 raft_consensus.cc:3060] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:50.034490 14979 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.995375 14318 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:49.995441 14620 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:49.980400 14334 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:49.961988 14870 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:50.024408 14293 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:50.037993 14825 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:50.038611 14913 consensus_queue.cc:1048] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:49.951433 14929 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:50.042598 14998 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:49.993042 14931 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:49.954294 14914 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:49.931324 14946 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.009995 14934 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:49.982280 14827 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:49.987958 14891 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:50.088893 14998 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:50.091735 14914 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:50.077668 14931 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:50.099256 14827 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:50.103135 14917 raft_consensus.cc:3055] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:50.103824 14917 raft_consensus.cc:740] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:50.048929 14981 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:50.073627 14867 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:50.060529 14938 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:50.141924 14996 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:50.162322 14929 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:50.154685 14870 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:50.110926 14848 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:50.363010 14915 consensus_queue.cc:1048] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:50.365566 14915 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:50.366958 14903 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.367906 14903 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:49.756726  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:50.374571 14512 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:50.375470 14512 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.246297  8280 catalog_manager.cc:5697] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 12 to 19, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 19 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:50.265847  8382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3892) took 1270 ms. Trace:
I20260709 13:03:50.377728  8382 rpcz_store.cc:276] 0709 13:03:48.995128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.998591 (+  3463us) service_pool.cc:224] Handling call
0709 13:03:48.998924 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:49.278070 (+279146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:49.278106 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:49.278577 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:03:49.430849 (+152272us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:49.430889 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.264856 (+833967us) spinlock_profiling.cc:243] Waited 59.6 ms on lock 0x7b54002cbd54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:50.264966 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:50.265108 (+   142us) raft_consensus.cc:1685] finished
0709 13:03:50.265126 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:50.265617 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26710,"raft.queue_time_us":123022,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":38006,"spinlock_wait_cycles":137187200,"thread_start_us":327555,"threads_started":2,"wal-append.queue_time_us":462169}
I20260709 13:03:50.378980  8280 catalog_manager.cc:5697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 13 to 14, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 14 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:50.280934  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:03:50.282160  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 309113us
I20260709 13:03:50.284049  8452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36448 (request call id 2764) took 1850 ms. Trace:
I20260709 13:03:50.380745 14922 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:50.380997  8452 rpcz_store.cc:276] 0709 13:03:48.433781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.434181 (+   400us) service_pool.cc:224] Handling call
0709 13:03:48.747617 (+313436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.796735 (+ 49118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.283546 (+1486811us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b540040d3d0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84848ad 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:50.283795 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":720100096}
I20260709 13:03:50.258322  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3894) took 1255 ms. Trace:
I20260709 13:03:50.284252  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:50.285915  8458 raft_consensus.cc:1240] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:03:50.019490  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:50.287935  8459 raft_consensus.cc:1275] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:50.284952  8453 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:03:50.254659  8349 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:50.305368  8283 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53484 (request call id 337) took 59246 ms (client timeout 15000 ms). Trace:
I20260709 13:03:50.308871  8377 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:50.333781  8386 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:50.335240  8384 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:50.335772  8424 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:50.343525  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:50.343699  8529 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:50.344766  8530 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:50.346179  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:50.346211  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:50.347695  8535 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
W20260709 13:03:50.348171  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 404262us
I20260709 13:03:50.042510  8531 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:50.381680 14922 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.398916  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:50.399348  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:50.400205  8533 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:50.400425  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:50.350327  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 306155us
I20260709 13:03:50.401961  8532 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:50.351500  9292 raft_consensus.cc:1240] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:50.352182  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:50.404425  8528 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:50.404489  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:50.405689  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:50.405774  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:50.406119  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:50.407150  8459 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 20: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:50.407608 15000 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:50.353673  9295 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 26 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:03:50.354727 14706 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:50.074536 14318 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.412279 14706 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.415446 14318 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:50.415608 14706 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:50.357535 14710 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.417413 14710 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.105020 14917 consensus_queue.cc:260] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.420074 14710 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:50.423491 15015 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.113564 14334 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:50.424407 15015 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.427618  8461 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:03:50.073850 14620 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:50.428000  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 173743us
I20260709 13:03:50.429577 14970 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:50.430154 14970 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:50.430734 14620 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:50.430864 14970 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:50.358652 14835 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:50.359237 14750 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:50.129886 14771 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:50.365545 14867 raft_consensus.cc:697] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:50.380461 14758 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:50.128923 14891 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:50.284226  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:50.159279 14946 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:50.204828 14990 raft_consensus.cc:697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:50.459544  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:50.206113 14996 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:50.081324 14979 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:50.473824 14804 consensus_queue.cc:1059] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:03:50.476446 14979 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:50.382537  8380 rpcz_store.cc:276] 0709 13:03:49.002804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.002933 (+   129us) service_pool.cc:224] Handling call
0709 13:03:49.003232 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:49.420266 (+417034us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:49.420305 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:49.420351 (+    46us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:49.420386 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.257455 (+837069us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b540026a054. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:50.257569 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:50.258001 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958666624}
I20260709 13:03:50.348778  8534 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:50.391534  8457 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 18.
I20260709 13:03:50.477289 14549 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:50.477878 14549 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:50.367025 14915 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.408488 15000 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.395308  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:50.412295  8526 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:50.431798 14835 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:50.435596  8349 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:50.438020  8427 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:50.460623 14990 consensus_queue.cc:237] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:50.456525  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 121093us
I20260709 13:03:50.453673 14758 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:50.458493  8454 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 14.
I20260709 13:03:50.461591  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:50.435890 14750 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.467715  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:50.449532 14867 consensus_queue.cc:237] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.465528  8280 catalog_manager.cc:5697] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 14 to 18, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 18 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:50.478255 14549 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:50.487888  8452 raft_consensus.cc:2368] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:50.499013  9292 raft_consensus.cc:1275] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:03:50.536083  8526 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 20.
I20260709 13:03:50.508487  8457 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:50.469997  9260 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:50.450332 14977 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:50.519776  8377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59328 (request call id 2892) took 1100 ms. Trace:
I20260709 13:03:50.553589  8377 rpcz_store.cc:276] 0709 13:03:49.419755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.419910 (+   155us) service_pool.cc:224] Handling call
0709 13:03:50.519498 (+1099588us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b540013e2d4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:50.519667 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1767496448}
I20260709 13:03:50.549726  8533 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
W20260709 13:03:50.500411  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 219923us
I20260709 13:03:50.477181 14989 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:50.548554  8532 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:50.556164  8280 catalog_manager.cc:5697] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 15 to 20, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 20 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:50.558562  8280 catalog_manager.cc:5697] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 13 to 16, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 16 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:50.562063  9287 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:50.489899 14512 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:50.563669  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 112173us
I20260709 13:03:50.564020 14512 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:50.564554 14512 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.564932 14512 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:50.560372  8280 catalog_manager.cc:5697] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 7 to 12, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 12 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:50.487262 14787 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:50.568663  8280 catalog_manager.cc:5697] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 17 to 19, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 19 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:50.570870 14891 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:50.571548 14891 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.578008 14891 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:50.570616  8280 catalog_manager.cc:5697] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 13 to 14, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 14 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:50.579121  8527 consensus_meta.cc:287] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.000s
I20260709 13:03:50.579634  8527 raft_consensus.cc:2468] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:50.580101 14903 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:50.501660 15015 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:50.486747 14922 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:50.580986  8280 catalog_manager.cc:5697] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 10 to 15, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 15 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:50.569891 14787 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.584470 14871 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:50.585353 14981 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.489337 15000 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:50.582523  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 195457us
I20260709 13:03:50.562470 14915 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:50.588786 14871 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.591719 14787 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:50.598362  8459 raft_consensus.cc:2393] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 17: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
W20260709 13:03:50.595965  8378 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.020s	sys 0.008s
I20260709 13:03:50.600932  8427 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:50.605173  8280 catalog_manager.cc:5697] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:50.607473  8280 catalog_manager.cc:5697] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 20 to 22, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 22 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:03:50.609885 14931 consensus_meta.cc:287] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.516s	user 0.012s	sys 0.008s
I20260709 13:03:50.610466 14931 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:50.596156 14871 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:50.591537 14549 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.612862 14931 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:50.623072  8280 catalog_manager.cc:5697] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 7 to 13, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 13 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:50.597594 14903 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:50.630919  8427 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:50.608788 14917 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:50.640518  8453 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:03:50.643541 14787 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:50.644090 14787 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.644306  8427 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:50.645699 14848 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:50.646023  8427 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:50.647215 14900 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:50.648164 14771 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:50.648627 14771 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.646144 14848 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.644554 14787 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:50.649528  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 214203us
I20260709 13:03:50.647617 14900 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.649031 14771 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:50.641613  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 53419.6us
I20260709 13:03:50.647593  8427 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:50.664325 14900 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:50.670576  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:50.602807 14989 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.665338  8280 catalog_manager.cc:5697] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 13 to 15, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 15 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:50.682130  8532 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:50.656980 14848 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:50.664467  9260 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:50.693193  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:50.665055 14981 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:50.696717 14293 consensus_meta.cc:287] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.524s	user 0.016s	sys 0.002s
W20260709 13:03:50.699872  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 125591us
I20260709 13:03:50.704186 14758 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:50.704372 14549 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:50.705210 14825 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.706017 14825 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.707036 14750 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:50.707240 14293 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:50.705266 14603 raft_consensus.cc:2804] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:50.708869 14603 raft_consensus.cc:697] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:50.709901 14603 consensus_queue.cc:237] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:50.713625  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:50.714335  8533 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:50.686126 14903 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:50.396134  8283 rpcz_store.cc:269] 0709 13:02:51.058940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.061265 (+  2325us) service_pool.cc:224] Handling call
0709 13:03:50.304999 (+59243734us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:41.123715 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:41.249418 (+125703us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:41.249480 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:03:41.249501 (+    21us) tablet.cc:662] Decoding operations
0709 13:03:41.250335 (+   834us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:41.250425 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:41.250459 (+    34us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:03:41.251142 (+   683us) tablet.cc:701] Row locks acquired
0709 13:03:41.251202 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:03:41.251383 (+   181us) write_op.cc:270] Start()
0709 13:03:41.251558 (+   175us) write_op.cc:276] Timestamp: P: 1783602221251310 usec, L: 0
0709 13:03:41.251608 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 13:03:41.252408 (+   800us) log.cc:844] Serialized 2079 byte log entry
0709 13:03:41.869238 (+616830us) op_driver.cc:464] REPLICATION: finished
0709 13:03:42.001401 (+132163us) write_op.cc:301] APPLY: starting
0709 13:03:42.001504 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:42.259937 (+258433us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:42.273654 (+ 13717us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:42.570626 (+296972us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:42.570944 (+   318us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:03:42.571004 (+    60us) write_op.cc:312] APPLY: finished
0709 13:03:42.571302 (+   298us) log.cc:844] Serialized 57 byte log entry
0709 13:03:42.571480 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:42.571604 (+   124us) write_op.cc:454] Released schema lock
0709 13:03:42.571673 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:42.572092 (+   419us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:42.572117 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":58097,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":131836,"apply.run_cpu_time_us":13255,"apply.run_wall_time_us":570681,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25047,"num_ops":5,"prepare.queue_time_us":142096,"prepare.run_cpu_time_us":28417,"prepare.run_wall_time_us":287434,"raft.queue_time_us":203954,"raft.run_cpu_time_us":9935,"raft.run_wall_time_us":56636,"replication_time_us":617428,"thread_start_us":286358,"threads_started":4,"wal-append.queue_time_us":143050,"wal-append.run_cpu_time_us":11263,"wal-append.run_wall_time_us":2188528}]]}
I20260709 13:03:50.740847  8457 raft_consensus.cc:1275] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:50.738040  8427 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:50.734720  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:50.742089  8460 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:50.748092  8351 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:50.749716  8426 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:50.751132  8349 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:50.752744 14946 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.753520 14946 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.754179 15000 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:50.756019 14946 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:50.757469  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:50.758793 14922 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:50.758973  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:50.714673 14512 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.760157 14970 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:50.760912  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:50.762295 14512 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:50.756924  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:50.765935  9292 raft_consensus.cc:2410] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:03:50.768950  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 54978.3us
I20260709 13:03:50.762317  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:50.752810  8349 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:50.775768  9296 raft_consensus.cc:2368] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15.
I20260709 13:03:50.778682  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:50.735878 15015 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:50.746053 14891 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.783558  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:50.785377  9287 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
W20260709 13:03:50.786586  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 62650.7us
I20260709 13:03:50.788089  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:50.789636  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 149377us
I20260709 13:03:50.781030 14835 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:50.801983 15002 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:50.790045 14900 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:50.823370 14989 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:50.801618 14891 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:50.802368 14334 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.026s
I20260709 13:03:50.805418  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:50.778404 14903 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:50.807425  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:50.807778  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:50.808552  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:50.791079 14915 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:50.818395 14970 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:50.820638 14549 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:03:50.824694  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 75211.4us
I20260709 13:03:50.826522  8380 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:50.805697  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:50.791368 14922 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:50.832453  8384 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 21.
I20260709 13:03:50.832602 14863 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:50.827930  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:50.834434  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 86429.6us
I20260709 13:03:50.833120 14863 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.823536 14900 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:50.847468 14750 raft_consensus.cc:493] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.848120 14750 raft_consensus.cc:515] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.849658 14925 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:50.850309 14925 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.850847 14750 leader_election.cc:290] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:50.851962 14929 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.852556 14929 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:50.844784 14863 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:50.833266 14915 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.840925  9260 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:50.828101 15002 raft_consensus.cc:697] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:50.833249 14922 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.855616  8378 raft_consensus.cc:3060] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:50.826970 15015 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:50.843807 14990 consensus_queue.cc:1059] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:03:50.852867 14925 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:50.856992  8382 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:50.864158  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:50.869922 14870 raft_consensus.cc:3055] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:50.860744 14915 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:50.873126 14870 raft_consensus.cc:740] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:50.861665 14750 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:50.877422  8351 leader_election.cc:400] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16.
I20260709 13:03:50.865963 14922 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:50.876332 14891 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:50.870307 14981 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:50.883950  8426 leader_election.cc:400] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15.
I20260709 13:03:50.881717  8351 leader_election.cc:403] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:50.884321  8426 leader_election.cc:403] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:03:50.882395  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:50.884877  8379 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 12.
I20260709 13:03:50.889637  8380 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 20.
I20260709 13:03:50.861532 14549 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.898149  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:50.884136 14981 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:50.893536 14997 raft_consensus.cc:3060] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:50.908818  8533 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:03:50.911151  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:50.914215  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:50.903673 14931 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 15. Current term is 16.
I20260709 13:03:50.916643  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:50.912039 14750 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:50.921746 14750 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:50.922173  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 67880.6us
I20260709 13:03:50.923552  8351 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:50.923576 14804 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:50.924443 14806 consensus_queue.cc:1048] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:50.924594 14804 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:50.925284 14977 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:50.926066 14806 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:50.926947 14977 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:50.926770 14806 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.927362 14977 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:50.927971 14977 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:50.927386 14932 consensus_queue.cc:1059] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:50.928755 14932 raft_consensus.cc:3055] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:50.929242 14932 raft_consensus.cc:740] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:03:50.930308 15024 log.cc:927] Time spent T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:03:50.930480  8378 raft_consensus.cc:2468] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 15.
I20260709 13:03:50.930586 14932 consensus_queue.cc:260] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:50.932122 14903 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:50.935109 14549 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:50.936604 14929 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:50.908010 14981 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:50.940326 14806 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:50.919021  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 92100.2us
I20260709 13:03:50.890753 14771 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:50.919833 15025 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:03:50.866602 15002 consensus_queue.cc:237] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:50.946900  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:50.954407  8424 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:50.959666  9260 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:50.964001  8427 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:50.968762  8533 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:03:50.965374  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:50.956182 14913 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:50.958520 14932 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:50.975952  9258 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:50.964133 14293 consensus_queue.cc:1048] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:03:50.981133 15004 consensus_queue.cc:1048] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.098s
I20260709 13:03:50.984454 14512 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:50.984673 15000 raft_consensus.cc:2804] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:50.985152 14512 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:50.985424 15000 raft_consensus.cc:697] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:50.985730 14512 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:50.986567 15000 consensus_queue.cc:237] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:50.984493  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 71115.3us
I20260709 13:03:50.967960 14750 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:50.993280  8501 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 2.054s (SENT) [suppressed 5 similar messages]
I20260709 13:03:51.001529 14804 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:51.010109  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 50534.8us
I20260709 13:03:51.011404  8382 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
W20260709 13:03:51.008283  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 45808.7us
I20260709 13:03:51.014142  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:51.012643  8427 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:51.015007  8379 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 10.
I20260709 13:03:50.969636 14970 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:51.006431 14870 consensus_queue.cc:260] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:51.019341 15015 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:51.019606  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:51.020249  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:51.025728  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:51.028252  8528 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 13: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:51.013422 14620 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:51.032497 14620 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:51.033146 14620 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:51.038000  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:51.041759  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 90855.2us
I20260709 13:03:51.041466  8459 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:03:51.054730  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:51.006256 14913 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.068437  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.048977  8427 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:51.074223 14913 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:51.047044 14900 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:51.077718  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:51.078837  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 27 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:51.069468  8452 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
W20260709 13:03:51.088696  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 45995.9us
I20260709 13:03:51.101692  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 27 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:51.103220  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 63449us
I20260709 13:03:51.100906  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.105561  8461 raft_consensus.cc:2410] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:03:51.106511  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:51.107295  9290 raft_consensus.cc:2368] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 17. Current term is 18.
I20260709 13:03:51.109401 14870 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:51.113584  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:51.114722  9293 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:51.117305  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.118247  8456 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 10.
I20260709 13:03:51.118784 14922 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.120704  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.123178  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.124207 14848 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:51.125869 15031 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 13:03:51.129470  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.044322 14970 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:51.137267 14915 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.138612  8380 raft_consensus.cc:2393] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 15: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:51.139000 14970 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:51.143872 14620 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.146756  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:51.147526  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:51.148329 14512 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:51.147524  8528 raft_consensus.cc:2368] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 19. Current term is 20.
I20260709 13:03:51.150414  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:51.150898 14512 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:51.151108  8528 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:51.153260 14915 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:51.154134  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:51.155747  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:51.160291  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:51.038553 14787 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.183152  8530 raft_consensus.cc:2393] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 15: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:51.185324 14825 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:51.193495  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:51.211275  8534 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
I20260709 13:03:51.219446  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:51.219066  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:51.181836 15004 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:03:51.210624 14871 consensus_meta.cc:287] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.571s	user 0.013s	sys 0.000s
I20260709 13:03:51.224342  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:51.225173  8528 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:51.233819  8533 raft_consensus.cc:2393] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 17: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:51.104195  8427 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:51.212477 14620 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:51.236963  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 132881us
I20260709 13:03:51.234252  8424 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:51.219027 14758 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:51.247294  8349 leader_election.cc:400] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 19. Current term is 20.
I20260709 13:03:51.247675  8349 leader_election.cc:403] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:03:51.225246 14870 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:51.251513  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:51.252205  8386 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:03:51.229818 14979 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:03:51.258518  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:51.235551 15015 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:51.261521  8379 raft_consensus.cc:2393] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 22: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
W20260709 13:03:51.262935  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 269679us
I20260709 13:03:51.239660 14871 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.252295 15004 raft_consensus.cc:697] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 20 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:51.255057 14549 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:51.260908 14771 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:51.261180 14975 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:51.256918 14870 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.294848 14975 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:51.296942 15003 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:51.297230 14809 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 19. Current term is 20.
I20260709 13:03:51.297475 15003 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:51.297997 15003 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:51.298801 14975 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:51.302083 14870 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:51.302327  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:51.303738  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.304512  8456 raft_consensus.cc:2368] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 17. Current term is 18.
I20260709 13:03:51.305130  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:51.305848  8459 raft_consensus.cc:2368] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 17. Current term is 18.
I20260709 13:03:51.305656 15004 consensus_queue.cc:237] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.305873  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.309238  8460 raft_consensus.cc:2393] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 15: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
W20260709 13:03:51.310909 15023 log.cc:927] Time spent T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.442s	user 0.003s	sys 0.000s
I20260709 13:03:51.309181  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.312337  8458 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36448 (request call id 2774) took 1034 ms. Trace:
I20260709 13:03:51.312721  8458 rpcz_store.cc:276] 0709 13:03:50.277880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.500341 (+222461us) service_pool.cc:224] Handling call
0709 13:03:50.500706 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:50.501401 (+   695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:50.501443 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:50.502054 (+   611us) log.cc:844] Serialized 26 byte log entry
0709 13:03:50.592687 (+ 90633us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:50.592733 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.592889 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:51.310144 (+717255us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:51.312019 (+  1875us) raft_consensus.cc:1685] finished
0709 13:03:51.312040 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:51.312261 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14718,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"spinlock_wait_cycles":5275520,"thread_start_us":90149,"threads_started":1,"wal-append.queue_time_us":323586}
I20260709 13:03:51.313098  8386 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
W20260709 13:03:51.316250  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 101882us
I20260709 13:03:51.256395 14981 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:51.333930 14848 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:51.334431 14981 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:51.336462 14871 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:51.318445 14787 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:51.272817 15015 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:51.271988 14903 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:51.357045 14903 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:51.359418  8424 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:51.359920 14903 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:51.362474 14922 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:51.363600 14977 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.365876 15015 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:51.366629 14922 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:51.367321 14922 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:51.369513 14922 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:51.369517 14871 raft_consensus.cc:2804] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:51.370671 14871 raft_consensus.cc:697] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:51.372009 14871 consensus_queue.cc:237] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.258200 14758 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:51.328291 14863 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:51.348565  8381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:57890 (request call id 10) took 1057 ms. Trace:
I20260709 13:03:51.350291  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:51.386832  8377 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:51.352023  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:51.388186  8378 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:51.274878 14549 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:51.355917  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:51.360733  8424 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:51.316047 14997 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15.
I20260709 13:03:51.385771  8381 rpcz_store.cc:276] 0709 13:03:50.291779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.292003 (+   224us) service_pool.cc:224] Handling call
0709 13:03:51.348004 (+1056001us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b54002cc254. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c848b735 00007f36c84839fa 00007f36cd44b4c9 00007f36c69c7c54 00007f36c69c7be2 00007f36c69c7b11 00007f36c69c7a8c 00007f36c69c6d42 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:51.348296 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665810816}
W20260709 13:03:51.382720  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 135558us
I20260709 13:03:51.392654  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:51.396263  8456 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:51.409578  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.413450  8457 raft_consensus.cc:2393] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 18: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:51.413410  8386 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:51.393827 14549 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:51.414498  8349 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:51.422535  8452 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:03:51.430814  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 70200.3us
I20260709 13:03:51.432677  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:51.419262 14787 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:51.451086  8427 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:51.453163  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:51.435173  8349 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:51.462666  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:51.463552  8382 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:03:51.471465  8378 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
I20260709 13:03:51.466132 14806 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:51.487859 14806 raft_consensus.cc:697] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:51.467569 14917 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.488794 14917 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.488884 14806 consensus_queue.cc:237] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:51.490685  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.477767 14977 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:51.479527  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:51.472425 15041 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:51.483464  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:51.438156 14293 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:03:51.485524  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:03:51.487947 15027 log.cc:927] Time spent T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.538s	user 0.003s	sys 0.000s
I20260709 13:03:51.491930  8380 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:03:51.492697  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:51.505934  8385 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 26.
I20260709 13:03:51.494086  8454 raft_consensus.cc:2468] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:03:51.503504  8377 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:51.514019  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:51.514652  8533 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:51.500902  8386 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:51.491456 14917 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:51.511384  8379 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
I20260709 13:03:51.517292  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:51.517464  8529 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:51.462149 15004 raft_consensus.cc:2804] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:51.511565  8456 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
I20260709 13:03:51.482724  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:51.515376  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:51.528122  8378 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:03:51.467044 14787 raft_consensus.cc:697] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:51.517861  8380 raft_consensus.cc:3060] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:03:51.520414 15041 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:51.513710 14922 raft_consensus.cc:2764] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 13:03:51.527521  8381 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:03:51.533541 15004 raft_consensus.cc:697] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:51.533985 14787 consensus_queue.cc:237] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.546173 14913 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:03:51.557716  8351 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:51.545598  8500 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:51.556334  8427 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:51.590809  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:51.541136 14750 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.592175  8427 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:51.598142  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.545058 14996 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:51.598152  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.600215  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.541031 14997 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:51.602777  8457 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
W20260709 13:03:51.603972  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 46345us
I20260709 13:03:51.603660  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.602814  8427 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:51.608194  8380 raft_consensus.cc:2468] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:03:51.609007  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.593981 14863 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:51.613443  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:51.619081  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.620397  8458 raft_consensus.cc:2393] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 15: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
W20260709 13:03:51.620615  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 75219.5us
I20260709 13:03:51.604949 15015 raft_consensus.cc:2764] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:03:51.622627  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:51.606454 14620 raft_consensus.cc:2804] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:51.624655  8351 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:51.608150 14917 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:51.627658  8351 leader_election.cc:400] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 17. Current term is 18.
I20260709 13:03:51.627985  8351 leader_election.cc:403] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:51.615540 14975 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:51.630230  8461 raft_consensus.cc:1240] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:51.633760  8351 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:51.601619  8271 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9e1d32431b1c45ebad1160a850495e16 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d653e71832b7402b9a03b46249d3b885 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:51.606359 14750 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.545658 15004 consensus_queue.cc:237] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.633389  9287 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:51.607717 14997 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.606673 14996 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.640908  8351 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:51.631521 14620 raft_consensus.cc:697] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:51.643570  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.634151 14806 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:03:51.634953 14975 raft_consensus.cc:697] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:51.627105 14932 consensus_queue.cc:1059] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.015s
I20260709 13:03:51.647850 14997 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:51.649158 15055 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:51.651984 14549 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:51.635911 14970 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 17. Current term is 18.
I20260709 13:03:51.637926 14931 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:51.653615 15044 log.cc:927] Time spent T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 13:03:51.645823 15046 log.cc:927] Time spent T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:03:51.696107  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.655498  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.661630 14620 consensus_queue.cc:237] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.663745 14996 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:51.659672 14903 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:51.665372  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.666169  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.668228  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.671150 14334 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:51.671708 15041 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:51.671841 15012 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:51.642436 15047 log.cc:927] Time spent T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c: Append to log took a long time: real 0.109s	user 0.003s	sys 0.000s
I20260709 13:03:51.668754 14977 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:51.680490  9287 raft_consensus.cc:1240] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:51.683328  8381 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:51.686101  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.688019  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:51.688540  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:51.755138  8528 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 13: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:51.688913  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:51.756016  8534 raft_consensus.cc:2368] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15.
I20260709 13:03:51.689237  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:51.690295  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:51.691663 14549 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:51.690335  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:51.734160  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.759729  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.777737  8459 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
I20260709 13:03:51.762564  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.763150  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1839dfeba648529deb101072b3ca8c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:51.781204  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:51.782065  8382 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 20: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:51.762682 14977 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:51.758212  8535 raft_consensus.cc:2393] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 15: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:51.763924  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:51.796733  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 189832us
I20260709 13:03:51.797158  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:51.756767 15055 raft_consensus.cc:697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:51.803169  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:51.803966  8380 raft_consensus.cc:2368] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
W20260709 13:03:51.804788  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 132421us
I20260709 13:03:51.807628  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:51.809769  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:51.809844  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:51.812961  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:51.816601  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:51.823539  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:51.823621  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:51.829783 15057 log.cc:927] Time spent T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:03:51.833668  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:51.783286 14334 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.845057 14758 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:51.845728  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:51.759006 15012 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.825546 15055 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.836792 14750 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:51.829259 14975 consensus_queue.cc:237] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:51.848384  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:51.844272  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:51.849671  8377 raft_consensus.cc:2393] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 19: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:51.850515  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:51.851254  8377 raft_consensus.cc:2393] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 18: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:51.846482  8380 raft_consensus.cc:2393] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 17: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:51.851799  8424 leader_election.cc:400] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15.
I20260709 13:03:51.853372  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:51.850646  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:51.856729  8528 raft_consensus.cc:2393] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 18: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:51.854532  8424 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:51.822490 15003 consensus_meta.cc:287] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.005s
I20260709 13:03:51.859187  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:51.860086  8424 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:51.858053  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 45132.3us
I20260709 13:03:51.863015  8500 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:51.863986 15004 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:51.868259  8424 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:51.876514  9260 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:51.885118  8381 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:03:51.891033  8500 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:51.891472  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:51.892093  8528 raft_consensus.cc:3060] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:51.901705  8384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59332 (request call id 3923) took 1046 ms. Trace:
I20260709 13:03:51.887719 15000 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.902200  8384 rpcz_store.cc:276] 0709 13:03:50.855786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.856275 (+   489us) service_pool.cc:224] Handling call
0709 13:03:50.856927 (+   652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:50.872705 (+ 15778us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:50.875737 (+  3032us) log.cc:844] Serialized 14 byte log entry
0709 13:03:51.519525 (+643788us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b18000458e0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:03:51.894146 (+374621us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b18000458e0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c802d4bc 00007f36c537b48b 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5395455 00007f36c847d060 00007f36c848f716 00007f36c84a0287
0709 13:03:51.901264 (+  7118us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:51.901341 (+    77us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:51.901402 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.901488 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:51.901645 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3362,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":36692,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":3661,"spinlock_wait_cycles":125836928,"thread_start_us":416328,"threads_started":2,"wal-append.queue_time_us":398456}
I20260709 13:03:51.904150 15067 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:51.908958  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:51.909319 15053 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:03:51.909737  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:51.919544  8386 raft_consensus.cc:2393] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 17: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:51.889778 15004 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:51.920789  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:51.910243  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:51.895988 14293 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:51.927995  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:51.929330  8384 raft_consensus.cc:2410] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:03:51.910885 14870 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:51.875085 15003 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:51.920047 14758 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.942705  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.924614 15040 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:51.946738  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:51.951398  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:51.930569 14891 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:51.930738 14293 raft_consensus.cc:697] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:51.970976  8455 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 13.
I20260709 13:03:51.979863  8528 raft_consensus.cc:2468] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:51.955500 14977 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:51.928128 15000 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:51.964277 14758 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:51.970191 15040 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:52.002295 15064 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:52.027372 15064 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:52.027850 15064 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:52.030606 15062 log.cc:927] Time spent T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.194s	user 0.003s	sys 0.000s
I20260709 13:03:52.036047 15065 consensus_queue.cc:1059] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 13:03:52.037453 15065 raft_consensus.cc:3055] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:52.037900 15065 raft_consensus.cc:740] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:52.038821 15065 consensus_queue.cc:260] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:52.040110 15040 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:52.044350  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:52.047034  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:52.047706  8533 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:52.048007 15066 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.048597 15066 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:52.049364  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:52.051585  8424 leader_election.cc:304] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:52.052809  8424 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.054909  8424 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.045028  8534 raft_consensus.cc:3060] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:52.058117  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:52.059746  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:52.060345  8530 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:52.067340  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:52.069952  9287 raft_consensus.cc:2393] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 18: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:52.070353  8533 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:52.071564  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:52.071655  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:52.036834 14758 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:52.072274  8378 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:52.076463  8384 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 26 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:03:52.067207 14848 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:52.079905  8424 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:52.082533  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:52.083166  8533 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 16.
I20260709 13:03:52.083326 15003 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:52.072834 15065 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:52.085807  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:52.087687  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:52.091289 15066 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:52.091931 14998 raft_consensus.cc:2749] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:52.094017  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:52.095598  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:52.096408  8386 raft_consensus.cc:2368] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:52.097416  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:52.098551  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:52.099586  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:52.100240  8381 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 20: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:52.012454 14293 consensus_queue.cc:237] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:52.100973  8533 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:52.102974  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:52.105769  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:52.113592  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:52.104879  8377 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:52.100934  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:52.116699  8424 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.069278 14620 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:52.118736  8534 raft_consensus.cc:2468] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:52.077332 14758 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.124475  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:52.124819  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:52.125201  8378 raft_consensus.cc:2376] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16. Re-sending same reply.
I20260709 13:03:52.127449  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:52.134788  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:52.134896  8351 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:52.135742 14806 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.136281 14806 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:52.120270 14975 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:52.138501 14806 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:52.122728 14835 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:52.139925  8459 raft_consensus.cc:1240] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:52.140748 14806 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:52.141002 15065 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.141255 14806 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:52.138156  8501 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.141739 14806 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:52.141569 15065 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:52.142246 15066 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:52.142761  8501 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.143690 15065 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:52.143879 15066 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:52.144368  8501 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.145563 15066 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:52.139259 15000 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:52.148598  8530 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
I20260709 13:03:52.149163 15081 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:52.150848 14917 raft_consensus.cc:3055] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:52.151276 14917 raft_consensus.cc:740] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:52.152083 14917 consensus_queue.cc:260] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:52.153409 14917 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:52.154042  8534 raft_consensus.cc:1275] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:52.155421  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:52.152693 14806 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:52.154620  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:52.153707  8351 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:52.165232  9261 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:52.165884 14758 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:52.170928  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:52.173278  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:52.184343 15064 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:52.187220  8501 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.188130 15015 consensus_queue.cc:1059] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:52.193423  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:52.191545  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:52.196779  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:52.203054  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 49439.3us
I20260709 13:03:52.204066  8351 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:52.205400  8456 raft_consensus.cc:2393] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 15: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:52.210469  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:52.211880  8351 leader_election.cc:400] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 17. Current term is 18.
I20260709 13:03:52.212405  8351 leader_election.cc:403] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:03:52.213533  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 89753.8us
I20260709 13:03:52.213781 15000 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:52.215091  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:52.215706  8461 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 16.
I20260709 13:03:52.216154  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:52.216941  9295 raft_consensus.cc:1240] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:52.217031  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:52.218150 14512 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:52.218459 14758 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:52.218546 14512 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:52.219257 14512 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:52.219719  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:52.217031 15040 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:52.220914 15066 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:52.221479 15066 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:52.222506  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:52.223719 15066 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:52.205819 14922 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:52.208524  8457 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
I20260709 13:03:52.219183  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:52.229454  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:52.230329  8457 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 16.
I20260709 13:03:52.233659  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:52.234864  8351 leader_election.cc:400] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 17. Current term is 18.
I20260709 13:03:52.235216  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:52.237416  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 50259.8us
I20260709 13:03:52.238231  8533 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:52.238631  8501 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.239569  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:52.242515  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:52.243592  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:52.244200  8526 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 12.
I20260709 13:03:52.245534  8526 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:52.245642 14806 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:52.240458  8351 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:52.246893  8526 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:52.246809 14806 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:52.247628 15079 log.cc:927] Time spent T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.158s	user 0.000s	sys 0.002s
I20260709 13:03:52.248078 15064 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:52.202203 14931 consensus_queue.cc:1048] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:03:52.248574  8351 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:52.248984  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:52.249290 14806 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:52.244246 15015 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:52.252924  8349 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:52.254667  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:52.259739  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:52.263594  8351 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:52.265661 14549 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:52.265920 14835 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:52.267686  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:52.269367  8501 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.235543 14977 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 17. Current term is 18.
I20260709 13:03:52.268321  9294 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
I20260709 13:03:52.271600  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:52.295293 14334 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:52.298826 15012 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:52.359797  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 100178us
W20260709 13:03:52.361403  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 97896us
I20260709 13:03:52.361963  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:52.362367  8351 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:52.266820 14913 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:52.375804  8461 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:52.379669  8457 raft_consensus.cc:1275] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:52.389245  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:52.366652 14758 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:52.388456  8500 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:52.366842 14915 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:52.375651 14334 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:52.383921 15015 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:52.391641 15064 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:52.415369  9261 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.396617 14915 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.431187 14915 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:52.434275 15078 log.cc:927] Time spent T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.337s	user 0.002s	sys 0.000s
I20260709 13:03:52.438663  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:52.441560  8500 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.399263 14870 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:52.442037 14931 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:03:52.469750  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 54556.2us
I20260709 13:03:52.459271 14981 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:52.478149  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:52.478149  8528 raft_consensus.cc:1275] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:52.459671 14870 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:52.465365 14929 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:52.476323  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 114057us
I20260709 13:03:52.483438  9261 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:52.485878  9261 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:52.484028 15012 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:52.489156 15012 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.489612 15012 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:52.493546  8532 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 13: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:52.502904 15065 raft_consensus.cc:3055] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:52.503454 15065 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:03:52.505242 15061 log.cc:927] Time spent T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.669s	user 0.008s	sys 0.000s
W20260709 13:03:52.505506 15085 log.cc:927] Time spent T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:03:52.482445 14870 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:52.504346 15065 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:52.514640 15065 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:52.521114 14915 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:52.523341 14915 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:52.526244  8455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53010 (request call id 1394) took 1131 ms. Trace:
I20260709 13:03:52.526448 14825 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:03:52.526958 14825 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 26 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:52.527395 14825 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:03:52.526283 15053 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:52.530750 15053 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:52.531141 15053 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:52.531777 15012 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:52.538816  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 52013.6us
I20260709 13:03:52.539598  9261 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:52.540760 15000 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:52.540874  9261 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:52.526717  8455 rpcz_store.cc:276] 0709 13:03:51.394861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.395001 (+   140us) service_pool.cc:224] Handling call
0709 13:03:52.526037 (+1131036us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b54000d2fd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:52.526143 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1281582848}
I20260709 13:03:52.543442 14293 raft_consensus.cc:2804] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:52.543844 14293 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:52.543911  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:52.544724  8527 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:52.546073  8529 raft_consensus.cc:1275] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:52.549539 14293 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:52.552489 15073 log.cc:927] Time spent T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.511s	user 0.003s	sys 0.000s
I20260709 13:03:52.549237 15000 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.553582  8528 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:52.554705 15075 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.555294 15075 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:52.553598 15000 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:52.562947  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 293635us
I20260709 13:03:52.562002  9261 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:52.485684  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:52.563505 14293 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:52.564522  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 78903.1us
I20260709 13:03:52.565575  8351 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:52.566959  8351 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:52.581632  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:52.582307  9287 raft_consensus.cc:1240] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:52.582346  9288 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 16.
I20260709 13:03:52.594648  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:52.591702  8501 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.596066  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:52.596812  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:52.596360  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:52.597927  8458 raft_consensus.cc:1275] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:52.600162  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:52.596177  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:52.604094  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:52.604336  8501 leader_election.cc:400] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:52.604707  8501 leader_election.cc:403] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:52.614706  8453 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 13: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:52.589298 14917 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:52.589769 14915 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:52.585592 14977 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:52.616684  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:52.630158  8378 raft_consensus.cc:2393] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 13: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:52.616686  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:52.625938  8386 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:52.634433  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:52.589910 14758 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:52.614187 14913 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:52.646526  8501 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.629467 14917 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.605212 14891 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 13:03:52.629848 14915 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:52.658633  8378 raft_consensus.cc:1240] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:52.614488 14929 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:03:52.639586 15075 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:52.661016 14917 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:52.724172 15012 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:52.648664 14758 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:52.736264 14758 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:52.674260 14512 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:52.675388  8384 raft_consensus.cc:1275] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:52.675725 15066 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 14. Current term is 15.
I20260709 13:03:52.678263 14825 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:52.666186 14915 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:52.682607  8383 raft_consensus.cc:1275] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:52.683159  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:52.746038  8382 raft_consensus.cc:2393] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 13: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:52.683938 15014 raft_consensus.cc:2804] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:03:52.684707  8270 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9e1d32431b1c45ebad1160a850495e16 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:52.690328  8427 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.690716 14913 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:52.749686  8270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 65181.3us
I20260709 13:03:52.690966  8527 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 13.
I20260709 13:03:52.691430 15093 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:52.746534  8528 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:03:52.750959  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 60748us
I20260709 13:03:52.751767  8427 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.753840  8427 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:52.764573  9294 raft_consensus.cc:1240] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16. Ops: []
W20260709 13:03:52.765704  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 161600us
W20260709 13:03:52.768850  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 122424us
I20260709 13:03:52.769934  8501 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.771507  8501 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.774813 14771 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:03:52.789054  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:52.774457 15094 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:52.763540 14549 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:52.763710 14835 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:52.786403 14825 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 27 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:52.811022  8500 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:52.774072 15004 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:52.773681 14929 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:52.767387 15014 raft_consensus.cc:697] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:52.823732  8501 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.826407  8501 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.832366  8501 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.818670 15112 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:52.817493 15004 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:03:52.841714  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 247115us
I20260709 13:03:52.817126 14603 consensus_queue.cc:1059] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:03:52.843704  8351 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:52.840922 14929 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:52.845259  8351 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:52.836404 15012 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:52.840390 15065 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:52.828182 14996 consensus_queue.cc:1048] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:03:52.850935  8351 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:52.843974 15004 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:52.833668 14870 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:52.858830  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.834985 15106 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:03:52.850729 14771 raft_consensus.cc:3055] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:52.848985 15097 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:52.848986 15096 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:52.864287  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:52.869067  8351 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:52.876462 14870 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:52.884685  8351 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
W20260709 13:03:52.885712 15101 log.cc:927] Time spent T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:03:52.888496 14512 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:52.883845 15110 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:52.889040  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:52.865304 14758 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:52.892977 15000 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:52.861788 14771 raft_consensus.cc:740] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:52.896471  9296 raft_consensus.cc:2368] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14.
I20260709 13:03:52.900003 14922 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:52.900485 14922 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.900836 14922 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:52.902659 14977 consensus_queue.cc:1059] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:52.903152 14293 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:52.903818 14977 raft_consensus.cc:3055] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:52.904194 14977 raft_consensus.cc:740] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:52.907334 15113 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.907902 15113 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:52.911540  8351 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:52.919740  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:52.923586 14917 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:52.926406  8379 raft_consensus.cc:1240] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:52.927940 14771 consensus_queue.cc:260] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:52.931545  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:52.930783  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:52.933001  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.931772  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:52.934536  8381 raft_consensus.cc:2410] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:03:52.897818 15040 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:52.937737 14293 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:52.859897 15014 consensus_queue.cc:237] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:52.940402 15113 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:52.940717 14917 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:52.947017  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:52.947839  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:52.948428  8382 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:03:52.953817  8535 raft_consensus.cc:1275] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:52.937036 15110 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:52.956096  8349 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
W20260709 13:03:52.959466  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.962752  8533 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:52.963339 15068 raft_consensus.cc:493] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:52.964745  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:52.965360  8454 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 19.
I20260709 13:03:52.966439  8501 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:52.971062  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:52.972452  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:52.975026  8530 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:52.976540  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:52.977612  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:52.978183 15114 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:52.979586 15114 consensus_queue.cc:1059] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:52.980680  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:52.983573  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:52.984745 14870 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.985284 14870 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:52.986994  9293 raft_consensus.cc:1240] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:52.987561 14870 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:52.990226 15097 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:52.990780 15097 raft_consensus.cc:697] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:52.990669 15113 consensus_queue.cc:1048] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:52.991706 15097 consensus_queue.cc:237] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:52.992102 15113 consensus_queue.cc:1059] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:52.993355  8384 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:03:52.993254 15041 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:03:52.995265 15074 log.cc:927] Time spent T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.954s	user 0.000s	sys 0.003s
I20260709 13:03:52.995747  8384 raft_consensus.cc:1275] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:52.997918  8377 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:52.996335 14903 raft_consensus.cc:3055] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:52.996371  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:53.007682  9291 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:53.003737  8457 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:52.997707 14293 consensus_queue.cc:1059] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:53.005491  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:52.964663 14771 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:52.964066 15068 raft_consensus.cc:515] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.011648  8426 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:53.017796 14913 consensus_queue.cc:1059] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:53.021853 15053 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.022565  8382 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 27.
I20260709 13:03:52.996794 14915 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:52.905030 14977 consensus_queue.cc:260] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:53.013707 15080 log.cc:927] Time spent T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.971s	user 0.004s	sys 0.000s
I20260709 13:03:53.031260  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:53.039057 14293 raft_consensus.cc:3055] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:53.039721 14293 raft_consensus.cc:740] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:53.006933 14903 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:53.045681  8382 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 27 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 26. Current term is 27. Ops: [24.17-26.18]
I20260709 13:03:53.044816  8501 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:53.052937 14293 consensus_queue.cc:260] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.054944  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:53.055227  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:53.058624  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:53.059378  8457 raft_consensus.cc:3060] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:53.059935  8385 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:53.007174 14825 consensus_queue.cc:1048] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:03:53.055902  8454 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 19.
I20260709 13:03:53.059136  8351 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:53.064968  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:53.045608 14975 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:53.040853 14891 raft_consensus.cc:3055] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:53.067080  8528 raft_consensus.cc:1275] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:03:53.067917  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 56360.1us
I20260709 13:03:53.072537  8535 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:03:53.078153 14293 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:53.050343 14913 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:53.080010  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:53.087788 14915 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:53.066258 15004 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:53.092020 15000 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:53.094058  8351 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:53.097242  8457 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 21.
I20260709 13:03:53.060072 14549 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:53.094866  8426 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:53.100060  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:53.069005 15096 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:53.101848  8528 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:53.069345 14891 raft_consensus.cc:740] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:53.104755  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:53.110587  8426 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:53.121814 15084 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:53.127473  8380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59328 (request call id 2907) took 1217 ms. Trace:
I20260709 13:03:53.127904  8380 rpcz_store.cc:276] 0709 13:03:51.909630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.911231 (+  1601us) service_pool.cc:224] Handling call
0709 13:03:51.911565 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:51.911888 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:51.911914 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:51.928907 (+ 16993us) log.cc:844] Serialized 26 byte log entry
0709 13:03:51.984676 (+ 55769us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:51.984742 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.984879 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:52.956767 (+971888us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
0709 13:03:53.112818 (+156051us) raft_consensus.cc:1685] finished
0709 13:03:53.112844 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:53.127405 (+ 14561us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2206,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":7891,"spinlock_wait_cycles":35539200,"thread_start_us":37653,"threads_started":1,"wal-append.queue_time_us":95661}
I20260709 13:03:53.109786 15093 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:53.141889  9291 raft_consensus.cc:2468] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 21.
I20260709 13:03:53.104465 14549 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:53.112550 15121 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:53.112893 15041 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:53.153965  8528 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
W20260709 13:03:53.143304  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 80994.7us
I20260709 13:03:53.074656  8453 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:53.158617  8453 raft_consensus.cc:606] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:53.158643 14293 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:53.159040  8453 raft_consensus.cc:614] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:53.162781  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 48266.9us
I20260709 13:03:53.169516  9260 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:03:53.171188  9260 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:53.152150 14771 consensus_queue.cc:1048] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:03:53.154417 15041 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.165366 15081 consensus_queue.cc:1059] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.012s
I20260709 13:03:53.181371 15081 raft_consensus.cc:3055] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:03:53.181842 15081 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:53.182792 15081 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.183908 15081 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:03:53.181396 14549 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:53.175434 14981 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:53.189047 14981 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.189495 14981 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:53.152988 15122 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:03:53.189381  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:53.193413  8460 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:53.201792  8528 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:53.197222 14946 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:03:53.210551  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 60547.1us
I20260709 13:03:53.195096 15041 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:53.225440 15117 log.cc:927] Time spent T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:03:53.202212 14512 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:03:53.161455 14891 consensus_queue.cc:260] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.234203 14891 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:53.236941 15124 consensus_queue.cc:1175] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d653e71832b7402b9a03b46249d3b885" responder_term: 10 status { last_received { term: 10 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 10 index: 9 } }
I20260709 13:03:53.255478 15004 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:53.264317  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:53.265106  8383 raft_consensus.cc:3060] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:53.266669  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:53.269569  8500 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:53.271101 15114 raft_consensus.cc:2804] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:53.271646 15114 raft_consensus.cc:697] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 21 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:53.272665  8383 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
I20260709 13:03:53.272545 15114 consensus_queue.cc:237] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.274482 15068 leader_election.cc:290] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:53.281742  9261 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:53.282755  8460 raft_consensus.cc:2468] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 14.
W20260709 13:03:53.289510  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 78125.1us
I20260709 13:03:53.294026 14867 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:53.295909 14946 consensus_queue.cc:1059] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:53.296633 14946 consensus_queue.cc:1243] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer d653e71832b7402b9a03b46249d3b885 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:03:53.297066 14549 consensus_queue.cc:1048] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:03:53.301316 14981 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.296660  9293 raft_consensus.cc:1240] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:53.232558 14922 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.211537 15110 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.096s
I20260709 13:03:53.313936  9261 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:53.314785 15014 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:53.315208  9261 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:53.315959 15014 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:03:53.316495 15014 raft_consensus.cc:697] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 27 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:53.317341  9261 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:53.316510 15075 consensus_queue.cc:1059] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:53.318195 14946 raft_consensus.cc:2804] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:03:53.312657  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 123867us
I20260709 13:03:53.321148  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:53.323467  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:53.324491  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:53.324594 15122 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:53.325103 15053 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:53.326829 15094 raft_consensus.cc:3055] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:53.327208 15094 raft_consensus.cc:740] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:53.328133 15094 consensus_queue.cc:260] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:53.329221 15112 consensus_queue.cc:1175] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "446d9310dce14ff4afff2dc2d64f68d8" responder_term: 16 status { last_received { term: 15 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:53.330546  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:53.319689 14900 consensus_queue.cc:1048] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:03:53.331583  8386 raft_consensus.cc:2393] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 17: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:53.326601 15128 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
W20260709 13:03:53.332863  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.333155  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:53.331310  9293 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 20: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
W20260709 13:03:53.334005  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 157443us
I20260709 13:03:53.318692 14946 raft_consensus.cc:697] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:53.339964  8460 raft_consensus.cc:1240] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:53.332764 14981 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:53.343194  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:53.343654  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:53.344553  8460 raft_consensus.cc:3060] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:53.359515 15094 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:53.346715 15110 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:53.369100 14922 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:53.369984  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:53.367666  8460 raft_consensus.cc:2468] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 20.
I20260709 13:03:53.358211 14970 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:53.379695 14970 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:53.384791  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.368068 15110 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.371091 14946 consensus_queue.cc:237] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.387837 15110 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:53.391964 15134 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:53.392584 15134 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.394757 15134 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:53.396960  8427 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:53.397854 15004 consensus_queue.cc:1048] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:53.398846 14787 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:53.400000 15004 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:53.401469  8380 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:53.402484  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:53.403236  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:53.404001 14996 consensus_queue.cc:1048] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:53.406162 14996 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:53.408732  8500 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:53.358912 15075 raft_consensus.cc:3055] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:53.412358  8500 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:53.414290  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:53.431257  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26eda7bdc3194871b01c986d3db7cccf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:53.434953  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:53.418805 14929 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:53.415506 15075 raft_consensus.cc:740] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:53.432771 15112 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:53.358737 15014 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.460632  8427 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:53.494203  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:53.496206  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 65768.5us
I20260709 13:03:53.459942 15053 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:53.495357  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:53.471499 15004 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:53.503542  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:53.505201  8424 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:53.506819  8424 leader_election.cc:304] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:53.516965  9260 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:53.538928  8461 raft_consensus.cc:1275] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:03:53.539404  8461 pending_rounds.cc:85] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12: Aborting all ops after (but not including) 7
I20260709 13:03:53.545511  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:53.517714 14750 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:53.523677 15128 raft_consensus.cc:2749] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:53.548628  9260 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:53.539687  8461 pending_rounds.cc:107] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:03:53.553609  8461 raft_consensus.cc:2889] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:53.513614 15053 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.502543 15114 consensus_queue.cc:1059] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:03:53.502015 15130 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.100s
I20260709 13:03:53.566165  8461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:53.566843  8461 raft_consensus.cc:606] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:53.548144 14970 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:53.571924 15136 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:53.572595 15136 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.574394 15148 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:53.564457 14946 raft_consensus.cc:2804] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:53.510725 15075 consensus_queue.cc:260] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:53.612253  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 92812.2us
I20260709 13:03:53.609100 15148 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:53.612123 14946 raft_consensus.cc:697] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:03:53.658423 15150 log.cc:927] Time spent T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:03:53.664037 15136 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:53.665766 15053 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:53.647698 14787 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:53.673631  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 116324us
W20260709 13:03:53.668804 15145 log.cc:927] Time spent T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 13:03:53.684368 15139 log.cc:927] Time spent T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.370s	user 0.002s	sys 0.000s
I20260709 13:03:53.690160  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:53.699636  8452 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:03:53.699762  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 55224.3us
W20260709 13:03:53.705411 15151 log.cc:927] Time spent T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:03:53.705780 14806 raft_consensus.cc:3055] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:53.706319 14806 raft_consensus.cc:740] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:53.707337 14806 consensus_queue.cc:260] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:53.708591 14806 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:53.709682 14931 consensus_queue.cc:1175] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "105d6581548546b98eddd4ee7083bb12" responder_term: 19 status { last_received { term: 19 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 19 index: 12 } }
I20260709 13:03:53.716023  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:53.734134  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:53.735721 15138 log.cc:927] Time spent T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.422s	user 0.002s	sys 0.003s
W20260709 13:03:53.738586 15153 log.cc:927] Time spent T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:03:53.738814 14946 consensus_queue.cc:237] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.653550 15148 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.739928 14977 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:53.741478 15148 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:53.742069 15129 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.423s	user 0.002s	sys 0.000s
I20260709 13:03:53.743854  8384 raft_consensus.cc:1240] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
W20260709 13:03:53.744827 15135 log.cc:927] Time spent T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.427s	user 0.002s	sys 0.000s
I20260709 13:03:53.751283  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:53.759220 14750 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:53.759984 14750 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:53.760922 15149 log.cc:927] Time spent T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:03:53.763123 14903 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:53.766013  8426 leader_election.cc:400] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 13 election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 13. Current term is 14.
I20260709 13:03:53.767556  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:53.768424 15041 consensus_meta.cc:287] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.530s	user 0.005s	sys 0.005s
I20260709 13:03:53.768865 15041 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:53.770001 15154 log.cc:927] Time spent T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:03:53.771019 15041 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:53.772596  8383 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 20: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:53.681968 14787 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.759400 15094 raft_consensus.cc:3055] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:53.786302  8377 raft_consensus.cc:1275] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:53.795426  9261 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:53.796715  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:53.797722  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:53.791285 14931 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.810456 14931 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.811254  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:53.790119 14922 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.782920 15094 raft_consensus.cc:740] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:53.813386  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:53.820228  9296 raft_consensus.cc:2393] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 17: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:53.815644  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:53.821105 15041 consensus_queue.cc:1048] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:53.822505  8461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:53.823392  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:53.825819  8461 raft_consensus.cc:606] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:53.826026  9291 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:53.813524 14758 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:53.839607  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:53.828063 15162 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:53.832679 15146 log.cc:927] Time spent T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.176s	user 0.003s	sys 0.000s
I20260709 13:03:53.843998  8456 raft_consensus.cc:2393] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 20: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
W20260709 13:03:53.848928  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.824856 14931 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:53.842545 15148 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:53.822177 14922 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.860368 14787 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:53.896096 15111 raft_consensus.cc:3055] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:53.896648 15111 raft_consensus.cc:740] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:53.897636 15111 consensus_queue.cc:260] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.898962 15111 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:53.903383  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 68566us
I20260709 13:03:53.905191  8456 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:53.909652  8456 raft_consensus.cc:606] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:53.910138  8456 raft_consensus.cc:614] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:53.913872  9260 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:53.918318  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:53.866916 15094 consensus_queue.cc:260] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:53.891111 15148 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:53.925953  9260 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:53.915620 14981 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:53.925421 14989 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.099s
I20260709 13:03:54.030392  8351 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:54.030737  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 211419us
W20260709 13:03:54.032781  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 106888us
I20260709 13:03:54.035094  9288 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:54.036087  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:54.045302 15106 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:54.046029 15106 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:54.044697 15081 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:54.050295 15081 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:54.052695 15081 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:54.048870 15106 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:54.059561 15095 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:54.059816 15168 log.cc:927] Time spent T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:03:54.060285 15095 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:54.061733  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:54.062709  9292 raft_consensus.cc:2393] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 11: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:54.064723 15095 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:54.070266 14758 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:54.074119 14922 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:54.033041 15094 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:54.076440 15112 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:54.077047 15112 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:54.078115 15124 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.078624 15124 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:54.078867 15012 consensus_queue.cc:1059] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:54.080438 15065 raft_consensus.cc:3055] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:54.080940 15065 raft_consensus.cc:740] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:54.082000 15065 consensus_queue.cc:260] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:54.083016 15065 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:54.034516 14825 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:54.103756  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 65417.5us
I20260709 13:03:54.103704  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:54.106303  8378 raft_consensus.cc:1240] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 13:03:54.090831  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 52442.9us
I20260709 13:03:54.105590  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:54.108904  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 70724.8us
I20260709 13:03:54.109890  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:54.110354  8456 raft_consensus.cc:2410] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:03:54.110044 15040 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:54.111414  9261 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:54.119948 15124 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:54.128701 15162 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:54.129834  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.122431 15040 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:54.131841 15040 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:54.133873 14903 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:54.140816  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:54.141021 15148 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:54.146931 15075 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:54.157641 15014 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:54.104111 15134 consensus_queue.cc:1048] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:03:54.158401  8531 raft_consensus.cc:1275] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:54.159907 15112 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:54.161406 15095 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:54.162922  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 48212us
I20260709 13:03:54.165027 14750 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:54.170674  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:54.170944  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:54.172135  9261 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:54.173442  8455 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:03:54.175137  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.176298  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:54.177057  8382 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 22.
I20260709 13:03:54.188804  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:54.188874  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 61149.5us
I20260709 13:03:54.189921  8531 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 20.
I20260709 13:03:54.204026  8455 raft_consensus.cc:1240] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:54.204914  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:54.205426  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:54.205614  8535 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 11.
I20260709 13:03:54.208550  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:54.209662  9287 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 21.
I20260709 13:03:54.194242  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:54.211436  8385 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 21.
I20260709 13:03:54.213730  8426 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:54.216508  8531 raft_consensus.cc:2410] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:03:54.195698  8501 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:54.218771  9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:54.225951  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:54.224629  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:54.193171 15173 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.230155  8349 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:54.231665  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:54.233144  9288 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:03:54.193128 15053 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:54.247282  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:54.247392  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:54.257848  9295 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:54.274008  9290 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31"
dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:54044
I20260709 13:03:54.274653  9290 raft_consensus.cc:606] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:03:54.275044  9290 raft_consensus.cc:614] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:54.277241  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:54.278441  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:54.279321  9293 raft_consensus.cc:2393] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 21: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:54.280478  8458 raft_consensus.cc:2393] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 18: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:54.289064 14806 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.289860 14806 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:54.292052 14806 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:54.263478 15066 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:54.298303 15066 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.298705 15066 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:54.304513 14835 raft_consensus.cc:993] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:03:54.305305 14787 raft_consensus.cc:1081] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:03:54.307591  8424 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:54.309768 14835 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:54.313181 15041 consensus_queue.cc:1048] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:03:54.224776 15172 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:54.278380 15153 log.cc:927] Time spent T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:54.221634 14771 consensus_queue.cc:1059] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.104s
I20260709 13:03:54.225214 15162 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.104s
I20260709 13:03:54.324759 15093 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:54.354966  8455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:54.355774  8455 raft_consensus.cc:606] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:54.357609  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:54.270529 15173 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:54.366999  8452 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 22.
I20260709 13:03:54.368124 15173 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:54.344780 15093 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.378597  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:54.395570  8379 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 22.
I20260709 13:03:54.403650  8427 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:54.406383 14975 raft_consensus.cc:3055] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:54.407018 14975 raft_consensus.cc:740] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:54.425753  8461 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:03:54.430733  8501 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:54.437954  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:54.440886  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:54.437655  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:54.442443 15064 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:54.442751  9294 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 19.
I20260709 13:03:54.442924 15064 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:54.443344 15064 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:54.394871 15093 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:54.457973  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:54.462242 14977 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:54.468112  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 64585.6us
I20260709 13:03:54.408218 14975 consensus_queue.cc:260] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:54.474984  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 200960us
I20260709 13:03:54.481563  8461 raft_consensus.cc:1275] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:03:54.482240  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 254875us
I20260709 13:03:54.485741  8351 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:54.489276  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:54.491537  8383 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:54.479000 15121 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:54.452086 15040 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:54.494860 15121 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.495344 15121 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:54.496645 15040 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:54.497546  8380 raft_consensus.cc:1240] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:54.454710 14989 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:03:54.494884 15110 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:54.505951 15110 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.506361 15110 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:54.510504  8500 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:54.511103 15094 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:54.511595 15124 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:54.512014 15124 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:54.512372 15124 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:54.518011  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
W20260709 13:03:54.494338 15111 consensus_meta.cc:287] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.004s
I20260709 13:03:54.487414 14977 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:54.529650  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:54.487856  8349 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:54.534466  9261 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:54.534855 14293 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:03:54.538869 15148 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:54.541507  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
W20260709 13:03:54.572881  8351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.530403 15065 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:54.575990  8384 raft_consensus.cc:1275] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:03:54.573753  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:54.550736 15095 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:54.579336  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 91567.6us
I20260709 13:03:54.531774 15130 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:54.576720  8384 pending_rounds.cc:85] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 13
I20260709 13:03:54.580433  8384 pending_rounds.cc:107] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:03:54.580696  8384 raft_consensus.cc:2889] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:54.551009 15183 consensus_queue.cc:1048] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:03:54.584085 14903 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:54.584888 14758 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:54.562990 15068 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:54.615949 15068 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:54.627915 15068 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:54.630249  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:54.633728  9293 raft_consensus.cc:2393] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 19: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
W20260709 13:03:54.645627  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.652087 15124 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:54.662868 15121 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:54.665263 15121 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 23 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:54.669400 15194 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.670418 15004 raft_consensus.cc:993] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:03:54.670886 15004 raft_consensus.cc:1081] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:03:54.670006 15194 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:54.675026 15093 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:54.678179 15093 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:54.681694 15124 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:54.682627  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:54.683781 15065 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:54.684365 15065 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:54.685623  8535 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 27 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:03:54.594671 15130 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:54.687074 15065 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:54.688133 15130 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:54.691193  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:54.693470  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:54.694238  9295 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:03:54.694530 15194 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:54.697197  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:54.698127  8458 raft_consensus.cc:2393] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 18: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:54.699978 15064 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:54.701233  8532 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:54.706341  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:54.709128  8532 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 22.
I20260709 13:03:54.715261  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:54.718097 15172 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:54.656857 15066 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:54.737322 15064 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:54.750375  9289 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:54.769106  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:54.775767  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:54.803923  8530 raft_consensus.cc:2393] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 20: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:54.767920  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:54.805748  8452 raft_consensus.cc:2393] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 23: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:54.787763  8529 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:54.806504  8531 raft_consensus.cc:2393] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 23: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:54.762831  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:54.774097  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:54.807750  8527 raft_consensus.cc:2393] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 23: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
W20260709 13:03:54.817194  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.818058  9295 raft_consensus.cc:2393] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 21: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:54.818259  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:54.785359  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:03:54.782262  8270 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9e1d32431b1c45ebad1160a850495e16 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 446d9310dce14ff4afff2dc2d64f68d8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:03:54.837229  8270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 57379.7us
I20260709 13:03:54.776593  8526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38894
I20260709 13:03:54.840006  8526 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:54.840128  8500 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:54.840413  8526 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:54.766927  8535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38894
I20260709 13:03:54.842312  8535 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:54.842777  8535 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:54.768009 15066 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:54.857980 15134 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.775442 15110 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:54.860980 15134 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:54.862416 15110 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:54.855279 15064 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:54.835561 14512 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.058s
I20260709 13:03:54.858590 15162 consensus_queue.cc:1048] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
W20260709 13:03:54.915920  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 105020us
I20260709 13:03:54.897064 15094 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.926740  8385 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 27 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:03:54.888916  8526 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:54.932770  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:54.933930  8379 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 17: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:54.935588  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:54.907212 15064 raft_consensus.cc:697] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:54.936403  8385 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 27.
I20260709 13:03:54.940452  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:54.940788  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:54.941435  8383 raft_consensus.cc:2368] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 21. Current term is 22.
I20260709 13:03:54.942327  8526 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:54.941606  8452 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:03:54.929522 15012 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.946111 15064 consensus_queue.cc:237] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:54.958418 15197 log.cc:927] Time spent T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:03:54.944773 15012 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:54.962970 15012 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:54.963992 15134 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:54.933666 15094 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:54.970440 15094 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:54.958560 15172 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.972783 15172 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:54.978662 15172 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:54.981894  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:54.982611  8527 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 11.
I20260709 13:03:54.985247  8535 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:54.990993  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:54.991837  8385 raft_consensus.cc:3060] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:54.995685  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 139135us
I20260709 13:03:54.997720  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:54.998314  8383 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:54.999276  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:54.999902  8379 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:55.004581  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:55.005239  8378 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:55.005290  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:55.005939  8452 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:03:55.002977  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:55.011968  8379 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
I20260709 13:03:55.012838  8501 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:55.014024  8535 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:55.020817  8501 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:55.028118  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:55.029791  8501 leader_election.cc:400] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 21. Current term is 22.
I20260709 13:03:55.030314  8501 leader_election.cc:403] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:03:55.033941  8501 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:55.036330  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:55.037271  9295 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:55.041342  8501 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:55.043959  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:55.044718  8379 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 10.
I20260709 13:03:55.048979  8426 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:55.051328  8383 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:55.020515 15066 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:55.058153  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:55.058821  9295 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:55.085114 14975 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:55.090245  8378 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
I20260709 13:03:55.041507 15112 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for earlier term 21. Current term is 22.
I20260709 13:03:55.044533 15191 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:55.111847  9261 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:55.055706 15081 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:55.092813 15012 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:03:55.052760 15161 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.066s
I20260709 13:03:55.113299 14603 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:55.118637 15191 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.116866 14867 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.126366 15081 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.145313 15081 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:55.149149 15191 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:55.162468  8452 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 20.
I20260709 13:03:55.135491 14603 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.198098  9295 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 20.
W20260709 13:03:55.196187  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 84459.9us
I20260709 13:03:55.198567  8351 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:55.198752 15148 raft_consensus.cc:2804] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:55.202015 15040 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.177114 14867 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:55.199457 14603 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:55.294580 15000 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:55.239032 14900 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:55.296833 15040 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:55.299436  8501 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:55.240581  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:55.301359  8461 raft_consensus.cc:3055] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:55.241451  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:55.246321 14835 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:03:55.247980  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.248705 15012 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:55.253747 15110 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.306066 14835 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:55.306847 15110 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:55.309064 15207 consensus_queue.cc:1059] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:55.309607 15110 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:55.262329  8277 catalog_manager.cc:5697] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 11 to 14, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 14 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:55.310220 15207 raft_consensus.cc:3055] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:55.271714 14806 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:55.310580 15207 raft_consensus.cc:740] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:55.299482 15040 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:55.311403 15207 consensus_queue.cc:260] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:55.296835 15173 raft_consensus.cc:993] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:03:55.312885 15207 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:55.312955 15173 raft_consensus.cc:1081] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:03:55.315778 14603 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:55.240903  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:55.318725  8455 raft_consensus.cc:3055] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:55.288796  8529 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:55.301826  8461 raft_consensus.cc:740] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:55.302716  8458 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
I20260709 13:03:55.305862 14900 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:55.319168  8455 raft_consensus.cc:740] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:55.337653  8526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38894
I20260709 13:03:55.285913 15148 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.338626  8526 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:55.344723  8526 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:55.340569  8385 raft_consensus.cc:2468] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 23.
I20260709 13:03:55.341535  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:55.328663  8455 consensus_queue.cc:260] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:55.346700  8455 raft_consensus.cc:3060] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:55.321668  8461 consensus_queue.cc:260] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:55.348526  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:55.355401  8425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:55.350554  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 51249.1us
I20260709 13:03:55.363732  8501 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:55.320566 15012 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:03:55.326769 14603 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:55.331140 15110 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:55.337904 14806 raft_consensus.cc:697] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 20 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:55.386582  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:55.387436  8531 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 20.
I20260709 13:03:55.389606  8349 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:55.394738  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:55.395570  9294 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:55.354128 15130 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.410058  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:55.373351 15064 raft_consensus.cc:2804] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:55.382869 15112 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:03:55.420092 15198 log.cc:927] Time spent T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.320s	user 0.004s	sys 0.001s
I20260709 13:03:55.423394 14900 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:55.408785 15130 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:55.425446 14806 consensus_queue.cc:237] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:55.426620 15130 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:55.400732 15110 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:55.434526 15110 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:55.392773 15094 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.436110 15094 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:55.441169 15094 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:55.411686 15194 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.442117  8277 catalog_manager.cc:5697] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 13 to 15, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 15 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.412098 14825 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.444080 14825 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:55.446784 14825 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:55.463403  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:55.442704 15194 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:55.455209 15064 raft_consensus.cc:697] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:55.459683  9294 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
W20260709 13:03:55.460850  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 52780.9us
I20260709 13:03:55.461902  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:55.446630 15081 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:55.469383  8426 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:55.412940 14917 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:55.351227 15148 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:55.526688  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:55.477826  8526 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:55.491309  8534 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:03:55.492342 14835 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:55.493383 15081 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:55.492774  8277 catalog_manager.cc:5697] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:55.493739  8280 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59480 (request call id 206) took 13252 ms (client timeout 15000 ms). Trace:
I20260709 13:03:55.494427 15064 consensus_queue.cc:237] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:55.498391 15194 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:55.499801 15202 log.cc:927] Time spent T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.359s	user 0.001s	sys 0.000s
I20260709 13:03:55.500600 14917 raft_consensus.cc:697] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 22 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:55.491719 15173 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:03:55.543016  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 240625us
I20260709 13:03:55.627061  8501 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:03:55.629246  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:55.349417  9295 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:03:55.553061  8460 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
I20260709 13:03:55.574692  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:55.577369  8526 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:55.608134  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:55.631050  9294 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:55.631323  9292 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:55.632993 15113 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:55.633752 15113 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:55.636587 15113 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:55.633555 14917 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:55.643852 15110 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:55.644574 15110 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:55.647394 15110 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:55.649507 15066 consensus_meta.cc:287] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.000s
I20260709 13:03:55.616086 14750 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:55.650516 14750 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:55.652781 14750 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:55.618328 15205 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.403s	user 0.001s	sys 0.001s
I20260709 13:03:55.653337  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:55.569514 14825 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.669677  9291 raft_consensus.cc:2410] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
W20260709 13:03:55.570043  8280 rpcz_store.cc:269] 0709 13:03:42.241593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.245277 (+  3684us) service_pool.cc:224] Handling call
0709 13:03:55.493663 (+13248386us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:51.303960 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:51.304700 (+   740us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:51.304756 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:03:51.304778 (+    22us) tablet.cc:662] Decoding operations
0709 13:03:51.398054 (+ 93276us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:51.398196 (+   142us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:51.398234 (+    38us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:03:51.400477 (+  2243us) tablet.cc:701] Row locks acquired
0709 13:03:51.400541 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:03:51.400932 (+   391us) write_op.cc:270] Start()
0709 13:03:51.401163 (+   231us) write_op.cc:276] Timestamp: P: 1783602231400844 usec, L: 0
0709 13:03:51.401210 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:03:51.402166 (+   956us) log.cc:844] Serialized 8196 byte log entry
0709 13:03:51.953650 (+551484us) op_driver.cc:464] REPLICATION: finished
0709 13:03:52.092701 (+139051us) write_op.cc:301] APPLY: starting
0709 13:03:52.092812 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:52.107411 (+ 14599us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:52.120039 (+ 12628us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:52.173905 (+ 53866us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b540014ebd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c848232a 00007f36c8407f14 00007f36c8407ec3 00007f36c8407e38 00007f36c8407df3 00007f36c84070dc 00007f36c8430e16 00007f36c8418cbb 00007f36c840339d 00007f36c8406d75
0709 13:03:52.502856 (+328951us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:52.503312 (+   456us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:03:52.503391 (+    79us) write_op.cc:312] APPLY: finished
0709 13:03:52.503896 (+   505us) log.cc:844] Serialized 188 byte log entry
0709 13:03:52.505997 (+  2101us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:52.506202 (+   205us) write_op.cc:454] Released schema lock
0709 13:03:52.506283 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:52.506770 (+   487us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:52.506802 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5125624,"reported_tablets":33,"spinlock_wait_cycles":6528,"child_traces":[["op",{"apply.queue_time_us":122421,"apply.run_cpu_time_us":31601,"apply.run_wall_time_us":414011,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91991,"num_ops":21,"prepare.queue_time_us":182054,"prepare.run_cpu_time_us":27547,"prepare.run_wall_time_us":168347,"raft.queue_time_us":114986,"raft.run_cpu_time_us":32902,"raft.run_wall_time_us":234558,"replication_time_us":545112,"spinlock_wait_cycles":5014912,"thread_start_us":335715,"threads_started":4,"wal-append.queue_time_us":131202,"wal-append.run_cpu_time_us":14903,"wal-append.run_wall_time_us":1979577}]]}
I20260709 13:03:55.654223 15173 raft_consensus.cc:697] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:55.564827 15012 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:55.658059  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:55.662731 15081 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:55.673795  8378 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:55.674010 15081 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:55.675032 15012 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 28 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:55.676460 15081 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:55.678529  8461 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:55.650015 15066 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:55.663615  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:55.708070  8385 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 15.
W20260709 13:03:55.708025  8350 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.032s	sys 0.053s
W20260709 13:03:55.671406  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 200107us
I20260709 13:03:55.676126 15173 consensus_queue.cc:237] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:55.658758  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:55.688953  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:55.712989  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:55.713727  8377 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:03:55.714211  8459 raft_consensus.cc:2410] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:03:55.693447  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:55.715013  8378 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:03:55.695055  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:55.692166  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:55.716063  8383 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:55.715184  8350 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.032s	sys 0.053s
I20260709 13:03:55.719164  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:55.661868  8454 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 19.
I20260709 13:03:55.721470  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:55.722254  8380 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:55.724700  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:55.725140  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.665961 15194 raft_consensus.cc:2804] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:55.728297  9261 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:55.648898 15191 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:55.730906  8530 raft_consensus.cc:2410] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:03:55.734570  8383 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 21.
I20260709 13:03:55.706880 14867 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:55.763527  8378 raft_consensus.cc:1240] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:55.750458  8501 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:55.766541  8501 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:55.768507  8501 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:55.736984 15112 raft_consensus.cc:697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 20 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:55.745347 14989 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:55.706238 14825 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:55.798550 14825 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:55.803529 15112 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:55.815977  8426 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:55.819312 14787 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:55.819854 14787 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:55.820308 14787 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:55.821528  8351 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:55.822052 15041 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:55.822543 15041 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:55.825261  8527 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:55.769387  8380 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:55.778048  8455 raft_consensus.cc:2468] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:55.751035 15194 raft_consensus.cc:697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 23 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:55.781737  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:55.830399  8424 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:55.830979  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:55.831920  8385 raft_consensus.cc:2393] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 17: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:55.779318  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:55.832962  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:55.833575  8378 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 20.
I20260709 13:03:55.785717  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:55.786840  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:55.777043 15081 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:55.795346  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:55.795701  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:55.780151 15110 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:55.846120  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:55.780287 14989 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.829663  8383 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:55.834888  9261 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:55.836802  8379 raft_consensus.cc:2368] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 20. Current term is 21.
I20260709 13:03:55.837182  8377 raft_consensus.cc:2393] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 23: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:55.838088  8381 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 17: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:55.855548  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:55.858853  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:55.859149  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:55.859797  9295 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:03:55.840014  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:55.844008  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:55.847944  8527 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 28 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 27. Current term is 28. Ops: []
I20260709 13:03:55.848544 15127 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:55.848839  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:55.866001  8458 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:03:55.849222  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:55.850518  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:55.867148  8455 raft_consensus.cc:3055] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:55.867491  8455 raft_consensus.cc:740] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:55.868305  8455 consensus_queue.cc:260] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:55.769932 15113 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:55.777827 15212 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:55.846814  8378 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:55.865226  8526 raft_consensus.cc:2393] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 17: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:55.871973  8377 raft_consensus.cc:1240] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:55.879469  8455 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:55.770464 15106 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:55.872915  8534 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 20: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:55.873139 14293 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:55.880668 14293 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.881072 14293 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:55.879719  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 257529us
I20260709 13:03:55.820395 15148 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:55.836829 15012 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:55.837601 15081 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.884069  8378 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 19. Current term is 20. Ops: []
W20260709 13:03:55.894266  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.863915 14989 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:55.872530 15127 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.907016  8455 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:03:55.899106 14293 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:55.881932 15106 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:55.924039  8349 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.004s	sys 0.007s
W20260709 13:03:55.924533  8349 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.004s	sys 0.007s
W20260709 13:03:55.924909  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 506135us
I20260709 13:03:55.930786  8349 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:55.883149 14917 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:55.896600 15081 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:55.913611 15127 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:55.874010 15110 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:55.968302  8270 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9e1d32431b1c45ebad1160a850495e16 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 446d9310dce14ff4afff2dc2d64f68d8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:55.881166 15113 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:55.942948 15106 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:55.883354 15212 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:55.904795 15134 consensus_queue.cc:1059] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 27.19, Next index: 20, Last known committed idx: 18, Time since last communication: 0.054s
I20260709 13:03:55.978673 15172 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.980156 15111 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.951082 15194 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:56.017500  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 115469us
I20260709 13:03:55.989048 14970 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:56.025009  8461 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
I20260709 13:03:56.026669  8500 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:55.990572 15220 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:56.013509 15191 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:56.032877  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 121164us
I20260709 13:03:56.023677 14970 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:56.047106  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 223919us
I20260709 13:03:56.051527  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:56.055737 15212 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:56.044562 15220 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:56.019557 15172 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:56.066763  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:56.067078  8458 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 21.
I20260709 13:03:56.069324  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:56.070263  8382 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:56.072151  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:56.073101  8382 raft_consensus.cc:3060] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:03:56.023964 15111 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:56.090652  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:56.047250 15216 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:56.046609 14970 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:56.093041  8461 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:56.065536 15041 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:56.110143  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:56.112398  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:56.144070  8377 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:03:56.056273 15075 raft_consensus.cc:3055] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:03:56.151953  8377 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
W20260709 13:03:56.103206 15214 log.cc:927] Time spent T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 13:03:56.166425  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 139804us
I20260709 13:03:56.166769  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:56.170214  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:56.175252  8382 raft_consensus.cc:2468] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
W20260709 13:03:56.176463  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 175068us
I20260709 13:03:56.167654 15012 raft_consensus.cc:697] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 21 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:56.212518  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:56.132516 15216 raft_consensus.cc:697] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
W20260709 13:03:56.192030  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 258198us
I20260709 13:03:56.154754 15075 raft_consensus.cc:740] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:03:56.230217  8424 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.256553  8456 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:56.242148  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:56.308574  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 157921us
I20260709 13:03:56.309497  9261 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:56.300818 15015 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:03:56.301350 15213 log.cc:927] Time spent T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 13:03:56.301947 15113 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:56.302963 15220 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:56.351018 15227 log.cc:927] Time spent T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
W20260709 13:03:56.357867 15222 log.cc:927] Time spent T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 13:03:56.362232 15111 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:56.371515 15012 consensus_queue.cc:237] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:56.182091  8277 catalog_manager.cc:5697] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.376227 15216 consensus_queue.cc:237] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:56.377910  8277 catalog_manager.cc:5697] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 11 to 13, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 13 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.383922 14293 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:56.384984 15172 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:56.386210 15239 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:56.386740  8528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47306 (request call id 1586) took 1051 ms. Trace:
W20260709 13:03:56.387521 15228 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 13:03:56.403025  8383 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:03:56.406491  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 65833.8us
I20260709 13:03:56.414156  8501 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:56.417375  8427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.334003 15148 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:56.423977  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:56.347882 15134 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:56.430785  8501 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:56.425820  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 174233us
W20260709 13:03:56.426716  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 156639us
I20260709 13:03:56.434754  8386 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:03:56.417335  8528 rpcz_store.cc:276] 0709 13:03:55.335567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.335725 (+   158us) service_pool.cc:224] Handling call
0709 13:03:55.336048 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:55.372668 (+ 36620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:55.372714 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:55.392854 (+ 20140us) log.cc:844] Serialized 52 byte log entry
0709 13:03:55.735619 (+342765us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:55.995865 (+260246us) log.cc:844] Serialized 14 byte log entry
0709 13:03:55.998635 (+  2770us) log.cc:844] Serialized 14 byte log entry
0709 13:03:56.000627 (+  1992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.000712 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:56.386492 (+385780us) raft_consensus.cc:1685] finished
0709 13:03:56.386515 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:56.386659 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39098,"prepare.queue_time_us":210449,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":45939,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":12276,"spinlock_wait_cycles":48820224,"thread_start_us":547787,"threads_started":2,"wal-append.queue_time_us":514305}
I20260709 13:03:56.436350  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:56.432633  8349 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:56.438051  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:56.441039  9295 raft_consensus.cc:2393] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 17: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:56.332530 15015 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:56.437932 14787 consensus_meta.cc:287] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.617s	user 0.013s	sys 0.000s
I20260709 13:03:56.455180  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:56.440380 15094 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:56.437378 15134 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.442436 15066 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:03:56.460345  9291 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:56.464833  8349 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:56.466163  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:56.466892  8528 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:56.470750  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:56.471604  8526 raft_consensus.cc:2393] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 17: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:56.478749  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:56.479408  8383 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:56.484498  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:56.485821  8530 raft_consensus.cc:2393] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 22: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:56.427553 15239 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:56.482853  9258 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:56.462170 15134 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:56.494059  8528 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
W20260709 13:03:56.483421 15127 consensus_meta.cc:287] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.003s
W20260709 13:03:56.501420  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 64041.7us
I20260709 13:03:56.502592  8501 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:56.457675 14787 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:56.480572 14806 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:56.480472 15220 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:56.499208 14989 consensus_meta.cc:287] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.580s	user 0.013s	sys 0.000s
I20260709 13:03:56.517926 15012 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:03:56.517680 15216 raft_consensus.cc:2804] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:56.503764 15111 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:56.511511  8277 catalog_manager.cc:5697] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 6 to 11, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 11 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:03:56.490708 15106 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:56.522171 14989 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:56.517971 15232 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:03:56.529392 15216 raft_consensus.cc:697] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:56.536784 15239 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:56.500491 15127 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:56.555533  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 121889us
I20260709 13:03:56.560189 14989 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:56.561156  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:56.561774  8383 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:56.550328  8427 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
W20260709 13:03:56.586424  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 44386us
I20260709 13:03:56.587781  8427 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:56.589780  8459 raft_consensus.cc:2393] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 19: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
W20260709 13:03:56.575659 15081 consensus_meta.cc:287] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.004s
I20260709 13:03:56.605335 15081 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:56.607784 15081 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:56.608485 14989 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:56.593236 15216 consensus_queue.cc:237] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:56.609159 14989 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:56.611492 14989 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:56.611527  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:56.594821  8277 catalog_manager.cc:5697] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 14 to 18, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 18 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.612370  8382 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:03:56.596808  8456 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:03:56.597143  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:56.590262 14996 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:56.614933 14996 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:56.615389 14996 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:56.599454  8458 raft_consensus.cc:1275] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:56.619572 15134 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:56.622591 15172 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:56.621941  8277 catalog_manager.cc:5697] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.626696  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:56.590289  8427 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:56.589805  8383 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:03:56.636710  8349 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:56.608028 15075 consensus_queue.cc:260] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:56.664865  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:56.666066  8379 raft_consensus.cc:2393] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 16: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:56.670233  8460 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:56.678097  8382 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
W20260709 13:03:56.682641  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 92429.9us
I20260709 13:03:56.683578  9295 raft_consensus.cc:2393] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 18: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:56.683713  8427 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:56.690752  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:56.692921  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:56.695554  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:56.698241  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:56.703773  8427 leader_election.cc:400] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 20. Current term is 21.
I20260709 13:03:56.704285  8427 leader_election.cc:403] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:56.706977 15248 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:56.721244 15247 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 20. Current term is 21.
I20260709 13:03:56.724835 15248 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:56.730753 14996 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:56.730237  8277 catalog_manager.cc:5697] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 8 to 13, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 13 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:03:56.688769 15041 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:56.732569  8277 catalog_manager.cc:5697] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:56.745018  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 54345.2us
I20260709 13:03:56.748299  8427 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:56.752774  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:56.753659  8383 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:56.757536  8526 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 13:03:56.740684 15252 log.cc:927] Time spent T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:03:56.690128 14900 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:56.765614  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:56.765975  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:56.766942  8384 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:56.732982 14970 consensus_meta.cc:287] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Time spent flushing consensus metadata: real 0.601s	user 0.007s	sys 0.003s
I20260709 13:03:56.768714  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:56.770844  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:56.773226  9294 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:56.765656  8383 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:56.739470 15134 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:56.780354  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:56.749645 15015 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:56.750207 14996 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:56.759649 15207 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:56.735152 15110 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:56.785354  8383 raft_consensus.cc:2368] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 17. Current term is 18.
I20260709 13:03:56.787452  8349 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:56.759693 15064 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:56.707582 15012 consensus_queue.cc:1059] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.073s
I20260709 13:03:56.756861 15257 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:56.777278 15250 log.cc:927] Time spent T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.227s	user 0.002s	sys 0.000s
I20260709 13:03:56.764269 15183 raft_consensus.cc:493] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:56.795557  9294 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:03:56.810928  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:56.811276  8349 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:56.817507 15041 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:56.817339 15183 raft_consensus.cc:515] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:56.820310 15183 leader_election.cc:290] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:56.821272 15012 consensus_queue.cc:1243] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer 105d6581548546b98eddd4ee7083bb12 log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:03:56.824797 14806 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:03:56.798225 15242 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:56.828078  8500 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:56.806681 15064 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:56.834262  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:56.838079 15064 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:56.788362 15238 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:03:56.842406 15110 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:56.823962  8277 catalog_manager.cc:5697] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.851831  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:56.796875 15207 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.858039 15248 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.859018 15248 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:56.865706  8385 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:03:56.858332 15207 raft_consensus.cc:3060] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:56.862888  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:03:56.867657  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 105712us
I20260709 13:03:56.867993  8380 raft_consensus.cc:2393] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 19: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:56.804584 14787 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:56.871666  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:56.873636  8384 raft_consensus.cc:2468] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:03:56.874985  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:56.876991  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:56.877420  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:56.877825  8457 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:56.878062  8455 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 16.
I20260709 13:03:56.879101  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:56.882064  9260 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:56.883071 14825 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:56.883370 15127 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:56.883466 14825 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:56.884330 14825 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:56.866076 15012 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:56.886405 15012 raft_consensus.cc:697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:56.887395 15012 consensus_queue.cc:237] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:56.887374  8457 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
W20260709 13:03:56.891655 15226 log.cc:927] Time spent T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.720s	user 0.000s	sys 0.004s
I20260709 13:03:56.897363  8459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36448 (request call id 2841) took 1048 ms. Trace:
I20260709 13:03:56.897845  8459 rpcz_store.cc:276] 0709 13:03:55.848775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.848920 (+   145us) service_pool.cc:224] Handling call
0709 13:03:56.897165 (+1048245us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b540041b254. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:03:56.897303 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1654207872}
I20260709 13:03:56.781250 14970 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:56.912755  9260 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:03:56.869592 15255 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.916189  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:56.914551  8427 leader_election.cc:400] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 17. Current term is 18.
I20260709 13:03:56.920925 15127 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:56.872948 15183 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:56.930306 15015 raft_consensus.cc:3055] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:56.931022  8383 raft_consensus.cc:2368] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 20. Current term is 21.
I20260709 13:03:56.931412  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:56.932070 14970 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:56.860936 15261 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.127s
I20260709 13:03:56.942368 15240 consensus_queue.cc:1048] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:56.943029 15106 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:56.949975  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:56.955734  8501 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:56.950764  8427 leader_election.cc:403] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:03:56.923815  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513b83e2d61c4ad7994ad4629a3d0079" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:56.966928  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:56.967824  8386 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:03:56.969273  9295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:56.985652  9261 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:03:56.986479  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 72059.9us
I20260709 13:03:56.957204  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:56.972419  9258 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:56.970640  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:56.988663  8532 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 20: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:56.955920  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:56.977074  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:03:56.977619  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 61541.7us
I20260709 13:03:56.978435  8454 raft_consensus.cc:2393] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 19: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:56.995069  9291 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:56.995174  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:56.996595  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:56.997381  8460 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:56.990273  9258 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:57.000128  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:57.000813  8378 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:57.001437  9294 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:56.917627 15243 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:56.952260 15194 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:56.998394 15004 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 17. Current term is 18.
I20260709 13:03:57.018481  8427 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:56.979827 15015 raft_consensus.cc:740] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:57.021945  9292 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:56.984344 15183 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:56.952723 15064 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:57.072899  8460 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 21.
W20260709 13:03:57.077762  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 79010.4us
I20260709 13:03:57.078801  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:56.983582 15237 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:57.002529 15199 raft_consensus.cc:2804] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:57.003348 15191 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:56.956028 15255 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:57.061779 15258 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:56.976359 15127 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:57.059152 15075 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:03:57.003038 15144 raft_consensus.cc:2804] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:57.062088 15172 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:57.054216 15106 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:57.128934  8458 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:57.102610  8351 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:57.106349  9294 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:03:57.112862 14806 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:57.015832 15254 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:57.082197 15248 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:57.118271  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.021122 15216 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.083s
W20260709 13:03:57.124006  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 117625us
I20260709 13:03:57.065521 15194 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:57.087177 14970 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:03:57.181885 15254 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:57.063203 15243 raft_consensus.cc:697] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:57.130395  8453 raft_consensus.cc:3060] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:57.183055 15194 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:57.131032  8500 leader_election.cc:304] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:57.184125 15254 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:57.087814 15064 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:57.122190 15258 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.185263 15258 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:57.186563 15064 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:57.187091 15245 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:57.187620 15245 raft_consensus.cc:697] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 21 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:57.190707 15183 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:57.131973 14981 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:57.133296 15172 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:57.183677 15243 consensus_queue.cc:237] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:57.179509 15093 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.124822 15199 raft_consensus.cc:697] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:57.134727 15106 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:57.224602 15199 consensus_queue.cc:237] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:57.125735 15191 raft_consensus.cc:697] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:57.219024 15218 raft_consensus.cc:2749] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:57.226331 15106 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:57.218312  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 87368.9us
I20260709 13:03:57.239503  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:57.240645  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:57.241189  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:57.242149  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:57.242733  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:57.134975 15144 raft_consensus.cc:697] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:57.244913 15144 consensus_queue.cc:237] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:57.222855 15093 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:57.227555 15191 consensus_queue.cc:237] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:57.114838 15081 consensus_queue.cc:1059] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:03:57.214594  8501 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:57.188426 15245 consensus_queue.cc:237] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:57.257189  9292 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:57.280061 15264 raft_consensus.cc:493] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:57.280848 15264 raft_consensus.cc:515] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:57.283182 15264 leader_election.cc:290] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:57.318557  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 104029us
I20260709 13:03:57.344220 15216 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:57.366797  8457 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:03:57.390154  8453 raft_consensus.cc:2468] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 12.
I20260709 13:03:57.340231 14970 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.068s
I20260709 13:03:57.422567 15110 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.423292 15110 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:57.429802 15093 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:57.438133 15110 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:57.438776 14825 consensus_meta.cc:287] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent flushing consensus metadata: real 0.554s	user 0.004s	sys 0.005s
I20260709 13:03:57.439332 14825 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:57.441959 15207 consensus_meta.cc:287] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: Time spent flushing consensus metadata: real 0.568s	user 0.005s	sys 0.008s
W20260709 13:03:57.452701  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 58583.5us
I20260709 13:03:57.366382 15237 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:03:57.455478  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:57.446419 15012 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:57.462472 15012 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:57.457407 15268 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:03:57.473235 15065 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:57.468863 15012 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:57.447225 15200 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.488760  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:57.490048  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:57.490664  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:57.491427  8456 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 21.
I20260709 13:03:57.487830 15200 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:57.492832 14825 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:57.442588 15207 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:57.494768  8455 raft_consensus.cc:2393] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 18: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:03:57.495780 15207 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:57.383268 15258 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:57.491329  8457 raft_consensus.cc:2410] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 24 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:03:57.499308 15258 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:57.503211 15257 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.503624 15172 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:57.503846 15257 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:57.504933 15200 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:57.505613  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:57.506332  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:57.506368  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:57.509375  8379 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:57.510555 15257 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:57.515029  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:57.515842  8457 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 15.
I20260709 13:03:57.516875  8351 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:57.523913  8351 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:57.528923 15257 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:57.547632  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:57.547907  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:57.548108 15257 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.548630 15257 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:57.549995 15127 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:57.549450 15015 consensus_queue.cc:260] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:57.551381 15110 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:57.548655  8379 raft_consensus.cc:2393] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 16: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:03:57.548698  8385 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
W20260709 13:03:57.572870  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.553382 15110 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.595638 15110 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:57.597456  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:57.638253  8382 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:57.642961  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:57.651263  8385 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
I20260709 13:03:57.671363  8501 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:57.645488 15081 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:03:57.704583 15111 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.728960 15111 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:57.731240 15111 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:57.701890 15124 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:57.732353 15124 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:57.732774 15124 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:57.718174  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 275582us
I20260709 13:03:57.677057 15066 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:03:57.772049  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:57.775926  8461 raft_consensus.cc:2368] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 16. Current term is 17.
I20260709 13:03:57.776944  8454 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:03:57.777503  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:57.782317  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.794770  8500 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:57.796362  8500 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:57.805907 15232 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:57.806952 15232 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:57.796578 15106 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:03:57.816632  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:57.822719  8529 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:57.824281  8526 raft_consensus.cc:1240] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 28 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 27. Current term is 28. Ops: []
I20260709 13:03:57.825585  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:57.826371  8382 raft_consensus.cc:2393] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 12: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:57.828238  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:57.833256  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:57.833292 15183 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.834878 15183 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:57.838171  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:57.840617  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:57.843464  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:57.838197  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:57.846045  8378 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
I20260709 13:03:57.850345  8378 raft_consensus.cc:1275] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:57.851018  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:57.851650  8535 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:57.832597  8529 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 21.
I20260709 13:03:57.853458 15255 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:57.855577  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:57.855783 15268 consensus_queue.cc:1048] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:57.859668  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:57.860639  8377 raft_consensus.cc:2393] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 18: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:57.862753 15183 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:57.863575  9258 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:57.863775  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:57.864497 15243 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:57.864924 15243 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.865310 15243 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:57.865424  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 44523.8us
I20260709 13:03:57.866887  8424 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:57.867677 15255 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:57.868453  8427 leader_election.cc:400] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 20. Current term is 21.
I20260709 13:03:57.869516  8427 leader_election.cc:403] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:03:57.864467  8378 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:57.870318 15255 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 20. Current term is 21.
I20260709 13:03:57.869374  8424 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:57.871486 15004 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:57.887243  8427 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:57.891495 15255 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:57.894541  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:57.895557  8453 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:03:57.902938  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:57.880380 15243 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:57.922461  8427 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:57.758116 15216 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:57.922544  8378 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:57.938126  8535 raft_consensus.cc:2393] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 12: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:57.943668 15212 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
W20260709 13:03:57.944567 15275 log.cc:927] Time spent T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 13:03:57.944407 15212 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:57.954859 15270 log.cc:927] Time spent T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
W20260709 13:03:57.956590 15276 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.236s	user 0.000s	sys 0.000s
I20260709 13:03:57.940146 15004 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:57.963596  8427 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:57.975052  8424 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:57.987074 15243 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:57.988853  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:57.989545  8535 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:57.963199 15216 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:57.991650 14900 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:57.993391 15216 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:57.976058 15004 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:57.995096 15004 raft_consensus.cc:697] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:57.996078 15004 consensus_queue.cc:237] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:57.996465 15257 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:57.997803  8379 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:03:57.999806 15257 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:58.002038 15110 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:58.009797  8380 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.010s	sys 0.045s
I20260709 13:03:58.016664  8535 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:03:58.039887 15124 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:58.048831 15110 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:58.049336  8532 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 20. Current term is 21. Ops: []
W20260709 13:03:58.064025  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 363870us
I20260709 13:03:58.075652 15124 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:03:58.085695  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 289396us
I20260709 13:03:58.094643  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:58.096036  8500 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:58.097702  8500 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:58.175097  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 77489.8us
I20260709 13:03:58.176193  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:58.182425  8270 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9e1d32431b1c45ebad1160a850495e16 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 446d9310dce14ff4afff2dc2d64f68d8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:03:58.176324  8460 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:58.190282  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:58.190900  8459 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:58.179262 15081 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:58.198180  8457 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:58.202140  8458 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:03:58.202839  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:58.178383 15258 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:58.203510  9292 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:03:58.180435 15237 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:58.179140 15066 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:58.207880  9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:58.208822  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:58.178051 15110 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:58.205262 15065 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:03:58.228410 15110 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:58.209831  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:58.229508  9293 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:58.229617  8426 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:58.230785 15110 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:58.230937 14900 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:58.188375 15291 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:58.210319  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edca272c646743e09fb3b0c827c963b8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:58.212693 15258 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:58.231810 15291 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:58.213274 15191 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:03:58.195895 15269 log.cc:927] Time spent T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:03:58.220671  8459 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:03:58.235807  8426 leader_election.cc:304] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:58.236488  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:58.262668  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:58.262492 14835 raft_consensus.cc:2749] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:58.265336 15093 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:03:58.268350 15277 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.562s	user 0.005s	sys 0.000s
I20260709 13:03:58.256748 15161 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.270239 15161 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:58.272075 15136 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:58.272536 15161 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:58.272663 15136 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:58.266168 15093 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:58.275004 15136 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:58.276659 15093 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:58.233930 15258 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:58.233932 15291 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:58.290961 15015 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:58.293823  9260 leader_election.cc:400] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 16. Current term is 17.
I20260709 13:03:58.294201  9260 leader_election.cc:403] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:03:58.296372  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:58.301331  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:58.306591 15212 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:58.311208  9293 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:03:58.314646  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:58.335505  8453 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:58.336226  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:58.338095  8386 raft_consensus.cc:1275] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:58.335544  8530 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:58.315407  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:58.339542  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:58.316411  8458 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:03:58.316324 15261 consensus_queue.cc:1059] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:58.318120 15278 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.341497  8424 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:58.342092 15278 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:58.344193 15278 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:58.345222  8382 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:03:58.318573 15113 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:58.346419 15261 raft_consensus.cc:3055] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:58.346647  8453 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 16.
I20260709 13:03:58.346817 15113 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:58.348348 15004 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:58.320967 15232 consensus_queue.cc:1059] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:58.323406  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:58.349663  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:58.325446  8526 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:03:58.326574  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:58.351759  9292 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 28.
I20260709 13:03:58.261201  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:58.333472  8384 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:58.334190  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:58.334559  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:58.334699  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:58.353850  8379 raft_consensus.cc:3060] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:58.338826  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:58.355226  8460 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:58.346854 15261 raft_consensus.cc:740] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:03:58.329576  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:58.363022  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 59465.7us
I20260709 13:03:58.364046 15113 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:58.364338  8531 raft_consensus.cc:2393] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 28: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:03:58.349051 15200 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 16. Current term is 17.
I20260709 13:03:58.416533  8379 raft_consensus.cc:2468] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:03:58.367515  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:58.418237  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:58.418898  8383 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 27.
I20260709 13:03:58.367607  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:58.367758  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:58.368564 15261 consensus_queue.cc:260] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:58.421527  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:58.371402  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:58.381505 15278 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.389846 15218 raft_consensus.cc:3055] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:58.400381  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:03:58.401387 15293 log.cc:927] Time spent T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.190s	user 0.002s	sys 0.000s
I20260709 13:03:58.402938  9293 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:58.403628  8534 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:03:58.431872  8534 pending_rounds.cc:85] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 14
I20260709 13:03:58.432152  8534 pending_rounds.cc:107] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:03:58.432384  8534 raft_consensus.cc:2889] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:58.404876 15302 log.cc:927] Time spent T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:03:58.406003  8460 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 22.
I20260709 13:03:58.429220  8349 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:58.436828  9292 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 18: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
W20260709 13:03:58.442255  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.449368 15012 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:58.454010 15294 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:58.438901 15134 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:03:58.440928 15279 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:03:58.429373 15218 raft_consensus.cc:740] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:58.461122 15218 consensus_queue.cc:260] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:58.462505 15218 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:58.431033 15278 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:58.415587 14900 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.475910 14900 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:58.447384  9260 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:03:58.497218  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 49946.8us
I20260709 13:03:58.499919  9260 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:03:58.498834  8534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38894 (request call id 3432) took 1552 ms. Trace:
I20260709 13:03:58.505677  8383 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:03:58.500838 15136 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:58.502561  8534 rpcz_store.cc:276] 0709 13:03:56.945966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.969567 (+ 23601us) service_pool.cc:224] Handling call
0709 13:03:56.969840 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:58.432806 (+1462966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:58.498508 (+ 65702us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400098154. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c8485e01 00007f36c848483e 00007f36cd449419 00007f36c69c0bd4 00007f36c69c0b62 00007f36c69c0a91 00007f36c69c0a0c 00007f36c69bfcc2 00007f36c67c048c 00007f36c67bf8c6
0709 13:03:58.498759 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3296574208}
I20260709 13:03:58.539546  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:58.549842 14900 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:58.514022 15243 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:58.529939 15000 raft_consensus.cc:2804] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:58.532907 15093 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.568641  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:58.569129 15093 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:58.571321 15093 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:58.514367 14989 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:03:58.573510  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:58.514196 15161 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:03:58.575212 15000 raft_consensus.cc:697] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:58.575237 15261 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:58.576272 15000 consensus_queue.cc:237] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:58.585575  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:03:58.567109 15278 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:58.595728  8379 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:03:58.599931  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 167365us
I20260709 13:03:58.594074 15295 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:58.627240  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 197409us
I20260709 13:03:58.630993  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:58.653867  8460 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:03:58.656066 14293 consensus_queue.cc:1048] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:58.657542  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:58.659277  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:58.619398 15295 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:58.704753 15232 consensus_queue.cc:1059] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:03:58.710399  9261 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:58.710927 15094 raft_consensus.cc:3055] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:58.711615 15094 raft_consensus.cc:740] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:58.712810 15094 consensus_queue.cc:260] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:58.715519 15283 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:58.717756  8457 raft_consensus.cc:1240] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:03:58.714304 15094 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:58.726356  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:58.726699  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:58.727552  8459 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:58.729192  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:58.731184  8456 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
W20260709 13:03:58.733222  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 46682.2us
I20260709 13:03:58.725159 15136 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:03:58.736210  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:58.737026  8458 raft_consensus.cc:2393] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 18: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:03:58.737892 15093 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:58.727075  8457 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 18.
I20260709 13:03:58.748330  8351 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:58.749577  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:58.751315  9261 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:58.756083  8351 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:58.757942  8454 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 21.
I20260709 13:03:58.761242  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:03:58.765290  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.768769  8351 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:58.774333 15257 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:58.775038 15257 raft_consensus.cc:697] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 22 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:58.760234 15093 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:58.775854 15093 raft_consensus.cc:697] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 16 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:03:58.775890 15257 consensus_queue.cc:237] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:58.776841 15093 consensus_queue.cc:237] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:58.776086  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:58.778771  8453 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 19.
I20260709 13:03:58.705190 15161 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.061s
I20260709 13:03:58.793911  9260 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:58.765509 14989 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:03:58.819061  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:58.827204  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:58.770841 15199 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:58.783250 15278 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:58.818403 14989 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:58.870357 15298 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.009s	sys 0.013s
W20260709 13:03:58.870910 15298 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.009s	sys 0.013s
I20260709 13:03:58.842005 15000 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:03:58.882252 15275 log.cc:927] Time spent T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:58.905041  8383 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:03:58.899210  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 72132.9us
I20260709 13:03:58.885180 14989 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:03:58.882969 15278 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:58.907994  8351 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:58.947748  8351 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:58.947160 15278 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.949256 15278 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:58.898491 15309 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 13:03:58.957051 15278 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:58.957669 15245 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:58.959462 15245 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:58.959820 15245 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.960150 15245 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:58.963753 15295 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:58.965878  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.968066 15245 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:58.970322 15245 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:58.972060 15278 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:58.958506  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:58.981312  8351 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:03:58.983500 15279 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:58.984239 15279 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:03:58.984601 15279 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:58.984966 15279 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:03:58.989035  8351 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:03:58.945102 15110 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.987691 15258 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:03:59.031069  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:59.031970  8455 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:59.033023  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:03:59.000696 15110 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:59.035787  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 241950us
I20260709 13:03:59.049837  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:59.025277 15294 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:59.027776 15113 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:59.066541  8455 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 20.
I20260709 13:03:59.078472 15110 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:59.083650  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 253895us
I20260709 13:03:59.087556  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:59.103488  8384 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:03:59.105677  8377 raft_consensus.cc:1240] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:03:59.114925  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:59.118250  8351 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:03:59.066636 15113 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:59.147159 14806 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:59.162467  8424 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
W20260709 13:03:59.163744  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 92895.1us
I20260709 13:03:59.217743  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:59.182000 14806 raft_consensus.cc:697] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 20 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
W20260709 13:03:59.239228  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 76840.9us
I20260709 13:03:59.159190 15218 consensus_queue.cc:1059] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:03:59.227754 15327 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:59.268512 15324 log.cc:927] Time spent T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:03:59.268347 14806 consensus_queue.cc:237] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:03:59.314975  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 74849.5us
W20260709 13:03:59.417235  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 101416us
I20260709 13:03:59.426188  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:03:59.320996 15342 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:59.462395 15342 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:59.463474 14989 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:59.469805  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 51486.3us
W20260709 13:03:59.473104 15338 log.cc:927] Time spent T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:03:59.320158 15279 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:59.477624 15329 log.cc:927] Time spent T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.255s	user 0.000s	sys 0.000s
I20260709 13:03:59.477459 15342 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:59.479363 15279 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 28 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:03:59.480733  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.421420 15261 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:03:59.491230  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:03:59.523232 15334 log.cc:927] Time spent T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.256s	user 0.001s	sys 0.001s
I20260709 13:03:59.494103 15113 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:59.545933 15232 raft_consensus.cc:3055] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:59.546555 15232 raft_consensus.cc:740] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:03:59.547480 15232 consensus_queue.cc:260] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:59.548751 15232 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:59.565796  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 75478.4us
I20260709 13:03:59.498147 15261 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:03:59.570602  8498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.572140  8528 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:59.574594  9291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18bf9e256e3046b497483817dac46e78"
dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:54044
I20260709 13:03:59.575188  9291 raft_consensus.cc:606] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:59.575548  9291 raft_consensus.cc:614] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:59.576340 14293 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:59.580574  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:03:59.568259 14989 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 29 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:59.591351  8499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.589687 14293 consensus_queue.cc:1059] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:59.589998  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:03:59.597771  9293 raft_consensus.cc:2368] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 28. Current term is 29.
I20260709 13:03:59.630270  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:59.630556  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:59.631191  8535 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:03:59.705238  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 85157.5us
W20260709 13:03:59.705802  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 74335us
I20260709 13:03:59.710631  8535 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 29.
I20260709 13:03:59.717670 14293 raft_consensus.cc:3055] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:59.718107 14293 raft_consensus.cc:740] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:03:59.721208  9291 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:59.721208 14293 consensus_queue.cc:260] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:59.722536 14293 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:59.736996  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:59.760876  8459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:59.761539  8459 raft_consensus.cc:606] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
W20260709 13:03:59.763108 15347 log.cc:927] Time spent T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:03:59.774322  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:59.781420  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:03:59.781616  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:03:59.775892  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:03:59.792917  8532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38892 (request call id 3091) took 1011 ms. Trace:
I20260709 13:03:59.793464  8532 rpcz_store.cc:276] 0709 13:03:58.781272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.791986 (+1010714us) service_pool.cc:224] Handling call
0709 13:03:59.792316 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:59.792522 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:59.792557 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:59.792610 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:59.792654 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.792721 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:59.792837 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:59.799515  8531 raft_consensus.cc:2368] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 28. Current term is 29.
I20260709 13:03:59.740911 15000 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:59.836526  8533 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:03:59.850153  8533 pending_rounds.cc:85] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 8
I20260709 13:03:59.850500  8533 pending_rounds.cc:107] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:03:59.851188  8533 raft_consensus.cc:2889] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:59.786907 15243 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:59.859262 14293 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:59.796247 15306 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:03:59.859802 14293 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:59.863746  8500 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:03:59.875723  8459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45d39340781e466abc648aacd7ee5822"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:59.876631  8459 raft_consensus.cc:606] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:03:59.877118  8459 raft_consensus.cc:614] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:59.868974  8500 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:03:59.882102 14293 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:03:59.855008 15000 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:59.872393 15243 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:03:59.887301 15000 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:03:59.870841 15306 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:03:59.860886 15094 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.887387 15243 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:03:59.900161  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 186487us
I20260709 13:03:59.893024 15261 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:03:59.891906 15365 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:03:59.961241  8459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:03:59.961915  8459 raft_consensus.cc:606] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 21 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:03:59.896128 15364 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:59.989934 15283 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:03:59.896268 15094 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.007755  9258 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:00.017812  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:04:00.018529  8457 raft_consensus.cc:606] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:03:59.998795 15064 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:00.019788  8457 raft_consensus.cc:614] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:04:00.021736  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 152838us
I20260709 13:04:00.000805 15364 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:00.023874  8457 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:59.988312 15365 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.038151  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:00.043624  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:00.024158 15363 raft_consensus.cc:2804] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:04:00.006273 15306 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:00.006899 15283 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.036665 15064 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.060690  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:04:00.061406  8457 raft_consensus.cc:606] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:04:00.061280  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:00.061971  8457 raft_consensus.cc:614] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:00.071216 15365 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:00.035056 15364 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.074544 15364 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:00.077064  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:00.080045  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:00.093047  8426 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:00.047858 15243 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:04:00.105791  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 49135.7us
I20260709 13:04:00.104777 15172 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:00.068434 15064 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.111253 15064 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:00.119810  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 93608.9us
W20260709 13:04:00.122051  9259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.108201 15360 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:00.125411  8500 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:00.105683 15331 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:04:00.129216 15365 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:00.138739 15365 raft_consensus.cc:697] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 21 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:00.127156 15369 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:04:00.133695 15094 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:00.140344 15323 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:00.141176 15323 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.135092 15283 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:00.144101 15323 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:00.116041 15243 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.145632 15199 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:00.146256 15199 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.147434 15243 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:00.126888 15360 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.153225  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:04:00.151077 15232 consensus_meta.cc:287] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31: Time spent flushing consensus metadata: real 0.602s	user 0.012s	sys 0.000s
I20260709 13:04:00.149469 15363 raft_consensus.cc:697] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 29 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
W20260709 13:04:00.158437 15373 log.cc:927] Time spent T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c: Append to log took a long time: real 0.204s	user 0.004s	sys 0.000s
I20260709 13:04:00.139788 15365 consensus_queue.cc:237] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.181654 15004 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.168358  8535 raft_consensus.cc:2410] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:04:00.185333  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:00.192256  8500 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:00.193785  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:00.199855 15094 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:00.205070  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:00.206094  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:00.207389  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:00.207137  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:00.208030  8456 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 22.
I20260709 13:04:00.205989  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:00.209242  8500 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:00.217857 15363 consensus_queue.cc:237] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.226167  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:04:00.255177  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 46077.4us
I20260709 13:04:00.255527  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:04:00.272562 15361 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:04:00.275076  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:00.274559  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:00.279386  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:00.283599  9258 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:00.285530 15161 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:00.289703 15161 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.292488 15161 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:00.207140 15199 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:00.302716 15391 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:00.304674 15243 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:00.249908 14835 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:00.249058 15172 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:00.339834 15383 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:00.195127 15004 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.293880 15379 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:00.274863 15381 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:00.329919 15360 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:00.308600 15375 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:00.343235 15364 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:04:00.375183 15386 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:04:00.303382 15391 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.363330 15258 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:00.384025  8453 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:04:00.341485 15084 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:00.370855 15245 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:00.359025 14835 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.372757 15390 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:00.376579 15379 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.410357 15084 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.378322 15383 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.424449 15396 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.424815 15249 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:00.417179 15258 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.427287 15093 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:00.428879 14835 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:00.410012 15245 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.404524 15350 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:00.412101 15379 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:00.372210 15172 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.402042 15364 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.413064 15110 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:00.412029 15294 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:00.377146 15381 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.438606 15325 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:00.410663 14806 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:00.498593  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:00.499200 15093 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.497344 15249 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.500439 15383 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:00.501174 15400 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:00.417862 15390 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.412496 15309 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.509407  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:04:00.490208  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 83833.6us
I20260709 13:04:00.413316 15212 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:00.495198  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:00.520879  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:00.592372  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:00.524765  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:00.487221 15375 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:00.583972  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:00.585781  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:00.511439 15397 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:00.523624 15279 raft_consensus.cc:493] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:00.522684 15340 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:00.612987  8455 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:04:00.602298 15383 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:00.489883 15396 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.525913 15294 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.656163 15294 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:00.656435 15396 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:00.526013 15110 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.608582 15397 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.659178 15397 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:00.659402 15110 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:00.583101 14806 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.627429 15279 raft_consensus.cc:515] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.667150 14806 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:00.667817 15279 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:00.668488 15381 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:00.670567 15084 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:00.641072 15395 log.cc:927] Time spent T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:04:00.641808 15401 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:00.645763 15391 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:00.560635 15350 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.647146 15399 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:00.627007 15340 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.605911 15375 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.650092 15172 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:00.650360 15390 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:00.594790 15400 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.582554 15325 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.652112 15258 leader_election.cc:290] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:00.602029 15212 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.603399 15309 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.663455  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:00.664670  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:00.682595  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:00.657037 15396 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:00.671873 15383 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.702689 15401 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.734825 15309 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:00.735709 15375 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:00.705304 15399 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.715281 15004 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:00.738804 15379 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.740258 15383 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:00.721028 15364 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:00.740795 15379 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:00.720510 15396 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.742313 15249 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:00.760862 15340 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:00.768889 15350 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:00.816886  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 183977us
W20260709 13:04:00.817862  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 232620us
I20260709 13:04:00.827131  8386 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
I20260709 13:04:00.832427  8382 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:04:00.707636  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 85710.1us
I20260709 13:04:00.861788 15093 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:00.871299 14835 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:00.872380 14835 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.875819 14835 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:00.876466 14835 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:00.877527 14900 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:00.878449 14900 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.847378  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:00.857589 15278 raft_consensus.cc:493] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:00.859300 15340 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:00.860378 15350 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:00.880961 15004 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:00.895284 15340 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.898346 15340 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:00.902853 15350 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.905689  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bf9e256e3046b497483817dac46e78" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:00.909629  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:00.910796  8381 raft_consensus.cc:3060] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:04:00.914777 15004 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.917936  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:00.921274 15278 raft_consensus.cc:515] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:00.937762  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:00.938330  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:00.938607  8349 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:00.930982  8458 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 21.
I20260709 13:04:00.935421  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:00.942085  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:00.946506  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:00.956418  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:00.943035 15245 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:00.957808  8459 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
I20260709 13:04:00.947695 15004 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:00.963568 15093 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:00.964231  8349 leader_election.cc:400] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 28 election: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 28. Current term is 29.
I20260709 13:04:00.964641  8349 leader_election.cc:403] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 28 election: Cancelling election due to peer responding with higher term
I20260709 13:04:00.965540  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:00.957407  8378 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:04:00.942828 14900 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:00.956920  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:00.970606 15424 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:00.971313  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:00.955186 14835 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:00.957609 15325 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:00.972949  8386 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:04:00.938603 15212 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:00.969280 15350 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:00.926442 15278 leader_election.cc:290] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:00.980778  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:00.981194  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:00.982149  8529 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:04:00.988794 14835 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:00.992190 15396 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:00.981410  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:04:01.009207  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 119677us
I20260709 13:04:01.032811  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.036062  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:01.043087  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.043435  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:01.045164  8459 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:01.048668  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.049546 15401 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:01.058120 15428 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:01.059302 15428 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:01.063504 15218 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:01.061383  8386 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:04:01.064703 15218 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:01.062507  8381 raft_consensus.cc:2468] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 29.
I20260709 13:04:01.067318 15249 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 29 FOLLOWER]: Leader election lost for term 28. Reason: Vote denied by peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767) with higher term. Message: Invalid argument: T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 28. Current term is 29.
I20260709 13:04:01.069167 15093 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:01.070691 15093 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:01.071080 14900 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:01.071974 14900 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:01.077207 14900 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:01.080969  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.089232  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.089524 15428 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:01.091095  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.094401 15400 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:01.095963  8351 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:01.097949  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.099148  8533 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
I20260709 13:04:01.100399  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.101280  8453 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:04:01.101797  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.103307 15399 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:01.103479 15093 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:01.103549  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.104887 15218 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:01.107118  8351 leader_election.cc:400] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 28 election: Vote denied by peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) with higher term. Message: Invalid argument: T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 28. Current term is 29.
I20260709 13:04:01.104828  8377 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 29 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
I20260709 13:04:01.108582  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.114908 15294 raft_consensus.cc:2749] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:04:01.114921  8424 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:01.108580  8459 raft_consensus.cc:2468] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 23.
I20260709 13:04:01.119234 15283 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:01.083746  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:01.130509  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.131402  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.146278 15283 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:01.147235  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:01.147416  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.135859  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.201632 15084 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:01.150890 15093 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:01.201659  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.207564  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.210528 15283 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:01.212704  8534 raft_consensus.cc:1275] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 29 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
W20260709 13:04:01.215875  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 101130us
I20260709 13:04:01.217481  8385 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 20.
I20260709 13:04:01.218380  8424 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:01.219478 15084 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:01.219911 15084 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.220255 15084 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:01.240027  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:01.227597  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.247531  8377 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 20.
I20260709 13:04:01.247885  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:01.252488  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.259449  8533 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 21.
W20260709 13:04:01.263536  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 116506us
I20260709 13:04:01.275977  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.278086 15421 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:01.278326 15283 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:01.278993  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.279211 15283 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:01.278797 15421 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:01.284857  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.305259 15357 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:01.306165 15357 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:01.311132  8424 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:01.317483 15421 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:01.320356 15339 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.315101  8500 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:01.325795  8424 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:04:01.333631  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 124569us
I20260709 13:04:01.331391 15283 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:01.333674 14835 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:01.323863 15339 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:01.341065  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:01.335991 15218 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:01.343004 14835 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:01.338061 15127 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:01.340209  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.338445 15341 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:01.357988  8459 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:04:01.351542 14835 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:01.351670 15127 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:01.347132 15218 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.364128 15127 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:01.368294 15432 log.cc:927] Time spent T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:04:01.364346 15218 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:01.352329 15385 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.025s
I20260709 13:04:01.370455  8424 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:01.373289 15341 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:01.386359 15428 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:01.370718  8500 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:01.388548 15283 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:01.395108 15094 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:01.395848 15094 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:01.391952  8427 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:01.398654 15094 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:01.403000 15015 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:01.389413 15283 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:01.404570 15015 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:01.411212  8500 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:01.408875 15015 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:04:01.422430  9261 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.739s (SENT) [suppressed 8 similar messages]
I20260709 13:04:01.429186 15428 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:01.438764 15094 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:01.445545 15094 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:04:01.458170  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 129531us
I20260709 13:04:01.462015  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.456267 15341 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:01.467177  8500 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:01.457803 15094 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:01.469240  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.475558  8427 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:01.464208 15339 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:01.492015 15428 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:01.496344 15283 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:01.503690  8500 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:04:01.537361  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 127714us
I20260709 13:04:01.539191 15357 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:01.537106 15344 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:01.549830 15064 raft_consensus.cc:2804] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:01.550567 15064 raft_consensus.cc:697] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 23 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:01.551687 15064 consensus_queue.cc:237] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:01.553289  8501 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:04:01.554674  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 52359.8us
I20260709 13:04:01.559329 15232 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.559765  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.559960 15232 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:01.560365  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.560954  8459 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:04:01.562320 15232 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:01.563117  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.564079 15367 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:01.562240  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.544737 15344 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:01.565326 15344 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:01.564853 15367 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:01.571807  8427 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:01.580828  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.592271 15172 raft_consensus.cc:993] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:04:01.592913 15172 raft_consensus.cc:1081] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:04:01.581862 15346 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:01.594105  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.601949  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.605962  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.596096 15346 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:01.608165  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.600883 15367 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:01.617373  8456 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 22. Current term is 23. Ops: []
W20260709 13:04:01.616061  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 79327.2us
I20260709 13:04:01.615290  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.622804  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.625923  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.622871  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:01.627708  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.615669 15346 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:01.631733 15084 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:01.643498  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:01.643533  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.647989  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:01.677668 14835 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:01.693969  8457 raft_consensus.cc:2393] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 22: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:04:01.682010 15367 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:01.682420 15084 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:01.684845  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:01.685745  8501 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:01.697243 15367 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:01.699203  8427 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:01.689344 15127 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:01.701668 15172 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:01.702239  8453 raft_consensus.cc:1240] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:01.703058 15094 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:01.705886  8427 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:01.706382 15127 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:01.708169 15371 consensus_queue.cc:1059] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:01.710489 15371 raft_consensus.cc:3055] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:01.710898 15371 raft_consensus.cc:740] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:04:01.711063  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.696767 15015 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:01.709435  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.711939  8457 raft_consensus.cc:2393] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 21: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:04:01.712410  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.711951 15371 consensus_queue.cc:260] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:01.708098  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:01.716177  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.722536  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:01.731364  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c1890dcc8947c89b8c213326526c75" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:01.733372  8532 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:01.730088  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:01.722894  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:01.716485 14835 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:01.742897 15094 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:01.746174  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.747526  8453 raft_consensus.cc:1240] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 21. Current term is 22. Ops: []
I20260709 13:04:01.722242  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:01.749327 15344 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:01.750759  8529 raft_consensus.cc:1240] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:01.736076 15357 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:01.753875 15344 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:01.714138 15371 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:01.713626 15015 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:01.763029  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 57250.3us
I20260709 13:04:01.763775  8427 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:01.708874 15218 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:01.762451 15000 consensus_queue.cc:1059] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:04:01.767601 15000 raft_consensus.cc:3055] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:01.767597  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:01.769496  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.773874  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:01.777660  8529 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:04:01.778049  8529 pending_rounds.cc:85] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 11
I20260709 13:04:01.778267  8529 pending_rounds.cc:107] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:04:01.778563  8529 raft_consensus.cc:2889] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:01.778900  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.779896  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.782976  8535 raft_consensus.cc:2393] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 17: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:04:01.768689 15000 raft_consensus.cc:740] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:04:01.786043  8378 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:01.786332  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:01.789144  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.791432  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:01.794010 15000 consensus_queue.cc:260] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:01.795836 15000 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:01.801131  8378 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:04:01.804280 15218 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:01.806972  8427 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:01.814606  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:01.775202 15357 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:01.819370  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.832430  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:04:01.839183 15439 log.cc:927] Time spent T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
I20260709 13:04:01.844192  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.844866  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.845785  8276 catalog_manager.cc:5697] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 13 to 14, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 14 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:01.846773  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.847728  8276 catalog_manager.cc:5697] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 6 to 10, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 10 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.848958  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.851119  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.852972  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.855626  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.857975  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.862388  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.865532  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef8cc956c764eeeb9389ea099a35006" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.865873  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.866452  8534 raft_consensus.cc:1240] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 21. Current term is 22. Ops: []
I20260709 13:04:01.866911  8535 raft_consensus.cc:1240] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 23 LEADER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 22. Current term is 23. Ops: []
I20260709 13:04:01.868230  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.870990  8532 raft_consensus.cc:2468] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 22.
I20260709 13:04:01.874037  8424 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:04:01.874987  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 68158.2us
I20260709 13:04:01.873199 15015 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:01.876175  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:01.878027  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.878731  8427 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:01.879748 15015 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:01.872244 15172 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:01.881966 15015 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:01.882841 15357 raft_consensus.cc:2804] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:01.883693 15357 raft_consensus.cc:697] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 22 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:04:01.885772 15357 consensus_queue.cc:237] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:01.891424 15346 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:01.892915  8455 raft_consensus.cc:1240] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Rejecting Update request from peer 446d9310dce14ff4afff2dc2d64f68d8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:04:01.894049  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:01.898818  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:01.900542  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:01.900329  8276 catalog_manager.cc:5697] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:01.902092  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:01.902407  8276 catalog_manager.cc:5697] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:01.903220 15385 consensus_queue.cc:1059] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:01.904284 15385 raft_consensus.cc:3055] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:04:01.904707 15385 raft_consensus.cc:740] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:04:01.904054  8276 catalog_manager.cc:5697] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:01.905779 15385 consensus_queue.cc:260] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:01.907949 14835 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:01.910070 15385 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:01.914299  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:01.918871  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.920614  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56cc480ba6f642e08bb2e547a0ef50a1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.920270  8276 catalog_manager.cc:5697] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:01.922394  8530 raft_consensus.cc:1240] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 21. Current term is 22. Ops: []
W20260709 13:04:01.909020  8277 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53486 (request call id 348) took 51263 ms (client timeout 15000 ms). Trace:
I20260709 13:04:01.908495  8427 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:04:01.928033  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:04:01.938338  9293 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:04:01.941236  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:04:01.942093 15172 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:01.945752 15172 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:01.946197 15172 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:01.925431 15346 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:01.950695  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:01.952193 15333 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:01.952104  8532 raft_consensus.cc:1240] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 20. Current term is 21. Ops: []
I20260709 13:04:01.952849 15333 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:01.955039 15333 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:01.959601 15172 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:01.960511  9291 raft_consensus.cc:2468] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 20.
W20260709 13:04:01.960984  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 52584.3us
I20260709 13:04:01.963852  8427 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:04:01.971143 15357 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:01.972440  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:01.972684  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:01.974856  8426 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:04:01.976064  8426 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:04:01.976763 14835 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:01.977244 14835 raft_consensus.cc:697] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:04:01.977541 15306 raft_consensus.cc:2804] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:01.978073 15306 raft_consensus.cc:697] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 20 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:04:01.978190 14835 consensus_queue.cc:237] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:01.979049 15306 consensus_queue.cc:237] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:01.923650  8277 rpcz_store.cc:269] 0709 13:03:10.644926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.645185 (+   259us) service_pool.cc:224] Handling call
0709 13:03:10.700162 (+ 54977us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b540014ebd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ef090 00007f36c848df3a 00007f36ce2441cc 00007f36ce34237e 00007f36cc8032a4 00007f36cc803232 00007f36cc803161 00007f36cc8030dc 00007f36cc802392 00007f36c67c048c 00007f36c67bf8c6
0709 13:04:01.908749 (+51208587us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:57.621299 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:57.621956 (+   657us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:57.622001 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:03:57.622020 (+    19us) tablet.cc:662] Decoding operations
0709 13:03:57.623165 (+  1145us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:57.623247 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:57.623279 (+    32us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:03:57.903270 (+279991us) tablet.cc:701] Row locks acquired
0709 13:03:57.922860 (+ 19590us) write_op.cc:260] PREPARE: finished
0709 13:03:57.940416 (+ 17556us) write_op.cc:270] Start()
0709 13:03:57.974015 (+ 33599us) write_op.cc:276] Timestamp: P: 1783602237940315 usec, L: 0
0709 13:03:57.975117 (+  1102us) op_driver.cc:348] REPLICATION: starting
0709 13:03:57.990780 (+ 15663us) log.cc:844] Serialized 4389 byte log entry
0709 13:03:58.673834 (+683054us) op_driver.cc:464] REPLICATION: finished
0709 13:03:58.864180 (+190346us) write_op.cc:301] APPLY: starting
0709 13:03:58.867125 (+  2945us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:58.952698 (+ 85573us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:58.952809 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:59.887047 (+934238us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:59.887292 (+   245us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:03:59.887336 (+    44us) write_op.cc:312] APPLY: finished
0709 13:03:59.887651 (+   315us) log.cc:844] Serialized 105 byte log entry
0709 13:03:59.993759 (+106108us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:00.004178 (+ 10419us) write_op.cc:454] Released schema lock
0709 13:04:00.004247 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:00.024069 (+ 19822us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:00.025364 (+  1295us) write_op.cc:454] Released schema lock
0709 13:04:00.147692 (+122328us) spinlock_profiling.cc:243] Waited 5.16 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c802086e 00007f36c801fbb6 00007f36c801f7d8 00007f36c8029221 00007f36c80291d9 00007f36c8029169
Metrics: {"mutex_wait_us":1835037,"reported_tablets":49,"spinlock_wait_cycles":67524864,"child_traces":[["op",{"apply.queue_time_us":157009,"apply.run_cpu_time_us":34333,"apply.run_wall_time_us":1170730,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50151,"num_ops":11,"prepare.queue_time_us":378899,"prepare.run_cpu_time_us":81683,"prepare.run_wall_time_us":640980,"raft.queue_time_us":372031,"raft.run_cpu_time_us":9470,"raft.run_wall_time_us":93496,"replication_time_us":698510,"spinlock_wait_cycles":11866880,"thread_start_us":1085286,"threads_started":5,"wal-append.queue_time_us":373382,"wal-append.run_cpu_time_us":30343,"wal-append.run_wall_time_us":2851593}]]}
I20260709 13:04:01.989509  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:01.985103  8427 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:01.972419 15357 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.994261 15357 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:01.995200 15346 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:01.996407  8427 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:01.997277 15333 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:01.997413 15400 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:01.998019 15400 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:01.998757  8427 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:01.987293 15172 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:01.963053  8276 catalog_manager.cc:5697] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:02.000206 15400 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:02.000836  8276 catalog_manager.cc:5697] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 5 to 11, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 11 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:02.004135  8276 catalog_manager.cc:5697] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:02.008066 15333 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:02.015574  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:02.016778 15000 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:02.017472 15000 consensus_queue.cc:1243] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Peer d653e71832b7402b9a03b46249d3b885 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:04:02.012419  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:02.013463  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:02.014560  8529 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:04:02.020630  8276 catalog_manager.cc:5697] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 10 to 15, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 15 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:02.014436  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:02.022787  8276 catalog_manager.cc:5697] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 15 to 16, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 16 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:02.033800 15400 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:02.039255  8385 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:04:02.039739  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:02.040216  8385 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:02.040712  8385 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:02.040973  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:02.041419  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:02.046720 15000 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:02.046833  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:02.047509  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:02.048156  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:02.048491  8379 raft_consensus.cc:2393] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 19: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:04:02.048079  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:02.050092  9261 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:02.050931  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:02.054986 15000 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:02.059675 15400 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:02.024407  8276 catalog_manager.cc:5697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:02.062734  8276 catalog_manager.cc:5697] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 8 to 16, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 16 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:02.064857  8385 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:02.068828  8385 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:02.074075  8381 raft_consensus.cc:1240] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:02.076097  8427 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:02.078048  9261 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:04:02.078662  8427 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:02.079111 15000 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:02.084481 15000 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:02.087924 15000 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:02.089264  8427 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:02.091431  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:02.094648 15333 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:04:02.094830  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:02.096141  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:02.080746 14835 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:02.085196 15346 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:02.098290  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:02.101054  8456 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
I20260709 13:04:02.102138  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:02.108044  9261 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:04:02.109161 15385 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:02.109616 15385 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:02.110031 15385 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:02.112381  8457 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 20. Current term is 21. Ops: []
I20260709 13:04:02.113538  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:02.113982 15446 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:04:02.097779 15357 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:02.122766 15357 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:02.124790 15437 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:04:02.123842  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:02.117266  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:02.126778  8500 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:02.115715  9261 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:02.064615  8276 catalog_manager.cc:5697] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 8 to 12, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 12 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:02.141640  9261 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:04:02.134279  8458 raft_consensus.cc:2393] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 in current term 17: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:04:02.137279  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:02.147476  8500 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:02.171813  8381 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:02.140340 15172 consensus_queue.cc:1059] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:02.141254 15371 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:02.176367  8276 catalog_manager.cc:5697] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 11 to 14, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 14 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:02.178586 15172 raft_consensus.cc:3055] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:02.178984  8276 catalog_manager.cc:5697] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 13 to 14, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 14 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:02.182142  8458 raft_consensus.cc:1240] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:04:02.173147 15218 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:02.183501 15218 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.183918 15218 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:02.185377 15448 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:02.185740 15000 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:02.185995 15448 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:02.173233 15437 consensus_queue.cc:1059] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:02.175273  9261 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:02.141505 15015 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:02.175844 15341 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:02.176788  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:02.215780  8533 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:02.188138 15448 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:02.189636  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
W20260709 13:04:02.189419  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 100731us
W20260709 13:04:02.246876  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 91986.1us
I20260709 13:04:02.247949  8381 raft_consensus.cc:2468] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 22.
I20260709 13:04:02.251245  8427 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:04:02.219185 15448 consensus_queue.cc:1059] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:04:02.188131 15000 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:02.252869 14835 raft_consensus.cc:2804] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:02.229768 15400 consensus_queue.cc:1059] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:04:02.147307 15446 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:02.216809 15341 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:02.178997 15172 raft_consensus.cc:740] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:04:02.256459 15341 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:02.257581 15172 consensus_queue.cc:260] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:02.259793 15172 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:02.253489 14835 raft_consensus.cc:697] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 22 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:04:02.237190 15339 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:02.262898 15064 raft_consensus.cc:3055] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:02.255740 15448 raft_consensus.cc:3055] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:04:02.266453 15448 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:04:02.247630 15367 consensus_queue.cc:1059] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:04:02.268326 15367 raft_consensus.cc:3055] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:04:02.268761 15367 raft_consensus.cc:740] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:02.270012 15367 consensus_queue.cc:260] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:02.270609 14835 consensus_queue.cc:237] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:02.271632 15367 raft_consensus.cc:3060] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:04:02.270025  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 94868.2us
I20260709 13:04:02.276096 14293 consensus_queue.cc:1048] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 13:04:02.225253  8276 catalog_manager.cc:5697] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 18 to 21, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 21 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:02.278898  8276 catalog_manager.cc:5697] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 7 to 8, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 8 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:02.239118 15385 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:02.283617 15385 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:02.285859 15064 raft_consensus.cc:740] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:02.286755 15064 consensus_queue.cc:260] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:02.304797  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:02.312799  9291 consensus_queue.cc:237] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:02.307600 15064 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:02.280393  8276 catalog_manager.cc:5697] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 14 to 18, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 18 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:02.313067  8533 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 18.
I20260709 13:04:02.304390 15448 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:02.332135 15448 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:04:02.348996  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 47225.7us
I20260709 13:04:02.303052 15400 consensus_queue.cc:1243] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer b8eb0ad4490645598004d862412f4e31 log is divergent from this leader: its last log entry 23.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:04:02.301311 15446 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:04:02.405447  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 144725us
W20260709 13:04:02.438390  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 99971.7us
I20260709 13:04:02.440193  8535 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:04:02.441973 15346 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:02.444845  8351 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:02.445523 14293 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:02.446136  8351 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:02.454064 15451 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:02.446071 14293 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:02.455927  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 181483us
I20260709 13:04:02.496176  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:04:02.519977  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 73913us
I20260709 13:04:02.538411  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:04:02.459860 15451 consensus_queue.cc:1059] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:04:02.543708 15451 consensus_queue.cc:1059] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:04:02.545565  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 50117us
I20260709 13:04:02.517493 15447 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:02.565765  8351 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:04:02.568078  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 95068.8us
I20260709 13:04:02.577457  9294 raft_consensus.cc:1240] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:02.567904 15452 consensus_queue.cc:1059] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 13:04:02.578269 14293 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:02.460235  8276 catalog_manager.cc:5697] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 14 to 15, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 15 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:02.580495  9293 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:04:02.582113 15341 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:02.584342 15341 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:02.586716 15218 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:02.589525  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:02.574536 15449 raft_consensus.cc:3055] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:04:02.590713 15449 raft_consensus.cc:740] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:04:02.591588  9289 raft_consensus.cc:1240] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:02.591763 15449 consensus_queue.cc:260] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:02.593809  9296 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:04:02.590240  9287 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
I20260709 13:04:02.594887  8458 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:04:02.595031  8382 raft_consensus.cc:3060] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:02.597412 15446 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:02.598212 15218 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:02.602739  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.573527 15400 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:02.606967  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:04:02.609421  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.571909  8349 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:02.610196  8381 raft_consensus.cc:3055] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:04:02.610785  8381 raft_consensus.cc:740] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:04:02.618513  8381 consensus_queue.cc:260] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:02.635757  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:02.605553 15449 raft_consensus.cc:3060] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:02.638971  8382 raft_consensus.cc:1275] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:04:02.637214  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 65400.5us
W20260709 13:04:02.641605  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 78905.3us
I20260709 13:04:02.643476  8381 raft_consensus.cc:3060] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:02.646332  8500 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:04:02.644532  9258 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:02.649290 15385 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:02.652390  8456 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:04:02.653005  9294 raft_consensus.cc:1240] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:02.654614  8351 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:04:02.655341  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.657275 15446 raft_consensus.cc:3055] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:02.657678 15446 raft_consensus.cc:740] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:04:02.658509 15446 consensus_queue.cc:260] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:02.659713 15446 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:02.660102  8351 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:02.661142 15400 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:02.661788 15460 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:02.664498 15461 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:04:02.665318  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 48115.4us
I20260709 13:04:02.666365  8351 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:02.654347  8349 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:02.667089 15459 consensus_queue.cc:1059] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:04:02.667711 15458 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:02.669034 15339 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:02.671607 15452 consensus_queue.cc:1059] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:02.672626 15446 raft_consensus.cc:3055] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:02.673031 15446 raft_consensus.cc:740] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:04:02.673470  8349 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:02.673899 15446 consensus_queue.cc:260] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:02.680620 15446 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:02.641399 15448 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:02.690698  8535 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:02.694984  8351 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:02.688807  8349 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:04:02.669054 15458 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:02.701135  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:02.702533  8458 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:02.678121 15461 raft_consensus.cc:697] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:02.691576 15452 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:04:02.712848  8350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.712455 15437 consensus_queue.cc:1059] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:02.716799 15400 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:02.699597 15015 consensus_queue.cc:1059] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:04:02.717442 15461 consensus_queue.cc:237] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:02.773972  8381 raft_consensus.cc:1275] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:04:02.721132 15218 raft_consensus.cc:3055] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:04:02.774578 15451 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 13:04:02.652719 15333 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:04:02.775889  8532 raft_consensus.cc:1240] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:04:02.774590  8533 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 13:04:02.776600  8533 pending_rounds.cc:85] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31: Aborting all ops after (but not including) 12
I20260709 13:04:02.776810  8533 pending_rounds.cc:107] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:04:02.777045  8533 raft_consensus.cc:2889] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:02.777324  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:02.774766 15218 raft_consensus.cc:740] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:02.778909  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:02.779377 15218 consensus_queue.cc:260] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:02.780310  8535 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:04:02.780673 15218 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:02.770300  9291 consensus_queue.cc:237] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:02.773175 15064 raft_consensus.cc:3055] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:02.786813  8458 raft_consensus.cc:2468] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 21.
W20260709 13:04:02.742712  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 67992.3us
I20260709 13:04:02.788401  8351 leader_election.cc:304] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:04:02.790604  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 141126us
I20260709 13:04:02.701135 15460 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:02.790891 15064 raft_consensus.cc:740] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:02.800273 15094 raft_consensus.cc:3055] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:02.800832 15094 raft_consensus.cc:740] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:02.800441 15064 consensus_queue.cc:260] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:02.802014 15064 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:02.801891 15094 consensus_queue.cc:260] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:02.803678 15094 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:02.791720 15464 consensus_queue.cc:1048] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:02.785393 15400 raft_consensus.cc:697] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 18 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:04:02.810913 15400 consensus_queue.cc:237] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:02.796885 15452 raft_consensus.cc:2749] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:02.797443 15448 consensus_queue.cc:1059] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:04:02.818450  8501 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.837517 15464 consensus_queue.cc:1048] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:02.834447 15468 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:04:02.833293 15172 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:04:02.833792  8426 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:02.844866  8500 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:02.874428 15459 raft_consensus.cc:2804] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:02.875103 15459 raft_consensus.cc:697] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 21 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:02.876062 15459 consensus_queue.cc:237] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:02.877784  8379 raft_consensus.cc:1275] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:04:02.891151  9289 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:04:02.880694 15084 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:02.905421  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:04:02.910879  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 65185.6us
I20260709 13:04:02.858011 15470 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 13:04:02.918936  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:02.919720  8385 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 19.
I20260709 13:04:02.906667 15449 raft_consensus.cc:3055] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:02.908458 15084 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:02.893428 15468 consensus_queue.cc:1048] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
W20260709 13:04:02.941205  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.945992  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:02.946967  8385 raft_consensus.cc:2376] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 29 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 29. Re-sending same reply.
I20260709 13:04:02.944547 15084 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:02.936836 15449 raft_consensus.cc:740] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:04:02.967286  8379 pending_rounds.cc:85] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 10
I20260709 13:04:02.972859  8379 pending_rounds.cc:107] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:04:02.973233  8379 raft_consensus.cc:2889] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:02.935125 14835 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:04:03.031193  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:03.086617  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:04:03.111475 15474 log.cc:927] Time spent T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:04:03.125360  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.137584  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
W20260709 13:04:03.144311  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:03.164587  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:03.168525  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.169921  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:03.092593 15449 consensus_queue.cc:260] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:03.193046  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:03.195034  8459 raft_consensus.cc:1240] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:04:03.197382  8457 raft_consensus.cc:1240] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:04:03.192261  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:04:03.204946  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.206368  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
W20260709 13:04:03.209208 15479 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 13:04:03.211669  8500 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.216079 15466 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:03.216640 15466 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:03.217813 15449 raft_consensus.cc:3060] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:03.218860 15466 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:03.220352  8378 raft_consensus.cc:1275] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:04:03.226786 15485 log.cc:927] Time spent T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.115s	user 0.002s	sys 0.000s
I20260709 13:04:03.230573  8461 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 18.
W20260709 13:04:03.237046 15476 log.cc:927] Time spent T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:04:03.238544  8501 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:03.247136  8501 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:03.249310  8501 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:03.256947  8501 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:03.259370  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:03.259410  8501 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:03.258594 15218 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:03.261219 15461 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:04:03.268424  8501 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:03.258258 15459 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:03.256107 15015 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:03.277400 15461 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:04:03.278505  8460 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:04:03.258096 15470 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:03.281702 15484 raft_consensus.cc:2955] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 7 to 13, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:03.283135  8501 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:03.291033  8501 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:03.297433 15461 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:03.297749 15455 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:04:03.306105 15084 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:03.308473 15084 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:03.305673  8460 raft_consensus.cc:2955] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 7 to 13, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:03.291242 15470 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:03.324960  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:03.325614 15452 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:03.325501  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:03.326819 15400 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:04:03.327301  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 83922.5us
I20260709 13:04:03.336434  8534 raft_consensus.cc:1275] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:04:03.347275  8533 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 22: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:04:03.354132  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:03.354856  8378 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 22.
I20260709 13:04:03.325532 15458 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:03.371531  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:03.372373  8378 raft_consensus.cc:2393] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 19: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:04:03.362800 15452 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:03.377799 15458 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:03.380533 15452 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:03.380687 15458 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:03.385231  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 60363.7us
I20260709 13:04:03.387176  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:03.388793  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:03.391189  8533 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 21.
I20260709 13:04:03.358821 15449 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:03.393496  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:03.361714 15447 consensus_queue.cc:1048] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:04:03.347115 15400 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:03.395602  8349 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:04:03.405025  8427 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:04:03.407925 15462 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:03.403149 15446 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:03.408458 15462 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:04:03.409176  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.409788 15449 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:03.410259 15449 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:03.410611 15449 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:03.414574  8461 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:03.408911 15462 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:03.422313 15400 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:03.425045  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1663cf9302e8495c8762465d306cb479"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:04:03.427575  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:03.428153  8457 raft_consensus.cc:606] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:04:03.428484  8457 raft_consensus.cc:614] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:03.428279  8533 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 19.
I20260709 13:04:03.433398  8351 leader_election.cc:304] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:03.442116  8349 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:04:03.454126 15447 raft_consensus.cc:2749] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:03.457877 15446 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:03.458370 15446 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:03.458750 15446 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:03.460429 15484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:53022 (request call id 6) took 1150 ms. Trace:
I20260709 13:04:03.469347 14293 raft_consensus.cc:2955] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 5 to 12, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:03.471988 15462 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:03.443434 15400 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:03.479416  8461 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:04:03.482287  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 54300.9us
I20260709 13:04:03.482774  8461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:04:03.483413  8461 raft_consensus.cc:606] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:04:03.484334  8461 raft_consensus.cc:614] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:03.481614 15084 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.480072 15447 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:03.492424  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:04:03.493070  8457 raft_consensus.cc:606] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:04:03.492853 15447 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:03.493444 15462 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:03.494164  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 82825.8us
I20260709 13:04:03.496423  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:03.496670 15459 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:03.486671 15084 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:03.460860 15484 rpcz_store.cc:276] 0709 13:04:02.310198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.310380 (+   182us) service_pool.cc:224] Handling call
0709 13:04:02.319363 (+  8983us) log.cc:844] Serialized 494 byte log entry
0709 13:04:02.603675 (+284312us) spinlock_profiling.cc:243] Waited 7.24 ms on lock 0x7b18002ee220. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c5312c0a 00007f36cea52219 00007f36c539aa40 00007f36c53954e4 00007f36c5395455 00007f36c83deb0b 00007f36c8463b63 00007f36c848b752 00007f36c84839fa
0709 13:04:03.460331 (+856656us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79876,"raft.queue_time_us":104598,"raft.run_cpu_time_us":1587,"raft.run_wall_time_us":44868,"spinlock_wait_cycles":16643456,"thread_start_us":196318,"threads_started":1,"wal-append.queue_time_us":253223}
I20260709 13:04:03.499751  8270 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9e1d32431b1c45ebad1160a850495e16 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
I20260709 13:04:03.502626  8351 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:03.503465 15460 raft_consensus.cc:2749] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:03.504714  8351 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:03.505467 15460 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:03.507171  8378 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 22.
I20260709 13:04:03.511328 15447 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:04:03.494843  9261 leader_election.cc:336] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Timed out: RequestConsensusVote RPC to 127.7.25.193:43631 timed out after 1.739s (SENT)
I20260709 13:04:03.523149  8351 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:03.514860  8427 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:04:03.494570 15400 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:03.533990  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:03.534663 15461 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:03.513521  8457 raft_consensus.cc:2955] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 5 to 12, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:03.535331 15461 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:03.535876 15400 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:03.548431 15400 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:03.558207 15449 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:03.560397 15449 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:03.552861 15446 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:03.563027 15446 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:03.567289  8455 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:04:03.569326  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:03.539791 15462 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:03.573654 15462 raft_consensus.cc:697] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 22 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:04:03.574198  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:03.574538 15462 consensus_queue.cc:237] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:03.578418 15461 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:03.556936 15084 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:03.582309  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:03.590533  8532 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 19.
I20260709 13:04:03.594430  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:03.595978  8349 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:04:03.599563  8533 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 21.
W20260709 13:04:03.600703  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 105904us
I20260709 13:04:03.602134  8270 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 455c5d2786974d92a3ee8b825edcfaa7 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 13:04:03.602523 15446 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:03.604161 15446 raft_consensus.cc:697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 19 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:04:03.605103 15446 consensus_queue.cc:237] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:03.606417  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 83700.3us
I20260709 13:04:03.607811  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:03.610471  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:04:03.612007  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:03.612713  9292 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 16.
W20260709 13:04:03.614100  9258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.616739  8349 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:04:03.623695  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:03.628716  8351 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:03.630072 15447 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:03.622267 15449 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:03.637868 15449 raft_consensus.cc:697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 21 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:04:03.639266 15449 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:03.644785  9287 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:04:03.619532 15400 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:03.617169 15367 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:04:03.661988  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:03.662312  9261 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:03.663595  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:03.670023 15000 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:03.670147  9261 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:03.671648  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:03.672515  8532 raft_consensus.cc:2393] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 22: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:04:03.674045  9289 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 19.
W20260709 13:04:03.675457  9260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.671191 15371 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:04:03.672127  9261 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:03.677198 15341 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:04:03.678755  9261 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:03.679529 15371 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:04:03.691298 15333 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.691946  8426 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:04:03.691860 15333 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:03.692788 14835 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:03.693238 14835 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:03.693234  8426 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:03.693858 14835 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:03.696975 15487 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:03.694347 15333 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:03.695003  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:03.697551 15487 raft_consensus.cc:697] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
W20260709 13:04:03.736542  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 50577.6us
W20260709 13:04:03.742426 15499 log.cc:927] Time spent T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:04:03.745628 15487 consensus_queue.cc:237] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:03.750699  8500 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:03.751734 15218 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:03.737952 15475 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:04:03.759392  9289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6"
dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:54044
I20260709 13:04:03.740109  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:03.760040  9289 raft_consensus.cc:606] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:04:03.760422  9289 raft_consensus.cc:614] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:04:03.759414  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:03.761137  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 132510us
W20260709 13:04:03.764911  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.760473  8535 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 21.
I20260709 13:04:03.737768 15400 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:03.779482  8461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:04:03.782923  8377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:03.789808  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:03.792846  8378 raft_consensus.cc:1275] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:04:03.793154  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:03.797123  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:03.780081  8461 raft_consensus.cc:606] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 20 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:04:03.797721  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:03.798141  8458 raft_consensus.cc:2393] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 21: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:04:03.800092  8459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:03.859476  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:03.905571  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:04:03.911607  8352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.906119  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:03.911974  8380 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 21.
I20260709 13:04:03.912279  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:03.812340  8377 raft_consensus.cc:2410] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:04:03.912375  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:03.811452  8455 raft_consensus.cc:1275] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:04:03.917891  8378 raft_consensus.cc:1275] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:04:03.918259  8378 pending_rounds.cc:85] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 11
I20260709 13:04:03.918301  9291 raft_consensus.cc:2393] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 19: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:04:03.918624  8378 pending_rounds.cc:107] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:04:03.918915  8378 raft_consensus.cc:2889] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:03.930207  8351 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:03.770570 14835 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:03.934095  8380 raft_consensus.cc:1275] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:04:03.935246  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:04:03.939482  9289 raft_consensus.cc:2393] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 19: Already voted for candidate 446d9310dce14ff4afff2dc2d64f68d8 in this term.
I20260709 13:04:03.907254 15462 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:03.811478 15484 consensus_queue.cc:1048] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.143s
I20260709 13:04:03.945503  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:03.946280  8351 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:03.944168  8424 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:03.953739  8386 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 19.
I20260709 13:04:03.947890  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:03.917565 15084 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:03.934046 15446 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:03.955459  8384 raft_consensus.cc:2410] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eb0ad4490645598004d862412f4e31 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:04:03.971486 15464 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:03.972062 15464 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.972486 15464 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:03.973464 15400 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:03.960856 15084 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:03.979327 15084 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:04.006464 14835 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Requested vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:03.951316 15462 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:04.017316 15462 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:04.026408  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:04.039680 15464 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:04.054580  8461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:04.061298  8461 raft_consensus.cc:2368] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 21. Current term is 22.
I20260709 13:04:04.064283  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:04:04.070822  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 124098us
W20260709 13:04:04.073287  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 127095us
I20260709 13:04:04.081151  8461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:04:04.081864  8461 raft_consensus.cc:606] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
W20260709 13:04:04.081565  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 126984us
I20260709 13:04:04.082245  8461 raft_consensus.cc:614] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:04.083264  8351 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:04.087541  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:04:04.088423  8351 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:04.092311  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:04.110937 15464 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:04.114374  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:04.116166 15460 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:04.093467  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:04.121506  8351 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:04.124677  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:04.125831 15460 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:04.120008  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:04.136461  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:04.089488 15449 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:04.144390 15459 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.144970 15459 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:04.147173 15459 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:04.135031 15514 consensus_queue.cc:1048] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:04:04.154381 15475 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:04.154981 15475 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:04.158241 15459 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.159606  8351 leader_election.cc:400] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 election: Vote denied by peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925) with higher term. Message: Invalid argument: T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 for earlier term 21. Current term is 22.
I20260709 13:04:04.160606 15428 raft_consensus.cc:993] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:04:04.161160 15428 raft_consensus.cc:1081] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:04:04.173785  8384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:04:04.174427  8384 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:04.174772  8384 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:04.176555  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:04.177325  9289 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
I20260709 13:04:04.183301  8500 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:04.184090 15437 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:04.184490 15437 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.184834 15437 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:04.190613  8531 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:04:04.192427 15428 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.193007 15428 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:04.195744 15475 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:04.194060 15459 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:04.203527 15459 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:04.200613  8460 raft_consensus.cc:1240] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Rejecting Update request from peer b8eb0ad4490645598004d862412f4e31 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:04.208642  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:04.210192 15475 consensus_queue.cc:1048] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:04.210961 15475 consensus_queue.cc:1243] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer d653e71832b7402b9a03b46249d3b885 log is divergent from this leader: its last log entry 22.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:04:04.211246 15514 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:04.213562  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:04.215327  8378 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:04:04.216692  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:04.217784  8386 raft_consensus.cc:2410] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:04:04.225893 15172 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:04:04.231688 15461 consensus_queue.cc:1059] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:04.232745 15461 raft_consensus.cc:3055] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:04.233155 15461 raft_consensus.cc:740] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:04.250345  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:04.251044  8531 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:04.248044  8424 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:04.249791  9261 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:04:04.253719  8529 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:04:04.256707  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:04.257678  8378 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:04:04.249727 15428 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:04.356537  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 150609us
I20260709 13:04:04.261507 15461 consensus_queue.cc:260] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:04.361971  8380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:04:04.363575  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 113848us
I20260709 13:04:04.377058 15461 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:04.377345  8501 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:04.365571  8351 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:04.382452 15462 raft_consensus.cc:993] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12: : Instructing follower b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:04:04.366219  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
W20260709 13:04:04.367306  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 109695us
I20260709 13:04:04.383380  8378 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:04:04.384967 15218 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:04.385466 15460 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:04.366704 15451 raft_consensus.cc:493] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.387050 15451 raft_consensus.cc:515] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:04.380815  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:04.388334  9287 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
I20260709 13:04:04.390918 15451 leader_election.cc:290] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:04.397604 15447 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.399757  8459 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 21. Current term is 22. Ops: []
I20260709 13:04:04.400177  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:04.398264 15447 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:04.392858 15437 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:04.403555 15447 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:04.371238 15341 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:04.416955  9287 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:04:04.417652 15341 raft_consensus.cc:493] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.418179 15341 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:04.370007  8531 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 22.
W20260709 13:04:04.371064  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 111701us
I20260709 13:04:04.364784  8384 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:04.360693 15491 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:04.421900  8386 raft_consensus.cc:1240] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:04.422852  8384 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:04.423429 15447 consensus_queue.cc:1059] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:04.424345 15447 raft_consensus.cc:3055] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:04:04.424698 15447 raft_consensus.cc:740] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:04:04.424829  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:04.426076  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:04.426632  8460 raft_consensus.cc:3055] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:04.426929  8460 raft_consensus.cc:740] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:04:04.258288 15339 consensus_queue.cc:1048] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:04:04.401350 15451 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.382953 15462 raft_consensus.cc:1081] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 20 LEADER]: Signalling peer b8eb0ad4490645598004d862412f4e31 to start an election
I20260709 13:04:04.431871  8530 raft_consensus.cc:1240] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Rejecting Update request from peer d653e71832b7402b9a03b46249d3b885 for earlier term 21. Current term is 22. Ops: []
I20260709 13:04:04.403772 15437 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:04.438647 15517 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:04.442080  8424 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:04.445230 15428 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:04.445739  8424 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:04.446569  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:04:04.447273  9293 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:04.447844 15491 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:04.451493 15465 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:04.454291  9293 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
I20260709 13:04:04.442914  8460 consensus_queue.cc:260] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:04.442456  8500 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:04:04.465518  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 88239.5us
I20260709 13:04:04.466198  8424 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:04.467312  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:04.468266  8530 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 17.
I20260709 13:04:04.469590  8460 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:04.470664 15461 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:04.471144 15461 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.471508 15461 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:04:04.473114 15522 consensus_queue.cc:1175] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b8eb0ad4490645598004d862412f4e31" responder_term: 18 status { last_received { term: 18 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 18 index: 10 } }
I20260709 13:04:04.440807 15451 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:04.476325 15451 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:04.425516 15447 consensus_queue.cc:260] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:04.477536 15447 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:04.487265  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:04.488246  8457 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
I20260709 13:04:04.494124  8424 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:04.490100  8351 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:04:04.520524  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 49995.6us
I20260709 13:04:04.468813  8500 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:04:04.523835  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 57640us
W20260709 13:04:04.524152  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 55441.9us
I20260709 13:04:04.526254  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:04.530375  8501 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
W20260709 13:04:04.542126  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 47723.1us
I20260709 13:04:04.548156  8532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc"
dest_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:38894
I20260709 13:04:04.548823  8532 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:04.549317  8532 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:04.548908  8501 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:04.497478  8383 raft_consensus.cc:2955] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 7 to 13, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:04:04.552523  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 58537.8us
I20260709 13:04:04.531494 15437 raft_consensus.cc:2804] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:04.527266 15462 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:04.544555 15449 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:04:04.580547  8426 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.544514 15523 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:04.586894  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 61398.5us
I20260709 13:04:04.557713 15367 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:04.573160  8532 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:04.563486 15465 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:04.582737 15449 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.622865  8532 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:04.624627  8460 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 19.
I20260709 13:04:04.602105 15475 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:04.602415 15437 raft_consensus.cc:697] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 20 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:04.608259 15465 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.606973 15462 raft_consensus.cc:697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 22 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:04:04.637759  8381 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:04:04.627980 15449 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:04:04.640929 15525 log.cc:927] Time spent T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:04:04.637027 15465 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:04.657804  8386 raft_consensus.cc:2955] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 5 to 12, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:04:04.695354  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 148352us
W20260709 13:04:04.703171  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 154358us
I20260709 13:04:04.729535  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612cbe4a26f4473aaa8e3c84a7719e03" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:04.729805  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:04.730422  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:04.730835  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:04.731467  8528 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 17.
I20260709 13:04:04.730947  8535 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:04.670395 15462 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:04.676427 15437 consensus_queue.cc:237] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:04.743276 15529 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 13:04:04.746681 15528 log.cc:927] Time spent T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:04:04.748914 15523 consensus_queue.cc:1048] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:04:04.751289 15530 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:04:04.741744  8349 leader_election.cc:304] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:04.756651  8349 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:04.763625  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:04:04.764287  9293 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:04.770334  9293 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 21.
W20260709 13:04:04.772904 15537 log.cc:927] Time spent T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:04:04.727188 15341 raft_consensus.cc:515] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:04.788276  8535 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 19.
I20260709 13:04:04.793009  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:04.793720  8381 raft_consensus.cc:3060] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:04:04.791363  8349 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:04:04.794267  8500 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:04.801184 15475 raft_consensus.cc:2804] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:04.801810 15475 raft_consensus.cc:697] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 21 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:04.802788 15475 consensus_queue.cc:237] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:04.758929 15538 raft_consensus.cc:2749] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:04.762676 15533 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:04.811707  9287 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 19. Current term is 20. Ops: []
I20260709 13:04:04.807816 15460 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:04.834417  8377 pending_rounds.cc:85] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 12
I20260709 13:04:04.834753  8377 pending_rounds.cc:107] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:04:04.835029  8377 raft_consensus.cc:2889] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:04.837339 15460 raft_consensus.cc:697] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 19 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:04:04.863232  8381 raft_consensus.cc:2468] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
I20260709 13:04:04.849066 15461 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:04.883184  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 241768us
I20260709 13:04:04.886691 15428 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:04:04.896309 15341 leader_election.cc:290] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:04.900374  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da501bdc0de7404f9ecae9db442353dc" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:04.901067  8453 raft_consensus.cc:3055] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:04.901397  8453 raft_consensus.cc:740] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:04:04.901985 15449 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:04.902165  8453 consensus_queue.cc:260] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:04.903142  8453 raft_consensus.cc:3060] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:04.859195 15460 consensus_queue.cc:237] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:04.916836  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:04:04.970456  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 156938us
I20260709 13:04:04.997378  9287 raft_consensus.cc:1240] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 20. Current term is 21. Ops: []
W20260709 13:04:04.998955  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 57125.6us
I20260709 13:04:04.849066 15465 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:05.010661  8533 raft_consensus.cc:1240] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 21 LEADER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 20. Current term is 21. Ops: []
I20260709 13:04:05.001900 15464 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:05.075274 15449 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:05.015956 15515 consensus_queue.cc:1059] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.045s
I20260709 13:04:05.082000 15465 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:05.086292 15545 log.cc:927] Time spent T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:04:05.045262 15464 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:05.095558  8453 raft_consensus.cc:2468] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 21.
W20260709 13:04:05.104022 15543 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.067s	user 0.000s	sys 0.002s
I20260709 13:04:05.140560  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:05.156742 15534 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.157464 15534 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:05.160377 15461 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:04:05.162226 15552 log.cc:927] Time spent T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:04:05.165164 15464 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:05.159825 15534 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:05.182687  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 191247us
W20260709 13:04:05.185333  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 160769us
W20260709 13:04:05.186609  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 162508us
W20260709 13:04:05.188266  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 163250us
I20260709 13:04:05.189313  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:05.194132  8453 raft_consensus.cc:2393] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 18: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:04:05.193958  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:05.194725  8386 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 21.
I20260709 13:04:05.194797  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd3ca20a5e4646d3b164329f7abcf44a" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:05.192677  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:05.195684  8382 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:05.195923  8381 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:04:05.210716  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:05.211630  8530 raft_consensus.cc:3060] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:05.212596  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:05.223245  8529 raft_consensus.cc:2393] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 21: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:04:05.208300  8501 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
W20260709 13:04:05.240257  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 192427us
I20260709 13:04:05.253574  9287 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:04:05.267124  8379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:05.272387  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:05.273144  8383 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 21.
I20260709 13:04:05.274662  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:04:05.275285  9287 raft_consensus.cc:3060] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:04:05.285755 15551 log.cc:927] Time spent T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:04:05.240526 15367 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:05.288559 15367 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.288961 15367 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:05.292500 15518 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:05.294618 15518 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:05.273638  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:05.296407  8453 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
I20260709 13:04:05.297032  8379 raft_consensus.cc:2393] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 18: Already voted for candidate d653e71832b7402b9a03b46249d3b885 in this term.
I20260709 13:04:05.297247  8530 raft_consensus.cc:2468] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 18.
I20260709 13:04:05.301412  9287 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
I20260709 13:04:05.304566  8382 raft_consensus.cc:2468] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 20.
I20260709 13:04:05.306810  8385 raft_consensus.cc:1240] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Rejecting Update request from peer 105d6581548546b98eddd4ee7083bb12 for earlier term 19. Current term is 20. Ops: [18.16-19.17]
I20260709 13:04:05.304976  8424 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:05.310158  9261 leader_election.cc:304] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:04:05.311174 15520 raft_consensus.cc:2804] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:05.271147 15526 raft_consensus.cc:493] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:05.323450  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:05.324142  8533 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:04:05.324047 15526 raft_consensus.cc:515] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:05.325359  9258 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:05.326335 15563 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:05.326761 15563 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:05.327122 15526 leader_election.cc:290] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:05.311985 15520 raft_consensus.cc:697] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:04:05.321149 15367 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:05.322028 15535 raft_consensus.cc:2804] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:05.322342 15518 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:05.301880 15530 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:04:05.336362 15535 raft_consensus.cc:697] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:04:05.337491 15535 consensus_queue.cc:237] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:05.328083  8382 raft_consensus.cc:1275] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:04:05.328924  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:05.344787 15367 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:05.305787  8381 raft_consensus.cc:2468] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
I20260709 13:04:05.334594 15520 consensus_queue.cc:237] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:05.327147 15563 raft_consensus.cc:3060] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:05.345446 15367 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:04:05.353616 15557 log.cc:927] Time spent T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:04:05.345436  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:05.359701  8383 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:05.367476  8501 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:04:05.368470 15437 raft_consensus.cc:2804] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:05.368994 15437 raft_consensus.cc:697] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 20 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:05.369892 15437 consensus_queue.cc:237] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:05.372723  8453 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:04:05.379992  8383 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 22.
I20260709 13:04:05.373337 15127 raft_consensus.cc:3055] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:04:05.381703 15127 raft_consensus.cc:740] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:04:05.382644 15127 consensus_queue.cc:260] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:05.387171 15127 raft_consensus.cc:3060] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:05.390113  8427 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: b8eb0ad4490645598004d862412f4e31
I20260709 13:04:05.391297 15306 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:05.391710 15306 raft_consensus.cc:493] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:05.392062 15306 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:04:05.396461  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 62507.9us
I20260709 13:04:05.398427  8501 leader_election.cc:304] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:04:05.403751  8381 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:04:05.404381  8381 pending_rounds.cc:85] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 14
I20260709 13:04:05.404683  8381 pending_rounds.cc:107] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:04:05.404984  8381 raft_consensus.cc:2889] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:05.420296  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:05.410730 15534 raft_consensus.cc:2804] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:05.435350 15534 raft_consensus.cc:697] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 22 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:05.436326 15534 consensus_queue.cc:237] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:05.407941 15447 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:04:05.441658  8530 raft_consensus.cc:2393] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d653e71832b7402b9a03b46249d3b885 in current term 18: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:04:05.388790 15563 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:05.449589 15514 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:05.450201 15514 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:05.458458 15563 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:05.460084 15514 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:05.482988  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:05.487004  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:05.487867  8458 raft_consensus.cc:2393] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 17: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:04:05.500880 15306 raft_consensus.cc:515] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:05.506314 15561 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:05.496730  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:05.514674  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:05.523443  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:05.515625  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:05.516459  8534 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:04:05.518147  8349 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:05.528663  9287 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:04:05.534965  8457 raft_consensus.cc:1275] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:04:05.541460  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:05.542605  8458 raft_consensus.cc:3060] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:05.547734  8533 raft_consensus.cc:2468] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 17.
I20260709 13:04:05.558395 15306 leader_election.cc:290] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:05.559191  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885"
I20260709 13:04:05.559962  8385 raft_consensus.cc:2368] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 21. Current term is 22.
I20260709 13:04:05.548849  9258 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:05.562747 15523 consensus_queue.cc:1048] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 13:04:05.563657 15339 raft_consensus.cc:2804] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:05.564215 15339 raft_consensus.cc:697] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:04:05.567184 15461 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 13:04:05.573770  8349 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:05.577322  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd574dc2f1347e8996cdb77177d1a54" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:05.578998 15532 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:04:05.566665 15573 log.cc:927] Time spent T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:04:05.541278 15451 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:04:05.583199  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:05.585508  8500 leader_election.cc:304] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:05.586324  8458 raft_consensus.cc:2468] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 22.
I20260709 13:04:05.587504 15560 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 13:04:05.565047 15339 consensus_queue.cc:237] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:05.594172  8457 raft_consensus.cc:2393] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 446d9310dce14ff4afff2dc2d64f68d8 in current term 17: Already voted for candidate 105d6581548546b98eddd4ee7083bb12 in this term.
I20260709 13:04:05.596168  8427 leader_election.cc:400] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 election: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 21. Current term is 22.
I20260709 13:04:05.596561  8427 leader_election.cc:403] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:04:05.600593 15513 raft_consensus.cc:2749] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631) with higher term. Message: Invalid argument: T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 for earlier term 21. Current term is 22.
I20260709 13:04:05.647040 15523 raft_consensus.cc:2749] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:05.648020  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 62678.6us
I20260709 13:04:05.652297 15523 consensus_queue.cc:1048] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:05.702997  8283 catalog_manager.cc:5697] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 16 to 20, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 20 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:05.704525  8283 catalog_manager.cc:5697] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:05.734715  8283 catalog_manager.cc:5697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.736709  8283 catalog_manager.cc:5697] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 12 to 21, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 21 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:05.738605  8283 catalog_manager.cc:5697] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 14 to 15, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 15 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:05.740149  8283 catalog_manager.cc:5697] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 17 to 18, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 18 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.742491  8283 catalog_manager.cc:5697] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 5 to 14. New cstate: current_term: 14 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:05.743916  8283 catalog_manager.cc:5697] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 17 to 19, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 19 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:05.747931  8276 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53484 (request call id 339) took 33329 ms (client timeout 15000 ms). Trace:
W20260709 13:04:05.748418  8276 rpcz_store.cc:269] 0709 13:03:32.418217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.419463 (+  1246us) service_pool.cc:224] Handling call
0709 13:04:05.747830 (+33328367us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:02.828544 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:02.835785 (+  7241us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:02.835859 (+    74us) write_op.cc:435] Acquired schema lock
0709 13:04:02.835885 (+    26us) tablet.cc:662] Decoding operations
0709 13:04:02.838521 (+  2636us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:02.838661 (+   140us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:02.838714 (+    53us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:04:02.841404 (+  2690us) tablet.cc:701] Row locks acquired
0709 13:04:02.841476 (+    72us) write_op.cc:260] PREPARE: finished
0709 13:04:02.847195 (+  5719us) write_op.cc:270] Start()
0709 13:04:02.858376 (+ 11181us) write_op.cc:276] Timestamp: P: 1783602242841600 usec, L: 0
0709 13:04:02.858431 (+    55us) op_driver.cc:348] REPLICATION: starting
0709 13:04:02.859701 (+  1270us) log.cc:844] Serialized 7826 byte log entry
0709 13:04:03.239097 (+379396us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b18003bb780. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:04:03.402573 (+163476us) op_driver.cc:464] REPLICATION: finished
0709 13:04:03.585629 (+183056us) write_op.cc:301] APPLY: starting
0709 13:04:03.585765 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:04.087099 (+501334us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:04.098261 (+ 11162us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:04.482980 (+384719us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:04.543319 (+ 60339us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:04:04.558231 (+ 14912us) write_op.cc:312] APPLY: finished
0709 13:04:04.644507 (+ 86276us) log.cc:844] Serialized 180 byte log entry
0709 13:04:04.859194 (+214687us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c537b0ac 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36c801f20b
0709 13:04:05.023877 (+164683us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:05.044323 (+ 20446us) write_op.cc:454] Released schema lock
0709 13:04:05.072939 (+ 28616us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:05.079593 (+  6654us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:05.079632 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":189411,"reported_tablets":49,"spinlock_wait_cycles":693632,"child_traces":[["op",{"apply.queue_time_us":182724,"apply.run_cpu_time_us":59266,"apply.run_wall_time_us":1493933,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87807,"num_ops":20,"prepare.queue_time_us":30509,"prepare.run_cpu_time_us":11588,"prepare.run_wall_time_us":110893,"raft.queue_time_us":132542,"raft.run_cpu_time_us":35283,"raft.run_wall_time_us":86157,"replication_time_us":543946,"spinlock_wait_cycles":9564288,"thread_start_us":567317,"threads_started":5,"wal-append.queue_time_us":476748,"wal-append.run_cpu_time_us":34577,"wal-append.run_wall_time_us":1121466}]]}
I20260709 13:04:05.767680  8460 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 17. (term mismatch)
I20260709 13:04:05.768071  8460 pending_rounds.cc:85] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: Aborting all ops after (but not including) 16
I20260709 13:04:05.768281  8460 pending_rounds.cc:107] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: Aborting uncommitted NO_OP operation due to leader change: 19.17
I20260709 13:04:05.768510  8460 raft_consensus.cc:2889] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:05.770037 15535 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:04:05.745389  8283 catalog_manager.cc:5697] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 14 to 16, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 16 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:05.778352  8385 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:04:05.783723  8385 pending_rounds.cc:85] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885: Aborting all ops after (but not including) 8
I20260709 13:04:05.783978  8385 pending_rounds.cc:107] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:04:05.784201  8385 raft_consensus.cc:2889] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:05.786274 15560 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:05.787237  8283 catalog_manager.cc:5697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 16 to 21, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 21 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.789126  8283 catalog_manager.cc:5697] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 10 to 14, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 14 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.791033  8283 catalog_manager.cc:5697] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 16 to 17, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 17 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.797847  8534 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:04:05.792848  8283 catalog_manager.cc:5697] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 13 to 16, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 16 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:05.823664  8283 catalog_manager.cc:5697] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:05.822512 15514 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:04:05.871523  8283 catalog_manager.cc:5697] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.875072  8283 catalog_manager.cc:5697] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 19 to 20, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 20 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:05.901933  8283 catalog_manager.cc:5697] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 22 to 26, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 26 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.923660  8385 raft_consensus.cc:1275] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:04:05.912400  8457 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:04:05.909911  8283 catalog_manager.cc:5697] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:05.938027  8283 catalog_manager.cc:5697] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:05.950639 15523 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:05.963985  8283 catalog_manager.cc:5697] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 13 to 17, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 17 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.980947  8283 catalog_manager.cc:5697] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 15 to 17, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 17 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.000092  8385 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:04:06.000927  8283 catalog_manager.cc:5697] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 11 to 19, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 19 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:06.003580 15566 consensus_queue.cc:1048] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.016s
I20260709 13:04:06.059809  9293 raft_consensus.cc:1275] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:04:06.061244  8529 raft_consensus.cc:1275] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:04:06.082743  8534 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:04:06.071269 15461 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:04:06.105154 15520 consensus_queue.cc:1048] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:04:06.106489 15535 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
W20260709 13:04:06.159624 15585 log.cc:927] Time spent T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.131s	user 0.000s	sys 0.002s
I20260709 13:04:06.177606  8378 raft_consensus.cc:1275] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:04:06.178222 15461 consensus_queue.cc:1048] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:06.197703  8457 raft_consensus.cc:1275] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:04:06.210908 15218 consensus_queue.cc:1048] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:04:06.202885 15428 raft_consensus.cc:493] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.222898 15428 raft_consensus.cc:515] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:06.205061 15566 consensus_queue.cc:1048] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:04:06.224996 15428 leader_election.cc:290] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:06.229140  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
W20260709 13:04:06.412873  8560 heartbeater.cc:646] Failed to heartbeat to 127.7.25.254:44471 (6 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.7.25.254:44471 timed out after 15.000s (SENT)
W20260709 13:04:06.451844  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 372475us
W20260709 13:04:06.457536 15595 log.cc:927] Time spent T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:04:06.472791  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1cdd90debd40a6a2361af7491977d6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:04:06.473281  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 48564.5us
W20260709 13:04:06.512977  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 82620.8us
W20260709 13:04:06.575881  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 63589.3us
W20260709 13:04:06.609678  9260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 95607.5us
I20260709 13:04:06.624506  8424 leader_election.cc:304] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:06.644932 15561 raft_consensus.cc:2749] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:04:06.673266  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 87140.8us
W20260709 13:04:06.679535  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 101304us
W20260709 13:04:06.685807 15599 log.cc:927] Time spent T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31: Append to log took a long time: real 0.058s	user 0.001s	sys 0.002s
W20260709 13:04:06.687387  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 171638us
W20260709 13:04:06.705472 15602 log.cc:927] Time spent T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885: Append to log took a long time: real 0.075s	user 0.002s	sys 0.000s
I20260709 13:04:06.695837 15546 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:06.728150 15546 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:06.744035  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 68887.2us
I20260709 13:04:06.755376 15546 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:06.758296  8378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d653e71832b7402b9a03b46249d3b885" is_pre_election: true
I20260709 13:04:06.761855  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:06.762149  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:06.785193  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:06.801497  8500 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:06.809389 15546 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:06.904767  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:04:06.905416  8457 raft_consensus.cc:606] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 21 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:04:06.909727  9293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e1d32431b1c45ebad1160a850495e16"
dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
mode: GRACEFUL
new_leader_uuid: "b8eb0ad4490645598004d862412f4e31"
 from {username='slave'} at 127.0.0.1:54044
I20260709 13:04:06.910369  9293 raft_consensus.cc:606] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 LEADER]: Received request to transfer leadership to TS b8eb0ad4490645598004d862412f4e31
I20260709 13:04:06.911234  9293 raft_consensus.cc:630] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 LEADER]: Rejecting request to transfer leadership because tablet server b8eb0ad4490645598004d862412f4e31 is not a voter in the active config
I20260709 13:04:06.915433  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:04:06.916067  8457 raft_consensus.cc:606] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:04:06.916384  8457 raft_consensus.cc:614] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:06.918977  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:04:06.919571  8457 raft_consensus.cc:606] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 23 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:04:06.924502  8458 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:04:06.925098  8458 raft_consensus.cc:606] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:04:06.926379  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:06.961251  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:06.961933  8277 catalog_manager.cc:5697] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 16 to 18, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 18 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.964257  8277 catalog_manager.cc:5697] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 14 to 15, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 15 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.965936  8277 catalog_manager.cc:5697] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.967502  8277 catalog_manager.cc:5697] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.969974  8277 catalog_manager.cc:5697] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 16 to 18, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 18 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:06.977883  8283 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53494 (request call id 331) took 16021 ms (client timeout 15000 ms). Trace:
W20260709 13:04:06.978399  8283 rpcz_store.cc:269] 0709 13:03:50.961139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.965970 (+  4831us) service_pool.cc:224] Handling call
0709 13:04:06.977797 (+16011827us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:06.525784 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:06.526366 (+   582us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:06.526408 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:04:06.526425 (+    17us) tablet.cc:662] Decoding operations
0709 13:04:06.570615 (+ 44190us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:06.570723 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:06.570763 (+    40us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:04:06.572927 (+  2164us) tablet.cc:701] Row locks acquired
0709 13:04:06.572955 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:04:06.576948 (+  3993us) write_op.cc:270] Start()
0709 13:04:06.610349 (+ 33401us) write_op.cc:276] Timestamp: P: 1783602246574844 usec, L: 0
0709 13:04:06.613427 (+  3078us) op_driver.cc:348] REPLICATION: starting
0709 13:04:06.649282 (+ 35855us) log.cc:844] Serialized 8575 byte log entry
0709 13:04:06.779953 (+130671us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b18003eaee0. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce26d5b1 00007f36c53983f3 00007f36c539a7c1 00007f36c539a779 00007f36c539a709 00007f36c539a6d1 00007f36c53999cd 000000000038f354 000000000038f199 00007f36c537b83a
0709 13:04:06.812843 (+ 32890us) op_driver.cc:464] REPLICATION: finished
0709 13:04:06.819885 (+  7042us) write_op.cc:301] APPLY: starting
0709 13:04:06.819987 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:06.822924 (+  2937us) spinlock_profiling.cc:243] Waited 9.72 ms on lock 0x7b540014ebd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c848232a 00007f36c8407f14 00007f36c8407ec3 00007f36c8407e38 00007f36c8407df3 00007f36c84070dc 00007f36c8430e16 00007f36c8418cbb 00007f36c840339d 00007f36c8406d75
0709 13:04:06.868653 (+ 45729us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:06.868686 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:06.912479 (+ 43793us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:06.912847 (+   368us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 13:04:06.912901 (+    54us) write_op.cc:312] APPLY: finished
0709 13:04:06.913437 (+   536us) log.cc:844] Serialized 196 byte log entry
0709 13:04:06.913623 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:06.913818 (+   195us) write_op.cc:454] Released schema lock
0709 13:04:06.913875 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:06.914325 (+   450us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:06.914368 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":70374,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":6770,"apply.run_cpu_time_us":27564,"apply.run_wall_time_us":94419,"cfile_cache_hit":90,"cfile_cache_hit_bytes":96175,"num_ops":22,"prepare.queue_time_us":107811,"prepare.run_cpu_time_us":14090,"prepare.run_wall_time_us":221395,"raft.queue_time_us":20342,"raft.run_cpu_time_us":7186,"raft.run_wall_time_us":20208,"replication_time_us":199222,"spinlock_wait_cycles":26982528,"thread_start_us":187275,"threads_started":4,"wal-append.queue_time_us":99849}]]}
I20260709 13:04:06.983302 15513 raft_consensus.cc:993] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:04:06.985333 15590 raft_consensus.cc:1081] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:04:06.987922  8380 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:04:06.988471  8380 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:06.988807  8380 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:06.996014  8277 catalog_manager.cc:5697] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 15 to 20, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 20 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.997681  8277 catalog_manager.cc:5697] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:06.998984  8277 catalog_manager.cc:5697] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:07.015277 15513 raft_consensus.cc:993] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:04:07.015791 15513 raft_consensus.cc:1081] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 23 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:04:07.017925  8378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:04:06.999696  8380 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:07.020434  8378 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:07.000263  8277 catalog_manager.cc:5697] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 10 to 12, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 12 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.020797  8378 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:07.025031  8277 catalog_manager.cc:5697] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 18 to 24, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 24 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:07.027220  8277 catalog_manager.cc:5697] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:07.028892  8380 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:07.029886  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:07.030483  8457 raft_consensus.cc:3055] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:07.030757  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:04:07.030771  8457 raft_consensus.cc:740] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:04:07.031316  9293 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:07.032328  8457 consensus_queue.cc:260] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:07.033603  8457 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:07.035893  8378 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:07.039000  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:07.039620  8458 raft_consensus.cc:3055] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:04:07.039968  8458 raft_consensus.cc:740] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:04:07.040656  9293 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 18.
I20260709 13:04:07.040987  8458 consensus_queue.cc:260] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:07.042181  8458 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:07.042188  8351 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:04:07.043478 15446 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:07.043946 15446 raft_consensus.cc:697] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 18 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:04:07.044806 15446 consensus_queue.cc:237] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:07.039975  8457 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 18.
I20260709 13:04:07.053472  8458 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 24.
I20260709 13:04:07.055367  8351 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:04:07.057960 15608 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:07.058485 15608 raft_consensus.cc:697] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 24 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:04:07.059360 15608 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:07.063839  8378 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 24 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:07.066445  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: true dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:04:07.067236  9287 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:07.029173  8277 catalog_manager.cc:5697] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:07.072470  8277 catalog_manager.cc:5697] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:07.074019  8277 catalog_manager.cc:5697] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.075330  9287 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 24.
I20260709 13:04:07.100062  8277 catalog_manager.cc:5697] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.117507 15519 raft_consensus.cc:993] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:04:07.118119 15606 raft_consensus.cc:1081] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 21 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:04:07.120851  8380 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:04:07.121430  8380 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:07.121767  8380 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:07.129297  8380 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:07.138608  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:07.139243  8457 raft_consensus.cc:3055] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:04:07.139598  8457 raft_consensus.cc:740] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:04:07.140607  8457 consensus_queue.cc:260] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:07.141788  8457 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:07.142784  8380 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:07.143957  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: true dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:04:07.148114  9287 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:07.169111  9287 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 22.
I20260709 13:04:07.173686  8351 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:04:07.174629 15608 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:07.175220 15608 raft_consensus.cc:697] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 22 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:04:07.176100 15608 consensus_queue.cc:237] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:07.183537  8457 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 22.
I20260709 13:04:07.239779  8277 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59480 (request call id 207) took 8759 ms. Trace:
I20260709 13:04:07.240595  8277 rpcz_store.cc:276] 0709 13:03:58.480019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.035686 (+3555667us) service_pool.cc:224] Handling call
0709 13:04:07.239694 (+5204008us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:07.112358 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:07.112919 (+   561us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:07.112955 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:04:07.112974 (+    19us) tablet.cc:662] Decoding operations
0709 13:04:07.114195 (+  1221us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:07.114254 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:07.114281 (+    27us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:04:07.115425 (+  1144us) tablet.cc:701] Row locks acquired
0709 13:04:07.115453 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:04:07.115586 (+   133us) write_op.cc:270] Start()
0709 13:04:07.115691 (+   105us) write_op.cc:276] Timestamp: P: 1783602247115540 usec, L: 0
0709 13:04:07.115713 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:04:07.117051 (+  1338us) log.cc:844] Serialized 5974 byte log entry
0709 13:04:07.120385 (+  3334us) op_driver.cc:464] REPLICATION: finished
0709 13:04:07.121386 (+  1001us) write_op.cc:301] APPLY: starting
0709 13:04:07.121468 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:07.134957 (+ 13489us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:07.135065 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:07.189135 (+ 54070us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:07.189565 (+   430us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:04:07.189642 (+    77us) write_op.cc:312] APPLY: finished
0709 13:04:07.190100 (+   458us) log.cc:844] Serialized 139 byte log entry
0709 13:04:07.191473 (+  1373us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:07.191688 (+   215us) write_op.cc:454] Released schema lock
0709 13:04:07.191768 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:07.192279 (+   511us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:07.192320 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":45822,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":761,"apply.run_cpu_time_us":20039,"apply.run_wall_time_us":70830,"cfile_cache_hit":60,"cfile_cache_hit_bytes":62760,"num_ops":15,"prepare.queue_time_us":105,"prepare.run_cpu_time_us":4471,"prepare.run_wall_time_us":5036,"replication_time_us":4528}]]}
I20260709 13:04:07.243602  8276 catalog_manager.cc:5697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 16 to 19, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 19 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.244846  8276 catalog_manager.cc:5697] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 17 to 18, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 18 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.246357  8276 catalog_manager.cc:5697] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:07.247627  8276 catalog_manager.cc:5697] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:07.248492  8276 catalog_manager.cc:5697] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.249657  8276 catalog_manager.cc:5697] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 15 to 22. New cstate: current_term: 22 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
W20260709 13:04:07.250414  8270 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 455c5d2786974d92a3ee8b825edcfaa7 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 5 but the committed config has opid_index of 12
I20260709 13:04:07.253278  8276 catalog_manager.cc:5697] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:07.255666  8276 catalog_manager.cc:5697] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index 7 to 13, term changed from 13 to 18, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New cstate: current_term: 18 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:07.257429  8276 catalog_manager.cc:5697] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:07.259150  8276 catalog_manager.cc:5697] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:07.274320  8276 catalog_manager.cc:5697] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:07.277138  8276 catalog_manager.cc:5697] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:07.281488  8276 catalog_manager.cc:5697] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 26 to 29, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 29 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:07.282876  8276 catalog_manager.cc:5697] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 19 to 23, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 23 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:07.284230  8276 catalog_manager.cc:5697] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 13 to 18, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 18 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:07.286497  8276 catalog_manager.cc:5697] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.290506  8276 catalog_manager.cc:5697] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 19 to 22, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 22 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:07.292745  8276 catalog_manager.cc:5697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:07.293993  8276 catalog_manager.cc:5697] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 19 to 20, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 20 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:07.296826  8276 catalog_manager.cc:5697] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 12 to 16, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 16 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:07.298754  8276 catalog_manager.cc:5697] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 14 to 19, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 19 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.301142  8276 catalog_manager.cc:5697] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 14 to 22. New cstate: current_term: 22 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:07.314918  8276 catalog_manager.cc:5697] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index 5 to 12, VOTER b8eb0ad4490645598004d862412f4e31 (127.7.25.195) evicted. New cstate: current_term: 14 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:07.316084  8276 catalog_manager.cc:5697] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 8 to 13, leader changed from b8eb0ad4490645598004d862412f4e31 (127.7.25.195) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 13 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.521214  8276 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53484 (request call id 341) took 1655 ms. Trace:
I20260709 13:04:07.522147  8276 rpcz_store.cc:276] 0709 13:04:05.863575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:05.863805 (+   230us) service_pool.cc:224] Handling call
0709 13:04:05.959978 (+ 96173us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b540014ebd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ef090 00007f36c848df3a 00007f36ce2441cc 00007f36ce34237e 00007f36cc8032a4 00007f36cc803232 00007f36cc803161 00007f36cc8030dc 00007f36cc802392 00007f36c67c048c 00007f36c67bf8c6
0709 13:04:07.518505 (+1558527us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:07.348397 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:07.348906 (+   509us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:07.348940 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:04:07.348954 (+    14us) tablet.cc:662] Decoding operations
0709 13:04:07.351147 (+  2193us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:07.351198 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:07.351225 (+    27us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:04:07.361199 (+  9974us) tablet.cc:701] Row locks acquired
0709 13:04:07.361216 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:04:07.361375 (+   159us) write_op.cc:270] Start()
0709 13:04:07.361496 (+   121us) write_op.cc:276] Timestamp: P: 1783602247361320 usec, L: 0
0709 13:04:07.361537 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:04:07.362328 (+   791us) log.cc:844] Serialized 9354 byte log entry
0709 13:04:07.365456 (+  3128us) op_driver.cc:464] REPLICATION: finished
0709 13:04:07.366052 (+   596us) write_op.cc:301] APPLY: starting
0709 13:04:07.366125 (+    73us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:07.377952 (+ 11827us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:07.378066 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:07.432616 (+ 54550us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:07.432919 (+   303us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 13:04:07.432962 (+    43us) write_op.cc:312] APPLY: finished
0709 13:04:07.433438 (+   476us) log.cc:844] Serialized 212 byte log entry
0709 13:04:07.435597 (+  2159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:07.435807 (+   210us) write_op.cc:454] Released schema lock
0709 13:04:07.435867 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:07.446062 (+ 10195us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:07.446093 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":49,"spinlock_wait_cycles":3919232,"child_traces":[["op",{"apply.queue_time_us":354,"apply.run_cpu_time_us":27341,"apply.run_wall_time_us":79965,"cfile_cache_hit":96,"cfile_cache_hit_bytes":100416,"num_ops":24,"prepare.queue_time_us":116,"prepare.run_cpu_time_us":5757,"prepare.run_wall_time_us":17504,"replication_time_us":3767}]]}
I20260709 13:04:07.551481  8277 catalog_manager.cc:5697] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.553817  8277 catalog_manager.cc:5697] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 20 to 21, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 21 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:07.565644  8277 catalog_manager.cc:5697] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.567440  8277 catalog_manager.cc:5697] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:07.570178  8277 catalog_manager.cc:5697] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 17 to 19, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 19 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:07.571540  8277 catalog_manager.cc:5697] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 16 to 17, leader changed from 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 17 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:07.574539  8458 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 24 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:04:07.576642 15608 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:04:07.597476  9293 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:04:07.613241 15608 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:04:07.621331  9293 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:04:07.628523 15608 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:07.629556  8457 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:04:07.630878 15608 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:07.636305  8523 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e1d32431b1c45ebad1160a850495e16 with delete_type TABLET_DATA_TOMBSTONED (TS b8eb0ad4490645598004d862412f4e31 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:55638
I20260709 13:04:07.637892  8520 tablet_service.cc:1558] Processing DeleteTablet for tablet 455c5d2786974d92a3ee8b825edcfaa7 with delete_type TABLET_DATA_TOMBSTONED (TS b8eb0ad4490645598004d862412f4e31 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:55638
W20260709 13:04:07.650731  8282 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53494 (request call id 328) took 75418 ms (client timeout 15000 ms). Trace:
I20260709 13:04:07.652115  8452 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:04:07.653644 15446 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:04:07.651172  8282 rpcz_store.cc:269] 0709 13:02:52.237933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.297582 (+ 59649us) service_pool.cc:224] Handling call
0709 13:04:07.650542 (+75352960us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14206,"reported_tablets":49}
I20260709 13:04:07.725950 15624 tablet_replica.cc:333] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:07.727293 15624 raft_consensus.cc:2243] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.728394 15624 raft_consensus.cc:2272] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:07.741289  8349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 76295.8us
I20260709 13:04:07.750372 15624 ts_tablet_manager.cc:1916] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:07.764207  8277 catalog_manager.cc:5697] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 23 to 24, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 24 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:07.766247  8277 catalog_manager.cc:5697] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 17 to 18, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 18 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:04:07.773422  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 84114.8us
I20260709 13:04:07.851152  9293 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:04:07.882661 15628 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:04:07.909844 15624 ts_tablet_manager.cc:1929] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.12
I20260709 13:04:07.910485 15624 log.cc:1199] T 9e1d32431b1c45ebad1160a850495e16 P b8eb0ad4490645598004d862412f4e31: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-2-root/wals/9e1d32431b1c45ebad1160a850495e16
I20260709 13:04:07.912925  8268 catalog_manager.cc:5028] TS b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): tablet 9e1d32431b1c45ebad1160a850495e16 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:04:07.943689 15624 tablet_replica.cc:333] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:07.955929  8277 catalog_manager.cc:5697] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 21 to 22, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 22 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:07.963655  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:08.065490 15624 raft_consensus.cc:2243] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:08.066514 15624 raft_consensus.cc:2272] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:08.070778 15624 ts_tablet_manager.cc:1916] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:04:08.080672  8278 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53484 (request call id 338) took 57750 ms (client timeout 15000 ms). Trace:
W20260709 13:04:08.081292  8278 rpcz_store.cc:269] 0709 13:03:10.330511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.330780 (+   269us) service_pool.cc:224] Handling call
0709 13:04:08.080541 (+57749761us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5267,"reported_tablets":49}
I20260709 13:04:08.107115 15624 ts_tablet_manager.cc:1929] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 13:04:08.107657 15624 log.cc:1199] T 455c5d2786974d92a3ee8b825edcfaa7 P b8eb0ad4490645598004d862412f4e31: Deleting WAL directory at /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602011513864-7271-0/minicluster-data/ts-2-root/wals/455c5d2786974d92a3ee8b825edcfaa7
I20260709 13:04:08.116858  8280 catalog_manager.cc:5697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 11 to 19. New cstate: current_term: 19 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:08.109282  8268 catalog_manager.cc:5028] TS b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): tablet 455c5d2786974d92a3ee8b825edcfaa7 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:04:08.129690  8523 tablet_service.cc:1558] Processing DeleteTablet for tablet 455c5d2786974d92a3ee8b825edcfaa7 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 12)) from {username='slave'} at 127.0.0.1:55638
I20260709 13:04:08.131296  8268 catalog_manager.cc:5028] TS b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): tablet 455c5d2786974d92a3ee8b825edcfaa7 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:04:08.141345  8523 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e1d32431b1c45ebad1160a850495e16 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 13)) from {username='slave'} at 127.0.0.1:55638
I20260709 13:04:08.142925  8268 catalog_manager.cc:5028] TS b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): tablet 9e1d32431b1c45ebad1160a850495e16 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
W20260709 13:04:08.142441  8281 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53494 (request call id 329) took 59141 ms (client timeout 15000 ms). Trace:
W20260709 13:04:08.154623  8281 rpcz_store.cc:269] 0709 13:03:09.001586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.006973 (+  5387us) service_pool.cc:224] Handling call
0709 13:04:08.083142 (+59076169us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b6800071360. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36ce260de1 00007f36ce23e0ca 00007f36ce23c808 00007f36ce23ae40 00007f36ce342c3e 00007f36cc8032a4 00007f36cc803232 00007f36cc803161 00007f36cc8030dc 00007f36cc802392 00007f36c67c048c
0709 13:04:08.142260 (+ 59118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55562,"reported_tablets":49,"spinlock_wait_cycles":8921472}
W20260709 13:04:08.175469  8427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 65555.7us
W20260709 13:04:08.254238  8280 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53486 (request call id 350) took 15432 ms (client timeout 15000 ms). Trace:
W20260709 13:04:08.263818  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 68005.6us
W20260709 13:04:08.261600  8280 rpcz_store.cc:269] 0709 13:03:52.821858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.749439 (+2927581us) service_pool.cc:224] Handling call
0709 13:03:56.521953 (+772514us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b5400300110. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c53610b2 00007f36ce2daa89 00007f36ce272da6 00007f36ce244088 00007f36ce34237e 00007f36cc8032a4 00007f36cc803232 00007f36cc803161 00007f36cc8030dc
0709 13:04:08.152223 (+11630270us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:08.152250 (+    27us) write_op.cc:454] Released schema lock
0709 13:04:08.254162 (+101912us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:08.143877 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:08.144454 (+   577us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:08.144487 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:04:08.144507 (+    20us) tablet.cc:662] Decoding operations
0709 13:04:08.144843 (+   336us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:08.144904 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:08.144945 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:08.145151 (+   206us) tablet.cc:701] Row locks acquired
0709 13:04:08.145171 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:04:08.145331 (+   160us) write_op.cc:270] Start()
0709 13:04:08.145439 (+   108us) write_op.cc:276] Timestamp: P: 1783602248145276 usec, L: 0
0709 13:04:08.145462 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:04:08.146140 (+   678us) log.cc:844] Serialized 538 byte log entry
0709 13:04:08.148228 (+  2088us) op_driver.cc:464] REPLICATION: finished
0709 13:04:08.148646 (+   418us) write_op.cc:301] APPLY: starting
0709 13:04:08.148733 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:08.149649 (+   916us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:08.149753 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:08.150561 (+   808us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:08.150735 (+   174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:04:08.150788 (+    53us) write_op.cc:312] APPLY: finished
0709 13:04:08.151003 (+   215us) log.cc:844] Serialized 25 byte log entry
0709 13:04:08.151163 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:08.151245 (+    82us) write_op.cc:454] Released schema lock
0709 13:04:08.151284 (+    39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":43128,"reported_tablets":49,"spinlock_wait_cycles":4897024,"child_traces":[["op",{"apply.queue_time_us":234,"apply.run_cpu_time_us":2897,"apply.run_wall_time_us":2897,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4184,"num_ops":1,"prepare.queue_time_us":3916,"prepare.run_cpu_time_us":2571,"prepare.run_wall_time_us":2571,"replication_time_us":2637}]]}
W20260709 13:04:08.428995  8275 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53484 (request call id 340) took 18111 ms (client timeout 15000 ms). Trace:
W20260709 13:04:08.461329  8275 rpcz_store.cc:269] 0709 13:03:50.318064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.321311 (+  3247us) service_pool.cc:224] Handling call
0709 13:04:08.428873 (+18107562us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17564,"reported_tablets":49}
W20260709 13:04:08.562500  8279 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53486 (request call id 349) took 34723 ms (client timeout 15000 ms). Trace:
W20260709 13:04:08.562955  8279 rpcz_store.cc:269] 0709 13:03:33.843508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.844591 (+  1083us) service_pool.cc:224] Handling call
0709 13:03:34.856623 (+1012032us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540014ebd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ef090 00007f36c848df3a 00007f36ce2441cc 00007f36ce34237e 00007f36cc8032a4 00007f36cc803232 00007f36cc803161 00007f36cc8030dc 00007f36cc802392 00007f36c67c048c 00007f36c67bf8c6
0709 13:04:08.562241 (+33705618us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75594,"reported_tablets":49,"spinlock_wait_cycles":323726464}
I20260709 13:04:08.613754  8523 tablet_service.cc:1558] Processing DeleteTablet for tablet 455c5d2786974d92a3ee8b825edcfaa7 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 12)) from {username='slave'} at 127.0.0.1:55638
I20260709 13:04:08.622428  8268 catalog_manager.cc:5028] TS b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): tablet 455c5d2786974d92a3ee8b825edcfaa7 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:04:08.634629  8523 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e1d32431b1c45ebad1160a850495e16 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 13)) from {username='slave'} at 127.0.0.1:55638
W20260709 13:04:08.635696  8284 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53494 (request call id 330) took 37849 ms (client timeout 15000 ms). Trace:
W20260709 13:04:08.636116  8284 rpcz_store.cc:269] 0709 13:03:30.786528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.786816 (+   288us) service_pool.cc:224] Handling call
0709 13:03:32.046845 (+1260029us) spinlock_profiling.cc:243] Waited 7.11 ms on lock 0x7b5400300110. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c53610b2 00007f36ce2daa89 00007f36ce272da6 00007f36ce244088 00007f36ce34237e 00007f36cc8032a4 00007f36cc803232 00007f36cc803161 00007f36cc8030dc
0709 13:04:08.635509 (+36588664us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151756,"reported_tablets":49,"spinlock_wait_cycles":16363904}
I20260709 13:04:08.638952  8268 catalog_manager.cc:5028] TS b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): tablet 9e1d32431b1c45ebad1160a850495e16 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:04:08.679948  8283 catalog_manager.cc:5697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } }
I20260709 13:04:08.705786  8283 catalog_manager.cc:5697] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 20 to 22, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 22 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:08.769773  8380 consensus_queue.cc:237] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:04:08.799016  8452 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:04:08.803194 15446 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:08.807360  8533 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:04:08.809216 15446 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:04:08.813671  8351 consensus_peers.cc:597] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf76dc240f6a432d80b0c04f50f2d9b6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:08.844190 15532 raft_consensus.cc:2955] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:04:08.867046  8457 raft_consensus.cc:2955] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:04:08.917492  8533 raft_consensus.cc:2955] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
W20260709 13:04:08.919528  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 81693.2us
I20260709 13:04:08.995261  8457 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:04:09.003996  8280 catalog_manager.cc:5697] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:09.007221  8523 tablet_service.cc:1558] Processing DeleteTablet for tablet 455c5d2786974d92a3ee8b825edcfaa7 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 12)) from {username='slave'} at 127.0.0.1:55638
I20260709 13:04:09.007537  8520 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e1d32431b1c45ebad1160a850495e16 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 13)) from {username='slave'} at 127.0.0.1:55638
I20260709 13:04:09.009855  8283 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53494 (request call id 332) took 2422 ms. Trace:
I20260709 13:04:09.010003  8268 catalog_manager.cc:5028] TS b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): tablet 455c5d2786974d92a3ee8b825edcfaa7 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:04:09.011323  8268 catalog_manager.cc:5028] TS b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): tablet 9e1d32431b1c45ebad1160a850495e16 (table test-workload [id=0997156cc4e34396a3ae068cffc60d9c]) successfully deleted
I20260709 13:04:09.011979  8283 rpcz_store.cc:276] 0709 13:04:06.587802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.982911 (+395109us) service_pool.cc:224] Handling call
0709 13:04:09.009783 (+2026872us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:08.734674 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:08.740560 (+  5886us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:08.740600 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:04:08.740622 (+    22us) tablet.cc:662] Decoding operations
0709 13:04:08.742065 (+  1443us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:08.742158 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:08.742193 (+    35us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:04:08.742527 (+   334us) tablet.cc:701] Row locks acquired
0709 13:04:08.742555 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:04:08.742690 (+   135us) write_op.cc:270] Start()
0709 13:04:08.742822 (+   132us) write_op.cc:276] Timestamp: P: 1783602248742644 usec, L: 0
0709 13:04:08.760243 (+ 17421us) op_driver.cc:348] REPLICATION: starting
0709 13:04:08.760951 (+   708us) log.cc:844] Serialized 923 byte log entry
0709 13:04:08.787780 (+ 26829us) op_driver.cc:464] REPLICATION: finished
0709 13:04:08.833741 (+ 45961us) write_op.cc:301] APPLY: starting
0709 13:04:08.833860 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:08.842939 (+  9079us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:08.844230 (+  1291us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:08.845920 (+  1690us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:08.846192 (+   272us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:04:08.846267 (+    75us) write_op.cc:312] APPLY: finished
0709 13:04:08.846534 (+   267us) log.cc:844] Serialized 33 byte log entry
0709 13:04:08.862143 (+ 15609us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:08.862232 (+    89us) write_op.cc:454] Released schema lock
0709 13:04:08.862274 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:08.869449 (+  7175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:08.869498 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2899,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":45616,"apply.run_cpu_time_us":6073,"apply.run_wall_time_us":35654,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12495,"num_ops":2,"prepare.queue_time_us":11802,"prepare.run_cpu_time_us":3049,"prepare.run_wall_time_us":37907,"replication_time_us":27363,"thread_start_us":48651,"threads_started":2}]]}
I20260709 13:04:09.080932  8283 catalog_manager.cc:5697] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index -1 to 12, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 19 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
W20260709 13:04:09.082248  8426 consensus_peers.cc:597] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4269b37b5f3540ba9fcfd6d23ad240b6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:09.090878  8533 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:04:09.092554 15635 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:09.103688  8276 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53484 (request call id 342) took 1529 ms. Trace:
I20260709 13:04:09.104158  8276 rpcz_store.cc:276] 0709 13:04:07.574366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:07.576959 (+  2593us) service_pool.cc:224] Handling call
0709 13:04:09.103620 (+1526661us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26842,"reported_tablets":11}
I20260709 13:04:09.118853  8378 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:04:09.120807 15606 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:09.124953 15635 raft_consensus.cc:2955] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index -1 to 16, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:04:09.177944  8533 raft_consensus.cc:2955] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index -1 to 16, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:04:09.197893  8378 raft_consensus.cc:2955] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index -1 to 16, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:04:09.224677  8284 catalog_manager.cc:5697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index -1 to 16, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 22 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:04:09.315106  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:09.378023 15658 ts_tablet_manager.cc:933] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631)
I20260709 13:04:09.395457  8534 consensus_queue.cc:237] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:04:09.397373 15658 tablet_copy_client.cc:323] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.193:43631
I20260709 13:04:09.399636  8396 tablet_copy_service.cc:140] P d653e71832b7402b9a03b46249d3b885: Received BeginTabletCopySession request for tablet bf76dc240f6a432d80b0c04f50f2d9b6 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:48484)
I20260709 13:04:09.400250  8396 tablet_copy_service.cc:161] P d653e71832b7402b9a03b46249d3b885: Beginning new tablet copy session on tablet bf76dc240f6a432d80b0c04f50f2d9b6 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:48484: session id = 446d9310dce14ff4afff2dc2d64f68d8-bf76dc240f6a432d80b0c04f50f2d9b6
I20260709 13:04:09.412365  8396 tablet_copy_source_session.cc:215] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:09.422674  8452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45d39340781e466abc648aacd7ee5822"
dest_uuid: "105d6581548546b98eddd4ee7083bb12"
mode: GRACEFUL
new_leader_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:43296
I20260709 13:04:09.423241  8452 raft_consensus.cc:606] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 22 LEADER]: Received request to transfer leadership to TS d653e71832b7402b9a03b46249d3b885
I20260709 13:04:09.425002  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:04:09.426882  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:09.429167 15658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf76dc240f6a432d80b0c04f50f2d9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:09.431318  8452 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:04:09.433447  8500 consensus_peers.cc:597] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67513665d04b44c292143601e7f66ac8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:09.434898 15546 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:09.466982 15658 tablet_copy_client.cc:806] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:09.468246 15658 tablet_copy_client.cc:670] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:09.472071 15546 raft_consensus.cc:2955] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:04:09.474658 15658 tablet_copy_client.cc:538] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:09.474113  8460 raft_consensus.cc:2955] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:04:09.492549  8380 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:04:09.494547 15612 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:09.498333  8280 catalog_manager.cc:5697] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index -1 to 13, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 17 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:04:09.506628 15658 tablet_bootstrap.cc:492] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:04:09.529027  8534 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:04:09.540292  8380 raft_consensus.cc:2955] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
W20260709 13:04:09.601250  8500 consensus_peers.cc:597] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 -> Peer 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669): Couldn't send request to peer 446d9310dce14ff4afff2dc2d64f68d8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dc2c20c2ffc24a6cb95e8c2fe8a8c025. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:09.608006  8460 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:04:09.609683 15661 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:09.621976  8380 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:04:09.625762 15661 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:09.627969 15665 ts_tablet_manager.cc:933] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:09.657584 15665 tablet_copy_client.cc:323] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.194:36925
I20260709 13:04:09.667724  8471 tablet_copy_service.cc:140] P 105d6581548546b98eddd4ee7083bb12: Received BeginTabletCopySession request for tablet 4269b37b5f3540ba9fcfd6d23ad240b6 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:53010)
I20260709 13:04:09.668725  8471 tablet_copy_service.cc:161] P 105d6581548546b98eddd4ee7083bb12: Beginning new tablet copy session on tablet 4269b37b5f3540ba9fcfd6d23ad240b6 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:53010: session id = 446d9310dce14ff4afff2dc2d64f68d8-4269b37b5f3540ba9fcfd6d23ad240b6
I20260709 13:04:09.681146 15612 raft_consensus.cc:2955] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index -1 to 15, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:04:09.690428  8460 raft_consensus.cc:2955] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index -1 to 15, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:04:09.741902  8471 tablet_copy_source_session.cc:215] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:09.767457 15665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4269b37b5f3540ba9fcfd6d23ad240b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:09.775112  8284 catalog_manager.cc:5697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index -1 to 15, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New cstate: current_term: 23 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:04:09.783152 15652 raft_consensus.cc:993] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12: : Instructing follower d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:04:09.783744 15652 raft_consensus.cc:1081] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 22 LEADER]: Signalling peer d653e71832b7402b9a03b46249d3b885 to start an election
I20260709 13:04:09.788399  8378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45d39340781e466abc648aacd7ee5822"
dest_uuid: "d653e71832b7402b9a03b46249d3b885"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:04:09.789048  8378 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:09.789418  8378 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:09.794917 15665 tablet_copy_client.cc:806] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:09.795841 15665 tablet_copy_client.cc:670] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:09.804594  8378 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:09.817742  8378 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 23 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:09.818976 15665 tablet_copy_client.cc:538] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:09.819366  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:09.819985  8534 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:09.819900  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:09.820916  8452 raft_consensus.cc:3055] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:04:09.821380  8452 raft_consensus.cc:740] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:04:09.822374  8452 consensus_queue.cc:260] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:09.823825  8452 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:09.828176  8534 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 23.
I20260709 13:04:09.829411  8349 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885; no voters: 
I20260709 13:04:09.830456 15532 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:09.831007 15532 raft_consensus.cc:697] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 23 LEADER]: Becoming Leader. State: Replica: d653e71832b7402b9a03b46249d3b885, State: Running, Role: LEADER
I20260709 13:04:09.841912  8452 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d653e71832b7402b9a03b46249d3b885 in term 23.
I20260709 13:04:09.846307 15532 consensus_queue.cc:237] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:09.847215  8380 raft_consensus.cc:2955] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index -1 to 15, NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } } }
I20260709 13:04:09.877138 15665 tablet_bootstrap.cc:492] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:04:09.912156 15658 tablet_bootstrap.cc:492] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:09.913136 15658 tablet_bootstrap.cc:492] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:04:09.913904 15658 ts_tablet_manager.cc:1403] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.408s	user 0.090s	sys 0.072s
I20260709 13:04:09.916706 15658 raft_consensus.cc:359] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:04:09.927192 15658 raft_consensus.cc:740] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:04:09.928488 15658 consensus_queue.cc:260] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:04:09.931784 15658 ts_tablet_manager.cc:1434] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:04:09.938370  8396 tablet_copy_service.cc:342] P d653e71832b7402b9a03b46249d3b885: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-bf76dc240f6a432d80b0c04f50f2d9b6 received from {username='slave'} at 127.0.0.1:48484
I20260709 13:04:09.938907  8396 tablet_copy_service.cc:434] P d653e71832b7402b9a03b46249d3b885: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-bf76dc240f6a432d80b0c04f50f2d9b6 on tablet bf76dc240f6a432d80b0c04f50f2d9b6 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:09.943627  8284 catalog_manager.cc:5697] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 reported cstate change: term changed from 22 to 23, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to d653e71832b7402b9a03b46249d3b885 (127.7.25.193). New cstate: current_term: 23 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.965276 15658 ts_tablet_manager.cc:933] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:10.010859 15665 tablet_bootstrap.cc:492] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=0 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:10.012197 15665 tablet_bootstrap.cc:492] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:04:10.013286 15665 ts_tablet_manager.cc:1403] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.156s	user 0.040s	sys 0.021s
I20260709 13:04:10.026809 15665 raft_consensus.cc:359] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:04:10.029531 15665 raft_consensus.cc:740] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:04:10.030409 15665 consensus_queue.cc:260] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:04:10.036526 15658 tablet_copy_client.cc:323] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.195:40767
I20260709 13:04:10.042358  8544 tablet_copy_service.cc:140] P b8eb0ad4490645598004d862412f4e31: Received BeginTabletCopySession request for tablet 67513665d04b44c292143601e7f66ac8 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:47306)
I20260709 13:04:10.043017  8544 tablet_copy_service.cc:161] P b8eb0ad4490645598004d862412f4e31: Beginning new tablet copy session on tablet 67513665d04b44c292143601e7f66ac8 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:47306: session id = 446d9310dce14ff4afff2dc2d64f68d8-67513665d04b44c292143601e7f66ac8
I20260709 13:04:10.078088  8544 tablet_copy_source_session.cc:215] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:10.080480 15665 ts_tablet_manager.cc:1434] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.001s
I20260709 13:04:10.084241 15658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67513665d04b44c292143601e7f66ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.087939  8471 tablet_copy_service.cc:342] P 105d6581548546b98eddd4ee7083bb12: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-4269b37b5f3540ba9fcfd6d23ad240b6 received from {username='slave'} at 127.0.0.1:53010
I20260709 13:04:10.088590  8471 tablet_copy_service.cc:434] P 105d6581548546b98eddd4ee7083bb12: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-4269b37b5f3540ba9fcfd6d23ad240b6 on tablet 4269b37b5f3540ba9fcfd6d23ad240b6 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:10.147033 15658 tablet_copy_client.cc:806] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:10.147845 15658 tablet_copy_client.cc:670] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:10.161175 15658 tablet_copy_client.cc:538] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:10.172959  9292 raft_consensus.cc:1217] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 LEARNER]: Deduplicated request from leader. Original: 22.15->[22.16-22.16]   Dedup: 22.16->[]
I20260709 13:04:10.183854 15665 ts_tablet_manager.cc:933] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8: Initiating tablet copy from peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:10.197351 15658 tablet_bootstrap.cc:492] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:04:10.257194 15665 tablet_copy_client.cc:323] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Beginning tablet copy session from remote peer at address 127.7.25.195:40767
I20260709 13:04:10.258997  8544 tablet_copy_service.cc:140] P b8eb0ad4490645598004d862412f4e31: Received BeginTabletCopySession request for tablet dc2c20c2ffc24a6cb95e8c2fe8a8c025 from peer 446d9310dce14ff4afff2dc2d64f68d8 ({username='slave'} at 127.0.0.1:47306)
I20260709 13:04:10.259575  8544 tablet_copy_service.cc:161] P b8eb0ad4490645598004d862412f4e31: Beginning new tablet copy session on tablet dc2c20c2ffc24a6cb95e8c2fe8a8c025 from peer 446d9310dce14ff4afff2dc2d64f68d8 at {username='slave'} at 127.0.0.1:47306: session id = 446d9310dce14ff4afff2dc2d64f68d8-dc2c20c2ffc24a6cb95e8c2fe8a8c025
I20260709 13:04:10.276507  8544 tablet_copy_source_session.cc:215] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:10.305116 15665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2c20c2ffc24a6cb95e8c2fe8a8c025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.365520  8534 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:04:10.367254 15532 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:10.376854  8460 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:04:10.378813 15672 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:04:10.427996  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:10.515061 15658 tablet_bootstrap.cc:492] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:10.515585 15665 tablet_copy_client.cc:806] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:10.516276 15665 tablet_copy_client.cc:670] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:10.516355 15658 tablet_bootstrap.cc:492] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:04:10.520428 15665 tablet_copy_client.cc:538] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:10.529455 15658 ts_tablet_manager.cc:1403] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.332s	user 0.046s	sys 0.011s
I20260709 13:04:10.535931 15658 raft_consensus.cc:359] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:04:10.556623 15665 tablet_bootstrap.cc:492] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap starting.
I20260709 13:04:10.576328  9292 raft_consensus.cc:1217] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.11->[19.12-19.12]   Dedup: 19.12->[]
I20260709 13:04:10.585196 15658 raft_consensus.cc:740] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:04:10.586074 15658 consensus_queue.cc:260] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:04:10.588786 15658 ts_tablet_manager.cc:1434] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.002s
I20260709 13:04:10.608167  8544 tablet_copy_service.cc:342] P b8eb0ad4490645598004d862412f4e31: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-67513665d04b44c292143601e7f66ac8 received from {username='slave'} at 127.0.0.1:47306
I20260709 13:04:10.608686  8544 tablet_copy_service.cc:434] P b8eb0ad4490645598004d862412f4e31: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-67513665d04b44c292143601e7f66ac8 on tablet 67513665d04b44c292143601e7f66ac8 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:10.758662 15693 raft_consensus.cc:1064] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
W20260709 13:04:10.784685  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 163992us
I20260709 13:04:10.803663 15693 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 14, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:10.858731  9293 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 LEARNER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:04:10.863525 15635 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:10.866614  9287 raft_consensus.cc:1217] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.12->[17.13-17.13]   Dedup: 17.13->[]
I20260709 13:04:10.869014  8385 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:04:10.893325 15635 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:04:10.925375  8535 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:04:10.982877 15665 tablet_bootstrap.cc:492] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=1 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:10.983888 15665 tablet_bootstrap.cc:492] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8: Bootstrap complete.
I20260709 13:04:10.984586 15692 raft_consensus.cc:2955] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 22 LEADER]: Committing config change with OpId 22.17: config changed from index 16 to 17, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:10.984634 15665 ts_tablet_manager.cc:1403] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent bootstrapping tablet: real 0.428s	user 0.048s	sys 0.013s
I20260709 13:04:10.991667 15687 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:04:10.988031  8378 raft_consensus.cc:2955] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 16 to 17, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:11.016716  9292 raft_consensus.cc:2955] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 16 to 17, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:11.028998 15665 raft_consensus.cc:359] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:04:11.029990 15665 raft_consensus.cc:740] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Initialized, Role: LEARNER
I20260709 13:04:11.030655 15665 consensus_queue.cc:260] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:04:11.037784 15665 ts_tablet_manager.cc:1434] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8: Time spent starting tablet: real 0.032s	user 0.001s	sys 0.004s
I20260709 13:04:11.036891  8533 raft_consensus.cc:2955] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 16 to 17, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:11.039590  8544 tablet_copy_service.cc:342] P b8eb0ad4490645598004d862412f4e31: Request end of tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-dc2c20c2ffc24a6cb95e8c2fe8a8c025 received from {username='slave'} at 127.0.0.1:47306
I20260709 13:04:11.040035  8544 tablet_copy_service.cc:434] P b8eb0ad4490645598004d862412f4e31: ending tablet copy session 446d9310dce14ff4afff2dc2d64f68d8-dc2c20c2ffc24a6cb95e8c2fe8a8c025 on tablet dc2c20c2ffc24a6cb95e8c2fe8a8c025 with peer 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:11.131313  7271 tablet_server.cc:179] TabletServer@127.7.25.193:0 shutting down...
I20260709 13:04:11.148646  8276 catalog_manager.cc:5697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 reported cstate change: config changed from index 16 to 17, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:04:11.187623  8427 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 13:04:11.304769  9261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 48269us
I20260709 13:04:11.405578 15698 raft_consensus.cc:1064] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
W20260709 13:04:11.416904  8427 consensus_peers.cc:597] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.424319  8427 consensus_peers.cc:597] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.433207  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 123881us
W20260709 13:04:11.443656  8427 consensus_peers.cc:597] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.447274  8427 consensus_peers.cc:597] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.451149  8427 consensus_peers.cc:597] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.409581 15698 consensus_queue.cc:237] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:11.490935 15672 raft_consensus.cc:1064] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:04:11.517382  9292 raft_consensus.cc:1217] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 LEARNER]: Deduplicated request from leader. Original: 23.14->[23.15-23.15]   Dedup: 23.15->[]
I20260709 13:04:11.515291 15672 consensus_queue.cc:237] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:11.580210  8427 consensus_peers.cc:597] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.580874  8427 consensus_peers.cc:597] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.581450  8427 consensus_peers.cc:597] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.583020  8452 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:04:11.595374 15612 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:04:11.591919  9261 consensus_peers.cc:597] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.590682  8427 consensus_peers.cc:597] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.622205  9293 raft_consensus.cc:1275] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEARNER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:04:11.616465  8427 consensus_peers.cc:597] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.635038  8535 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:04:11.636142 15689 consensus_queue.cc:1048] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
W20260709 13:04:11.650161  8427 consensus_peers.cc:597] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.655396  8427 consensus_peers.cc:597] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.669701  8501 consensus_peers.cc:597] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.670526  8501 consensus_peers.cc:597] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.671134  8501 consensus_peers.cc:597] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.673997  8501 consensus_peers.cc:597] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.674994 15683 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:11.694962  9291 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 LEARNER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:04:11.724694 15680 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:11.733315 15689 raft_consensus.cc:2955] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:11.753887  8458 raft_consensus.cc:2955] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:04:11.757705  9261 consensus_peers.cc:597] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.759188  9261 consensus_peers.cc:597] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.759130  8452 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Refusing update from remote peer d653e71832b7402b9a03b46249d3b885: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:04:11.760265  9261 consensus_peers.cc:597] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.762969  9261 consensus_peers.cc:597] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.763623  9261 consensus_peers.cc:597] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.764305  9261 consensus_peers.cc:597] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.764922  9261 consensus_peers.cc:597] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.769047  8501 consensus_peers.cc:597] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.770355  9261 consensus_peers.cc:597] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.770761  8501 consensus_peers.cc:597] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.770999  9261 consensus_peers.cc:597] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.771806  8501 consensus_peers.cc:597] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.773840  8501 consensus_peers.cc:597] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.777973  8501 consensus_peers.cc:597] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.783083  8501 consensus_peers.cc:597] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.784185  8501 consensus_peers.cc:597] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.796406 15672 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:11.798144  9291 raft_consensus.cc:2955] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
W20260709 13:04:11.850617  8501 consensus_peers.cc:597] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.851702  8501 consensus_peers.cc:597] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.858892 15683 raft_consensus.cc:2955] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:11.909628  8276 catalog_manager.cc:5697] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: config changed from index 13 to 14, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:11.920521  9292 raft_consensus.cc:2955] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:11.938194  8535 raft_consensus.cc:2955] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:11.947580  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:11.956036  7271 tablet_replica.cc:333] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:11.957228  7271 raft_consensus.cc:2243] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:04:11.958567  7271 raft_consensus.cc:2272] T 5b3df375d584465c8712d996256828cf P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:11.962605  8457 raft_consensus.cc:2955] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:12.009568  7271 tablet_replica.cc:333] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.010731  7271 raft_consensus.cc:2243] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.011713  7271 raft_consensus.cc:2272] T 37c1890dcc8947c89b8c213326526c75 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.054015 15672 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:12.054706 15672 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:12.057428 15672 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:12.061642  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.062232 15612 raft_consensus.cc:1064] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31: attempting to promote NON_VOTER 446d9310dce14ff4afff2dc2d64f68d8 to VOTER
I20260709 13:04:12.058728  7271 tablet_replica.cc:333] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.063561  7271 raft_consensus.cc:2243] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.064530  7271 raft_consensus.cc:2272] T 612cbe4a26f4473aaa8e3c84a7719e03 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.065721 15612 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 13, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:12.067940  7271 tablet_replica.cc:333] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.081486  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c80796a5190345179ad066af334e5bae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:12.083293 15683 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:12.083986 15683 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:12.089358  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.068949  7271 raft_consensus.cc:2243] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:12.094759  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa98ca5e34b24545adab36c2973a2f6e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:12.096450  8457 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:12.094296  8351 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:12.092947 15683 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:12.106236 15684 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:12.112458  7271 raft_consensus.cc:2272] T 45d39340781e466abc648aacd7ee5822 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.116080  7271 tablet_replica.cc:333] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.117583  9293 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 LEARNER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:04:12.120460 15684 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:12.122400  8452 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:04:12.080291  8280 catalog_manager.cc:5697] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: config changed from index 12 to 13, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "d653e71832b7402b9a03b46249d3b885" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:12.154098  7271 raft_consensus.cc:2243] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.155198  7271 raft_consensus.cc:2272] T 9e1d32431b1c45ebad1160a850495e16 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.152266 15612 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 13:04:12.158289  7271 tablet_replica.cc:333] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.158448  9293 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:04:12.159446 15698 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:12.153208  8351 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:12.164029 15672 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:12.164021 15635 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.003s
I20260709 13:04:12.159463  7271 raft_consensus.cc:2243] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.178678 15684 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:12.182742 15684 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:12.190086  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.196204  8534 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:04:12.198597 15635 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:04:12.217360  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 51478.4us
W20260709 13:04:12.222786  8501 consensus_peers.cc:597] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:12.222815  7271 raft_consensus.cc:2272] T fd3ca20a5e4646d3b164329f7abcf44a P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.228569  7271 tablet_replica.cc:333] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.249526  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6762ba0124b3a87dd4d54f5693927" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:12.257550 15684 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:12.258289 15684 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:12.259780 15683 raft_consensus.cc:493] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:12.260403 15683 raft_consensus.cc:515] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:12.261044  7271 raft_consensus.cc:2243] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.261926 15680 raft_consensus.cc:493] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:12.262723 15683 leader_election.cc:290] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:12.262584 15680 raft_consensus.cc:515] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:12.261821  7271 raft_consensus.cc:2272] T 4ef8cc956c764eeeb9389ea099a35006 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.264605 15635 raft_consensus.cc:2955] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 22 LEADER]: Committing config change with OpId 22.18: config changed from index 17 to 18, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:12.267258  7271 tablet_replica.cc:333] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.268252  7271 raft_consensus.cc:2243] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:04:12.270031  8351 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:12.270762 15680 leader_election.cc:290] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:12.270939 15683 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:12.270298  8533 raft_consensus.cc:2955] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Committing config change with OpId 22.18: config changed from index 17 to 18, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:12.271770  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:12.273710  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455c5d2786974d92a3ee8b825edcfaa7" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:12.274473  9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:12.276564  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.280215 15612 raft_consensus.cc:2955] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 23 LEADER]: Committing config change with OpId 23.16: config changed from index 15 to 16, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:12.285913  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7142cc29d84f4204bd97e07c0f6f6a84" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:12.286551  8351 leader_election.cc:304] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:12.287472 15672 raft_consensus.cc:2749] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:12.294327  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ecd063b1dc49a69b15eb593af51b89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:12.301352  7271 raft_consensus.cc:2272] T 9c3c85d53de1420dab74923e2fc80f02 P d653e71832b7402b9a03b46249d3b885 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.303369  8349 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:12.304603 15683 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:12.306609  7271 tablet_replica.cc:333] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.312920  8351 leader_election.cc:304] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:12.317823 15683 raft_consensus.cc:2749] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:12.319238  9293 raft_consensus.cc:2955] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:12.317643  7271 raft_consensus.cc:2243] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.325660  7271 raft_consensus.cc:2272] T 455c5d2786974d92a3ee8b825edcfaa7 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.326013 15684 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:12.346289  8270 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4269b37b5f3540ba9fcfd6d23ad240b6 with cas_config_opid_index 17: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:12.349946 15680 raft_consensus.cc:493] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:12.350862 15680 raft_consensus.cc:515] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:12.353732  7271 tablet_replica.cc:333] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.353838 15680 leader_election.cc:290] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:12.355073  7271 raft_consensus.cc:2243] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.355886  7271 raft_consensus.cc:2272] T a6ecd063b1dc49a69b15eb593af51b89 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.357292  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.363006 15683 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:12.363833 15684 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:12.363637 15683 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:12.364459 15684 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:12.365963 15683 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:12.366457 15684 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:12.366977 15684 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:12.368439 15672 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:12.370605  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:12.371932 15672 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:12.376003  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:12.376643 15683 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:12.377285 15683 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:12.379518  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:12.381313 15694 raft_consensus.cc:493] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:12.381942 15694 raft_consensus.cc:515] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:12.383582 15532 raft_consensus.cc:493] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:12.384151 15532 raft_consensus.cc:515] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:12.386044 15694 leader_election.cc:290] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:12.386175 15683 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:12.371160  7271 tablet_replica.cc:333] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.375509 15672 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:12.388355 15532 leader_election.cc:290] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:12.402431 15532 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:12.389453  7271 raft_consensus.cc:2243] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:12.403656 15532 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:04:12.404632  7271 raft_consensus.cc:2272] T 30e70dfc88914a66b000a84bef302149 P d653e71832b7402b9a03b46249d3b885 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.405964 15532 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:12.406797  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:12.407457  7271 tablet_replica.cc:333] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.408607  7271 raft_consensus.cc:2243] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.371652 15684 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:12.410848 15684 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:12.416056  7271 raft_consensus.cc:2272] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.390153 15683 raft_consensus.cc:493] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:12.418074  9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27bb2ddbf1e4b7daa5333a909bbaf31" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:12.418439  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:12.418735  9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:12.394294  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:12.400108 15694 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:12.419791 15684 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:12.416441  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866f457c2bf048109ab977c2b010de5a" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:12.420436 15684 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:12.420092 15694 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: NON_VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: true } }
I20260709 13:04:12.422603 15684 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:12.423075 15684 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:12.423210  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:12.423544 15694 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:12.423558 15684 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:12.427884  7271 tablet_replica.cc:333] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.427666  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a5ca9d87124561a0ec4d39bdfdf577" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.432406  7271 raft_consensus.cc:2243] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.428800  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a457c771b2be434bb71c63fe617485e1" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.433029  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:12.431668  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:12.417279 15683 raft_consensus.cc:515] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:12.435988 15683 leader_election.cc:290] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:12.433279  7271 raft_consensus.cc:2272] T 0cd574dc2f1347e8996cdb77177d1a54 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.429697 15684 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:12.440449  7271 tablet_replica.cc:333] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.441368  7271 raft_consensus.cc:2243] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:12.442552  7271 raft_consensus.cc:2272] T f8ce47d03b224808b5f7f17c341a5293 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.443040  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911fa6f4e14f47f6a76fff18a00cd58e" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.443315  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb2781af004accaffe494aebc4c13c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.436295  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:12.445351  7271 tablet_replica.cc:333] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.446727  7271 raft_consensus.cc:2243] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.447592  7271 raft_consensus.cc:2272] T 56cc480ba6f642e08bb2e547a0ef50a1 P d653e71832b7402b9a03b46249d3b885 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.451100  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:12.455044  7271 tablet_replica.cc:333] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.467316  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427ce7790bd4629985d340936d6f356" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:12.467435  8351 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:12.465698  8280 catalog_manager.cc:5697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index 17 to 18, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New cstate: current_term: 22 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:12.472848  8351 leader_election.cc:304] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:12.474552  8351 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:12.477591 15684 raft_consensus.cc:493] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:12.478232 15684 raft_consensus.cc:515] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:12.479943 15532 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:12.480440 15684 leader_election.cc:290] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:12.480679 15532 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:12.483151 15532 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:12.483696  7271 raft_consensus.cc:2243] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.489454 15680 raft_consensus.cc:2749] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:04:12.491061  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:12.492277  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1ae2a0b869453e80401c580552e127" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:12.492177  9292 raft_consensus.cc:2955] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Committing config change with OpId 22.18: config changed from index 17 to 18, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:12.495924  7271 raft_consensus.cc:2272] T aa98ca5e34b24545adab36c2973a2f6e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.490419 15672 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:12.475234 15683 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:12.499647  7271 tablet_replica.cc:333] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.500489  7271 raft_consensus.cc:2243] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.506410  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:12.508258  7271 raft_consensus.cc:2272] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.509574 15683 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:12.510965 15672 raft_consensus.cc:493] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:12.510877  8351 leader_election.cc:304] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:12.504446 15684 raft_consensus.cc:493] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:12.539007 15672 raft_consensus.cc:515] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:12.539786 15684 raft_consensus.cc:515] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:12.539795 15694 raft_consensus.cc:2749] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:12.536875 15683 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:12.543872  7271 tablet_replica.cc:333] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.544729  7271 raft_consensus.cc:2243] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.546936 15532 raft_consensus.cc:493] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:12.547470 15532 raft_consensus.cc:515] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:12.549347 15672 leader_election.cc:290] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:12.549919 15672 raft_consensus.cc:493] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 446d9310dce14ff4afff2dc2d64f68d8)
I20260709 13:04:12.550443  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:12.550890 15672 raft_consensus.cc:515] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:12.554819  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:12.571882 15532 leader_election.cc:290] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:12.583964  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:12.585987 15683 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:12.589466  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:12.591435  8351 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8
I20260709 13:04:12.592453  7271 raft_consensus.cc:2272] T e27bb2ddbf1e4b7daa5333a909bbaf31 P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.593259 15694 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:12.591531 15684 leader_election.cc:290] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:12.595633  7271 tablet_replica.cc:333] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.605440  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:12.588958  8349 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:12.609560  7271 raft_consensus.cc:2243] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.605321  8283 catalog_manager.cc:5697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index 15 to 16, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.615202 15672 leader_election.cc:290] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:12.616882  8349 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:12.617228  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:12.618139 15672 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:12.619390  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 92989.8us
I20260709 13:04:12.622412  8349 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:12.623116 15683 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:12.623739 15683 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:12.625871  7271 raft_consensus.cc:2272] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.629629  8349 leader_election.cc:304] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:12.632359 15672 raft_consensus.cc:2749] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:12.635680  8460 raft_consensus.cc:2955] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } attrs { replace: true } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:12.639987  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eedf264cd691413dbd2eec9e2b133ddf" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.644934  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83390ed01194281aab5dc3a33f49783" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.645591  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2c20c2ffc24a6cb95e8c2fe8a8c025" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.646327 15672 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:12.646919 15672 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:12.649518 15672 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:12.650578  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:12.650815 15672 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:12.651531 15672 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:12.652467  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564c455d9a5b45a4ac479c57433dcb89" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.653918  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b8dc23aaf4956bbebb9f2fa7268cd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.655232  8526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f865794cdc54a73bac275a71cb2034c" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.655499  8534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a125e8035444f5921cc2a7eef152ae" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.656119  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aa75e5347f4ba5a20776a3b619eb68" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.628985  7271 tablet_replica.cc:333] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.656816  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67513665d04b44c292143601e7f66ac8" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.673861  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.656289  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f40fa9720bd41db92cb895437b29f60" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.675379  8532 consensus_queue.cc:237] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:12.679312  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:12.699681  7271 raft_consensus.cc:2243] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:12.700896  7271 raft_consensus.cc:2272] T bf76dc240f6a432d80b0c04f50f2d9b6 P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.690413 15672 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:12.702144  8271 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 93105.5us
I20260709 13:04:12.708688  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f60cb7236fe439e9faa6d4f269e96da" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.714335  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d98f2932e74257b6a032b544f7b4bd" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.714476  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f53ea2cc904a72ae2c12832985b519" candidate_uuid: "d653e71832b7402b9a03b46249d3b885" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:12.718526  8349 leader_election.cc:304] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:12.720141  8349 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:04:12.721966  8349 raft_consensus.cc:2686] T e83390ed01194281aab5dc3a33f49783 P d653e71832b7402b9a03b46249d3b885: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:04:12.722811  8349 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:04:12.723361  8349 raft_consensus.cc:2686] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P d653e71832b7402b9a03b46249d3b885: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:04:12.720120 15672 raft_consensus.cc:2749] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:12.704069  8271 catalog_manager.cc:4755] TS d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4269b37b5f3540ba9fcfd6d23ad240b6: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:04:12.721506  7271 tablet_replica.cc:333] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.745638  8349 leader_election.cc:304] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:12.749778  9292 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:04:12.746941 15672 raft_consensus.cc:2749] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:12.751462  8349 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:12.746023  7271 raft_consensus.cc:2243] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:12.752331 15672 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:12.752761  8349 leader_election.cc:304] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:12.753976  7271 raft_consensus.cc:2272] T aee63d7055b1430b8d1edea205bc40f0 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.757213  8460 raft_consensus.cc:1275] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:04:12.754027  8349 leader_election.cc:304] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:12.754477 15672 raft_consensus.cc:2749] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:12.774291  8349 leader_election.cc:304] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:12.775002 15672 raft_consensus.cc:2749] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:12.778378 15672 raft_consensus.cc:2749] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:12.779161  7271 tablet_replica.cc:333] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.780089  7271 raft_consensus.cc:2243] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:12.781713  8349 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:12.782511 15688 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:12.784812  7271 raft_consensus.cc:2272] T 4923120e1f194cdabb09a6bc8feeba88 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.785745 15672 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:12.787842  7271 tablet_replica.cc:333] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.788731  7271 raft_consensus.cc:2243] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:12.789244  8349 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:12.791344 15672 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:12.791805  8349 leader_election.cc:304] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
W20260709 13:04:12.792481  8349 raft_consensus.cc:2686] T 4f60cb7236fe439e9faa6d4f269e96da P d653e71832b7402b9a03b46249d3b885: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:04:12.793620 15729 consensus_queue.cc:1048] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:12.804808  8349 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:12.815917 15672 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:12.817555  8349 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d653e71832b7402b9a03b46249d3b885; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:12.818845  7271 raft_consensus.cc:2272] T 1663cf9302e8495c8762465d306cb479 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.827514 15694 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:12.826869 15729 raft_consensus.cc:2955] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 23 LEADER]: Committing config change with OpId 23.17: config changed from index 16 to 17, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:12.845747  7271 tablet_replica.cc:333] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.845928  9292 raft_consensus.cc:2955] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:12.847942  8460 raft_consensus.cc:2955] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:12.846840  7271 raft_consensus.cc:2243] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.850553  7271 raft_consensus.cc:2272] T 67513665d04b44c292143601e7f66ac8 P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.852007  8268 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dc2c20c2ffc24a6cb95e8c2fe8a8c025 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:12.856256  7271 tablet_replica.cc:333] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.857160  7271 raft_consensus.cc:2243] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.857733  7271 raft_consensus.cc:2272] T 21f53ea2cc904a72ae2c12832985b519 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.866891  8280 catalog_manager.cc:5697] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index 16 to 17, VOTER d653e71832b7402b9a03b46249d3b885 (127.7.25.193) evicted. New cstate: current_term: 23 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.883008  7271 tablet_replica.cc:333] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.886935  7271 raft_consensus.cc:2243] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.887879  7271 raft_consensus.cc:2272] T 82a5ca9d87124561a0ec4d39bdfdf577 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.934266  7271 tablet_replica.cc:333] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.935194  7271 raft_consensus.cc:2243] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.936285  7271 raft_consensus.cc:2272] T 4269b37b5f3540ba9fcfd6d23ad240b6 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.964555  7271 tablet_replica.cc:333] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.967571  7271 raft_consensus.cc:2243] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:12.968446  7271 raft_consensus.cc:2272] T 6427ce7790bd4629985d340936d6f356 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:12.971728  7271 tablet_replica.cc:333] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:12.972546  7271 raft_consensus.cc:2243] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:04:12.997962  7271 raft_consensus.cc:2272] T 94c2a7ffe57c4521a141ed4b370b82f6 P d653e71832b7402b9a03b46249d3b885 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.006067  7271 tablet_replica.cc:333] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:13.006839  7271 raft_consensus.cc:2243] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.007740  7271 raft_consensus.cc:2272] T 564c455d9a5b45a4ac479c57433dcb89 P d653e71832b7402b9a03b46249d3b885 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.010299  7271 tablet_replica.cc:333] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:13.026058  7271 raft_consensus.cc:2243] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.026914  7271 raft_consensus.cc:2272] T d9cb2781af004accaffe494aebc4c13c P d653e71832b7402b9a03b46249d3b885 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.033529  7271 tablet_replica.cc:333] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:13.034409  7271 raft_consensus.cc:2243] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.035280  7271 raft_consensus.cc:2272] T 866f457c2bf048109ab977c2b010de5a P d653e71832b7402b9a03b46249d3b885 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.038523  7271 tablet_replica.cc:333] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:13.072391  7271 raft_consensus.cc:2243] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.079164 15729 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:13.079778 15729 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:13.087333  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:13.091987  7271 raft_consensus.cc:2272] T eedf264cd691413dbd2eec9e2b133ddf P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.095266  7271 tablet_replica.cc:333] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:13.096172  7271 raft_consensus.cc:2243] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:13.101686  8501 leader_election.cc:336] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:13.089017 15729 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:13.102361  8501 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:13.106097 15729 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:13.129279  7271 raft_consensus.cc:2272] T 28d98f2932e74257b6a032b544f7b4bd P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.136379  7271 tablet_replica.cc:333] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:13.141793  7271 raft_consensus.cc:2243] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.143726  7271 raft_consensus.cc:2272] T 74f6762ba0124b3a87dd4d54f5693927 P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.147908  7271 tablet_replica.cc:333] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:13.158264 15693 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:13.159329 15693 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:13.159714  7271 raft_consensus.cc:2243] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.161535  7271 raft_consensus.cc:2272] T de8d0dfcd55e4b03b9a131362bf19085 P d653e71832b7402b9a03b46249d3b885 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.161996 15693 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:13.163496  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:13.166723  7271 tablet_replica.cc:333] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:13.167695  7271 raft_consensus.cc:2243] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.177578  7271 raft_consensus.cc:2272] T c80796a5190345179ad066af334e5bae P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:13.169209  8427 leader_election.cc:336] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:13.179646  8427 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:13.180725 15693 raft_consensus.cc:2749] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:13.186448  7271 tablet_replica.cc:333] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:13.187495  7271 raft_consensus.cc:2243] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.188820  7271 raft_consensus.cc:2272] T 911fa6f4e14f47f6a76fff18a00cd58e P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.194108  7271 tablet_replica.cc:333] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:13.196164 15729 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:13.205948  7271 raft_consensus.cc:2243] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.211158  7271 raft_consensus.cc:2272] T e63b8dc23aaf4956bbebb9f2fa7268cd P d653e71832b7402b9a03b46249d3b885 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.205610 15729 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:13.213430 15729 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:13.219900  8501 leader_election.cc:336] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:13.222985  7271 tablet_replica.cc:333] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:13.223913  7271 raft_consensus.cc:2243] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.224748  7271 raft_consensus.cc:2272] T dc1ae2a0b869453e80401c580552e127 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.227632  7271 tablet_replica.cc:333] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:13.228323  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:13.229844  8500 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:13.232930  7271 raft_consensus.cc:2243] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.233702 15729 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:13.238145  7271 raft_consensus.cc:2272] T 7142cc29d84f4204bd97e07c0f6f6a84 P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.241345  7271 tablet_replica.cc:333] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:13.242084  7271 raft_consensus.cc:2243] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.242794  7271 raft_consensus.cc:2272] T 25a125e8035444f5921cc2a7eef152ae P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.246009  7271 tablet_replica.cc:333] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:13.248370  7271 raft_consensus.cc:2243] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.248981  7271 raft_consensus.cc:2272] T 5f40fa9720bd41db92cb895437b29f60 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.251996  7271 tablet_replica.cc:333] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:13.253221  7271 raft_consensus.cc:2243] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.254246  7271 raft_consensus.cc:2272] T 8897541fb7574f928493aa8e97a58f2f P d653e71832b7402b9a03b46249d3b885 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.256624  7271 tablet_replica.cc:333] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:13.257326  7271 raft_consensus.cc:2243] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.258392  7271 raft_consensus.cc:2272] T 1a4fc34dde1d4b269abf3c59d18630ec P d653e71832b7402b9a03b46249d3b885 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.261161  7271 tablet_replica.cc:333] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:13.262058  7271 raft_consensus.cc:2243] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.263203  7271 raft_consensus.cc:2272] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P d653e71832b7402b9a03b46249d3b885 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.264843 15693 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:13.265415 15693 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:13.267781 15693 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:13.269757  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:13.270413  8535 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 23.
I20260709 13:04:13.270790  7271 tablet_replica.cc:333] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:13.271570  7271 raft_consensus.cc:2243] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.271718  8424 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:13.272609 15693 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:04:13.273003 15693 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:13.273435 15693 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:13.273729 15729 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:13.274284 15729 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:13.276475 15729 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:13.278175  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:13.278800  8457 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
W20260709 13:04:13.279814  8501 leader_election.cc:336] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:13.272612  8427 leader_election.cc:336] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:13.280507  8500 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:13.282223 15729 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:13.282615 15729 raft_consensus.cc:493] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:13.282975 15729 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:13.286389 15693 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:04:13.291383  8427 leader_election.cc:336] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:13.291958  7271 raft_consensus.cc:2272] T c2aa75e5347f4ba5a20776a3b619eb68 P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.293578 15729 raft_consensus.cc:515] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:13.295095  7271 tablet_replica.cc:333] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
I20260709 13:04:13.295879 15729 leader_election.cc:290] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:13.297262 15693 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 24 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:13.295980  7271 raft_consensus.cc:2243] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.297847  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d39340781e466abc648aacd7ee5822" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:13.298377  7271 raft_consensus.cc:2272] T 1f865794cdc54a73bac275a71cb2034c P d653e71832b7402b9a03b46249d3b885 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.298447  8535 raft_consensus.cc:3060] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:13.302067  7271 tablet_replica.cc:333] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885: stopping tablet replica
W20260709 13:04:13.302276  8501 leader_election.cc:336] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:13.302805  7271 raft_consensus.cc:2243] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.298731  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3df375d584465c8712d996256828cf" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:13.303723  8457 raft_consensus.cc:3060] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:13.307431  8535 raft_consensus.cc:2468] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 24.
I20260709 13:04:13.308804  8424 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:13.310170 15693 raft_consensus.cc:2804] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:13.310695 15693 raft_consensus.cc:697] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 24 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:04:13.311641 15693 consensus_queue.cc:237] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:13.303900  7271 raft_consensus.cc:2272] T a457c771b2be434bb71c63fe617485e1 P d653e71832b7402b9a03b46249d3b885 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.346622  8457 raft_consensus.cc:2468] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:04:13.352149  8500 leader_election.cc:304] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:13.355666 15688 raft_consensus.cc:2804] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:13.356361 15688 raft_consensus.cc:697] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:13.357963 15688 consensus_queue.cc:237] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:13.393338  8280 catalog_manager.cc:5697] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 23 to 24, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 24 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.433624 15693 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:13.434326 15693 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:13.437060 15693 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:13.442220  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:13.461964  8283 catalog_manager.cc:5697] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 15 to 16, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 16 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:13.466506  8427 leader_election.cc:336] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:13.467111  8427 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:13.468174 15693 raft_consensus.cc:2749] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:13.506317 15699 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:13.507018 15699 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:13.511446 15699 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:13.513276  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:13.514089  8535 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 13.
I20260709 13:04:13.519084  8424 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:13.522881 15693 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:13.523612 15693 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:13.524197 15693 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:13.542693 15693 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:13.554214 15693 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:13.556464  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c3c85d53de1420dab74923e2fc80f02" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:13.557394  8532 raft_consensus.cc:3060] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:13.573112  8532 raft_consensus.cc:2468] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 14.
I20260709 13:04:13.574277  8424 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:13.576154 15699 raft_consensus.cc:2804] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:13.576742 15699 raft_consensus.cc:697] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:04:13.587119 15699 consensus_queue.cc:237] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:13.581506 15734 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:13.590909 15734 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:13.596791 15734 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:13.598050  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:13.598817  8457 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 18.
I20260709 13:04:13.600214  9260 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:04:13.601717 15734 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:13.602288 15734 raft_consensus.cc:493] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:13.602818 15734 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:13.619968 15734 raft_consensus.cc:515] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:13.638509  9261 leader_election.cc:336] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:13.658622  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ce47d03b224808b5f7f17c341a5293" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:13.659248  8457 raft_consensus.cc:3060] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:13.661309 15734 leader_election.cc:290] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:13.691030  8457 raft_consensus.cc:2468] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 19.
W20260709 13:04:13.693413  8427 leader_election.cc:336] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:13.709726  8427 leader_election.cc:336] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:13.705626  9261 leader_election.cc:336] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:13.722122  9260 leader_election.cc:304] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:13.729192 15734 raft_consensus.cc:2804] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:13.731259 15734 raft_consensus.cc:697] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:04:13.732378 15734 consensus_queue.cc:237] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:13.749557 15693 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:13.750136 15693 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:13.752396 15693 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:13.755457  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:13.765229  8283 catalog_manager.cc:5697] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 18 to 19, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 19 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:13.785166  8501 consensus_peers.cc:597] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:13.803619  8427 consensus_peers.cc:597] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:13.804287  8427 consensus_peers.cc:597] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:13.804786  8427 consensus_peers.cc:597] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.810040 15734 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:13.812770 15734 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:13.816840  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:13.818809 15734 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:13.821187  9261 leader_election.cc:336] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:13.829453  8283 catalog_manager.cc:5697] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 13 to 14, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 14 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.821748  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:13.833904 15734 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:13.840333  8427 consensus_peers.cc:597] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:13.840938  8427 consensus_peers.cc:597] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:13.841348  8427 leader_election.cc:336] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:13.842922  8427 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:13.843667 15693 raft_consensus.cc:2749] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:13.850536  8427 consensus_peers.cc:597] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:13.852792  9261 consensus_peers.cc:597] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:13.853421  9261 consensus_peers.cc:597] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.867041  8532 raft_consensus.cc:1275] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:04:13.868822 15693 consensus_queue.cc:1048] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:04:13.869004  8271 catalog_manager.cc:4755] TS d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4269b37b5f3540ba9fcfd6d23ad240b6: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:13.878672 15693 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:13.879343 15693 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:13.887218  8427 leader_election.cc:336] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:13.892488  8501 consensus_peers.cc:597] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.893661  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:04:13.895264  9261 consensus_peers.cc:597] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.895226  8424 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:13.896499 15699 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:13.902915  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:13.902725 15693 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:13.915766  8452 raft_consensus.cc:1275] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:04:13.918102 15698 consensus_queue.cc:1048] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:13.919245 15734 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:13.919864 15734 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:13.922150 15734 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:13.929029  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:13.930454 15698 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:13.931038 15698 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:04:13.933252  9261 leader_election.cc:336] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:13.933758  9261 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:13.935474 15734 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:04:13.947027  8501 leader_election.cc:336] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:13.949338  8427 consensus_peers.cc:597] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.962164 15698 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:13.964860  8427 consensus_peers.cc:597] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:13.970216  8501 consensus_peers.cc:597] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:13.971583 15734 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:13.972304 15734 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:13.981812  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:13.982448  8457 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 19.
I20260709 13:04:13.984297 15734 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:13.986954  8533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:04:13.998931  8501 consensus_peers.cc:597] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:14.007828  9261 consensus_peers.cc:597] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:14.010159  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:14.010825  8457 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 21.
I20260709 13:04:14.017100 15750 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:14.017722 15750 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:14.020222 15750 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:14.021287  8500 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:14.022994 15730 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:14.023432 15730 raft_consensus.cc:493] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:14.023856 15730 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:14.035804 15730 raft_consensus.cc:515] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:14.038179 15730 leader_election.cc:290] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:14.082015  8427 consensus_peers.cc:597] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:14.082629  8427 consensus_peers.cc:597] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:14.087877  8533 raft_consensus.cc:1275] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:14.092906 15750 consensus_queue.cc:1048] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:14.096244  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:14.096952  9296 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 20.
I20260709 13:04:14.102118  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e70dfc88914a66b000a84bef302149" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:14.102811  8452 raft_consensus.cc:3060] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:04:14.103147  8501 consensus_peers.cc:597] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:14.104038  8427 consensus_peers.cc:597] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:14.104607  8501 consensus_peers.cc:597] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:14.105227  8427 consensus_peers.cc:597] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:14.107903  8427 leader_election.cc:336] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:14.114266  8452 raft_consensus.cc:2468] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 22.
W20260709 13:04:14.103441  9261 leader_election.cc:336] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:14.119055  9261 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:14.119841 15734 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:04:14.120905  9261 consensus_peers.cc:597] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:14.125986  8500 leader_election.cc:304] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:14.127970 15698 raft_consensus.cc:2804] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:14.128490 15698 raft_consensus.cc:697] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 22 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:14.143431 15730 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:14.144076 15730 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:14.145448 15688 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:14.129374 15698 consensus_queue.cc:237] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:14.146028 15688 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:14.148940 15688 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:14.150394  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:14.151172  8452 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
I20260709 13:04:14.153008 15730 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:04:14.154933  8501 leader_election.cc:336] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:14.173636  8501 consensus_peers.cc:597] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:14.157477  8426 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:14.175042 15755 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:14.175462 15755 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:14.175827 15755 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:04:14.157015  9261 consensus_peers.cc:597] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:14.201499  8452 raft_consensus.cc:1275] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:04:14.206184 15693 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:14.206297 15734 consensus_queue.cc:1048] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:14.207106 15693 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:14.209200 15693 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:14.210208  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:14.210871  9296 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
I20260709 13:04:14.212082  9296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:14.212698  9296 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 22.
I20260709 13:04:14.213181 15699 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:04:14.214205  8501 consensus_peers.cc:597] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:14.214717  8501 consensus_peers.cc:597] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:14.213752 15699 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:14.212073 15755 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:14.217897 15699 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:14.217913 15755 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:14.234169  8500 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:14.236435  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:14.238772  8500 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:14.246045  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:14.246800  9293 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 22.
I20260709 13:04:14.247663  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1663cf9302e8495c8762465d306cb479" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:04:14.248824  9294 raft_consensus.cc:3060] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:14.241218 15688 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:14.248438 15729 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:04:14.279959  8501 leader_election.cc:336] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:14.280997  8501 leader_election.cc:336] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:14.281450  9261 consensus_peers.cc:597] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:14.281749  8501 consensus_peers.cc:597] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:14.281976  9261 consensus_peers.cc:597] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:14.284221 15729 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:14.284761 15729 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:14.287344  9294 raft_consensus.cc:2468] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 21.
I20260709 13:04:14.263468  8283 catalog_manager.cc:5697] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 21 to 22, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 22 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:14.301465  8426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 62153us
I20260709 13:04:14.258836 15688 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:04:14.303367  8427 consensus_peers.cc:597] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:14.306488  8427 leader_election.cc:336] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:14.308212 15748 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:14.308964 15748 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:14.316322  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 74889.1us
I20260709 13:04:14.306154 15688 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:14.316025 15748 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:14.332834  8501 consensus_peers.cc:597] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:14.333477  8501 consensus_peers.cc:597] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:14.330040  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:14.334254  8452 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 24.
W20260709 13:04:14.330605  9261 consensus_peers.cc:597] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:14.337009  9261 consensus_peers.cc:597] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:14.356799  9261 leader_election.cc:336] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:14.342677 15750 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:04:14.360113  8501 consensus_peers.cc:597] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:14.336747  8426 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:14.363469 15765 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:14.360772 15750 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:14.364624 15765 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:14.365338 15765 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:14.366429 15750 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:14.368558  8426 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:04:14.374739  9260 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:14.384584 15747 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:04:14.385108 15747 raft_consensus.cc:493] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:14.385488 15747 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:14.388957 15688 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:14.377805 15750 raft_consensus.cc:2804] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:14.396708 15730 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:14.397240 15750 raft_consensus.cc:697] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 21 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:04:14.397310 15730 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:14.398301 15750 consensus_queue.cc:237] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:14.399507 15730 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:04:14.401360  8501 leader_election.cc:336] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:14.409783  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:14.413534 15688 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:04:14.409966  9261 consensus_peers.cc:597] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:14.418609 15730 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:14.419305 15730 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:14.421574 15730 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:14.422775  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:04:14.423429  9294 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:14.459486  8458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf76dc240f6a432d80b0c04f50f2d9b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:14.460186  8458 raft_consensus.cc:3060] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:14.463944  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:14.464654  8460 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 14.
I20260709 13:04:14.465854  8500 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:14.466784 15763 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:14.467235 15763 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
W20260709 13:04:14.467480  8501 leader_election.cc:336] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:14.467602 15763 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:14.467980  8501 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:14.468452 15750 raft_consensus.cc:493] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:14.468714 15764 raft_consensus.cc:2749] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:14.469110 15750 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:14.472503 15750 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:14.468495  8458 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
I20260709 13:04:14.478937  9294 raft_consensus.cc:2468] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
I20260709 13:04:14.479888  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:14.481876  8500 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:14.483963  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:14.484606 15764 raft_consensus.cc:2804] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:14.494589 15763 raft_consensus.cc:515] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:14.498418  8535 raft_consensus.cc:2393] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 105d6581548546b98eddd4ee7083bb12 in current term 15: Already voted for candidate b8eb0ad4490645598004d862412f4e31 in this term.
I20260709 13:04:14.495443 15764 raft_consensus.cc:697] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 20 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:14.501307 15764 consensus_queue.cc:237] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:14.484730 15747 raft_consensus.cc:515] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:14.515712 15747 leader_election.cc:290] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:14.441488 15765 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:14.521585 15765 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 23 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:14.521670  8283 catalog_manager.cc:5697] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 20 to 21, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 21 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.517500 15763 leader_election.cc:290] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:14.522269 15729 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:14.526916  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4923120e1f194cdabb09a6bc8feeba88" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:04:14.529850  9294 raft_consensus.cc:3060] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:14.532418 15729 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:14.533444 15693 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:14.533977 15693 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:14.535946 15693 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:14.527177  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8d0dfcd55e4b03b9a131362bf19085" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
W20260709 13:04:14.528121  9261 leader_election.cc:336] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:14.536710  8460 raft_consensus.cc:3060] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:14.537775  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee63d7055b1430b8d1edea205bc40f0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:04:14.538354  9293 raft_consensus.cc:3060] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:14.539357  9294 raft_consensus.cc:2468] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 105d6581548546b98eddd4ee7083bb12 in term 23.
I20260709 13:04:14.540483  8426 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: 
I20260709 13:04:14.542249 15693 raft_consensus.cc:2804] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:14.542769 15693 raft_consensus.cc:697] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 23 LEADER]: Becoming Leader. State: Replica: 105d6581548546b98eddd4ee7083bb12, State: Running, Role: LEADER
I20260709 13:04:14.543723 15693 consensus_queue.cc:237] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:14.546365  9293 raft_consensus.cc:2468] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 23.
I20260709 13:04:14.548461  8500 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:04:14.549110  8501 leader_election.cc:336] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:14.549435 15730 raft_consensus.cc:2804] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:04:14.551050  8427 leader_election.cc:336] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:14.553488 15730 raft_consensus.cc:697] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 23 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:14.553799  8427 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: 446d9310dce14ff4afff2dc2d64f68d8, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:14.554453 15730 consensus_queue.cc:237] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:14.554992  8427 leader_election.cc:336] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:14.559417  8501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 45572.9us
W20260709 13:04:14.568187  8427 leader_election.cc:336] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:14.569782  8427 leader_election.cc:336] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:14.573390  8460 raft_consensus.cc:2468] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 25.
I20260709 13:04:14.575294 15759 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:14.587535 15759 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:04:14.589154  8427 leader_election.cc:336] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:14.586385  8501 leader_election.cc:336] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:14.589960  8427 leader_election.cc:336] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:14.590159  8501 leader_election.cc:336] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:14.590842  7271 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8407)
W20260709 13:04:14.591265  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 79144.9us
I20260709 13:04:14.594514 15759 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:14.595703 15765 raft_consensus.cc:2749] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:14.596451  8280 catalog_manager.cc:5697] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 19 to 20, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 20 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:14.602866  8501 leader_election.cc:336] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:14.605230  9260 leader_election.cc:304] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, 446d9310dce14ff4afff2dc2d64f68d8; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:14.606490 15747 raft_consensus.cc:2804] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:04:14.607024 15747 raft_consensus.cc:697] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 25 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:04:14.607915 15747 consensus_queue.cc:237] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:14.613565  8424 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:14.642445 15693 raft_consensus.cc:2749] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:14.643915  8424 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:14.644788 15693 raft_consensus.cc:3060] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:14.652314  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "105d6581548546b98eddd4ee7083bb12" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:14.651938  8280 catalog_manager.cc:5697] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 reported cstate change: term changed from 22 to 23, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 105d6581548546b98eddd4ee7083bb12 (127.7.25.194). New cstate: current_term: 23 leader_uuid: "105d6581548546b98eddd4ee7083bb12" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.663942  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c2a7ffe57c4521a141ed4b370b82f6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:14.665257  8276 catalog_manager.cc:5697] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 24 to 25, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 25 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:14.666167  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:14.666807  8457 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:04:14.656584  8283 catalog_manager.cc:5697] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 22 to 23, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 23 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.683740  8457 raft_consensus.cc:1275] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:04:14.689313 15693 raft_consensus.cc:2749] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:14.703845  8501 consensus_peers.cc:597] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:14.713743  8500 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:14.715385  8460 raft_consensus.cc:2468] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 15.
I20260709 13:04:14.717844 15764 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:14.722918 15764 raft_consensus.cc:493] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:14.726111 15759 consensus_queue.cc:1048] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:14.728262 15747 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:14.729569 15747 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:14.730693 15764 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:14.732957  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:14.733662  8532 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 19.
I20260709 13:04:14.734997  9258 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:14.735822 15766 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:14.736218 15766 raft_consensus.cc:493] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:14.736574 15766 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:14.737437  8424 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:14.738559 15693 raft_consensus.cc:2749] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:14.743345 15759 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:14.744004 15759 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:14.746335 15747 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:14.750303  9261 leader_election.cc:336] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:14.751426 15759 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:14.744551 15766 raft_consensus.cc:515] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:14.765722  9261 leader_election.cc:336] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:14.767323  8501 leader_election.cc:336] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:14.768075  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848cbd6ceda8400e9d2f1d58cbbdcb7b" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31"
I20260709 13:04:14.768784  8532 raft_consensus.cc:3060] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:14.770795 15766 leader_election.cc:290] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:14.783140  8532 raft_consensus.cc:2468] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446d9310dce14ff4afff2dc2d64f68d8 in term 20.
W20260709 13:04:14.793000  8424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 53134.8us
I20260709 13:04:14.804440  8500 leader_election.cc:304] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:14.807006 15759 raft_consensus.cc:2804] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:14.807570 15759 raft_consensus.cc:697] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:14.808490 15759 consensus_queue.cc:237] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:14.813884  9258 leader_election.cc:304] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:14.815474 15766 raft_consensus.cc:2804] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:14.816231 15766 raft_consensus.cc:697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 LEADER]: Becoming Leader. State: Replica: 446d9310dce14ff4afff2dc2d64f68d8, State: Running, Role: LEADER
I20260709 13:04:14.817214 15766 consensus_queue.cc:237] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:14.852463  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12" is_pre_election: true
I20260709 13:04:14.867918  8460 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:04:14.870322  8500 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:14.871265 15730 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:14.840552 15764 raft_consensus.cc:515] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:14.871682 15730 raft_consensus.cc:493] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d653e71832b7402b9a03b46249d3b885)
I20260709 13:04:14.880508 15730 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:14.891243  8283 catalog_manager.cc:5697] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 reported cstate change: term changed from 19 to 20, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196). New cstate: current_term: 20 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:14.898968 15764 leader_election.cc:290] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:14.899941  8460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8897541fb7574f928493aa8e97a58f2f" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:14.900563  8460 raft_consensus.cc:3060] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:14.909406  8501 leader_election.cc:336] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:14.920054 15730 raft_consensus.cc:515] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:14.924501  9294 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:04:14.932204 15764 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:14.954713 15730 leader_election.cc:290] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Requested vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:14.967082  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fc34dde1d4b269abf3c59d18630ec" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "105d6581548546b98eddd4ee7083bb12"
I20260709 13:04:14.948428  8460 raft_consensus.cc:2468] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:04:14.967875  8457 raft_consensus.cc:3060] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:14.968209  9292 raft_consensus.cc:1275] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:04:14.961828  8501 leader_election.cc:336] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:14.972846  8500 leader_election.cc:304] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:14.970198  8283 catalog_manager.cc:5697] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 14 to 15, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 15 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:14.985590 15688 raft_consensus.cc:2804] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:14.976078 15771 consensus_queue.cc:1048] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 13:04:15.077715  8457 raft_consensus.cc:2468] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
I20260709 13:04:15.091984  9294 raft_consensus.cc:1275] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Refusing update from remote peer 105d6581548546b98eddd4ee7083bb12: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
W20260709 13:04:15.164151  8427 consensus_peers.cc:597] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.205693  8460 raft_consensus.cc:1275] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:04:15.208631 15688 raft_consensus.cc:697] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:15.209755 15688 consensus_queue.cc:237] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:04:15.210951  8427 consensus_peers.cc:597] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.213773  8460 raft_consensus.cc:1275] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 25 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 13:04:15.214684  8500 leader_election.cc:304] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31; no voters: d653e71832b7402b9a03b46249d3b885
I20260709 13:04:15.215539 15789 raft_consensus.cc:2804] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:15.217648 15789 raft_consensus.cc:697] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:15.220661 15789 consensus_queue.cc:237] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:15.228345 15785 consensus_queue.cc:1048] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
W20260709 13:04:15.225072  8501 consensus_peers.cc:597] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.240489 15784 consensus_queue.cc:1048] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:04:15.242777  9261 consensus_peers.cc:597] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.249984  8271 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 180405us
W20260709 13:04:15.254747  8271 catalog_manager.cc:4755] TS d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4269b37b5f3540ba9fcfd6d23ad240b6: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:15.259855 15755 consensus_queue.cc:1048] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:04:15.269992  8501 consensus_peers.cc:597] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.311614  8280 catalog_manager.cc:5697] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 15 to 16, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 16 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.327546  9294 raft_consensus.cc:1275] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:04:15.338728  8529 raft_consensus.cc:1275] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:04:15.349097  8501 consensus_peers.cc:597] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.365330  8460 raft_consensus.cc:1275] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:15.353574 15785 consensus_queue.cc:1048] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 13:04:15.379493 15787 consensus_queue.cc:1048] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:15.391239  8280 catalog_manager.cc:5697] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 18 to 19, leader changed from d653e71832b7402b9a03b46249d3b885 (127.7.25.193) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 19 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.393036 15786 consensus_queue.cc:1048] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:04:15.521040 15775 log.cc:927] Time spent T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8: Append to log took a long time: real 0.063s	user 0.002s	sys 0.002s
W20260709 13:04:15.537492  9261 consensus_peers.cc:597] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.557323  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 133192us
W20260709 13:04:15.592476  7271 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 8407)
W20260709 13:04:15.732825  8501 consensus_peers.cc:597] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.757267  8501 consensus_peers.cc:597] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.824198  8457 raft_consensus.cc:1275] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:04:15.832118 15787 consensus_queue.cc:1048] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:15.834250  8457 raft_consensus.cc:1275] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:15.838486 15787 consensus_queue.cc:1048] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:04:16.188627  8427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111) [suppressed 420 similar messages]
W20260709 13:04:16.219417  8427 consensus_peers.cc:597] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.225015  8427 consensus_peers.cc:597] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.250643  9261 consensus_peers.cc:597] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.251498  8427 consensus_peers.cc:597] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.275367  8501 consensus_peers.cc:597] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.326372  8427 consensus_peers.cc:597] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.341826  8427 consensus_peers.cc:597] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.351910  9261 consensus_peers.cc:597] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.429292  8501 consensus_peers.cc:597] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.439838  8501 consensus_peers.cc:597] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:16.454361  8501 consensus_peers.cc:597] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.463167  8427 consensus_peers.cc:597] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.510313  8427 consensus_peers.cc:597] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.551530  9261 consensus_peers.cc:597] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.592978  7271 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 8407)
W20260709 13:04:16.603567  8501 consensus_peers.cc:597] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.624868  9261 consensus_peers.cc:597] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.631822  9261 consensus_peers.cc:597] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.640190  9261 consensus_peers.cc:597] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.651628  8501 consensus_peers.cc:597] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.681986  8501 consensus_peers.cc:597] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.682085  8427 consensus_peers.cc:597] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.704293  9261 consensus_peers.cc:597] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.705910  8501 consensus_peers.cc:597] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.721985  8427 consensus_peers.cc:597] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.728626  8501 consensus_peers.cc:597] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.739694  8427 consensus_peers.cc:597] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.741842  8501 consensus_peers.cc:597] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.742393  8501 consensus_peers.cc:597] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.794298  8427 consensus_peers.cc:597] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.795003  8501 consensus_peers.cc:597] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.830667  8427 consensus_peers.cc:597] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:16.850824  9261 consensus_peers.cc:597] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.851543  9261 consensus_peers.cc:597] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:16.856009  9261 consensus_peers.cc:597] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.867309  9261 consensus_peers.cc:597] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:16.882187  8501 consensus_peers.cc:597] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:17.007148  8427 consensus_peers.cc:597] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:17.341966  8271 catalog_manager.cc:4755] TS d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4269b37b5f3540ba9fcfd6d23ad240b6: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:17.438566  8501 consensus_peers.cc:597] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:17.505517  8501 consensus_peers.cc:597] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:17.594117  7271 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 8407)
W20260709 13:04:17.599344  8427 consensus_peers.cc:597] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:17.614040  9261 consensus_peers.cc:597] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:17.715992  8501 consensus_peers.cc:597] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:17.767799  8427 consensus_peers.cc:597] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:17.849339  8501 consensus_peers.cc:597] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:17.909046  9261 consensus_peers.cc:597] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:18.379606  8501 consensus_peers.cc:597] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:18.430079  8427 consensus_peers.cc:597] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:18.527776  9261 consensus_peers.cc:597] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:18.546742  8501 consensus_peers.cc:597] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:18.586514  8501 consensus_peers.cc:597] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:18.594743  7271 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 8407)
W20260709 13:04:18.594807  8427 consensus_peers.cc:597] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:18.653257  8427 consensus_peers.cc:597] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:18.780404  8427 consensus_peers.cc:597] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:18.842842  9261 consensus_peers.cc:597] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:18.850893  8501 consensus_peers.cc:597] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:18.871592  8427 consensus_peers.cc:597] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:18.923418  8501 consensus_peers.cc:597] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.035086  8501 consensus_peers.cc:597] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.062172  8427 consensus_peers.cc:597] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.067144  8501 consensus_peers.cc:597] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.090972  9261 consensus_peers.cc:597] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.207971  8427 consensus_peers.cc:597] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.219452  8501 consensus_peers.cc:597] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.220158  8501 consensus_peers.cc:597] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.229496  8501 consensus_peers.cc:597] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.229719  9261 consensus_peers.cc:597] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.244249  9261 consensus_peers.cc:597] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.260908  8501 consensus_peers.cc:597] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.263679  8427 consensus_peers.cc:597] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.264263  9261 consensus_peers.cc:597] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.282636  8427 consensus_peers.cc:597] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.313956  8501 consensus_peers.cc:597] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.344090  8501 consensus_peers.cc:597] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.354984  8501 consensus_peers.cc:597] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.389360  8427 consensus_peers.cc:597] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:19.419972  8427 consensus_peers.cc:597] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.431147  9261 consensus_peers.cc:597] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.456664  9261 consensus_peers.cc:597] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.473268  9261 consensus_peers.cc:597] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.516306  9261 consensus_peers.cc:597] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:19.526954  8427 consensus_peers.cc:597] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.546370  8501 consensus_peers.cc:597] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.595278  7271 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 8407)
W20260709 13:04:19.641222  9261 consensus_peers.cc:597] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:19.662427  8427 consensus_peers.cc:597] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:19.844349  8501 consensus_peers.cc:597] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:19.881875  8501 consensus_peers.cc:597] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:19.944705  8501 consensus_peers.cc:597] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:19.977504  9261 consensus_peers.cc:597] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:20.029429  7271 tablet_server.cc:196] TabletServer@127.7.25.193:0 shutdown complete.
W20260709 13:04:20.174629  8501 consensus_peers.cc:597] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:20.207273  8427 consensus_peers.cc:597] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:20.339329  8427 consensus_peers.cc:597] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:20.351596  7271 tablet_server.cc:179] TabletServer@127.7.25.194:0 shutting down...
W20260709 13:04:20.373730  8500 consensus_peers.cc:597] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:20.439113  8500 consensus_peers.cc:597] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:20.465572  9260 consensus_peers.cc:597] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:20.486642  8500 consensus_peers.cc:597] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.532068  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:20.538501  7271 tablet_replica.cc:333] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.539587  7271 raft_consensus.cc:2243] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:20.548877  8500 consensus_peers.cc:597] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.549563  7271 raft_consensus.cc:2272] T 5b3df375d584465c8712d996256828cf P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.552451  7271 tablet_replica.cc:333] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.553417  7271 raft_consensus.cc:2243] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:20.554579  7271 raft_consensus.cc:2272] T 45d39340781e466abc648aacd7ee5822 P 105d6581548546b98eddd4ee7083bb12 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.557502  7271 tablet_replica.cc:333] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.558467  7271 raft_consensus.cc:2243] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.559286  7271 raft_consensus.cc:2272] T 37c1890dcc8947c89b8c213326526c75 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.562588  7271 tablet_replica.cc:333] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.565909  7271 raft_consensus.cc:2243] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.566721  7271 raft_consensus.cc:2272] T cf1cdd90debd40a6a2361af7491977d6 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.570472  7271 tablet_replica.cc:333] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.571285  7271 raft_consensus.cc:2243] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:04:20.572046  9260 consensus_peers.cc:597] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.572410  7271 raft_consensus.cc:2272] T b3aa2530ec1a42c890e68f3e67582ca0 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:20.574978  8500 consensus_peers.cc:597] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.575155  7271 tablet_replica.cc:333] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.577316  7271 raft_consensus.cc:2243] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.584245  7271 raft_consensus.cc:2272] T 9e1d32431b1c45ebad1160a850495e16 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.587638  7271 tablet_replica.cc:333] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.589650  7271 raft_consensus.cc:2243] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.590396  7271 raft_consensus.cc:2272] T fd3ca20a5e4646d3b164329f7abcf44a P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:20.591332  9260 consensus_peers.cc:597] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.594579  7271 tablet_replica.cc:333] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.595604  7271 raft_consensus.cc:2243] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.597440  7271 raft_consensus.cc:2272] T 612cbe4a26f4473aaa8e3c84a7719e03 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:20.600519  9260 consensus_peers.cc:597] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.602629  7271 tablet_replica.cc:333] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.603570  7271 raft_consensus.cc:2243] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:20.604668  7271 raft_consensus.cc:2272] T 4ef8cc956c764eeeb9389ea099a35006 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:20.606361  9260 consensus_peers.cc:597] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.608865  7271 tablet_replica.cc:333] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.609848  7271 raft_consensus.cc:2243] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.610496  7271 raft_consensus.cc:2272] T 513b83e2d61c4ad7994ad4629a3d0079 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.617172  7271 tablet_replica.cc:333] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
W20260709 13:04:20.617718  8500 consensus_peers.cc:597] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.618278  7271 raft_consensus.cc:2243] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.619009  7271 raft_consensus.cc:2272] T edca272c646743e09fb3b0c827c963b8 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.622143  7271 tablet_replica.cc:333] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.622989  7271 raft_consensus.cc:2243] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.623891  7271 raft_consensus.cc:2272] T 455c5d2786974d92a3ee8b825edcfaa7 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.626508  7271 tablet_replica.cc:333] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.627251  7271 raft_consensus.cc:2243] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:04:20.628329  7271 raft_consensus.cc:2272] T 9c3c85d53de1420dab74923e2fc80f02 P 105d6581548546b98eddd4ee7083bb12 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.630944  7271 tablet_replica.cc:333] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.631718  7271 raft_consensus.cc:2243] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.632371  7271 raft_consensus.cc:2272] T a6ecd063b1dc49a69b15eb593af51b89 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.636476  7271 tablet_replica.cc:333] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.637300  7271 raft_consensus.cc:2243] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.637881  7271 raft_consensus.cc:2272] T 30e70dfc88914a66b000a84bef302149 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:20.637826  8500 consensus_peers.cc:597] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.640899  7271 tablet_replica.cc:333] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.641883  7271 raft_consensus.cc:2243] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:20.642252  9261 consensus_peers.cc:597] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:20.642772  7271 raft_consensus.cc:2272] T 0cd574dc2f1347e8996cdb77177d1a54 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.645792  7271 tablet_replica.cc:333] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.646700  7271 raft_consensus.cc:2243] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.647344  7271 raft_consensus.cc:2272] T f8ce47d03b224808b5f7f17c341a5293 P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.650070  7271 tablet_replica.cc:333] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.650982  7271 raft_consensus.cc:2243] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:20.652112  7271 raft_consensus.cc:2272] T 6427ce7790bd4629985d340936d6f356 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.655192  7271 tablet_replica.cc:333] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.656061  7271 raft_consensus.cc:2243] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:20.657143  7271 raft_consensus.cc:2272] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.659734  7271 tablet_replica.cc:333] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.660787  7271 raft_consensus.cc:2243] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.661943  7271 raft_consensus.cc:2272] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.664681  7271 tablet_replica.cc:333] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.665547  7271 raft_consensus.cc:2243] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.666173  7271 raft_consensus.cc:2272] T 56cc480ba6f642e08bb2e547a0ef50a1 P 105d6581548546b98eddd4ee7083bb12 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.668789  7271 tablet_replica.cc:333] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.669557  7271 raft_consensus.cc:2243] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:20.670629  7271 raft_consensus.cc:2272] T aa98ca5e34b24545adab36c2973a2f6e P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:20.674198  9260 consensus_peers.cc:597] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:20.677717  8500 consensus_peers.cc:597] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:20.681128  9260 consensus_peers.cc:597] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.685245  7271 tablet_replica.cc:333] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.689849  7271 raft_consensus.cc:2243] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:04:20.691599  8500 consensus_peers.cc:597] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.693109  7271 raft_consensus.cc:2272] T e83390ed01194281aab5dc3a33f49783 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.701574  7271 tablet_replica.cc:333] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
W20260709 13:04:20.701613  9260 consensus_peers.cc:597] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.702719  7271 raft_consensus.cc:2243] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:20.705614  7271 raft_consensus.cc:2272] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 105d6581548546b98eddd4ee7083bb12 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.710260  7271 tablet_replica.cc:333] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
W20260709 13:04:20.715487  9260 consensus_peers.cc:597] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.715459  7271 raft_consensus.cc:2243] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.716805  7271 raft_consensus.cc:2272] T 67513665d04b44c292143601e7f66ac8 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.719762  7271 tablet_replica.cc:333] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.720643  7271 raft_consensus.cc:2243] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.721477  7271 raft_consensus.cc:2272] T bf76dc240f6a432d80b0c04f50f2d9b6 P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.724180  7271 tablet_replica.cc:333] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.725018  7271 raft_consensus.cc:2243] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:04:20.726138  7271 raft_consensus.cc:2272] T a6565bc3f96a474988bd4e41a01fa3be P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.730785  7271 tablet_replica.cc:333] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.731681  7271 raft_consensus.cc:2243] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:04:20.732889  9260 consensus_peers.cc:597] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.736061  7271 raft_consensus.cc:2272] T 4923120e1f194cdabb09a6bc8feeba88 P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:20.737738  8500 consensus_peers.cc:597] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:20.738760  9260 consensus_peers.cc:597] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.740963  7271 tablet_replica.cc:333] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.744850  7271 raft_consensus.cc:2243] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:20.747579  7271 raft_consensus.cc:2272] T 1663cf9302e8495c8762465d306cb479 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.752275  7271 tablet_replica.cc:333] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.758083  7271 raft_consensus.cc:2243] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.762024  7271 raft_consensus.cc:2272] T 1a4fc34dde1d4b269abf3c59d18630ec P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:20.762358  8500 consensus_peers.cc:597] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.764995  7271 tablet_replica.cc:333] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
W20260709 13:04:20.765395  8500 consensus_peers.cc:597] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.766032  7271 raft_consensus.cc:2243] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:20.767561  7271 raft_consensus.cc:2272] T 21f53ea2cc904a72ae2c12832985b519 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.770525  7271 tablet_replica.cc:333] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
W20260709 13:04:20.770748  9260 consensus_peers.cc:597] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.771416  7271 raft_consensus.cc:2243] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:20.772596  7271 raft_consensus.cc:2272] T da34f43baf6c442b83da63228cfeb9a2 P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.775708  7271 tablet_replica.cc:333] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.776578  7271 raft_consensus.cc:2243] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.777241  7271 raft_consensus.cc:2272] T da501bdc0de7404f9ecae9db442353dc P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.781407  7271 tablet_replica.cc:333] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.783730  7271 raft_consensus.cc:2243] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.784783  7271 raft_consensus.cc:2272] T 94c2a7ffe57c4521a141ed4b370b82f6 P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.788201  7271 tablet_replica.cc:333] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.788973  7271 raft_consensus.cc:2243] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:20.790050  7271 raft_consensus.cc:2272] T 564c455d9a5b45a4ac479c57433dcb89 P 105d6581548546b98eddd4ee7083bb12 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.793051  7271 tablet_replica.cc:333] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
W20260709 13:04:20.793151  8500 consensus_peers.cc:597] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:20.794047  9260 consensus_peers.cc:597] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.794006  7271 raft_consensus.cc:2243] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.795234  7271 raft_consensus.cc:2272] T ba1839dfeba648529deb101072b3ca8c P 105d6581548546b98eddd4ee7083bb12 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.798282  7271 tablet_replica.cc:333] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.799180  7271 raft_consensus.cc:2243] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:20.800324  7271 raft_consensus.cc:2272] T 82a5ca9d87124561a0ec4d39bdfdf577 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.805833  7271 tablet_replica.cc:333] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.806725  7271 raft_consensus.cc:2243] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.807621  7271 raft_consensus.cc:2272] T 18bf9e256e3046b497483817dac46e78 P 105d6581548546b98eddd4ee7083bb12 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.811234  7271 tablet_replica.cc:333] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.812336  7271 raft_consensus.cc:2243] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.812999  7271 raft_consensus.cc:2272] T d9cb2781af004accaffe494aebc4c13c P 105d6581548546b98eddd4ee7083bb12 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.822791  7271 tablet_replica.cc:333] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.825623  7271 raft_consensus.cc:2243] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:20.826500  8500 consensus_peers.cc:597] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.827199  7271 raft_consensus.cc:2272] T eedf264cd691413dbd2eec9e2b133ddf P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.841660  7271 tablet_replica.cc:333] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.846899  7271 raft_consensus.cc:2243] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.847402  7271 raft_consensus.cc:2272] T dc1ae2a0b869453e80401c580552e127 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.849484  7271 tablet_replica.cc:333] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.850281  7271 raft_consensus.cc:2243] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:20.851439  7271 raft_consensus.cc:2272] T 7142cc29d84f4204bd97e07c0f6f6a84 P 105d6581548546b98eddd4ee7083bb12 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.854713  7271 tablet_replica.cc:333] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.855541  7271 raft_consensus.cc:2243] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.856173  7271 raft_consensus.cc:2272] T 26eda7bdc3194871b01c986d3db7cccf P 105d6581548546b98eddd4ee7083bb12 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:20.857739  9260 consensus_peers.cc:597] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.858775  7271 tablet_replica.cc:333] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.859508  7271 raft_consensus.cc:2243] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.861073  7271 raft_consensus.cc:2272] T e63b8dc23aaf4956bbebb9f2fa7268cd P 105d6581548546b98eddd4ee7083bb12 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.864895  7271 tablet_replica.cc:333] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
W20260709 13:04:20.874825  8500 consensus_peers.cc:597] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.865769  7271 raft_consensus.cc:2243] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.883883  7271 raft_consensus.cc:2272] T de8d0dfcd55e4b03b9a131362bf19085 P 105d6581548546b98eddd4ee7083bb12 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.892714  7271 tablet_replica.cc:333] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.895362  7271 raft_consensus.cc:2243] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:04:20.896585  7271 raft_consensus.cc:2272] T c80796a5190345179ad066af334e5bae P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:20.894382  8500 consensus_peers.cc:597] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.899951  7271 tablet_replica.cc:333] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.900904  7271 raft_consensus.cc:2243] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.901571  7271 raft_consensus.cc:2272] T 8897541fb7574f928493aa8e97a58f2f P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.904376  7271 tablet_replica.cc:333] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.905221  7271 raft_consensus.cc:2243] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:20.905879  7271 raft_consensus.cc:2272] T 1f865794cdc54a73bac275a71cb2034c P 105d6581548546b98eddd4ee7083bb12 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:20.908900  7271 tablet_replica.cc:333] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12: stopping tablet replica
I20260709 13:04:20.909735  7271 raft_consensus.cc:2243] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:04:20.910900  7271 raft_consensus.cc:2272] T a457c771b2be434bb71c63fe617485e1 P 105d6581548546b98eddd4ee7083bb12 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:20.918527  9261 consensus_peers.cc:597] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:20.918783  8501 consensus_peers.cc:597] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:21.000224  8501 consensus_peers.cc:597] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:21.021230  8501 consensus_peers.cc:597] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:21.201804  9260 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111) [suppressed 502 similar messages]
W20260709 13:04:21.452628  9261 consensus_peers.cc:597] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:21.472378  8501 consensus_peers.cc:597] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:21.473104  8501 consensus_peers.cc:597] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:21.501420  8501 consensus_peers.cc:597] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:21.529556  8271 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.25.193:43631, user_credentials={real_user=slave}} blocked reactor thread for 43587us
W20260709 13:04:21.535322  8271 catalog_manager.cc:4755] TS d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4269b37b5f3540ba9fcfd6d23ad240b6: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:21.595925  9261 consensus_peers.cc:597] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:21.598131 15787 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:21.599104 15787 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:04:21.599836  9261 consensus_peers.cc:597] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:21.607326  8501 consensus_peers.cc:597] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:21.609004 15787 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:21.612736  8501 leader_election.cc:336] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:21.636204  8500 leader_election.cc:336] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:21.636776  8500 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:21.637709 15823 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:21.721144  8501 consensus_peers.cc:597] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:21.731106 15819 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:21.732064 15819 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:21.738370 15787 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:21.739099 15787 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:04:21.740011  8501 consensus_peers.cc:597] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:21.741106 15787 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:21.745687  8501 leader_election.cc:336] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:21.751194  8500 leader_election.cc:336] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:21.751952  8500 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:04:21.754280  8501 consensus_peers.cc:597] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:21.756188  9260 leader_election.cc:336] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:21.757402 15822 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:21.759562  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:21.767963  9258 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
W20260709 13:04:21.768330  8501 consensus_peers.cc:597] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:21.769104 15818 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:21.756855 15819 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:21.797690  9261 consensus_peers.cc:597] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:21.801155 15819 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:21.802016 15819 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:21.809719  9260 leader_election.cc:336] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:21.845896 15818 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:21.846633 15818 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:21.852917 15818 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:21.859385 15804 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:21.860185 15804 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:21.862994 15804 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:21.893041  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:21.898505 15819 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:21.901973 15730 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:21.902626 15730 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:04:21.904518  8501 consensus_peers.cc:597] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:21.904526 15730 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:21.905162 15830 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:21.905972 15830 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:21.909513 15830 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:21.912093  8501 leader_election.cc:336] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:21.917619  9258 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:21.919351  8535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
I20260709 13:04:21.920742 15830 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:04:21.926122  9260 leader_election.cc:336] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:21.926853  9260 leader_election.cc:336] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:21.932305 15822 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:04:21.933331  9260 leader_election.cc:336] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:21.933020 15822 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:21.935782 15822 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:21.937903  9258 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:21.950448 15804 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:04:21.940335  9261 consensus_peers.cc:597] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:21.944025 15730 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:21.952986 15730 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:04:21.947978  8501 consensus_peers.cc:597] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:21.955142 15730 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:21.957783  8501 leader_election.cc:336] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:21.967687 15730 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:21.972395 15730 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:21.974915 15730 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:04:21.979055  8501 leader_election.cc:336] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:21.980254  9261 leader_election.cc:336] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:21.981599 15804 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:21.981961  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:21.984769 15814 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:21.984895  9261 leader_election.cc:336] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:21.985375  9261 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:21.986177 15814 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:04:21.986399  9261 consensus_peers.cc:597] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:21.987164  9261 consensus_peers.cc:597] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:21.982354 15804 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:21.991411 15804 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:21.983395  8500 leader_election.cc:336] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:21.991989  8500 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:21.992702  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "446d9310dce14ff4afff2dc2d64f68d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "b8eb0ad4490645598004d862412f4e31" is_pre_election: true
W20260709 13:04:21.997040  9260 leader_election.cc:336] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:21.997386 15730 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:21.997574  9260 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:21.998889 15804 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:22.013626 15730 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:22.014446 15730 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:22.016686 15730 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:22.022408 15804 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:22.023114 15804 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:22.025170  8500 leader_election.cc:336] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:22.030395  9260 leader_election.cc:336] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:22.029793  8501 leader_election.cc:336] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:22.025182 15804 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:22.031944 15730 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:22.032650 15730 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:22.034799 15730 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:22.038630  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:22.039399  9293 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 19.
I20260709 13:04:22.030339  8500 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:22.040964 15730 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:22.049031 15730 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:22.049678 15730 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:22.051738 15730 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:22.066300 15824 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:22.067140 15824 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:22.069727 15824 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:22.071211  8500 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
W20260709 13:04:22.072299  8501 leader_election.cc:336] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:22.075124 15824 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:22.075610 15824 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:22.076043 15824 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:04:22.073160  9261 consensus_peers.cc:597] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:22.081907  9261 leader_election.cc:336] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:22.086212  9261 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:22.087042 15804 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:22.083154  8500 leader_election.cc:336] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:22.087879  8500 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:22.091859 15730 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:22.092073  8500 leader_election.cc:336] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:22.085691  8501 leader_election.cc:336] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:22.099910 15730 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:22.100560 15730 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:22.102960 15730 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:04:22.111516  9261 consensus_peers.cc:597] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:22.117802 15804 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:22.118476 15804 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:22.120810 15804 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:22.127168  9260 leader_election.cc:336] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:22.127722  9261 consensus_peers.cc:597] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:22.116747  8501 consensus_peers.cc:597] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:22.131291  8501 leader_election.cc:336] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:22.134202  7271 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8482)
I20260709 13:04:22.145236 15824 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:22.149286  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:22.154027 15730 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:22.158736  9292 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 22.
I20260709 13:04:22.158849 15730 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:22.160848 15730 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:04:22.152813  8500 leader_election.cc:336] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:22.156518 15822 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:22.162106 15822 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:22.164398 15822 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:22.164992  8500 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:22.167069 15822 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:22.168239  8500 leader_election.cc:336] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:22.180639  8500 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:22.183542 15822 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:22.177394  9261 leader_election.cc:336] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:22.185135  9261 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:22.188211 15804 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:22.179543 15824 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:04:22.200299  8501 consensus_peers.cc:597] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:22.217680 15824 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:22.218415 15824 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:22.220537 15824 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:22.245285  8500 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:22.249473 15822 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:22.249914 15822 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:22.250276 15822 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:22.257264 15824 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:22.259905 15824 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:22.274533  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:22.275264  9292 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 16.
I20260709 13:04:22.276510  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8" is_pre_election: true
I20260709 13:04:22.277072  9292 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
W20260709 13:04:22.283914  8501 leader_election.cc:336] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:22.298334  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3aa2530ec1a42c890e68f3e67582ca0" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:04:22.298933  9292 raft_consensus.cc:3060] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:22.286756 15822 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:22.303215 15822 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
W20260709 13:04:22.290062  8500 leader_election.cc:336] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:22.307683  8500 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:22.308501 15730 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:04:22.309635  8500 leader_election.cc:336] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:22.310117  8500 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:22.310896 15730 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:22.312042  8500 leader_election.cc:336] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:22.306881  9292 raft_consensus.cc:2468] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 20.
W20260709 13:04:22.307073  8501 leader_election.cc:336] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:22.288614 15824 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:22.331707  9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4269b37b5f3540ba9fcfd6d23ad240b6" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:04:22.332298  9292 raft_consensus.cc:3060] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:04:22.332206  8500 leader_election.cc:336] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:22.332939  8500 leader_election.cc:336] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:22.333424  8500 leader_election.cc:336] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:22.339864  9292 raft_consensus.cc:2468] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 23.
I20260709 13:04:22.353837  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:04:22.355540 15822 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:22.355962 15822 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:22.356328 15822 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:22.382619 15822 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:22.385977 15822 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:22.384016  8500 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:04:22.390256 15730 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:22.390688 15730 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:22.391021 15730 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:22.399367 15730 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:22.404805 15730 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Requested vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), 446d9310dce14ff4afff2dc2d64f68d8 (127.7.25.196:40669)
I20260709 13:04:22.387369  8500 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12
I20260709 13:04:22.414230 15730 raft_consensus.cc:2804] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:22.415105 15730 raft_consensus.cc:697] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 20 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:22.416200 15730 consensus_queue.cc:237] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:22.417963  8500 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:22.420646 15824 raft_consensus.cc:2804] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:22.421284 15824 raft_consensus.cc:697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 23 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:22.422281 15824 consensus_queue.cc:237] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:22.449177  8500 leader_election.cc:336] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:22.449759  8500 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:04:22.450955  8500 leader_election.cc:336] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:22.457726  8500 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:22.458537 15730 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:04:22.459615  8500 leader_election.cc:336] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:22.451517 15822 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:22.465612  9294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6565bc3f96a474988bd4e41a01fa3be" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:04:22.466303  9294 raft_consensus.cc:3060] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:22.467096  9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da34f43baf6c442b83da63228cfeb9a2" candidate_uuid: "b8eb0ad4490645598004d862412f4e31" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "446d9310dce14ff4afff2dc2d64f68d8"
I20260709 13:04:22.467800  9293 raft_consensus.cc:3060] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:22.478991  9293 raft_consensus.cc:2468] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 18.
I20260709 13:04:22.476771  9294 raft_consensus.cc:2468] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eb0ad4490645598004d862412f4e31 in term 17.
W20260709 13:04:22.533780  8501 consensus_peers.cc:597] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:22.536737  8283 catalog_manager.cc:5697] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 19 to 20, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 20 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:22.538694  8283 catalog_manager.cc:5697] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 22 to 23, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 23 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:22.547827  8501 consensus_peers.cc:597] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:22.574489  8500 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:22.589314 15730 raft_consensus.cc:2804] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:22.589924 15730 raft_consensus.cc:697] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:22.591080 15730 consensus_queue.cc:237] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:22.606693  8500 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8, b8eb0ad4490645598004d862412f4e31; no voters: 
I20260709 13:04:22.614142 15822 raft_consensus.cc:2804] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:22.615161 15822 raft_consensus.cc:697] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Becoming Leader. State: Replica: b8eb0ad4490645598004d862412f4e31, State: Running, Role: LEADER
I20260709 13:04:22.637058 15822 consensus_queue.cc:237] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:22.646742  8500 leader_election.cc:336] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:22.647769  8500 leader_election.cc:336] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:22.675927  9261 consensus_peers.cc:597] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:22.712303  8501 consensus_peers.cc:597] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:22.717425  8283 catalog_manager.cc:5697] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 17 to 18, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 18 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:22.719221  8283 catalog_manager.cc:5697] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 reported cstate change: term changed from 16 to 17, leader changed from 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) to b8eb0ad4490645598004d862412f4e31 (127.7.25.195). New cstate: current_term: 17 leader_uuid: "b8eb0ad4490645598004d862412f4e31" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:22.723760  8501 consensus_peers.cc:597] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:22.747617  8500 consensus_peers.cc:597] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:22.757459  9260 consensus_peers.cc:597] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:22.993630  9260 consensus_peers.cc:597] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.121416  9260 consensus_peers.cc:597] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.141251  7271 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 8482)
W20260709 13:04:23.158680  9260 consensus_peers.cc:597] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.161368  9260 consensus_peers.cc:597] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.166134  8500 consensus_peers.cc:597] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:23.181861  9293 raft_consensus.cc:1275] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:04:23.183264  8500 consensus_peers.cc:597] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.189328  9260 consensus_peers.cc:597] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:23.269553 15843 consensus_queue.cc:1048] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:04:23.283037  8500 consensus_peers.cc:597] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.283540  8500 consensus_peers.cc:597] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:23.297775  9294 raft_consensus.cc:1275] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:04:23.310524  9296 raft_consensus.cc:1275] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:04:23.320636 15822 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:04:23.320971  8501 consensus_peers.cc:597] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:23.321331 15822 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:04:23.316948  8500 consensus_peers.cc:597] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.328431  9261 consensus_peers.cc:597] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:23.323520 15822 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:23.369483  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 60470.9us
W20260709 13:04:23.380934  8501 leader_election.cc:336] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:23.399739  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:36925, user_credentials={real_user=slave}} blocked reactor thread for 73562.2us
W20260709 13:04:23.400622  8500 consensus_peers.cc:597] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:23.401175  8500 consensus_peers.cc:597] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:23.443595  9293 raft_consensus.cc:1275] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Refusing update from remote peer b8eb0ad4490645598004d862412f4e31: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
W20260709 13:04:23.444810  9260 consensus_peers.cc:597] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.445408  9260 consensus_peers.cc:597] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.445850  9260 consensus_peers.cc:597] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.446251  9260 consensus_peers.cc:597] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.446727  9260 consensus_peers.cc:597] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:23.448367 15824 consensus_queue.cc:1048] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:04:23.451599 15824 consensus_queue.cc:1048] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:04:23.468540  9261 consensus_peers.cc:597] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:23.469213 15730 consensus_queue.cc:1048] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 13:04:23.474095  8500 consensus_peers.cc:597] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.474640  8500 consensus_peers.cc:597] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:23.475221  8500 consensus_peers.cc:597] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.475732  9260 consensus_peers.cc:597] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:23.480193 15848 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:23.487552 15848 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:23.490753 15848 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:23.481197  8500 consensus_peers.cc:597] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.496174  8501 leader_election.cc:336] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:23.492800  8500 leader_election.cc:336] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:23.497612  8500 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:23.509436 15848 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:23.510730  8500 consensus_peers.cc:597] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.561367  8500 leader_election.cc:336] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:23.566140  8500 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:23.567811 15730 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:04:23.578549  9260 consensus_peers.cc:597] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:23.609377 15835 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:23.610044 15835 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:23.625422  8500 consensus_peers.cc:597] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:23.625780 15835 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:23.634555  9260 leader_election.cc:336] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:23.626031  8500 consensus_peers.cc:597] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.643045  8500 consensus_peers.cc:597] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.649009  9261 leader_election.cc:336] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:23.649617  9261 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:23.652400 15851 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:04:23.700733  8501 consensus_peers.cc:597] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:23.705694 15846 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:23.706255 15846 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:23.708331 15846 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:23.706288  8500 consensus_peers.cc:597] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.716116  8501 leader_election.cc:336] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:23.754427  8500 consensus_peers.cc:597] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.758921  8500 leader_election.cc:336] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:23.763276  9260 consensus_peers.cc:597] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.771499  8501 consensus_peers.cc:597] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:23.765758  8500 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:23.784008 15846 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:23.815773 15846 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:23.816394 15846 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:23.819563 15846 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:23.832264  8501 leader_election.cc:336] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:23.842905  8500 leader_election.cc:336] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:23.848673  8500 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:23.849593 15846 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:23.855778  8500 consensus_peers.cc:597] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:23.866374 15846 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:23.867033 15846 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:23.869305 15846 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:23.874797  8501 leader_election.cc:336] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:23.889802  8500 leader_election.cc:336] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:23.890341  8500 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:23.891166 15846 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:04:23.902617  8500 consensus_peers.cc:597] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.936532  8501 consensus_peers.cc:597] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:23.987234 15851 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:23.987766 15851 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:23.992362 15835 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:23.992878 15835 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:23.997793 15835 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:24.003731  9260 leader_election.cc:336] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:24.005875  9261 leader_election.cc:336] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:24.008440  9261 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:24.012611 15849 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:23.990018 15851 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:24.016117  9260 leader_election.cc:336] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:24.018929  9261 leader_election.cc:336] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:24.019408  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:24.020335 15835 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:24.028455  9261 consensus_peers.cc:597] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:24.042995  9261 consensus_peers.cc:597] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:24.062772 15846 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:24.064505 15846 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:24.066725 15846 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:24.074321  8501 leader_election.cc:336] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:24.077349  8500 leader_election.cc:336] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:24.077971  8500 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:24.082753 15846 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:04:24.107033  9261 consensus_peers.cc:597] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:24.110551  9261 consensus_peers.cc:597] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:24.122655  8501 consensus_peers.cc:597] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:24.125598 15846 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:24.126245 15846 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:24.132207 15846 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:24.141506 15844 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:24.142055 15844 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:04:24.143030  8501 leader_election.cc:336] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:24.143600  7271 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 8482)
I20260709 13:04:24.144716 15844 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:24.158439  8501 leader_election.cc:336] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:24.166128  8500 leader_election.cc:336] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:24.166723  8500 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:24.167503 15844 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:24.174355 15849 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:24.175021 15849 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:24.179710 15849 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:24.188642  9261 leader_election.cc:336] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:24.190173  9260 leader_election.cc:336] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:24.190639  9260 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:24.191866 15849 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:24.194137 15846 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:24.194692 15846 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:24.196817 15846 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:24.205525  8556 debug-util.cc:398] Leaking SignalData structure 0x7b080040cfe0 after lost signal to thread 7274
W20260709 13:04:24.206713  8556 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6300 after lost signal to thread 8318
W20260709 13:04:24.208127  8556 debug-util.cc:398] Leaking SignalData structure 0x7b080032e400 after lost signal to thread 8559
W20260709 13:04:24.209436  8556 debug-util.cc:398] Leaking SignalData structure 0x7b0800414100 after lost signal to thread 9320
W20260709 13:04:24.206588  8501 leader_election.cc:336] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:24.218189  8500 leader_election.cc:336] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:24.222285  8501 consensus_peers.cc:597] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:24.221732  8500 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:04:24.222875  8501 consensus_peers.cc:597] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:24.232072 15844 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:04:24.249637  8501 consensus_peers.cc:597] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:24.272954  8500 leader_election.cc:336] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:24.287591  8500 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:24.288440 15846 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:24.296838  9261 consensus_peers.cc:597] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:24.350824  8501 consensus_peers.cc:597] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:24.370504  8501 consensus_peers.cc:597] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:24.373801  8501 consensus_peers.cc:597] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:24.414891  9261 consensus_peers.cc:597] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:24.457373 15861 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:24.457965 15861 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:24.460171 15861 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:24.472995  8501 leader_election.cc:336] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:24.476615  8500 leader_election.cc:336] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:24.477195  8500 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:24.478461 15861 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:24.491466 15861 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:24.492162 15861 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:04:24.498276  9261 consensus_peers.cc:597] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:24.501530  8501 leader_election.cc:336] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:24.502379  8501 consensus_peers.cc:597] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:24.494544 15861 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:24.510891  8500 leader_election.cc:336] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:24.511420  8500 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:24.512197 15861 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:04:24.568212  9261 consensus_peers.cc:597] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:24.623435  9261 consensus_peers.cc:597] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:24.774165  9261 consensus_peers.cc:597] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:24.801573  8501 consensus_peers.cc:597] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:24.841396  8501 consensus_peers.cc:597] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:24.930919  8501 consensus_peers.cc:597] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:24.991236  8501 consensus_peers.cc:597] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:25.144165  7271 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 8482)
W20260709 13:04:25.192440  8501 consensus_peers.cc:597] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:25.211022  9261 consensus_peers.cc:597] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:25.220383 15846 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:25.221024 15846 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:25.223452 15846 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:25.230417  8501 leader_election.cc:336] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:25.231022  8500 leader_election.cc:336] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:25.231693  8500 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:25.234273 15844 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:04:25.258909  8500 consensus_peers.cc:597] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:25.301303  8501 consensus_peers.cc:597] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:25.311025  8501 consensus_peers.cc:597] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:25.393692  9260 consensus_peers.cc:597] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:25.438982  8500 consensus_peers.cc:597] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:25.491921  9260 consensus_peers.cc:597] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:25.500890  8500 consensus_peers.cc:597] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:25.505265 15846 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:25.506175 15846 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:25.509796 15846 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:25.522377  8501 leader_election.cc:336] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:25.540411  8500 leader_election.cc:336] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:25.541013  8500 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:25.550442 15863 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:25.550801  8500 consensus_peers.cc:597] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:25.577721  8500 consensus_peers.cc:597] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:25.597075  8501 consensus_peers.cc:597] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:25.625160  8500 consensus_peers.cc:597] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:25.629427  8500 consensus_peers.cc:597] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:25.639451  9260 consensus_peers.cc:597] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:25.658071  9260 consensus_peers.cc:597] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:25.658727  9260 consensus_peers.cc:597] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:25.675800  9260 consensus_peers.cc:597] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:25.693161  8500 consensus_peers.cc:597] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:25.719017  9261 consensus_peers.cc:597] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:25.748322  8500 consensus_peers.cc:597] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:25.790845  9260 consensus_peers.cc:597] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:25.822106  8500 consensus_peers.cc:597] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:25.848877 15862 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:25.849502 15862 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:25.851585 15862 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:25.862004  9260 consensus_peers.cc:597] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:25.870319  8500 consensus_peers.cc:597] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:25.879907  9260 leader_election.cc:336] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:25.882861  9261 leader_election.cc:336] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:25.887077  9261 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:04:25.889282  9260 consensus_peers.cc:597] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:25.898066 15851 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:04:25.929695  8500 consensus_peers.cc:597] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:25.936264  9260 consensus_peers.cc:597] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:25.937145 15851 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:25.937635 15851 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:25.939656 15851 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:25.947574  9260 leader_election.cc:336] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:25.951491  9261 leader_election.cc:336] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:25.951920  9261 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:25.953543 15862 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:25.959504  9261 consensus_peers.cc:597] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:25.981525  9260 consensus_peers.cc:597] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:25.982254  8500 consensus_peers.cc:597] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:25.991892  9260 consensus_peers.cc:597] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:26.004242 15863 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:26.004864 15863 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:26.007148 15863 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:26.007619 15863 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:26.008085 15863 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:26.011031 15863 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:26.019014  8501 leader_election.cc:336] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:26.025244  8500 leader_election.cc:336] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:26.026233  8500 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:26.028391 15863 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:26.026860  8501 leader_election.cc:336] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:26.033906  8500 leader_election.cc:336] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:26.034387  8500 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:26.035152 15846 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:04:26.039708  8500 consensus_peers.cc:597] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:26.047313 15851 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:26.047863 15851 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:26.049962 15851 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:26.055205  9260 leader_election.cc:336] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:26.060056  9261 leader_election.cc:336] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:26.060525  9261 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:26.061312 15851 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:04:26.074077  9260 consensus_peers.cc:597] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:26.096882  8500 consensus_peers.cc:597] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:26.110821  8500 consensus_peers.cc:597] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:26.122025  8501 consensus_peers.cc:597] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:26.135296  8500 consensus_peers.cc:597] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:26.144657  7271 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 8482)
W20260709 13:04:26.178303  9260 consensus_peers.cc:597] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:26.212069  9260 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111) [suppressed 714 similar messages]
W20260709 13:04:26.233855  8501 consensus_peers.cc:597] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:26.281843  9261 consensus_peers.cc:597] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:26.304288  8500 consensus_peers.cc:597] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:26.356456  9261 consensus_peers.cc:597] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:26.380806  8500 consensus_peers.cc:597] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:26.418975 15846 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:26.419589 15846 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:26.421638 15846 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:26.428412  8501 leader_election.cc:336] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:26.429263  8500 leader_election.cc:336] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:26.429713  8500 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:26.430485 15846 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:26.436226  8500 consensus_peers.cc:597] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:26.501920  9261 consensus_peers.cc:597] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:26.527588  8501 consensus_peers.cc:597] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:26.633740  8501 consensus_peers.cc:597] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:26.655429  8501 consensus_peers.cc:597] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:26.670994  8501 consensus_peers.cc:597] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:26.679116  8501 consensus_peers.cc:597] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:26.702908 15846 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:26.703425 15846 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:04:26.707237  9261 consensus_peers.cc:597] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:26.712040 15846 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:26.714656  8501 leader_election.cc:336] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:26.717109  9261 consensus_peers.cc:597] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:26.725277  8501 consensus_peers.cc:597] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:26.726306  8500 leader_election.cc:336] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:26.728159  8500 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:26.730933 15846 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:04:26.745584  8501 consensus_peers.cc:597] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:26.806435  8501 consensus_peers.cc:597] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:26.846698  8501 consensus_peers.cc:597] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:26.878199  9261 consensus_peers.cc:597] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:26.885725 15863 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:26.886327 15863 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:26.890311 15863 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:26.897102  8501 leader_election.cc:336] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:26.907409  8500 leader_election.cc:336] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:26.907876  8500 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:26.908948 15844 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:27.067054  9261 consensus_peers.cc:597] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:27.114634  9261 consensus_peers.cc:597] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:27.117962 15866 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:27.118618 15866 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:27.127751  9261 leader_election.cc:336] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:27.129745  9260 leader_election.cc:336] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:27.130209  9260 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:27.131168 15866 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:27.131826 15865 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:27.145155  7271 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 8482)
I20260709 13:04:27.149503 15863 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:04:27.149973  8501 consensus_peers.cc:597] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:27.150110 15863 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:27.151396 15844 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:27.151960 15844 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:27.152349 15863 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:27.154178 15844 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:27.159087  9261 consensus_peers.cc:597] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:27.163084  8500 leader_election.cc:336] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:27.168732  8500 leader_election.cc:336] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:27.170874  8501 leader_election.cc:336] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:27.176118  8501 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:04:27.177587  8501 leader_election.cc:336] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:27.182505  8501 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:27.178112 15844 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:27.184791 15844 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:04:27.201349  9261 consensus_peers.cc:597] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:27.253269  8501 consensus_peers.cc:597] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:27.263984 15844 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:27.264662 15844 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:27.266952 15844 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:27.271876  8501 leader_election.cc:336] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:27.274796  8500 leader_election.cc:336] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:27.275277  8500 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:27.276572 15844 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:27.317219  8501 consensus_peers.cc:597] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:27.482800 15844 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:27.483355 15844 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:27.485579 15844 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:27.493485  8501 leader_election.cc:336] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:27.494030  8500 leader_election.cc:336] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:27.494431  8500 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:27.495630 15863 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:04:27.529312  8501 consensus_peers.cc:597] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:27.624064 15844 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:27.624624 15844 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:27.626797 15844 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:27.631613  8501 leader_election.cc:336] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:27.641209  8500 leader_election.cc:336] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:27.641686  8500 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:27.642433 15844 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:27.693991  8501 consensus_peers.cc:597] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:27.772444  8500 consensus_peers.cc:597] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:27.776829  9260 consensus_peers.cc:597] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:27.808076  8500 consensus_peers.cc:597] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:27.818284  8500 consensus_peers.cc:597] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:27.838161  8500 consensus_peers.cc:597] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:27.856659  8501 consensus_peers.cc:597] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:27.868044 15862 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:27.868686 15862 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:27.872651 15862 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:27.886950  9260 leader_election.cc:336] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:27.888594  9261 leader_election.cc:336] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:27.890112  9261 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:27.892161 15866 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:04:27.917495  8500 consensus_peers.cc:597] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:27.944078  9260 consensus_peers.cc:597] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:27.978206  9261 consensus_peers.cc:597] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:27.986372  9261 consensus_peers.cc:597] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:28.003252  9260 consensus_peers.cc:597] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.051854  8501 consensus_peers.cc:597] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:28.066457  9260 consensus_peers.cc:597] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.086957  8501 consensus_peers.cc:597] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:28.115762  9260 consensus_peers.cc:597] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.145680  7271 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 8482)
W20260709 13:04:28.157438  9260 consensus_peers.cc:597] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.179979  8500 consensus_peers.cc:597] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:28.191326  8500 consensus_peers.cc:597] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.240082  9260 consensus_peers.cc:597] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.243643  8500 consensus_peers.cc:597] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.282626  9261 consensus_peers.cc:597] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:28.338505  8500 consensus_peers.cc:597] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.369622  8500 consensus_peers.cc:597] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.371984  8500 consensus_peers.cc:597] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.437117  8500 consensus_peers.cc:597] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.441462  8500 consensus_peers.cc:597] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.694525  9260 consensus_peers.cc:597] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.749552  9260 consensus_peers.cc:597] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:28.753334 15867 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
W20260709 13:04:28.756825  8501 consensus_peers.cc:597] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:28.753993 15867 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:28.762873 15867 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:28.767745  8501 leader_election.cc:336] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:28.771497 15867 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:28.772064 15867 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:28.774339 15867 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:28.776373  8500 consensus_peers.cc:597] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.784746  8501 leader_election.cc:336] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:28.788204 15874 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:28.788847 15874 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:28.791496  9260 consensus_peers.cc:597] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.792132  9260 consensus_peers.cc:597] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:28.798866 15874 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:28.812885  8501 consensus_peers.cc:597] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:28.813071  9261 leader_election.cc:336] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:28.816718  9260 consensus_peers.cc:597] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.817981  9260 consensus_peers.cc:597] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.823830  9261 consensus_peers.cc:597] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:28.826848  9260 leader_election.cc:336] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:28.827739  8500 consensus_peers.cc:597] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.832700  8500 consensus_peers.cc:597] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:28.831806  9260 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:04:28.835141  9260 consensus_peers.cc:597] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:28.835647 15874 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:28.842808  8500 consensus_peers.cc:597] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.843581  8501 consensus_peers.cc:597] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:28.847460  8500 consensus_peers.cc:597] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.847879  8500 leader_election.cc:336] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:28.853956  8500 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:28.854938 15870 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:04:28.855988  8500 leader_election.cc:336] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:28.856468  8500 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:28.857299 15870 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:28.887753  8500 consensus_peers.cc:597] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:28.953779  8500 consensus_peers.cc:597] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:29.146154  7271 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 8482)
W20260709 13:04:29.147588  9261 consensus_peers.cc:597] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:04:29.188706 15870 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:29.189275 15870 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:29.191329 15870 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:29.204031 15844 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:29.204630 15844 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:29.206717 15844 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:29.211402  8501 consensus_peers.cc:597] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:29.212517  9261 consensus_peers.cc:597] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:29.216912  8501 consensus_peers.cc:597] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:29.229481  8500 leader_election.cc:336] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:29.241096  8500 leader_election.cc:336] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:29.243593  8501 consensus_peers.cc:597] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:29.249764  8501 leader_election.cc:336] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:29.251664  8501 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:29.254384 15844 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:29.285553 15867 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:29.286067 15867 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:29.287993 15867 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:29.319288  8501 leader_election.cc:336] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:29.320299  8501 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:29.330647 15867 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:04:29.331733  8501 consensus_peers.cc:597] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:29.338030  8501 consensus_peers.cc:597] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:29.374927  8501 consensus_peers.cc:597] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:29.375957  8500 leader_election.cc:336] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:29.391386  9261 consensus_peers.cc:597] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:29.397272  9261 consensus_peers.cc:597] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:04:29.398563 15844 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:29.408574 15844 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:29.410629 15844 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:29.429278  8501 leader_election.cc:336] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:29.431476  8501 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:29.434549 15844 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:29.435878  8501 consensus_peers.cc:597] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:29.441864  9261 consensus_peers.cc:597] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:29.454123  8501 leader_election.cc:336] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:29.456110  8315 debug-util.cc:398] Leaking SignalData structure 0x7b08000a7600 after lost signal to thread 7274
W20260709 13:04:29.457949  8315 debug-util.cc:398] Leaking SignalData structure 0x7b08002c7540 after lost signal to thread 8318
W20260709 13:04:29.459291  8315 debug-util.cc:398] Leaking SignalData structure 0x7b080031dbc0 after lost signal to thread 8559
W20260709 13:04:29.460523  8315 debug-util.cc:398] Leaking SignalData structure 0x7b0800390de0 after lost signal to thread 9320
W20260709 13:04:29.471864  8500 leader_election.cc:336] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:29.477272  8500 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:04:29.475756  8501 consensus_peers.cc:597] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:04:29.479486 15844 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:29.557919 15844 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:29.558435 15844 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:29.560401 15844 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:29.595144  8501 leader_election.cc:336] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:29.598312  8500 leader_election.cc:336] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:29.599766  8500 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:29.605283 15844 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:04:29.601466  9261 consensus_peers.cc:597] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:29.643791  8501 consensus_peers.cc:597] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:29.645418  9261 consensus_peers.cc:597] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:29.668931  9261 consensus_peers.cc:597] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:29.787312  8501 consensus_peers.cc:597] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:29.795298  8271 catalog_manager.cc:4755] TS d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4269b37b5f3540ba9fcfd6d23ad240b6: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:29.805171 15867 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:29.805860 15867 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:29.810725 15867 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:29.816767  8501 leader_election.cc:336] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:29.844403  9261 consensus_peers.cc:597] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:29.854383  8500 leader_election.cc:336] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:29.855000  8500 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:29.856911 15870 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:04:29.863476  8501 consensus_peers.cc:597] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:30.125013  8500 consensus_peers.cc:597] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:30.146649  7271 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 8482)
W20260709 13:04:30.165131  9260 consensus_peers.cc:597] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:30.182631  8500 consensus_peers.cc:597] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:30.290709 15873 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:30.291397 15873 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:30.298821 15873 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:30.301050  9260 leader_election.cc:336] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:30.301966  9261 leader_election.cc:336] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:30.302356  9261 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:30.303063 15873 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:04:30.336508  9261 consensus_peers.cc:597] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:30.342613  8500 consensus_peers.cc:597] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:30.345916  8501 consensus_peers.cc:597] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:30.423286  8501 consensus_peers.cc:597] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:30.453176  8500 consensus_peers.cc:597] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:30.502883  8501 consensus_peers.cc:597] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:30.506796  8500 consensus_peers.cc:597] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:30.571763 15870 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:30.572270 15870 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:04:30.579679  8501 leader_election.cc:336] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:30.580752  9260 consensus_peers.cc:597] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:30.590567  8500 leader_election.cc:336] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:30.591044  8500 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:30.591892 15867 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:04:30.593524  8501 consensus_peers.cc:597] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:30.580821 15870 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:30.635609  8500 consensus_peers.cc:597] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:30.691128  8501 consensus_peers.cc:597] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:30.712785  8500 consensus_peers.cc:597] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:30.719434  9260 consensus_peers.cc:597] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:30.737972  9260 consensus_peers.cc:597] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:30.741245  9260 consensus_peers.cc:597] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:30.759232  9261 consensus_peers.cc:597] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:30.788333  9261 consensus_peers.cc:597] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:04:30.823359  9293 consensus_queue.cc:237] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:30.839457  8533 raft_consensus.cc:1275] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Refusing update from remote peer 446d9310dce14ff4afff2dc2d64f68d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:30.847021 15880 consensus_queue.cc:1048] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:04:30.865243  8500 consensus_peers.cc:597] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:30.880578  9261 consensus_peers.cc:597] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:30.906174  8500 consensus_peers.cc:597] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:30.911679  8500 consensus_peers.cc:597] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:30.917719 15880 raft_consensus.cc:2955] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 4 to 11, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:30.920614  8535 raft_consensus.cc:2955] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 4 to 11, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:30.953536  8276 catalog_manager.cc:5697] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 reported cstate change: config changed from index 4 to 11, VOTER 105d6581548546b98eddd4ee7083bb12 (127.7.25.194) evicted. New cstate: current_term: 12 leader_uuid: "446d9310dce14ff4afff2dc2d64f68d8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } } }
I20260709 13:04:30.967900  8270 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 56cc480ba6f642e08bb2e547a0ef50a1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
W20260709 13:04:31.014578  8500 consensus_peers.cc:597] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:31.031278  8500 consensus_peers.cc:597] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:31.024587  9260 consensus_peers.cc:597] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:31.033452  9260 consensus_peers.cc:597] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:31.050595  8500 consensus_peers.cc:597] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:31.053388  8500 consensus_peers.cc:597] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:31.069715  9260 consensus_peers.cc:597] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:31.079087  8270 catalog_manager.cc:4755] TS 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 56cc480ba6f642e08bb2e547a0ef50a1: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:31.080703 15844 raft_consensus.cc:493] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:31.081266 15844 raft_consensus.cc:515] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:31.083168 15844 leader_election.cc:290] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:31.089761  8501 leader_election.cc:336] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:31.095407  8500 leader_election.cc:336] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:31.095963  8500 leader_election.cc:304] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:31.100481 15844 raft_consensus.cc:2749] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:31.107729  8500 consensus_peers.cc:597] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:31.120906  8501 consensus_peers.cc:597] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:31.123544  9260 consensus_peers.cc:597] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:31.147145  7271 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 8482)
W20260709 13:04:31.161737  8500 consensus_peers.cc:597] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:31.162403  8500 consensus_peers.cc:597] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:31.177505  9260 consensus_peers.cc:597] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:31.223711  8501 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111) [suppressed 704 similar messages]
W20260709 13:04:31.270438  9260 consensus_peers.cc:597] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:31.332505 15880 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:31.333024 15880 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:31.335124 15880 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:31.345220  9260 leader_election.cc:336] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:31.353588  9261 leader_election.cc:336] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:31.354102  9261 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:31.354966 15880 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:04:31.365545  8500 consensus_peers.cc:597] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:31.374794  9260 consensus_peers.cc:597] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:31.384147  8500 consensus_peers.cc:597] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:31.416749  9260 consensus_peers.cc:597] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:31.431969  9261 consensus_peers.cc:597] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:31.446779  8501 consensus_peers.cc:597] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:31.447765  8500 consensus_peers.cc:597] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:31.448485  9261 consensus_peers.cc:597] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:31.524348  8501 consensus_peers.cc:597] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:31.575703  8501 consensus_peers.cc:597] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:31.585016  8501 consensus_peers.cc:597] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:31.613540  9261 consensus_peers.cc:597] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:31.666913  9261 consensus_peers.cc:597] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:04:31.685794 15880 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:31.687135 15880 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:31.690943 15880 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:31.706003  8501 consensus_peers.cc:597] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:31.706970  9260 leader_election.cc:336] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:31.709164  9261 leader_election.cc:336] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:31.711340  9261 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:31.713160 15892 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:31.734089  8501 consensus_peers.cc:597] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:31.739202  9261 consensus_peers.cc:597] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:31.777500  8501 consensus_peers.cc:597] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:04:31.879757 15891 raft_consensus.cc:493] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:31.880517 15891 raft_consensus.cc:515] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:31.883064 15891 leader_election.cc:290] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:31.894506  9261 consensus_peers.cc:597] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:31.931516  8501 leader_election.cc:336] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:31.962644  9261 consensus_peers.cc:597] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:31.963543  8501 consensus_peers.cc:597] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:31.965543  8500 leader_election.cc:336] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:31.966061  8500 leader_election.cc:304] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:31.967172 15891 raft_consensus.cc:2749] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:04:31.979228  8501 consensus_peers.cc:597] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:32.019237  8501 consensus_peers.cc:597] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:32.123237  9261 consensus_peers.cc:597] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:32.148187  7271 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 8482)
W20260709 13:04:32.204588  8501 consensus_peers.cc:597] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:04:32.306391 15844 raft_consensus.cc:493] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:32.307013 15844 raft_consensus.cc:515] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:04:32.313541  8501 leader_election.cc:336] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:32.315670 15844 leader_election.cc:290] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:32.325361  8500 leader_election.cc:336] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:32.332305  8501 consensus_peers.cc:597] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:04:32.333009  8500 leader_election.cc:304] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:32.334983 15891 raft_consensus.cc:2749] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:04:32.340489  8270 catalog_manager.cc:4755] TS 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 56cc480ba6f642e08bb2e547a0ef50a1: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:32.350574  9261 consensus_peers.cc:597] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:32.361732  8501 consensus_peers.cc:597] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:04:32.541913 15844 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:32.542616 15844 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:32.545849 15844 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:32.575269  8500 consensus_peers.cc:597] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:32.577327  8501 leader_election.cc:336] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:32.880355 15899 raft_consensus.cc:493] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:32.944097 15899 raft_consensus.cc:515] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:32.947065 15899 leader_election.cc:290] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:33.034205  8500 leader_election.cc:336] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:33.034754  8500 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:04:33.035573  9261 consensus_peers.cc:597] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:33.038159  9260 consensus_peers.cc:597] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:33.038575 15899 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:33.044330  8501 consensus_peers.cc:597] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:33.064268  8501 leader_election.cc:336] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:33.065130  8501 consensus_peers.cc:597] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:33.065743  8501 consensus_peers.cc:597] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:04:33.106541 15899 raft_consensus.cc:493] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:33.107259 15899 raft_consensus.cc:515] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:33.109426 15899 leader_election.cc:290] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:33.124588  8501 leader_election.cc:336] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:33.137221  8501 consensus_peers.cc:597] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:04:33.138728 15891 raft_consensus.cc:493] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:33.139564 15891 raft_consensus.cc:515] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:33.141827 15891 leader_election.cc:290] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:33.144240  8500 consensus_peers.cc:597] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:33.144948  8500 leader_election.cc:336] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:33.145455  8500 leader_election.cc:304] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:04:33.146595  8500 consensus_peers.cc:597] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:33.146639 15905 raft_consensus.cc:2749] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:04:33.148677  7271 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 8482)
W20260709 13:04:33.152441  8501 leader_election.cc:336] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:33.155673  8500 consensus_peers.cc:597] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:33.161669  8500 leader_election.cc:336] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:33.162122  8500 leader_election.cc:304] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:33.166337 15905 raft_consensus.cc:2749] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:04:33.169498  8500 consensus_peers.cc:597] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:33.170974  9260 consensus_peers.cc:597] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:33.176009  8500 leader_election.cc:336] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:33.176554  8500 leader_election.cc:304] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:33.177305 15905 raft_consensus.cc:2749] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:04:33.212767  9260 consensus_peers.cc:597] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:33.225574 15899 raft_consensus.cc:493] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:33.226368 15899 raft_consensus.cc:515] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:33.228734 15899 leader_election.cc:290] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:33.235299  8501 leader_election.cc:336] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:33.242463  8500 leader_election.cc:336] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:33.243005  8500 leader_election.cc:304] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:33.244652 15899 raft_consensus.cc:2749] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:33.295780  8500 consensus_peers.cc:597] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:33.300004  9260 consensus_peers.cc:597] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:33.318573 15905 raft_consensus.cc:493] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:33.319726 15905 raft_consensus.cc:515] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
W20260709 13:04:33.326122  8501 leader_election.cc:336] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:33.327610 15905 leader_election.cc:290] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:33.327695  8500 leader_election.cc:336] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:33.328286  8500 leader_election.cc:304] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:33.330554 15905 raft_consensus.cc:2749] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:33.390333 15892 raft_consensus.cc:493] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:33.390875 15892 raft_consensus.cc:515] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:33.398890  9261 leader_election.cc:336] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:33.399628  8500 consensus_peers.cc:597] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:33.405135  8500 consensus_peers.cc:597] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:33.407420  9260 leader_election.cc:336] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:33.407900  9260 leader_election.cc:304] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:33.408793 15903 raft_consensus.cc:2749] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:33.409305 15892 leader_election.cc:290] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:33.418883  8270 catalog_manager.cc:4755] TS 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 56cc480ba6f642e08bb2e547a0ef50a1: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:33.445216  8500 consensus_peers.cc:597] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:33.467131  9260 consensus_peers.cc:597] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:33.477871  9260 consensus_peers.cc:597] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:33.493932  9260 consensus_peers.cc:597] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:33.500759  8500 consensus_peers.cc:597] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:33.509371  9261 consensus_peers.cc:597] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:33.525260  8500 consensus_peers.cc:597] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:33.585251  8501 consensus_peers.cc:597] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:33.618621  9261 consensus_peers.cc:597] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:33.624274  9261 consensus_peers.cc:597] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:33.632516  8500 consensus_peers.cc:597] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:33.641294  8500 consensus_peers.cc:597] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:33.645624  8501 consensus_peers.cc:597] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:33.660930  9260 consensus_peers.cc:597] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:33.677769  8500 consensus_peers.cc:597] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:33.681775  9260 consensus_peers.cc:597] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:33.695979  9317 debug-util.cc:398] Leaking SignalData structure 0x7b0800349240 after lost signal to thread 7274
W20260709 13:04:33.697153  9317 debug-util.cc:398] Leaking SignalData structure 0x7b0800375b40 after lost signal to thread 8318
W20260709 13:04:33.698227  9317 debug-util.cc:398] Leaking SignalData structure 0x7b08002f61a0 after lost signal to thread 8559
W20260709 13:04:33.699157  9317 debug-util.cc:398] Leaking SignalData structure 0x7b080019f980 after lost signal to thread 9320
W20260709 13:04:33.754582  8500 consensus_peers.cc:597] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:33.807101 15903 raft_consensus.cc:493] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:33.807739 15903 raft_consensus.cc:515] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:33.810171 15903 leader_election.cc:290] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:33.820602  9260 leader_election.cc:336] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:33.822459  9261 leader_election.cc:336] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:33.823149  9261 leader_election.cc:304] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:33.823998 15903 raft_consensus.cc:2749] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:04:33.854130  8500 consensus_peers.cc:597] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:33.902280  9260 consensus_peers.cc:597] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:33.909075  9260 consensus_peers.cc:597] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:34.001312  9260 consensus_peers.cc:597] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:34.004352  9260 consensus_peers.cc:597] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:34.066108  9261 consensus_peers.cc:597] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:34.081648  8501 consensus_peers.cc:597] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:34.106688  9261 consensus_peers.cc:597] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:34.149142  7271 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 8482)
W20260709 13:04:34.168125  9261 consensus_peers.cc:597] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:34.167090  8500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:40669, user_credentials={real_user=slave}} blocked reactor thread for 67254.5us
W20260709 13:04:34.195384  8501 consensus_peers.cc:597] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:34.199685  8500 consensus_peers.cc:597] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:34.232231  8500 consensus_peers.cc:597] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:34.235707  9261 consensus_peers.cc:597] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:34.251158  8500 consensus_peers.cc:597] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:34.296784  8501 consensus_peers.cc:597] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:34.312630  8501 consensus_peers.cc:597] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:34.364122  8500 consensus_peers.cc:597] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:34.386019  8501 consensus_peers.cc:597] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:34.391785  8501 consensus_peers.cc:597] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:34.426945  8501 consensus_peers.cc:597] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:34.453529  9261 consensus_peers.cc:597] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:34.470057  8501 consensus_peers.cc:597] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:04:34.511884 15905 raft_consensus.cc:493] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:34.512486 15905 raft_consensus.cc:515] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:34.515094 15905 leader_election.cc:290] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:34.525238  8501 leader_election.cc:336] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:34.549029  8500 leader_election.cc:336] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:34.549710  8500 leader_election.cc:304] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:34.550719 15899 raft_consensus.cc:2749] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:04:34.632882  9261 consensus_peers.cc:597] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:34.674789  9261 consensus_peers.cc:597] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:34.698921  8501 consensus_peers.cc:597] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:34.775264  8501 consensus_peers.cc:597] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:34.779608  8500 consensus_peers.cc:597] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:34.792166  9261 consensus_peers.cc:597] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:34.795356  8501 consensus_peers.cc:597] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:34.801335  8501 consensus_peers.cc:597] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:34.834626  8501 consensus_peers.cc:597] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:04:34.925228 15905 raft_consensus.cc:493] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:34.925810 15905 raft_consensus.cc:515] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:34.928006 15905 leader_election.cc:290] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:34.948463  8500 leader_election.cc:336] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:34.950134  8501 leader_election.cc:336] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:34.951325  8501 leader_election.cc:304] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:34.952417 15905 raft_consensus.cc:2749] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:35.016115  7271 tablet_server.cc:196] TabletServer@127.7.25.194:0 shutdown complete.
W20260709 13:04:35.162288  9258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:40767, user_credentials={real_user=slave}} blocked reactor thread for 43746.3us
W20260709 13:04:35.174077  8501 consensus_peers.cc:597] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:04:35.179993 15899 raft_consensus.cc:493] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:35.180682 15899 raft_consensus.cc:515] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } }
I20260709 13:04:35.182813 15899 leader_election.cc:290] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
I20260709 13:04:35.205000  7271 tablet_server.cc:179] TabletServer@127.7.25.195:0 shutting down...
W20260709 13:04:35.215582  8500 leader_election.cc:336] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:35.225059  9261 consensus_peers.cc:597] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:35.239233  8501 leader_election.cc:336] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:35.239730  8501 leader_election.cc:304] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eb0ad4490645598004d862412f4e31; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:35.240504 15899 raft_consensus.cc:2749] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:35.276775  9258 consensus_peers.cc:597] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Couldn't send request to peer b8eb0ad4490645598004d862412f4e31. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:35.298869  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:35.300364  7271 tablet_replica.cc:333] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.301617  7271 raft_consensus.cc:2243] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.303045  7271 raft_consensus.cc:2272] T 5b3df375d584465c8712d996256828cf P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.306286  7271 tablet_replica.cc:333] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.307229  7271 raft_consensus.cc:2243] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.307958  7271 raft_consensus.cc:2272] T 45d39340781e466abc648aacd7ee5822 P b8eb0ad4490645598004d862412f4e31 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.310824  7271 tablet_replica.cc:333] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.311740  7271 raft_consensus.cc:2243] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.312431  7271 raft_consensus.cc:2272] T cf1cdd90debd40a6a2361af7491977d6 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.315522  7271 tablet_replica.cc:333] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.316329  7271 raft_consensus.cc:2243] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.318306  7271 raft_consensus.cc:2272] T b3aa2530ec1a42c890e68f3e67582ca0 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.321805  7271 tablet_replica.cc:333] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.322614  7271 raft_consensus.cc:2243] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.323732  7271 raft_consensus.cc:2272] T 612cbe4a26f4473aaa8e3c84a7719e03 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.326406  7271 tablet_replica.cc:333] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.327324  7271 raft_consensus.cc:2243] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.327905  7271 raft_consensus.cc:2272] T 513b83e2d61c4ad7994ad4629a3d0079 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.330765  7271 tablet_replica.cc:333] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.331621  7271 raft_consensus.cc:2243] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.332644  7271 raft_consensus.cc:2272] T 4ef8cc956c764eeeb9389ea099a35006 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.335493  7271 tablet_replica.cc:333] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.336289  7271 raft_consensus.cc:2243] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.337512  7271 raft_consensus.cc:2272] T 74f6762ba0124b3a87dd4d54f5693927 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.340196  7271 tablet_replica.cc:333] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.341182  7271 raft_consensus.cc:2243] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.342334  7271 raft_consensus.cc:2272] T edca272c646743e09fb3b0c827c963b8 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.345156  7271 tablet_replica.cc:333] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
W20260709 13:04:35.345583  9260 consensus_peers.cc:597] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:35.346172  7271 raft_consensus.cc:2243] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.346894  7271 raft_consensus.cc:2272] T 9c3c85d53de1420dab74923e2fc80f02 P b8eb0ad4490645598004d862412f4e31 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.352979  7271 tablet_replica.cc:333] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.353824  7271 raft_consensus.cc:2243] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.355115  7271 raft_consensus.cc:2272] T 0cd574dc2f1347e8996cdb77177d1a54 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:35.357178  9258 consensus_peers.cc:597] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Couldn't send request to peer b8eb0ad4490645598004d862412f4e31. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:35.357908  7271 tablet_replica.cc:333] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
W20260709 13:04:35.362509  9258 consensus_peers.cc:597] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Couldn't send request to peer b8eb0ad4490645598004d862412f4e31. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:35.364655  7271 raft_consensus.cc:2243] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.366051  7271 raft_consensus.cc:2272] T 30e70dfc88914a66b000a84bef302149 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.368903  7271 tablet_replica.cc:333] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.369684  7271 raft_consensus.cc:2243] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.370916  7271 raft_consensus.cc:2272] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.373814  7271 tablet_replica.cc:333] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.374588  7271 raft_consensus.cc:2243] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.376344  7271 raft_consensus.cc:2272] T bf76dc240f6a432d80b0c04f50f2d9b6 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.379381  7271 tablet_replica.cc:333] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
W20260709 13:04:35.380105  9258 consensus_peers.cc:597] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Couldn't send request to peer b8eb0ad4490645598004d862412f4e31. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:35.380295  7271 raft_consensus.cc:2243] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.384254  7271 raft_consensus.cc:2272] T a6565bc3f96a474988bd4e41a01fa3be P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.387308  7271 tablet_replica.cc:333] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.388154  7271 raft_consensus.cc:2243] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.388916  7271 raft_consensus.cc:2272] T 56cc480ba6f642e08bb2e547a0ef50a1 P b8eb0ad4490645598004d862412f4e31 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.391706  7271 tablet_replica.cc:333] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.392508  7271 raft_consensus.cc:2243] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.393488  7271 raft_consensus.cc:2272] T aa98ca5e34b24545adab36c2973a2f6e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.396402  7271 tablet_replica.cc:333] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.397202  7271 raft_consensus.cc:2243] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.397841  7271 raft_consensus.cc:2272] T e83390ed01194281aab5dc3a33f49783 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.400478  7271 tablet_replica.cc:333] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.401938  7271 raft_consensus.cc:2243] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.402612  7271 raft_consensus.cc:2272] T 4f60cb7236fe439e9faa6d4f269e96da P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:35.403971  8501 consensus_peers.cc:597] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:04:35.405284  7271 tablet_replica.cc:333] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.406257  7271 raft_consensus.cc:2243] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.407658  7271 raft_consensus.cc:2272] T 25a125e8035444f5921cc2a7eef152ae P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.410408  7271 tablet_replica.cc:333] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.411265  7271 raft_consensus.cc:2243] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.412053  7271 raft_consensus.cc:2272] T ba1839dfeba648529deb101072b3ca8c P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.414863  7271 tablet_replica.cc:333] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.415633  7271 raft_consensus.cc:2243] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.417339  7271 raft_consensus.cc:2272] T 67513665d04b44c292143601e7f66ac8 P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.420409  7271 tablet_replica.cc:333] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.421226  7271 raft_consensus.cc:2243] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.421860  7271 raft_consensus.cc:2272] T 21f53ea2cc904a72ae2c12832985b519 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.424805  7271 tablet_replica.cc:333] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.426334  7271 raft_consensus.cc:2243] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.428272  7271 raft_consensus.cc:2272] T da34f43baf6c442b83da63228cfeb9a2 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.431051  7271 tablet_replica.cc:333] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.431911  7271 raft_consensus.cc:2243] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.433018  7271 raft_consensus.cc:2272] T 18bf9e256e3046b497483817dac46e78 P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.436517  7271 tablet_replica.cc:333] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.437321  7271 raft_consensus.cc:2243] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.438755  7271 raft_consensus.cc:2272] T da501bdc0de7404f9ecae9db442353dc P b8eb0ad4490645598004d862412f4e31 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.441411  7271 tablet_replica.cc:333] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.442135  7271 raft_consensus.cc:2243] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.443724  7271 raft_consensus.cc:2272] T 4269b37b5f3540ba9fcfd6d23ad240b6 P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.446560  7271 tablet_replica.cc:333] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.447265  7271 raft_consensus.cc:2243] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.448539  7271 raft_consensus.cc:2272] T 94c2a7ffe57c4521a141ed4b370b82f6 P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.451298  7271 tablet_replica.cc:333] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.452075  7271 raft_consensus.cc:2243] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.452728  7271 raft_consensus.cc:2272] T 564c455d9a5b45a4ac479c57433dcb89 P b8eb0ad4490645598004d862412f4e31 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.455333  7271 tablet_replica.cc:333] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.456051  7271 raft_consensus.cc:2243] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.456813  7271 raft_consensus.cc:2272] T 82a5ca9d87124561a0ec4d39bdfdf577 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.459450  7271 tablet_replica.cc:333] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.460791  7271 raft_consensus.cc:2243] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.462042  7271 raft_consensus.cc:2272] T aee63d7055b1430b8d1edea205bc40f0 P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.466503  7271 tablet_replica.cc:333] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.467216  7271 raft_consensus.cc:2243] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.468550  7271 raft_consensus.cc:2272] T d9cb2781af004accaffe494aebc4c13c P b8eb0ad4490645598004d862412f4e31 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:35.467294  9261 consensus_peers.cc:597] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:04:35.471980  7271 tablet_replica.cc:333] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.472770  7271 raft_consensus.cc:2243] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.473562  7271 raft_consensus.cc:2272] T 866f457c2bf048109ab977c2b010de5a P b8eb0ad4490645598004d862412f4e31 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.476316  7271 tablet_replica.cc:333] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.477047  7271 raft_consensus.cc:2243] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.478253  7271 raft_consensus.cc:2272] T eedf264cd691413dbd2eec9e2b133ddf P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.480732  7271 tablet_replica.cc:333] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.481473  7271 raft_consensus.cc:2243] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.482653  7271 raft_consensus.cc:2272] T 28d98f2932e74257b6a032b544f7b4bd P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.485276  7271 tablet_replica.cc:333] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
W20260709 13:04:35.485972  9258 consensus_peers.cc:597] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Couldn't send request to peer b8eb0ad4490645598004d862412f4e31. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:35.485978  7271 raft_consensus.cc:2243] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.487250  7271 raft_consensus.cc:2272] T 26eda7bdc3194871b01c986d3db7cccf P b8eb0ad4490645598004d862412f4e31 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.490176  7271 tablet_replica.cc:333] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.490919  7271 raft_consensus.cc:2243] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.491505  7271 raft_consensus.cc:2272] T c80796a5190345179ad066af334e5bae P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.494166  7271 tablet_replica.cc:333] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.494922  7271 raft_consensus.cc:2243] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.496207  7271 raft_consensus.cc:2272] T 911fa6f4e14f47f6a76fff18a00cd58e P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.498893  7271 tablet_replica.cc:333] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.499629  7271 raft_consensus.cc:2243] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.500787  7271 raft_consensus.cc:2272] T e63b8dc23aaf4956bbebb9f2fa7268cd P b8eb0ad4490645598004d862412f4e31 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.504352  7271 tablet_replica.cc:333] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.505293  7271 raft_consensus.cc:2243] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.506670  7271 raft_consensus.cc:2272] T 1a4fc34dde1d4b269abf3c59d18630ec P b8eb0ad4490645598004d862412f4e31 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:35.507476  8270 catalog_manager.cc:4755] TS 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 56cc480ba6f642e08bb2e547a0ef50a1: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:35.509268  7271 tablet_replica.cc:333] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.510035  7271 raft_consensus.cc:2243] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.510681  7271 raft_consensus.cc:2272] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.513593  7271 tablet_replica.cc:333] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
W20260709 13:04:35.513504  9258 consensus_peers.cc:597] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Couldn't send request to peer b8eb0ad4490645598004d862412f4e31. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:35.514452  7271 raft_consensus.cc:2243] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.515681  7271 raft_consensus.cc:2272] T c2aa75e5347f4ba5a20776a3b619eb68 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.518316  7271 tablet_replica.cc:333] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.519027  7271 raft_consensus.cc:2243] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.520218  7271 raft_consensus.cc:2272] T 8897541fb7574f928493aa8e97a58f2f P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.522734  7271 tablet_replica.cc:333] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.523430  7271 raft_consensus.cc:2243] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.524108  7271 raft_consensus.cc:2272] T 5f40fa9720bd41db92cb895437b29f60 P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.526983  7271 tablet_replica.cc:333] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.527661  7271 raft_consensus.cc:2243] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.528292  7271 raft_consensus.cc:2272] T a457c771b2be434bb71c63fe617485e1 P b8eb0ad4490645598004d862412f4e31 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.530937  7271 tablet_replica.cc:333] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.531563  7271 raft_consensus.cc:2243] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.532713  7271 raft_consensus.cc:2272] T 1f865794cdc54a73bac275a71cb2034c P b8eb0ad4490645598004d862412f4e31 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.535110  7271 tablet_replica.cc:333] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31: stopping tablet replica
I20260709 13:04:35.535665  7271 raft_consensus.cc:2243] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.536255  7271 raft_consensus.cc:2272] T 7142cc29d84f4204bd97e07c0f6f6a84 P b8eb0ad4490645598004d862412f4e31 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:35.560334  9260 consensus_peers.cc:597] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:35.565603  9258 consensus_peers.cc:597] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Couldn't send request to peer b8eb0ad4490645598004d862412f4e31. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:35.568931  9258 consensus_peers.cc:597] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Couldn't send request to peer b8eb0ad4490645598004d862412f4e31. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:35.574072  9258 consensus_peers.cc:597] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Couldn't send request to peer b8eb0ad4490645598004d862412f4e31. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:35.613814  9258 consensus_peers.cc:597] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Couldn't send request to peer b8eb0ad4490645598004d862412f4e31. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:35.619930 15903 raft_consensus.cc:493] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:35.620761 15903 raft_consensus.cc:515] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:35.633302  9260 leader_election.cc:336] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:35.635878 15903 leader_election.cc:290] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:35.638568  9261 leader_election.cc:336] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:35.639086  9261 leader_election.cc:304] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:35.640985 15903 raft_consensus.cc:2749] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:35.728832  9260 consensus_peers.cc:597] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:35.820663  9260 consensus_peers.cc:597] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:35.863880  9260 consensus_peers.cc:597] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:35.926885  9260 consensus_peers.cc:597] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:35.993896  9261 consensus_peers.cc:597] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:36.036922  9260 consensus_peers.cc:597] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:36.046545  9261 consensus_peers.cc:597] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:36.109436  9260 consensus_peers.cc:597] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:36.173830 15903 raft_consensus.cc:493] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 105d6581548546b98eddd4ee7083bb12)
I20260709 13:04:36.174378 15903 raft_consensus.cc:515] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:36.176183 15903 leader_election.cc:290] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925)
W20260709 13:04:36.180953  9261 leader_election.cc:336] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:36.181823  9260 leader_election.cc:336] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:36.182178  9260 leader_election.cc:304] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:36.182794 15903 raft_consensus.cc:2749] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:04:36.247200  9261 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111) [suppressed 628 similar messages]
W20260709 13:04:36.271561  9261 consensus_peers.cc:597] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:36.333113  9260 consensus_peers.cc:597] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:36.430670  9260 consensus_peers.cc:597] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:36.441342  9260 consensus_peers.cc:597] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:36.441375  9261 consensus_peers.cc:597] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:36.517688  9261 consensus_peers.cc:597] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:36.557300  9260 consensus_peers.cc:597] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:36.569777  9260 consensus_peers.cc:597] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Couldn't send request to peer 105d6581548546b98eddd4ee7083bb12. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:36.573596 15892 raft_consensus.cc:493] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:36.574129 15892 raft_consensus.cc:515] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:36.576109 15892 leader_election.cc:290] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:36.580199  9261 leader_election.cc:336] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:36.580726  9258 leader_election.cc:336] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Network error: Client connection negotiation failed: client connection to 127.7.25.195:40767: connect: Connection refused (error 111)
I20260709 13:04:36.581149  9258 leader_election.cc:304] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:36.581866 15892 raft_consensus.cc:2749] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:36.660099 15892 raft_consensus.cc:493] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:36.660321 15903 raft_consensus.cc:493] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:36.660653 15892 raft_consensus.cc:515] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:36.660923 15903 raft_consensus.cc:515] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:36.662967 15903 leader_election.cc:290] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:36.667502 15903 raft_consensus.cc:493] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
W20260709 13:04:36.668051  9258 leader_election.cc:336] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Network error: Client connection negotiation failed: client connection to 127.7.25.195:40767: connect: Connection refused (error 111)
W20260709 13:04:36.668638  9258 leader_election.cc:336] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Network error: Client connection negotiation failed: client connection to 127.7.25.195:40767: connect: Connection refused (error 111)
I20260709 13:04:36.668084 15903 raft_consensus.cc:515] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:36.670127 15892 leader_election.cc:290] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:36.670531  9260 leader_election.cc:336] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:36.671190  9260 leader_election.cc:304] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:36.671871 15903 leader_election.cc:290] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:36.672084  9260 leader_election.cc:336] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:36.672816  9260 leader_election.cc:304] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:36.672369 15892 raft_consensus.cc:2749] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:36.674490 15903 raft_consensus.cc:493] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:36.675015 15903 raft_consensus.cc:515] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:36.676884 15903 leader_election.cc:290] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:36.679884 15892 raft_consensus.cc:2749] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:36.687077  9260 leader_election.cc:336] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:36.691834  9261 leader_election.cc:336] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:36.692258  9261 leader_election.cc:304] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, d653e71832b7402b9a03b46249d3b885
W20260709 13:04:36.693053  9261 leader_election.cc:336] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:36.693213 15915 raft_consensus.cc:2749] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:04:36.692889  9258 leader_election.cc:336] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Network error: Client connection negotiation failed: client connection to 127.7.25.195:40767: connect: Connection refused (error 111)
W20260709 13:04:36.697016  9258 leader_election.cc:336] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Network error: Client connection negotiation failed: client connection to 127.7.25.195:40767: connect: Connection refused (error 111)
I20260709 13:04:36.697443  9258 leader_election.cc:304] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:36.698127 15915 raft_consensus.cc:2749] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:36.699712 15916 raft_consensus.cc:493] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:36.700245 15916 raft_consensus.cc:515] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:36.702330 15916 leader_election.cc:290] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:36.706197  9260 leader_election.cc:336] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:36.707937  9258 leader_election.cc:336] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Network error: Client connection negotiation failed: client connection to 127.7.25.195:40767: connect: Connection refused (error 111)
I20260709 13:04:36.708334  9258 leader_election.cc:304] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:36.709015 15916 raft_consensus.cc:2749] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:36.716821  7271 tablet_server.cc:196] TabletServer@127.7.25.195:0 shutdown complete.
I20260709 13:04:36.728317 15916 raft_consensus.cc:493] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:36.728909 15916 raft_consensus.cc:515] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:36.731225 15916 leader_election.cc:290] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:36.734416 15916 raft_consensus.cc:493] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:36.734983 15916 raft_consensus.cc:515] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:36.736421  9261 leader_election.cc:336] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:36.737100 15916 leader_election.cc:290] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:36.740332  9258 leader_election.cc:336] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Network error: Client connection negotiation failed: client connection to 127.7.25.195:40767: connect: Connection refused (error 111)
I20260709 13:04:36.740741  9258 leader_election.cc:304] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:36.741926 15916 raft_consensus.cc:2749] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:36.742705  9260 leader_election.cc:336] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:36.745471  9258 leader_election.cc:336] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Network error: Client connection negotiation failed: client connection to 127.7.25.195:40767: connect: Connection refused (error 111)
I20260709 13:04:36.745954  9258 leader_election.cc:304] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:36.746711 15916 raft_consensus.cc:2749] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:36.756942 15916 raft_consensus.cc:493] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:36.757578 15916 raft_consensus.cc:515] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:36.764140  9261 leader_election.cc:336] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:36.765482 15916 leader_election.cc:290] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:36.767958  9258 leader_election.cc:336] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Network error: Client connection negotiation failed: client connection to 127.7.25.195:40767: connect: Connection refused (error 111)
I20260709 13:04:36.769141  9258 leader_election.cc:304] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:36.771178 15916 raft_consensus.cc:2749] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:36.777669 15916 raft_consensus.cc:493] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:36.778167 15916 raft_consensus.cc:515] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:36.780174 15916 leader_election.cc:290] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:36.784547  9261 leader_election.cc:336] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:36.786996  9258 leader_election.cc:336] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Network error: Client connection negotiation failed: client connection to 127.7.25.195:40767: connect: Connection refused (error 111)
I20260709 13:04:36.787472  9258 leader_election.cc:304] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:36.788096 15916 raft_consensus.cc:2749] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:36.837014  9261 consensus_peers.cc:597] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:04:36.851181 15916 raft_consensus.cc:493] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:36.852259 15915 raft_consensus.cc:493] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:36.852807 15915 raft_consensus.cc:515] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:36.853226 15903 raft_consensus.cc:493] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:36.855327 15915 leader_election.cc:290] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
I20260709 13:04:36.855288 15903 raft_consensus.cc:515] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:36.857656 15903 leader_election.cc:290] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:36.862249  9260 leader_election.cc:336] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:36.851768 15916 raft_consensus.cc:515] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
W20260709 13:04:36.863562  9258 leader_election.cc:336] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Network error: Client connection negotiation failed: client connection to 127.7.25.195:40767: connect: Connection refused (error 111)
I20260709 13:04:36.864048  9258 leader_election.cc:304] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:36.864557  7271 tablet_server.cc:179] TabletServer@127.7.25.196:0 shutting down...
I20260709 13:04:36.864753 15903 raft_consensus.cc:2749] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:04:36.864912  9258 leader_election.cc:336] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Network error: Client connection negotiation failed: client connection to 127.7.25.195:40767: connect: Connection refused (error 111)
I20260709 13:04:36.869045 15916 leader_election.cc:290] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:36.869683  9260 leader_election.cc:336] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:36.870121  9260 leader_election.cc:304] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:36.871821 15916 raft_consensus.cc:2749] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:36.875823  9258 leader_election.cc:336] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Network error: Client connection negotiation failed: client connection to 127.7.25.195:40767: connect: Connection refused (error 111)
W20260709 13:04:36.880023  9261 consensus_peers.cc:597] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:36.880126  9260 leader_election.cc:336] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
I20260709 13:04:36.880784  9260 leader_election.cc:304] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: 105d6581548546b98eddd4ee7083bb12, b8eb0ad4490645598004d862412f4e31
I20260709 13:04:36.881495 15916 raft_consensus.cc:2749] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:36.884420 15903 raft_consensus.cc:493] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8eb0ad4490645598004d862412f4e31)
I20260709 13:04:36.885188 15903 raft_consensus.cc:515] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d653e71832b7402b9a03b46249d3b885" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 43631 } } peers { permanent_uuid: "105d6581548546b98eddd4ee7083bb12" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 36925 } attrs { replace: true } } peers { permanent_uuid: "b8eb0ad4490645598004d862412f4e31" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40767 } } peers { permanent_uuid: "446d9310dce14ff4afff2dc2d64f68d8" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 40669 } attrs { promote: false } }
I20260709 13:04:36.889787 15903 leader_election.cc:290] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631), 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925), b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767)
W20260709 13:04:36.893069  9261 leader_election.cc:336] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
W20260709 13:04:36.894272  9258 leader_election.cc:336] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8eb0ad4490645598004d862412f4e31 (127.7.25.195:40767): Network error: Client connection negotiation failed: client connection to 127.7.25.195:40767: connect: Connection refused (error 111)
I20260709 13:04:36.894641  9258 leader_election.cc:304] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 446d9310dce14ff4afff2dc2d64f68d8; no voters: b8eb0ad4490645598004d862412f4e31, d653e71832b7402b9a03b46249d3b885
I20260709 13:04:36.896759 15903 raft_consensus.cc:2749] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:36.902493  9260 leader_election.cc:336] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:36.903930  9261 consensus_peers.cc:597] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:04:36.925760  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:36.927314  7271 tablet_replica.cc:333] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:36.928424  7271 raft_consensus.cc:2243] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:36.929255  7271 raft_consensus.cc:2272] T 67513665d04b44c292143601e7f66ac8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.931722  7271 tablet_replica.cc:333] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:36.932403  7271 raft_consensus.cc:2243] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:36.933070  7271 raft_consensus.cc:2272] T dc2c20c2ffc24a6cb95e8c2fe8a8c025 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.935608  7271 tablet_replica.cc:333] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:36.936218  7271 raft_consensus.cc:2243] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:36.936846  7271 raft_consensus.cc:2272] T 4269b37b5f3540ba9fcfd6d23ad240b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.939133  7271 tablet_replica.cc:333] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:36.939850  7271 raft_consensus.cc:2243] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:36.940752  7271 raft_consensus.cc:2272] T 9e1d32431b1c45ebad1160a850495e16 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.943028  7271 tablet_replica.cc:333] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:36.943804  7271 raft_consensus.cc:2243] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:36.944303  7271 raft_consensus.cc:2272] T b3aa2530ec1a42c890e68f3e67582ca0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.946367  7271 tablet_replica.cc:333] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:36.946943  7271 raft_consensus.cc:2243] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:36.947432  7271 raft_consensus.cc:2272] T 28d98f2932e74257b6a032b544f7b4bd P 446d9310dce14ff4afff2dc2d64f68d8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.949723  7271 tablet_replica.cc:333] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:36.950314  7271 raft_consensus.cc:2243] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:36.950911  7271 raft_consensus.cc:2272] T da34f43baf6c442b83da63228cfeb9a2 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.953244  7271 tablet_replica.cc:333] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:36.954010  7271 raft_consensus.cc:2243] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:36.954941  7271 raft_consensus.cc:2272] T fd3ca20a5e4646d3b164329f7abcf44a P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.957273  7271 tablet_replica.cc:333] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:36.957897  7271 raft_consensus.cc:2243] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:04:36.958843  7271 raft_consensus.cc:2272] T de8d0dfcd55e4b03b9a131362bf19085 P 446d9310dce14ff4afff2dc2d64f68d8 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.961297  7271 tablet_replica.cc:333] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:36.962097  7271 raft_consensus.cc:2243] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:36.962608  7271 raft_consensus.cc:2272] T c2aa75e5347f4ba5a20776a3b619eb68 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.964529  7271 tablet_replica.cc:333] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:36.965147  7271 raft_consensus.cc:2243] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:36.966007  7271 raft_consensus.cc:2272] T ba1839dfeba648529deb101072b3ca8c P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.968158  7271 tablet_replica.cc:333] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:36.968740  7271 raft_consensus.cc:2243] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:36.969421  7271 raft_consensus.cc:2272] T da501bdc0de7404f9ecae9db442353dc P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.971884  7271 tablet_replica.cc:333] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:36.972661  7271 raft_consensus.cc:2243] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:36.973680  7271 raft_consensus.cc:2272] T cf1cdd90debd40a6a2361af7491977d6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.975661  7271 tablet_replica.cc:333] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:36.976215  7271 raft_consensus.cc:2243] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:36.976723  7271 raft_consensus.cc:2272] T 6427ce7790bd4629985d340936d6f356 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.978793  7271 tablet_replica.cc:333] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:36.979354  7271 raft_consensus.cc:2243] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:36.980185  7271 raft_consensus.cc:2272] T 5f40fa9720bd41db92cb895437b29f60 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.982148  7271 tablet_replica.cc:333] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:36.982684  7271 raft_consensus.cc:2243] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:36.983642  7271 raft_consensus.cc:2272] T 848cbd6ceda8400e9d2f1d58cbbdcb7b P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.986333  7271 tablet_replica.cc:333] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:36.987073  7271 raft_consensus.cc:2243] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:36.987910  7271 raft_consensus.cc:2272] T aee63d7055b1430b8d1edea205bc40f0 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.990375  7271 tablet_replica.cc:333] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:36.990917  7271 raft_consensus.cc:2243] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:04:36.991799  7271 raft_consensus.cc:2272] T 866f457c2bf048109ab977c2b010de5a P 446d9310dce14ff4afff2dc2d64f68d8 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.993796  7271 tablet_replica.cc:333] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:36.994361  7271 raft_consensus.cc:2243] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:36.995026  7271 raft_consensus.cc:2272] T 4923120e1f194cdabb09a6bc8feeba88 P 446d9310dce14ff4afff2dc2d64f68d8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:36.997226  7271 tablet_replica.cc:333] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:36.997750  7271 raft_consensus.cc:2243] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:36.998180  7271 raft_consensus.cc:2272] T 1663cf9302e8495c8762465d306cb479 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.000186  7271 tablet_replica.cc:333] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:37.000746  7271 raft_consensus.cc:2243] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.001662  7271 raft_consensus.cc:2272] T dc1ae2a0b869453e80401c580552e127 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.003592  7271 tablet_replica.cc:333] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:37.004122  7271 raft_consensus.cc:2243] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.004992  7271 raft_consensus.cc:2272] T edca272c646743e09fb3b0c827c963b8 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.007244  7271 tablet_replica.cc:333] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:37.007872  7271 raft_consensus.cc:2243] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.008347  7271 raft_consensus.cc:2272] T bf76dc240f6a432d80b0c04f50f2d9b6 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.010458  7271 tablet_replica.cc:333] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:37.010967  7271 raft_consensus.cc:2243] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.011463  7271 raft_consensus.cc:2272] T a6565bc3f96a474988bd4e41a01fa3be P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.013556  7271 tablet_replica.cc:333] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:37.014178  7271 raft_consensus.cc:2243] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.015030  7271 raft_consensus.cc:2272] T 513b83e2d61c4ad7994ad4629a3d0079 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.017051  7271 tablet_replica.cc:333] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:37.017776  7271 raft_consensus.cc:2243] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.018674  7271 raft_consensus.cc:2272] T 56cc480ba6f642e08bb2e547a0ef50a1 P 446d9310dce14ff4afff2dc2d64f68d8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.021281  7271 tablet_replica.cc:333] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:37.021878  7271 raft_consensus.cc:2243] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:37.021944  9261 consensus_peers.cc:597] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 -> Peer d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): Couldn't send request to peer d653e71832b7402b9a03b46249d3b885. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:04:37.022548  7271 raft_consensus.cc:2272] T e27bb2ddbf1e4b7daa5333a909bbaf31 P 446d9310dce14ff4afff2dc2d64f68d8 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.024585  7271 tablet_replica.cc:333] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:37.025202  7271 raft_consensus.cc:2243] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.026014  7271 raft_consensus.cc:2272] T 4f60cb7236fe439e9faa6d4f269e96da P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.027997  7271 tablet_replica.cc:333] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:37.028558  7271 raft_consensus.cc:2243] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.030256  7271 raft_consensus.cc:2272] T f8ce47d03b224808b5f7f17c341a5293 P 446d9310dce14ff4afff2dc2d64f68d8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.032752  7271 tablet_replica.cc:333] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:37.033458  7271 raft_consensus.cc:2243] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.034590  7271 raft_consensus.cc:2272] T 455c5d2786974d92a3ee8b825edcfaa7 P 446d9310dce14ff4afff2dc2d64f68d8 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.036974  7271 tablet_replica.cc:333] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:37.037659  7271 raft_consensus.cc:2243] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.038540  7271 raft_consensus.cc:2272] T 37c1890dcc8947c89b8c213326526c75 P 446d9310dce14ff4afff2dc2d64f68d8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.040644  7271 tablet_replica.cc:333] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:37.041256  7271 raft_consensus.cc:2243] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.042136  7271 raft_consensus.cc:2272] T a6ecd063b1dc49a69b15eb593af51b89 P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.044060  7271 tablet_replica.cc:333] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:37.044596  7271 raft_consensus.cc:2243] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.045070  7271 raft_consensus.cc:2272] T 74f6762ba0124b3a87dd4d54f5693927 P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.047092  7271 tablet_replica.cc:333] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:37.047590  7271 raft_consensus.cc:2243] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.048435  7271 raft_consensus.cc:2272] T 26eda7bdc3194871b01c986d3db7cccf P 446d9310dce14ff4afff2dc2d64f68d8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.050501  7271 tablet_replica.cc:333] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:37.051065  7271 raft_consensus.cc:2243] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.051576  7271 raft_consensus.cc:2272] T 911fa6f4e14f47f6a76fff18a00cd58e P 446d9310dce14ff4afff2dc2d64f68d8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.053927  7271 tablet_replica.cc:333] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:37.054565  7271 raft_consensus.cc:2243] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.055147  7271 raft_consensus.cc:2272] T 25a125e8035444f5921cc2a7eef152ae P 446d9310dce14ff4afff2dc2d64f68d8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.057196  7271 tablet_replica.cc:333] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8: stopping tablet replica
I20260709 13:04:37.057709  7271 raft_consensus.cc:2243] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.058180  7271 raft_consensus.cc:2272] T 18bf9e256e3046b497483817dac46e78 P 446d9310dce14ff4afff2dc2d64f68d8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.512241  7271 tablet_server.cc:196] TabletServer@127.7.25.196:0 shutdown complete.
I20260709 13:04:37.583348  7271 master.cc:562] Master@127.7.25.254:44471 shutting down...
W20260709 13:04:37.620172  8332 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:04:37.620611  8332 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:04:37.620853  8332 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:04:39.612461  8270 catalog_manager.cc:4755] TS 105d6581548546b98eddd4ee7083bb12 (127.7.25.194:36925): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 56cc480ba6f642e08bb2e547a0ef50a1: Network error: Client connection negotiation failed: client connection to 127.7.25.194:36925: connect: Connection refused (error 111)
W20260709 13:04:39.663122  8315 debug-util.cc:398] Leaking SignalData structure 0x7b08002e45e0 after lost signal to thread 7274
W20260709 13:04:39.663648  8315 debug-util.cc:398] Leaking SignalData structure 0x7b0800324980 after lost signal to thread 8318
W20260709 13:04:46.219697  8271 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111) [suppressed 92 similar messages]
W20260709 13:04:46.223349  8271 catalog_manager.cc:4755] TS d653e71832b7402b9a03b46249d3b885 (127.7.25.193:43631): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4269b37b5f3540ba9fcfd6d23ad240b6: Network error: Client connection negotiation failed: client connection to 127.7.25.193:43631: connect: Connection refused (error 111)
I20260709 13:04:46.364843  7271 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.365942  7271 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.367136  7271 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3a492d68031a44b1b0b286d8ce68436c: stopping tablet replica
I20260709 13:04:46.609498  7271 master.cc:584] Master@127.7.25.254:44471 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (250134 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:04:46.724368  7271 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.25.254:39391
I20260709 13:04:46.725726  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:46.731341 15922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:46.731410 15923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:46.733038 15925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:46.734448  7271 server_base.cc:1061] running on GCE node
I20260709 13:04:46.737954  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:46.738150  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:46.738263  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602286738253 us; error 0 us; skew 500 ppm
I20260709 13:04:46.738715  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:46.741677  7271 webserver.cc:533] Webserver started at http://127.7.25.254:46575/ using document root <none> and password file <none>
I20260709 13:04:46.742158  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:46.742309  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:46.742528  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:46.743791  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/master-0-root/instance:
uuid: "05e762bf99a14b7b95889a4341734e8b"
format_stamp: "Formatted at 2026-07-09 13:04:46 on dist-test-slave-z1zn"
I20260709 13:04:46.748327  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:46.751780 15930 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:46.752626  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:46.752969  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/master-0-root
uuid: "05e762bf99a14b7b95889a4341734e8b"
format_stamp: "Formatted at 2026-07-09 13:04:46 on dist-test-slave-z1zn"
I20260709 13:04:46.753386  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:46.793658  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:46.795033  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:46.836755  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.254:39391
I20260709 13:04:46.836867 15981 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.254:39391 every 8 connection(s)
I20260709 13:04:46.840983 15982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.852604 15982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b: Bootstrap starting.
I20260709 13:04:46.857944 15982 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.862223 15982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b: No bootstrap required, opened a new log
I20260709 13:04:46.864445 15982 raft_consensus.cc:359] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e762bf99a14b7b95889a4341734e8b" member_type: VOTER }
I20260709 13:04:46.864910 15982 raft_consensus.cc:385] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.865213 15982 raft_consensus.cc:740] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05e762bf99a14b7b95889a4341734e8b, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.865792 15982 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e762bf99a14b7b95889a4341734e8b" member_type: VOTER }
I20260709 13:04:46.866287 15982 raft_consensus.cc:399] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:46.866511 15982 raft_consensus.cc:493] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:46.866852 15982 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.871387 15982 raft_consensus.cc:515] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e762bf99a14b7b95889a4341734e8b" member_type: VOTER }
I20260709 13:04:46.871899 15982 leader_election.cc:304] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05e762bf99a14b7b95889a4341734e8b; no voters: 
I20260709 13:04:46.872988 15982 leader_election.cc:290] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:46.873443 15985 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:46.874788 15985 raft_consensus.cc:697] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b [term 1 LEADER]: Becoming Leader. State: Replica: 05e762bf99a14b7b95889a4341734e8b, State: Running, Role: LEADER
I20260709 13:04:46.875504 15985 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e762bf99a14b7b95889a4341734e8b" member_type: VOTER }
I20260709 13:04:46.876109 15982 sys_catalog.cc:565] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:46.886215 15987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05e762bf99a14b7b95889a4341734e8b. Latest consensus state: current_term: 1 leader_uuid: "05e762bf99a14b7b95889a4341734e8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e762bf99a14b7b95889a4341734e8b" member_type: VOTER } }
I20260709 13:04:46.886096 15986 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05e762bf99a14b7b95889a4341734e8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e762bf99a14b7b95889a4341734e8b" member_type: VOTER } }
I20260709 13:04:46.886853 15987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:46.886969 15986 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:46.889781 15996 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:46.897382 15996 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:46.898519  7271 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:46.906960 15996 catalog_manager.cc:1383] Generated new cluster ID: e3dc720236e84d33a461486845d84cad
I20260709 13:04:46.907290 15996 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:46.933223 15996 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:46.934571 15996 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:46.946132 15996 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b: Generated new TSK 0
I20260709 13:04:46.946777 15996 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:46.965426  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:46.971856 16003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:46.972914 16004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:46.975097 16006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:46.975449  7271 server_base.cc:1061] running on GCE node
I20260709 13:04:46.978113  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:46.978307  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:46.978511  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602286978471 us; error 0 us; skew 500 ppm
I20260709 13:04:46.979118  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:46.981590  7271 webserver.cc:533] Webserver started at http://127.7.25.193:37899/ using document root <none> and password file <none>
I20260709 13:04:46.982097  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:46.982287  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:46.982577  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:46.983778  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-0-root/instance:
uuid: "ec8b54f5a9e44f428a4d537391138dcf"
format_stamp: "Formatted at 2026-07-09 13:04:46 on dist-test-slave-z1zn"
I20260709 13:04:46.988560  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 13:04:46.991995 16011 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:46.992786  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:46.993131  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-0-root
uuid: "ec8b54f5a9e44f428a4d537391138dcf"
format_stamp: "Formatted at 2026-07-09 13:04:46 on dist-test-slave-z1zn"
I20260709 13:04:46.993474  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:47.032824  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:47.034121  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:47.035624  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:47.038021  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:47.038246  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:47.038487  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:47.038683  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:47.080888  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.193:44491
I20260709 13:04:47.081053 16073 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.193:44491 every 8 connection(s)
I20260709 13:04:47.086526  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:47.094535 16078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:47.096887 16079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:47.099417 16081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:47.100155  7271 server_base.cc:1061] running on GCE node
I20260709 13:04:47.100687 16074 heartbeater.cc:344] Connected to a master server at 127.7.25.254:39391
I20260709 13:04:47.101159 16074 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:47.102164 16074 heartbeater.cc:507] Master 127.7.25.254:39391 requested a full tablet report, sending...
I20260709 13:04:47.103760  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:47.104081  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:47.104292  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602287104273 us; error 0 us; skew 500 ppm
I20260709 13:04:47.104936  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:47.105022 15947 ts_manager.cc:194] Registered new tserver with Master: ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:47.107265 15947 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59466
I20260709 13:04:47.107771  7271 webserver.cc:533] Webserver started at http://127.7.25.194:39519/ using document root <none> and password file <none>
I20260709 13:04:47.108439  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:47.108704  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:47.108986  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:47.110311  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-1-root/instance:
uuid: "36b15691c8e648a18b69e98bee3349b4"
format_stamp: "Formatted at 2026-07-09 13:04:47 on dist-test-slave-z1zn"
I20260709 13:04:47.115078  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:47.118824 16086 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:47.119683  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:04:47.120083  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-1-root
uuid: "36b15691c8e648a18b69e98bee3349b4"
format_stamp: "Formatted at 2026-07-09 13:04:47 on dist-test-slave-z1zn"
I20260709 13:04:47.120407  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:47.130052  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:47.131320  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:47.132814  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:47.135195  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:47.135422  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:47.135661  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:47.135830  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:47.179651  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.194:45195
I20260709 13:04:47.179754 16148 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.194:45195 every 8 connection(s)
I20260709 13:04:47.184753  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:47.194288 16152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:47.194998 16153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:47.198909 16155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:47.199008 16149 heartbeater.cc:344] Connected to a master server at 127.7.25.254:39391
I20260709 13:04:47.199165  7271 server_base.cc:1061] running on GCE node
I20260709 13:04:47.199800 16149 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:47.200544  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:47.200860  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:47.200898 16149 heartbeater.cc:507] Master 127.7.25.254:39391 requested a full tablet report, sending...
I20260709 13:04:47.201232  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602287201211 us; error 0 us; skew 500 ppm
I20260709 13:04:47.202098  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:47.203517 15947 ts_manager.cc:194] Registered new tserver with Master: 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:47.205350 15947 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59482
I20260709 13:04:47.205348  7271 webserver.cc:533] Webserver started at http://127.7.25.195:44041/ using document root <none> and password file <none>
I20260709 13:04:47.206214  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:47.206454  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:47.206760  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:47.207998  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-2-root/instance:
uuid: "e1e05442c5b44a079dd1de9dd124c990"
format_stamp: "Formatted at 2026-07-09 13:04:47 on dist-test-slave-z1zn"
I20260709 13:04:47.212527  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:04:47.216245 16160 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:47.217197  7271 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:47.217523  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-2-root
uuid: "e1e05442c5b44a079dd1de9dd124c990"
format_stamp: "Formatted at 2026-07-09 13:04:47 on dist-test-slave-z1zn"
I20260709 13:04:47.217844  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:47.229537  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:47.230796  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:47.232345  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:47.234644  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:47.234870  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:47.235136  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:47.235306  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:47.278149  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.195:44725
I20260709 13:04:47.278316 16222 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.195:44725 every 8 connection(s)
I20260709 13:04:47.283252  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:47.291608 16226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:47.293838 16227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:47.295591  7271 server_base.cc:1061] running on GCE node
W20260709 13:04:47.296378 16229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:47.297149 16223 heartbeater.cc:344] Connected to a master server at 127.7.25.254:39391
I20260709 13:04:47.297499  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:04:47.297525 16223 heartbeater.cc:461] Registering TS with master...
W20260709 13:04:47.297855  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:47.298074  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602287298058 us; error 0 us; skew 500 ppm
I20260709 13:04:47.298547 16223 heartbeater.cc:507] Master 127.7.25.254:39391 requested a full tablet report, sending...
I20260709 13:04:47.298820  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:47.301952 15947 ts_manager.cc:194] Registered new tserver with Master: e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:47.302274  7271 webserver.cc:533] Webserver started at http://127.7.25.196:44551/ using document root <none> and password file <none>
I20260709 13:04:47.302956  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:47.303203  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:47.303519  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:47.303839 15947 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59484
I20260709 13:04:47.305119  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-3-root/instance:
uuid: "d2e22ad700e94d1095c014708c364bb7"
format_stamp: "Formatted at 2026-07-09 13:04:47 on dist-test-slave-z1zn"
I20260709 13:04:47.309798  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:47.313266 16234 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:47.314038  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:04:47.314337  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-3-root
uuid: "d2e22ad700e94d1095c014708c364bb7"
format_stamp: "Formatted at 2026-07-09 13:04:47 on dist-test-slave-z1zn"
I20260709 13:04:47.314596  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:47.339450  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:47.340741  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:47.342327  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:47.344574  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:47.344786  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:47.345032  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:47.345266  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:04:47.389307  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.196:41631
I20260709 13:04:47.389412 16296 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.196:41631 every 8 connection(s)
I20260709 13:04:47.404072 16297 heartbeater.cc:344] Connected to a master server at 127.7.25.254:39391
I20260709 13:04:47.404488 16297 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:47.405401 16297 heartbeater.cc:507] Master 127.7.25.254:39391 requested a full tablet report, sending...
I20260709 13:04:47.407658 15947 ts_manager.cc:194] Registered new tserver with Master: d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:47.408739  7271 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016188285s
I20260709 13:04:47.409157 15947 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59494
I20260709 13:04:47.436941 15947 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59510:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:04:47.675459 16039 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6c90e7e1974ef0ade824c72386b5f3 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:47.678332 16038 tablet_service.cc:1511] Processing CreateTablet for tablet baa51a24c3524741836e9666f1b4babe (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:47.679343 16035 tablet_service.cc:1511] Processing CreateTablet for tablet f697dfb6287b4feeac50690912201da2 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:47.680840 16037 tablet_service.cc:1511] Processing CreateTablet for tablet a07d00d6ed2e42308d7de0f098fa286c (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:47.682794 16114 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6c90e7e1974ef0ade824c72386b5f3 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:47.683221 16036 tablet_service.cc:1511] Processing CreateTablet for tablet 16f108a2d22648a781f7e30b9730fb4a (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:47.684247 16114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6c90e7e1974ef0ade824c72386b5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.685686 16113 tablet_service.cc:1511] Processing CreateTablet for tablet baa51a24c3524741836e9666f1b4babe (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:47.686399 16111 tablet_service.cc:1511] Processing CreateTablet for tablet 16f108a2d22648a781f7e30b9730fb4a (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:47.687131 16113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa51a24c3524741836e9666f1b4babe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.687821 16111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f108a2d22648a781f7e30b9730fb4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.689419 16112 tablet_service.cc:1511] Processing CreateTablet for tablet 1353edd9d7d544b890b5ba9ca2c72872 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:47.690358 16034 tablet_service.cc:1511] Processing CreateTablet for tablet 15ec9187fe3a4ca1acae98f045a1c35d (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:47.690917 16112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1353edd9d7d544b890b5ba9ca2c72872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.694368 16109 tablet_service.cc:1511] Processing CreateTablet for tablet 27d59706e6f746aca969af7bf2206197 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:47.694924 16039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6c90e7e1974ef0ade824c72386b5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.695825 16109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27d59706e6f746aca969af7bf2206197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.696218 16036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f108a2d22648a781f7e30b9730fb4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.697376 16037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07d00d6ed2e42308d7de0f098fa286c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.697831 16108 tablet_service.cc:1511] Processing CreateTablet for tablet 1be59fdebe7a44cc9f945fa9793ddfda (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:47.698549 16038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa51a24c3524741836e9666f1b4babe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.699257 16108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1be59fdebe7a44cc9f945fa9793ddfda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.694370 16033 tablet_service.cc:1511] Processing CreateTablet for tablet 1be59fdebe7a44cc9f945fa9793ddfda (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:47.702598 16033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1be59fdebe7a44cc9f945fa9793ddfda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.692808 16110 tablet_service.cc:1511] Processing CreateTablet for tablet f697dfb6287b4feeac50690912201da2 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:47.705662 16034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15ec9187fe3a4ca1acae98f045a1c35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.709708 16032 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3ffb334ab54abb8bdb4893844c3b6b (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:47.711186 16032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3ffb334ab54abb8bdb4893844c3b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.712538 16262 tablet_service.cc:1511] Processing CreateTablet for tablet baa51a24c3524741836e9666f1b4babe (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:47.713445 16035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f697dfb6287b4feeac50690912201da2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.713336 16107 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3ffb334ab54abb8bdb4893844c3b6b (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:47.714057 16262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa51a24c3524741836e9666f1b4babe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.715471 16110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f697dfb6287b4feeac50690912201da2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.720127 16107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3ffb334ab54abb8bdb4893844c3b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.732597 16031 tablet_service.cc:1511] Processing CreateTablet for tablet adc5c10cfdd24c64a4db9e4339808499 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:47.734248 16031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adc5c10cfdd24c64a4db9e4339808499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.741580 16188 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6c90e7e1974ef0ade824c72386b5f3 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:47.743142 16188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6c90e7e1974ef0ade824c72386b5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.744266 16186 tablet_service.cc:1511] Processing CreateTablet for tablet 1353edd9d7d544b890b5ba9ca2c72872 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:47.746289 16187 tablet_service.cc:1511] Processing CreateTablet for tablet a07d00d6ed2e42308d7de0f098fa286c (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:47.747823 16187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07d00d6ed2e42308d7de0f098fa286c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.747506 16184 tablet_service.cc:1511] Processing CreateTablet for tablet 15ec9187fe3a4ca1acae98f045a1c35d (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:47.748898 16184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15ec9187fe3a4ca1acae98f045a1c35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.751915 16182 tablet_service.cc:1511] Processing CreateTablet for tablet 1be59fdebe7a44cc9f945fa9793ddfda (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:47.750030 16183 tablet_service.cc:1511] Processing CreateTablet for tablet 27d59706e6f746aca969af7bf2206197 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:47.750269 16106 tablet_service.cc:1511] Processing CreateTablet for tablet d6c9099428b34e0f9bec85f2159b656e (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:47.754285 16181 tablet_service.cc:1511] Processing CreateTablet for tablet adc5c10cfdd24c64a4db9e4339808499 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:47.746291 16185 tablet_service.cc:1511] Processing CreateTablet for tablet 16f108a2d22648a781f7e30b9730fb4a (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:47.756170 16182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1be59fdebe7a44cc9f945fa9793ddfda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.756840 16183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27d59706e6f746aca969af7bf2206197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.757525 16181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adc5c10cfdd24c64a4db9e4339808499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.758185 16186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1353edd9d7d544b890b5ba9ca2c72872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.758771 16185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f108a2d22648a781f7e30b9730fb4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.754715 16106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c9099428b34e0f9bec85f2159b656e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.760974 16180 tablet_service.cc:1511] Processing CreateTablet for tablet d6c9099428b34e0f9bec85f2159b656e (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:47.762501 16180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c9099428b34e0f9bec85f2159b656e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.775527 16030 tablet_service.cc:1511] Processing CreateTablet for tablet 4e61baecc1a74998a356870a675301ea (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:47.777675 16030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e61baecc1a74998a356870a675301ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.779147 16105 tablet_service.cc:1511] Processing CreateTablet for tablet 4e61baecc1a74998a356870a675301ea (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:47.780625 16105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e61baecc1a74998a356870a675301ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.817502 16316 tablet_bootstrap.cc:492] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:47.818382 16261 tablet_service.cc:1511] Processing CreateTablet for tablet a07d00d6ed2e42308d7de0f098fa286c (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:47.819828 16261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07d00d6ed2e42308d7de0f098fa286c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.824883 16316 tablet_bootstrap.cc:654] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.856768 16179 tablet_service.cc:1511] Processing CreateTablet for tablet 4e61baecc1a74998a356870a675301ea (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:47.858707 16179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e61baecc1a74998a356870a675301ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.868777 16260 tablet_service.cc:1511] Processing CreateTablet for tablet f697dfb6287b4feeac50690912201da2 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:47.870498 16260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f697dfb6287b4feeac50690912201da2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.870393 16259 tablet_service.cc:1511] Processing CreateTablet for tablet 15ec9187fe3a4ca1acae98f045a1c35d (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:47.874336 16258 tablet_service.cc:1511] Processing CreateTablet for tablet 27d59706e6f746aca969af7bf2206197 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:47.876556 16262 tablet_service.cc:1511] Processing CreateTablet for tablet 1353edd9d7d544b890b5ba9ca2c72872 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
W20260709 13:04:47.887727 15994 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:47.890964 16257 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3ffb334ab54abb8bdb4893844c3b6b (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:47.894197 16256 tablet_service.cc:1511] Processing CreateTablet for tablet adc5c10cfdd24c64a4db9e4339808499 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:47.897413 16255 tablet_service.cc:1511] Processing CreateTablet for tablet d6c9099428b34e0f9bec85f2159b656e (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:47.928298 16317 tablet_bootstrap.cc:492] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:47.934266 16259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15ec9187fe3a4ca1acae98f045a1c35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.936307 16255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c9099428b34e0f9bec85f2159b656e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.938696 16261 tablet_service.cc:1511] Processing CreateTablet for tablet 09412044d26f417da5c842c8acf1149d (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:47.940119 16261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09412044d26f417da5c842c8acf1149d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.940752 16257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3ffb334ab54abb8bdb4893844c3b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.941378 16262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1353edd9d7d544b890b5ba9ca2c72872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.942028 16256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adc5c10cfdd24c64a4db9e4339808499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.945647 16258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27d59706e6f746aca969af7bf2206197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.946928 16037 tablet_service.cc:1511] Processing CreateTablet for tablet 09412044d26f417da5c842c8acf1149d (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:47.948280 16037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09412044d26f417da5c842c8acf1149d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.950048 16316 tablet_bootstrap.cc:492] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:47.950564 16316 ts_tablet_manager.cc:1403] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.135s	user 0.027s	sys 0.008s
I20260709 13:04:47.951179 16110 tablet_service.cc:1511] Processing CreateTablet for tablet 09412044d26f417da5c842c8acf1149d (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:47.952454 16110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09412044d26f417da5c842c8acf1149d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.965464 16254 tablet_service.cc:1511] Processing CreateTablet for tablet 154f438524734d2599d72ae02e2230e6 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:47.966135 16319 tablet_bootstrap.cc:492] T a07d00d6ed2e42308d7de0f098fa286c P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:47.967238 16033 tablet_service.cc:1511] Processing CreateTablet for tablet 154f438524734d2599d72ae02e2230e6 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:47.968606 16033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 154f438524734d2599d72ae02e2230e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.965623 16316 raft_consensus.cc:359] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:47.969257 16316 raft_consensus.cc:385] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.968976 16317 tablet_bootstrap.cc:654] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.969571 16316 raft_consensus.cc:740] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.973227 16316 consensus_queue.cc:260] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:47.975617 16254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 154f438524734d2599d72ae02e2230e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.979365 16179 tablet_service.cc:1511] Processing CreateTablet for tablet 154f438524734d2599d72ae02e2230e6 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:47.991453 16182 tablet_service.cc:1511] Processing CreateTablet for tablet fc581e6f2f6741bc9a63c49459198306 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:47.998128 16107 tablet_service.cc:1511] Processing CreateTablet for tablet fc581e6f2f6741bc9a63c49459198306 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:48.000648 16107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc581e6f2f6741bc9a63c49459198306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.981123 16179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 154f438524734d2599d72ae02e2230e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.007964 16297 heartbeater.cc:499] Master 127.7.25.254:39391 was elected leader, sending a full tablet report...
I20260709 13:04:48.022686 16320 tablet_bootstrap.cc:492] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:48.023422 16182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc581e6f2f6741bc9a63c49459198306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.026722 16316 ts_tablet_manager.cc:1434] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.004s
I20260709 13:04:48.028908 16317 tablet_bootstrap.cc:492] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:48.049126 16317 ts_tablet_manager.cc:1403] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.121s	user 0.012s	sys 0.003s
I20260709 13:04:48.053550 16317 raft_consensus.cc:359] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:48.033440 16319 tablet_bootstrap.cc:654] T a07d00d6ed2e42308d7de0f098fa286c P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.039558 16261 tablet_service.cc:1511] Processing CreateTablet for tablet fc581e6f2f6741bc9a63c49459198306 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:48.056691 16317 raft_consensus.cc:385] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.057274 16317 raft_consensus.cc:740] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.057533 16261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc581e6f2f6741bc9a63c49459198306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.045965 16180 tablet_service.cc:1511] Processing CreateTablet for tablet 16ba50f699994c75b3a8cc2ea2ba8cc9 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:48.047122 16109 tablet_service.cc:1511] Processing CreateTablet for tablet 16ba50f699994c75b3a8cc2ea2ba8cc9 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:48.061288 16180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ba50f699994c75b3a8cc2ea2ba8cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.061434 16109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ba50f699994c75b3a8cc2ea2ba8cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.064891 16033 tablet_service.cc:1511] Processing CreateTablet for tablet 16ba50f699994c75b3a8cc2ea2ba8cc9 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:48.066401 16033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ba50f699994c75b3a8cc2ea2ba8cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.069307 16030 tablet_service.cc:1511] Processing CreateTablet for tablet 406b6fe9ceac45fb8a980a2feb9cc063 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:48.070749 16030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406b6fe9ceac45fb8a980a2feb9cc063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.048496 16316 tablet_bootstrap.cc:492] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:48.031796 16320 tablet_bootstrap.cc:654] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.080914 16255 tablet_service.cc:1511] Processing CreateTablet for tablet 406b6fe9ceac45fb8a980a2feb9cc063 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:48.093297 16316 tablet_bootstrap.cc:654] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.094172 16111 tablet_service.cc:1511] Processing CreateTablet for tablet 406b6fe9ceac45fb8a980a2feb9cc063 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:48.094550 16039 tablet_service.cc:1511] Processing CreateTablet for tablet 5dfecacf6d204abc99b0b341ab7256b1 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:48.095885 16111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406b6fe9ceac45fb8a980a2feb9cc063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.096311 16039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dfecacf6d204abc99b0b341ab7256b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.100219 16258 tablet_service.cc:1511] Processing CreateTablet for tablet 5dfecacf6d204abc99b0b341ab7256b1 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:48.109416 16255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406b6fe9ceac45fb8a980a2feb9cc063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.110224 16258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dfecacf6d204abc99b0b341ab7256b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.110289 16074 heartbeater.cc:499] Master 127.7.25.254:39391 was elected leader, sending a full tablet report...
I20260709 13:04:48.128473 16188 tablet_service.cc:1511] Processing CreateTablet for tablet 5dfecacf6d204abc99b0b341ab7256b1 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:48.130239 16188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dfecacf6d204abc99b0b341ab7256b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.128351 16317 consensus_queue.cc:260] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:48.138131 16323 raft_consensus.cc:493] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.138926 16323 raft_consensus.cc:515] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
W20260709 13:04:48.149003 16298 tablet.cc:2406] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:48.155435 16107 tablet_service.cc:1511] Processing CreateTablet for tablet 76c283cfd76b4e9aacd796f6ead6e4b8 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:48.155846 16323 leader_election.cc:290] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:48.157485 16149 heartbeater.cc:499] Master 127.7.25.254:39391 was elected leader, sending a full tablet report...
I20260709 13:04:48.158800 16319 tablet_bootstrap.cc:492] T a07d00d6ed2e42308d7de0f098fa286c P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:48.159333 16319 ts_tablet_manager.cc:1403] T a07d00d6ed2e42308d7de0f098fa286c P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.194s	user 0.012s	sys 0.010s
I20260709 13:04:48.156922 16107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76c283cfd76b4e9aacd796f6ead6e4b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.162742 16320 tablet_bootstrap.cc:492] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:48.163254 16320 ts_tablet_manager.cc:1403] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.141s	user 0.010s	sys 0.016s
I20260709 13:04:48.179189 16319 raft_consensus.cc:359] T a07d00d6ed2e42308d7de0f098fa286c P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:48.180013 16319 raft_consensus.cc:385] T a07d00d6ed2e42308d7de0f098fa286c P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.180310 16319 raft_consensus.cc:740] T a07d00d6ed2e42308d7de0f098fa286c P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.196362 16322 raft_consensus.cc:493] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.182268 16320 raft_consensus.cc:359] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:48.197009 16322 raft_consensus.cc:515] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:48.197835 16320 raft_consensus.cc:385] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.198328 16320 raft_consensus.cc:740] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.199407 16320 consensus_queue.cc:260] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:48.202615 16322 leader_election.cc:290] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:48.181070 16319 consensus_queue.cc:260] T a07d00d6ed2e42308d7de0f098fa286c P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:48.221968 16320 ts_tablet_manager.cc:1434] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.058s	user 0.015s	sys 0.008s
I20260709 13:04:48.236634 16030 tablet_service.cc:1511] Processing CreateTablet for tablet 105468bfb6dc48c28c16d3449c691f6b (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:48.238438 16320 tablet_bootstrap.cc:492] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:48.238670 16030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105468bfb6dc48c28c16d3449c691f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.241966 16182 tablet_service.cc:1511] Processing CreateTablet for tablet 76c283cfd76b4e9aacd796f6ead6e4b8 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:48.243422 16182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76c283cfd76b4e9aacd796f6ead6e4b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.245105 16320 tablet_bootstrap.cc:654] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.254626 16317 ts_tablet_manager.cc:1434] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.204s	user 0.034s	sys 0.007s
I20260709 13:04:48.256124 16317 tablet_bootstrap.cc:492] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:48.256453 16316 tablet_bootstrap.cc:492] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:48.256996 16316 ts_tablet_manager.cc:1403] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.209s	user 0.007s	sys 0.036s
I20260709 13:04:48.260558 16316 raft_consensus.cc:359] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:48.261605 16316 raft_consensus.cc:385] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.261968 16316 raft_consensus.cc:740] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.266911 16316 consensus_queue.cc:260] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:48.262096 16111 tablet_service.cc:1511] Processing CreateTablet for tablet 105468bfb6dc48c28c16d3449c691f6b (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:48.273936 16111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105468bfb6dc48c28c16d3449c691f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.275885 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:48.277639 16316 ts_tablet_manager.cc:1434] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:04:48.277874 16320 tablet_bootstrap.cc:492] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
W20260709 13:04:48.278165 16089 leader_election.cc:343] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:48.279753 16320 ts_tablet_manager.cc:1403] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.010s
I20260709 13:04:48.280750 16322 raft_consensus.cc:493] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.281288 16322 raft_consensus.cc:515] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:48.263316 16188 tablet_service.cc:1511] Processing CreateTablet for tablet 105468bfb6dc48c28c16d3449c691f6b (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:48.283381 16320 raft_consensus.cc:359] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:48.283788 16322 leader_election.cc:290] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:48.284447 16320 raft_consensus.cc:385] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.284711 16188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105468bfb6dc48c28c16d3449c691f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.284859 16320 raft_consensus.cc:740] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.289726 16317 tablet_bootstrap.cc:654] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.292213 16319 ts_tablet_manager.cc:1434] T a07d00d6ed2e42308d7de0f098fa286c P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.133s	user 0.009s	sys 0.005s
I20260709 13:04:48.287397 16223 heartbeater.cc:499] Master 127.7.25.254:39391 was elected leader, sending a full tablet report...
I20260709 13:04:48.286576 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa51a24c3524741836e9666f1b4babe" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:48.297397 16320 consensus_queue.cc:260] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:48.286294 16316 tablet_bootstrap.cc:492] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:48.314293 16320 ts_tablet_manager.cc:1434] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
I20260709 13:04:48.315405 16320 tablet_bootstrap.cc:492] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:48.308274 16319 tablet_bootstrap.cc:492] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:48.308915 16317 tablet_bootstrap.cc:492] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
W20260709 13:04:48.301649 16237 leader_election.cc:343] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:48.304888 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:48.318037 16317 ts_tablet_manager.cc:1403] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.000s
W20260709 13:04:48.319377 16089 leader_election.cc:343] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:48.319820 16089 leader_election.cc:304] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:48.320283 16316 tablet_bootstrap.cc:654] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.321117 16326 raft_consensus.cc:2749] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:48.310725 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa51a24c3524741836e9666f1b4babe" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:48.321372 16317 raft_consensus.cc:359] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:48.322301 16317 raft_consensus.cc:385] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.311082 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07d00d6ed2e42308d7de0f098fa286c" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:48.322602 16317 raft_consensus.cc:740] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.298923 16258 tablet_service.cc:1511] Processing CreateTablet for tablet 76c283cfd76b4e9aacd796f6ead6e4b8 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
W20260709 13:04:48.324633 16236 leader_election.cc:343] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:48.328433 16236 leader_election.cc:304] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:48.328907 16258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76c283cfd76b4e9aacd796f6ead6e4b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.328985 16107 tablet_service.cc:1511] Processing CreateTablet for tablet 6f053de7054c4b3786ffa35aa5accb15 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
W20260709 13:04:48.330116 16236 leader_election.cc:343] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:48.330420 16107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f053de7054c4b3786ffa35aa5accb15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.330770 16322 raft_consensus.cc:2749] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:48.333304 16320 tablet_bootstrap.cc:654] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.334193 16255 tablet_service.cc:1511] Processing CreateTablet for tablet 6f053de7054c4b3786ffa35aa5accb15 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:48.335585 16255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f053de7054c4b3786ffa35aa5accb15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.324544 16317 consensus_queue.cc:260] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:48.326507 16182 tablet_service.cc:1511] Processing CreateTablet for tablet 08a6b0df9a4d4b55a27f4ffb956db8d0 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:48.326815 16039 tablet_service.cc:1511] Processing CreateTablet for tablet 6f053de7054c4b3786ffa35aa5accb15 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:48.339226 16039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f053de7054c4b3786ffa35aa5accb15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.338579 16261 tablet_service.cc:1511] Processing CreateTablet for tablet 08a6b0df9a4d4b55a27f4ffb956db8d0 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:48.340422 16261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a6b0df9a4d4b55a27f4ffb956db8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.338670 16035 tablet_service.cc:1511] Processing CreateTablet for tablet 08a6b0df9a4d4b55a27f4ffb956db8d0 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:48.342832 16035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a6b0df9a4d4b55a27f4ffb956db8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.358860 16180 tablet_service.cc:1511] Processing CreateTablet for tablet fe849f02803548a48394a1ff9f356f98 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:48.358889 16109 tablet_service.cc:1511] Processing CreateTablet for tablet fe849f02803548a48394a1ff9f356f98 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:48.360394 16180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe849f02803548a48394a1ff9f356f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.361071 16109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe849f02803548a48394a1ff9f356f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.365478 16182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a6b0df9a4d4b55a27f4ffb956db8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.370962 16317 ts_tablet_manager.cc:1434] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.003s
I20260709 13:04:48.372473 16317 tablet_bootstrap.cc:492] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:48.374783 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07d00d6ed2e42308d7de0f098fa286c" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:48.375560 16198 raft_consensus.cc:2468] T a07d00d6ed2e42308d7de0f098fa286c P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:48.377066 16237 leader_election.cc:304] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:48.378376 16322 raft_consensus.cc:2804] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:48.378749 16322 raft_consensus.cc:493] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.379073 16322 raft_consensus.cc:3060] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.386379 16322 raft_consensus.cc:515] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:48.390923 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07d00d6ed2e42308d7de0f098fa286c" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:48.391558 16198 raft_consensus.cc:3060] T a07d00d6ed2e42308d7de0f098fa286c P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.394727 16319 tablet_bootstrap.cc:654] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.401046 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07d00d6ed2e42308d7de0f098fa286c" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
W20260709 13:04:48.402742 16236 leader_election.cc:343] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:48.403775 16198 raft_consensus.cc:2468] T a07d00d6ed2e42308d7de0f098fa286c P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:48.406577 16259 tablet_service.cc:1511] Processing CreateTablet for tablet fe849f02803548a48394a1ff9f356f98 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:48.407886 16259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe849f02803548a48394a1ff9f356f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.408159 16033 tablet_service.cc:1511] Processing CreateTablet for tablet bf5dc804032442d1a074ba2adaf03311 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:48.409152 16316 tablet_bootstrap.cc:492] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:48.409449 16033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5dc804032442d1a074ba2adaf03311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.409693 16316 ts_tablet_manager.cc:1403] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.124s	user 0.016s	sys 0.000s
I20260709 13:04:48.409627 16237 leader_election.cc:304] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:48.404292 16322 leader_election.cc:290] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:48.424177 16322 raft_consensus.cc:2804] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:48.425180 16316 raft_consensus.cc:359] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:48.431118 16316 raft_consensus.cc:385] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.431505 16316 raft_consensus.cc:740] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.432353 16316 consensus_queue.cc:260] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:48.434638 16316 ts_tablet_manager.cc:1434] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:04:48.437004 16106 tablet_service.cc:1511] Processing CreateTablet for tablet bf5dc804032442d1a074ba2adaf03311 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:48.439050 16106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5dc804032442d1a074ba2adaf03311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.439949 16320 tablet_bootstrap.cc:492] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:48.440819 16320 ts_tablet_manager.cc:1403] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.126s	user 0.023s	sys 0.025s
I20260709 13:04:48.444090 16320 raft_consensus.cc:359] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:48.440548 16180 tablet_service.cc:1511] Processing CreateTablet for tablet bf5dc804032442d1a074ba2adaf03311 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:48.439064 16316 tablet_bootstrap.cc:492] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:48.446019 16039 tablet_service.cc:1511] Processing CreateTablet for tablet eac8a97b1adc49389919710edf7c5e03 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:48.452430 16180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5dc804032442d1a074ba2adaf03311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.452582 16039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac8a97b1adc49389919710edf7c5e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.447671 16258 tablet_service.cc:1511] Processing CreateTablet for tablet eac8a97b1adc49389919710edf7c5e03 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:48.448120 16110 tablet_service.cc:1511] Processing CreateTablet for tablet eac8a97b1adc49389919710edf7c5e03 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:48.438275 16317 tablet_bootstrap.cc:654] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.453934 16110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac8a97b1adc49389919710edf7c5e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.459041 16316 tablet_bootstrap.cc:654] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.460837 16258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac8a97b1adc49389919710edf7c5e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.459879 16320 raft_consensus.cc:385] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.459467 16322 raft_consensus.cc:697] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:48.466347 16320 raft_consensus.cc:740] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.466979 16322 consensus_queue.cc:237] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:48.467227 16320 consensus_queue.cc:260] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:48.475291 16320 ts_tablet_manager.cc:1434] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.003s
I20260709 13:04:48.476341 16320 tablet_bootstrap.cc:492] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:48.488722 16330 raft_consensus.cc:493] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.489346 16330 raft_consensus.cc:515] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:48.491312 16319 tablet_bootstrap.cc:492] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:48.491847 16319 ts_tablet_manager.cc:1403] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.184s	user 0.009s	sys 0.010s
I20260709 13:04:48.492648 16330 leader_election.cc:290] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:48.494397 16317 tablet_bootstrap.cc:492] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:48.494935 16317 ts_tablet_manager.cc:1403] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.123s	user 0.007s	sys 0.008s
I20260709 13:04:48.499598 16330 raft_consensus.cc:493] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.500020 16319 raft_consensus.cc:359] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:48.500339 16330 raft_consensus.cc:515] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:48.500908 16319 raft_consensus.cc:385] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.501322 16319 raft_consensus.cc:740] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.501165 16317 raft_consensus.cc:359] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:48.502147 16317 raft_consensus.cc:385] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.502539 16317 raft_consensus.cc:740] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.502210 16319 consensus_queue.cc:260] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:48.502954 16330 leader_election.cc:290] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:48.503441 16317 consensus_queue.cc:260] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:48.504525 16319 ts_tablet_manager.cc:1434] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:04:48.505519 16319 tablet_bootstrap.cc:492] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:48.506455 16182 tablet_service.cc:1511] Processing CreateTablet for tablet 522541a48c1647ccaf475543121810d2 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:48.507755 16182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522541a48c1647ccaf475543121810d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.511991 16319 tablet_bootstrap.cc:654] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.492975 16320 tablet_bootstrap.cc:654] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.517526 16261 tablet_service.cc:1511] Processing CreateTablet for tablet 522541a48c1647ccaf475543121810d2 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:48.518839 16261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522541a48c1647ccaf475543121810d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.521755 16033 tablet_service.cc:1511] Processing CreateTablet for tablet 522541a48c1647ccaf475543121810d2 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:48.523051 16033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522541a48c1647ccaf475543121810d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.524273 16035 tablet_service.cc:1511] Processing CreateTablet for tablet 8eede189c87343c6a45e71d7cb23c41d (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:48.525614 16259 tablet_service.cc:1511] Processing CreateTablet for tablet 7cc73085eee348a0b029b5aa5f51e288 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:48.526028 16188 tablet_service.cc:1511] Processing CreateTablet for tablet 7cc73085eee348a0b029b5aa5f51e288 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:48.526922 16259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cc73085eee348a0b029b5aa5f51e288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.527245 16188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cc73085eee348a0b029b5aa5f51e288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.525614 16110 tablet_service.cc:1511] Processing CreateTablet for tablet 7cc73085eee348a0b029b5aa5f51e288 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:48.531046 16035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eede189c87343c6a45e71d7cb23c41d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.531895 16110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cc73085eee348a0b029b5aa5f51e288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.550710 16180 tablet_service.cc:1511] Processing CreateTablet for tablet 8eede189c87343c6a45e71d7cb23c41d (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:48.552317 16180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eede189c87343c6a45e71d7cb23c41d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.553632 16106 tablet_service.cc:1511] Processing CreateTablet for tablet 8eede189c87343c6a45e71d7cb23c41d (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:48.555562 16106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eede189c87343c6a45e71d7cb23c41d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.561717 16030 tablet_service.cc:1511] Processing CreateTablet for tablet fe9bf004f8eb4f0f910840561945e386 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:48.564052 16030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9bf004f8eb4f0f910840561945e386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.570152 16255 tablet_service.cc:1511] Processing CreateTablet for tablet fe9bf004f8eb4f0f910840561945e386 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:48.571555 16255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9bf004f8eb4f0f910840561945e386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.572526 15943 catalog_manager.cc:5697] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 1 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.574141 16109 tablet_service.cc:1511] Processing CreateTablet for tablet fe9bf004f8eb4f0f910840561945e386 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:48.575515 16109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9bf004f8eb4f0f910840561945e386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.588366 16179 tablet_service.cc:1511] Processing CreateTablet for tablet e44eefc0f2e540b99fa97ec775185660 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:48.591346 16179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e44eefc0f2e540b99fa97ec775185660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.593287 16317 ts_tablet_manager.cc:1434] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.098s	user 0.005s	sys 0.005s
I20260709 13:04:48.594488 16317 tablet_bootstrap.cc:492] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:48.594986 16033 tablet_service.cc:1511] Processing CreateTablet for tablet e44eefc0f2e540b99fa97ec775185660 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:48.596537 16033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e44eefc0f2e540b99fa97ec775185660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.619066 16316 tablet_bootstrap.cc:492] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:48.619756 16316 ts_tablet_manager.cc:1403] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.181s	user 0.016s	sys 0.012s
I20260709 13:04:48.620097 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:48.621421 16111 tablet_service.cc:1511] Processing CreateTablet for tablet c32eb3a1727b42348bb90a85f5f0e419 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:48.622707 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc5c10cfdd24c64a4db9e4339808499" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:48.617522 16326 raft_consensus.cc:493] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.623034 16111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c32eb3a1727b42348bb90a85f5f0e419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.623817 16326 raft_consensus.cc:515] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:48.629783 16259 tablet_service.cc:1511] Processing CreateTablet for tablet e44eefc0f2e540b99fa97ec775185660 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:48.631412 16259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e44eefc0f2e540b99fa97ec775185660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.633136 16326 leader_election.cc:290] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:48.635735 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa51a24c3524741836e9666f1b4babe" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:48.636531 16272 raft_consensus.cc:2468] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:48.639590 16089 leader_election.cc:304] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:04:48.643399 16188 tablet_service.cc:1511] Processing CreateTablet for tablet c32eb3a1727b42348bb90a85f5f0e419 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:48.644755 16188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c32eb3a1727b42348bb90a85f5f0e419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.655143 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:48.655296 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc5c10cfdd24c64a4db9e4339808499" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:48.651293 16326 raft_consensus.cc:2804] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:48.665213 16326 raft_consensus.cc:493] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.665798 16326 raft_consensus.cc:3060] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.667878 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa51a24c3524741836e9666f1b4babe" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:48.668905 16048 raft_consensus.cc:2468] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:48.671121 16319 tablet_bootstrap.cc:492] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:48.671959 16319 ts_tablet_manager.cc:1403] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.167s	user 0.017s	sys 0.019s
I20260709 13:04:48.672654 16030 tablet_service.cc:1511] Processing CreateTablet for tablet aaaad334dede46d888c92db5c932655e (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:48.674616 16030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaaad334dede46d888c92db5c932655e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.681125 16255 tablet_service.cc:1511] Processing CreateTablet for tablet c32eb3a1727b42348bb90a85f5f0e419 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:48.682497 16255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c32eb3a1727b42348bb90a85f5f0e419. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:48.676173 16014 leader_election.cc:343] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:48.686244 16014 leader_election.cc:343] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:48.687152 16014 leader_election.cc:343] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:48.687753 16014 leader_election.cc:304] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:48.688848 16330 raft_consensus.cc:2749] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:48.693821 16014 leader_election.cc:343] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:48.694314 16014 leader_election.cc:304] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:48.695214 16330 raft_consensus.cc:2749] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:48.698661 16322 raft_consensus.cc:493] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.699240 16322 raft_consensus.cc:515] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:48.725620 16352 raft_consensus.cc:493] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.726099 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:48.726243 16352 raft_consensus.cc:515] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:48.726768 16124 raft_consensus.cc:2468] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:48.728221 16237 leader_election.cc:304] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:04:48.729617 16342 raft_consensus.cc:2804] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:48.730010 16342 raft_consensus.cc:493] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.730336 16342 raft_consensus.cc:3060] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.730386 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f697dfb6287b4feeac50690912201da2" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
W20260709 13:04:48.732344 16089 leader_election.cc:343] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:48.733775 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f697dfb6287b4feeac50690912201da2" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
W20260709 13:04:48.735433 16088 leader_election.cc:343] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:48.735895 16088 leader_election.cc:304] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:48.736523 16109 tablet_service.cc:1511] Processing CreateTablet for tablet aaaad334dede46d888c92db5c932655e (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:48.725801 16317 tablet_bootstrap.cc:654] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.738044 16109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaaad334dede46d888c92db5c932655e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.738842 16335 raft_consensus.cc:493] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.739359 16335 raft_consensus.cc:515] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
W20260709 13:04:48.740216 16014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 46425.9us
I20260709 13:04:48.675822 16316 raft_consensus.cc:359] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:48.756281 16182 tablet_service.cc:1511] Processing CreateTablet for tablet aaaad334dede46d888c92db5c932655e (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:48.757788 16182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaaad334dede46d888c92db5c932655e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.757530 16259 tablet_service.cc:1511] Processing CreateTablet for tablet 48faa67625c143aa8ce08eb068a3a8dc (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:48.759217 16259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48faa67625c143aa8ce08eb068a3a8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.761961 16335 leader_election.cc:290] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:48.742619 16352 leader_election.cc:290] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:48.762775 16352 raft_consensus.cc:2749] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:48.766590 16342 raft_consensus.cc:515] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:48.771461 16035 tablet_service.cc:1511] Processing CreateTablet for tablet 48faa67625c143aa8ce08eb068a3a8dc (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:48.772501 16110 tablet_service.cc:1511] Processing CreateTablet for tablet 48faa67625c143aa8ce08eb068a3a8dc (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:48.773309 16035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48faa67625c143aa8ce08eb068a3a8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.773809 16110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48faa67625c143aa8ce08eb068a3a8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.777690 16179 tablet_service.cc:1511] Processing CreateTablet for tablet 3f21b3c8be8f42be9186b827a2a086e3 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:48.779062 16179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f21b3c8be8f42be9186b827a2a086e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.781332 16322 leader_election.cc:290] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:48.782002 16319 raft_consensus.cc:359] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:48.782616 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:48.783378 16198 raft_consensus.cc:2468] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:48.754017 16316 raft_consensus.cc:385] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.788029 16316 raft_consensus.cc:740] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.782826 16319 raft_consensus.cc:385] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.790244 16319 raft_consensus.cc:740] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.797968 16320 tablet_bootstrap.cc:492] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
W20260709 13:04:48.795750 16088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 60480.2us
I20260709 13:04:48.798548 16320 ts_tablet_manager.cc:1403] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.322s	user 0.026s	sys 0.029s
I20260709 13:04:48.799979 16317 tablet_bootstrap.cc:492] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:48.808497 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:48.793403 16316 consensus_queue.cc:260] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:48.791335 16319 consensus_queue.cc:260] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:48.809214 16124 raft_consensus.cc:3060] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.818367 16258 tablet_service.cc:1511] Processing CreateTablet for tablet 3f21b3c8be8f42be9186b827a2a086e3 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:48.819787 16258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f21b3c8be8f42be9186b827a2a086e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.821236 16320 raft_consensus.cc:359] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:48.822063 16320 raft_consensus.cc:385] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.822376 16320 raft_consensus.cc:740] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.823269 16320 consensus_queue.cc:260] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:48.811599 16317 ts_tablet_manager.cc:1403] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.217s	user 0.006s	sys 0.025s
I20260709 13:04:48.830842 16319 ts_tablet_manager.cc:1434] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.158s	user 0.010s	sys 0.004s
I20260709 13:04:48.831889 16317 raft_consensus.cc:359] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:48.832563 16316 ts_tablet_manager.cc:1434] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.212s	user 0.006s	sys 0.009s
I20260709 13:04:48.832705 16317 raft_consensus.cc:385] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.833679 16316 tablet_bootstrap.cc:492] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:48.852958 16111 tablet_service.cc:1511] Processing CreateTablet for tablet c98ba329bddb47c5aec148957811a4c2 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:48.834932 16326 raft_consensus.cc:515] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:48.857467 16124 raft_consensus.cc:2468] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:48.852190 16180 tablet_service.cc:1511] Processing CreateTablet for tablet c98ba329bddb47c5aec148957811a4c2 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:48.840896 16261 tablet_service.cc:1511] Processing CreateTablet for tablet c98ba329bddb47c5aec148957811a4c2 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:48.859112 16326 leader_election.cc:290] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:48.860416 16261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98ba329bddb47c5aec148957811a4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.860201 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa51a24c3524741836e9666f1b4babe" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:48.861724 16048 raft_consensus.cc:3060] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.859820 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa51a24c3524741836e9666f1b4babe" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:48.863613 16272 raft_consensus.cc:3060] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.837067 16030 tablet_service.cc:1511] Processing CreateTablet for tablet 3f21b3c8be8f42be9186b827a2a086e3 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:48.866540 16030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f21b3c8be8f42be9186b827a2a086e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.869153 16335 raft_consensus.cc:493] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.870103 16342 leader_election.cc:290] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:48.842463 16039 tablet_service.cc:1511] Processing CreateTablet for tablet a26858ecdea24ad9bb9b64ee8d133dd2 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:48.871452 16039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a26858ecdea24ad9bb9b64ee8d133dd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.871176 16106 tablet_service.cc:1511] Processing CreateTablet for tablet a26858ecdea24ad9bb9b64ee8d133dd2 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:48.872092 16237 leader_election.cc:304] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:04:48.873467 16322 raft_consensus.cc:2804] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:48.833071 16317 raft_consensus.cc:740] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.834810 16319 tablet_bootstrap.cc:492] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:48.844131 16320 ts_tablet_manager.cc:1434] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 13:04:48.877801 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:48.878422 16198 raft_consensus.cc:3060] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.873987 16322 raft_consensus.cc:697] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:48.881909 16322 consensus_queue.cc:237] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:48.869722 16335 raft_consensus.cc:515] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:48.886749 16335 leader_election.cc:290] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:48.886631 16182 tablet_service.cc:1511] Processing CreateTablet for tablet a26858ecdea24ad9bb9b64ee8d133dd2 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 13:04:48.890350 15994 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:48.892915 16035 tablet_service.cc:1511] Processing CreateTablet for tablet c600c8f1ec454bc0b4a3716ea85d8499 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:48.859020 16180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98ba329bddb47c5aec148957811a4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.896220 16035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c600c8f1ec454bc0b4a3716ea85d8499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.896997 16107 tablet_service.cc:1511] Processing CreateTablet for tablet c600c8f1ec454bc0b4a3716ea85d8499 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:48.892982 16198 raft_consensus.cc:2468] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:48.899456 16317 consensus_queue.cc:260] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:48.903638 16320 tablet_bootstrap.cc:492] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:48.906699 16272 raft_consensus.cc:2468] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:48.908149 16089 leader_election.cc:304] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:04:48.909149 16326 raft_consensus.cc:2804] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:48.903829 16317 ts_tablet_manager.cc:1434] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.002s
I20260709 13:04:48.911077 16326 raft_consensus.cc:697] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:04:48.911998 16326 consensus_queue.cc:237] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:48.928385 16033 tablet_service.cc:1511] Processing CreateTablet for tablet 3808fd28794c4ce098037730316b2e58 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:48.929345 16182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a26858ecdea24ad9bb9b64ee8d133dd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.929831 16033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3808fd28794c4ce098037730316b2e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.930209 16188 tablet_service.cc:1511] Processing CreateTablet for tablet 3808fd28794c4ce098037730316b2e58 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:48.931509 16188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3808fd28794c4ce098037730316b2e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.934023 16255 tablet_service.cc:1511] Processing CreateTablet for tablet 3808fd28794c4ce098037730316b2e58 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:48.937933 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:48.938340 16316 tablet_bootstrap.cc:654] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.938774 16124 raft_consensus.cc:2393] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1e05442c5b44a079dd1de9dd124c990 in current term 1: Already voted for candidate d2e22ad700e94d1095c014708c364bb7 in this term.
I20260709 13:04:48.935670 16354 raft_consensus.cc:493] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.941347 16354 raft_consensus.cc:515] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:48.944145 16354 leader_election.cc:290] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:48.944816 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ffb334ab54abb8bdb4893844c3b6b" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
W20260709 13:04:48.946461 16088 leader_election.cc:343] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:48.949222 16320 tablet_bootstrap.cc:654] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.949074 15946 catalog_manager.cc:5697] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 1 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:48.953534 16255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3808fd28794c4ce098037730316b2e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.961220 16111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98ba329bddb47c5aec148957811a4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.962050 16106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a26858ecdea24ad9bb9b64ee8d133dd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.907668 16259 tablet_service.cc:1511] Processing CreateTablet for tablet c600c8f1ec454bc0b4a3716ea85d8499 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:48.963624 16107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c600c8f1ec454bc0b4a3716ea85d8499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.964058 16259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c600c8f1ec454bc0b4a3716ea85d8499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.980813 16319 tablet_bootstrap.cc:654] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.963548 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ffb334ab54abb8bdb4893844c3b6b" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:48.991878 16340 raft_consensus.cc:493] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.992463 16340 raft_consensus.cc:515] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:48.997725 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:48.998430 16049 raft_consensus.cc:2468] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:48.998631 16317 tablet_bootstrap.cc:492] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:48.999899 16162 leader_election.cc:304] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:49.000912 16335 raft_consensus.cc:2804] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:49.001408 16335 raft_consensus.cc:493] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.001766 16335 raft_consensus.cc:3060] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.002262 16110 tablet_service.cc:1511] Processing CreateTablet for tablet 5e6e04804ef846e8b828194d87904eaa (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:49.003587 16110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6e04804ef846e8b828194d87904eaa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:49.006196 16089 leader_election.cc:343] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:49.006721 16089 leader_election.cc:304] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:49.007002 16340 leader_election.cc:290] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:49.007576 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09412044d26f417da5c842c8acf1149d" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:48.993840 16048 raft_consensus.cc:2468] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:49.015808 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09412044d26f417da5c842c8acf1149d" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:49.017928 16179 tablet_service.cc:1511] Processing CreateTablet for tablet 5e6e04804ef846e8b828194d87904eaa (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:49.019387 16179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6e04804ef846e8b828194d87904eaa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:49.018280 16236 leader_election.cc:343] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:49.022197 16236 consensus_peers.cc:597] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:49.022760 16237 leader_election.cc:343] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:49.009963 16326 raft_consensus.cc:2749] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:49.025671 16237 leader_election.cc:304] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:49.027805 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:49.027966 15946 catalog_manager.cc:5697] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:49.029601 16163 leader_election.cc:343] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:49.030512 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:49.031160 16322 raft_consensus.cc:2749] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:49.034310 16258 tablet_service.cc:1511] Processing CreateTablet for tablet 5e6e04804ef846e8b828194d87904eaa (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:49.035723 16258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6e04804ef846e8b828194d87904eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.035509 16163 leader_election.cc:304] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:49.039232 16317 tablet_bootstrap.cc:654] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.046504 16335 raft_consensus.cc:515] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:49.048566 16039 tablet_service.cc:1511] Processing CreateTablet for tablet dbeb3d9bac364b43abf555b36674a82e (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:49.050025 16039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbeb3d9bac364b43abf555b36674a82e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.049944 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:49.050601 16048 raft_consensus.cc:3060] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.056272 16109 tablet_service.cc:1511] Processing CreateTablet for tablet dbeb3d9bac364b43abf555b36674a82e (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:49.057678 16109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbeb3d9bac364b43abf555b36674a82e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.058972 16335 leader_election.cc:290] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:49.058925 16181 tablet_service.cc:1511] Processing CreateTablet for tablet dbeb3d9bac364b43abf555b36674a82e (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:49.059715 16335 raft_consensus.cc:2749] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:49.060328 16181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbeb3d9bac364b43abf555b36674a82e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.060586 16320 tablet_bootstrap.cc:492] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:49.061167 16316 tablet_bootstrap.cc:492] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:49.061662 16316 ts_tablet_manager.cc:1403] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.228s	user 0.005s	sys 0.022s
I20260709 13:04:49.067859 16048 raft_consensus.cc:2468] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:49.068748 16254 tablet_service.cc:1511] Processing CreateTablet for tablet ffc93f8cfc444912a0c7ef667a931a5c (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:49.069231 16162 leader_election.cc:304] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:49.070133 16335 raft_consensus.cc:2804] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:49.070344 16254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc93f8cfc444912a0c7ef667a931a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.070662 16335 raft_consensus.cc:697] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:49.072440 16322 consensus_queue.cc:1048] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:49.072461 16335 consensus_queue.cc:237] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:49.071698 16320 ts_tablet_manager.cc:1403] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.168s	user 0.006s	sys 0.021s
I20260709 13:04:49.091943 16320 raft_consensus.cc:359] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:49.092698 16320 raft_consensus.cc:385] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.101672 16317 tablet_bootstrap.cc:492] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:49.102473 16317 ts_tablet_manager.cc:1403] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.104s	user 0.012s	sys 0.002s
I20260709 13:04:49.104598 16108 tablet_service.cc:1511] Processing CreateTablet for tablet ffc93f8cfc444912a0c7ef667a931a5c (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:49.106000 16108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc93f8cfc444912a0c7ef667a931a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.107810 16033 tablet_service.cc:1511] Processing CreateTablet for tablet ffc93f8cfc444912a0c7ef667a931a5c (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:49.110121 16033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc93f8cfc444912a0c7ef667a931a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.064843 16316 raft_consensus.cc:359] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:49.126823 16316 raft_consensus.cc:385] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.127388 16316 raft_consensus.cc:740] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.128679 16316 consensus_queue.cc:260] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:49.131978 16316 ts_tablet_manager.cc:1434] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 13:04:49.092981 16320 raft_consensus.cc:740] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.138671 16319 tablet_bootstrap.cc:492] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:49.142187 16181 tablet_service.cc:1511] Processing CreateTablet for tablet 06d457e5782e42e78f4b0978f2b41dac (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:49.146726 16181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06d457e5782e42e78f4b0978f2b41dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.115129 16317 raft_consensus.cc:359] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.154316 16317 raft_consensus.cc:385] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.154721 16317 raft_consensus.cc:740] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.154505 16259 tablet_service.cc:1511] Processing CreateTablet for tablet 06d457e5782e42e78f4b0978f2b41dac (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:49.155740 16317 consensus_queue.cc:260] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.156483 16259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06d457e5782e42e78f4b0978f2b41dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.159365 16030 tablet_service.cc:1511] Processing CreateTablet for tablet 06d457e5782e42e78f4b0978f2b41dac (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:49.160669 16030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06d457e5782e42e78f4b0978f2b41dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.161581 16111 tablet_service.cc:1511] Processing CreateTablet for tablet 3589ea61d3c14d5da5f955ac6d719881 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260709 13:04:49.145315 16163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 109912us
I20260709 13:04:49.170483 16255 tablet_service.cc:1511] Processing CreateTablet for tablet 3589ea61d3c14d5da5f955ac6d719881 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:49.171792 16255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3589ea61d3c14d5da5f955ac6d719881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.173235 16320 consensus_queue.cc:260] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:49.175601 16320 ts_tablet_manager.cc:1434] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.087s	user 0.005s	sys 0.000s
I20260709 13:04:49.176580 16320 tablet_bootstrap.cc:492] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:49.185474 16035 tablet_service.cc:1511] Processing CreateTablet for tablet 496077ee29374b90a7c924539c590475 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:49.186781 16035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496077ee29374b90a7c924539c590475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.190120 16032 tablet_service.cc:1511] Processing CreateTablet for tablet c6c51469e614423d8a9cc50e024cf468 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:49.191499 16032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6c51469e614423d8a9cc50e024cf468. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.192876 16188 tablet_service.cc:1511] Processing CreateTablet for tablet 496077ee29374b90a7c924539c590475 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:49.194191 16188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496077ee29374b90a7c924539c590475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.196102 16179 tablet_service.cc:1511] Processing CreateTablet for tablet 3589ea61d3c14d5da5f955ac6d719881 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:49.197415 16179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3589ea61d3c14d5da5f955ac6d719881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.192905 16106 tablet_service.cc:1511] Processing CreateTablet for tablet 496077ee29374b90a7c924539c590475 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:49.201388 16316 tablet_bootstrap.cc:492] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:49.207576 16330 raft_consensus.cc:493] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.208168 16330 raft_consensus.cc:515] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.210271 16106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496077ee29374b90a7c924539c590475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.210654 16330 leader_election.cc:290] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:49.212699 16110 tablet_service.cc:1511] Processing CreateTablet for tablet c6c51469e614423d8a9cc50e024cf468 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:49.214025 16110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6c51469e614423d8a9cc50e024cf468. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.218808 16317 ts_tablet_manager.cc:1434] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.116s	user 0.009s	sys 0.001s
I20260709 13:04:49.163779 16319 ts_tablet_manager.cc:1403] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.329s	user 0.052s	sys 0.026s
I20260709 13:04:49.208889 16320 tablet_bootstrap.cc:654] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.234622 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:49.234899 16182 tablet_service.cc:1511] Processing CreateTablet for tablet e1713f6b73c3463c87e7eb5c94959eb0 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:49.236249 16182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1713f6b73c3463c87e7eb5c94959eb0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:49.236440 16163 leader_election.cc:343] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:49.237246 16111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3589ea61d3c14d5da5f955ac6d719881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.226120 16317 tablet_bootstrap.cc:492] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:49.244448 16322 raft_consensus.cc:493] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.245639 16322 raft_consensus.cc:515] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:49.245760 16261 tablet_service.cc:1511] Processing CreateTablet for tablet e1713f6b73c3463c87e7eb5c94959eb0 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:49.247094 16037 tablet_service.cc:1511] Processing CreateTablet for tablet e1713f6b73c3463c87e7eb5c94959eb0 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:49.247759 16322 leader_election.cc:290] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:49.248391 16037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1713f6b73c3463c87e7eb5c94959eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.247123 16261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1713f6b73c3463c87e7eb5c94959eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.249446 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f697dfb6287b4feeac50690912201da2" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:49.250213 16124 raft_consensus.cc:2468] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:49.252611 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f697dfb6287b4feeac50690912201da2" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:49.253707 16237 leader_election.cc:304] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
W20260709 13:04:49.254338 16236 leader_election.cc:343] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:49.254591 16322 raft_consensus.cc:2804] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:49.255031 16322 raft_consensus.cc:493] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.255371 16322 raft_consensus.cc:3060] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.259207 16316 tablet_bootstrap.cc:654] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.264248 16259 tablet_service.cc:1511] Processing CreateTablet for tablet c6c51469e614423d8a9cc50e024cf468 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:49.264986 16322 raft_consensus.cc:515] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:49.265728 16259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6c51469e614423d8a9cc50e024cf468. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.268188 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f697dfb6287b4feeac50690912201da2" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:49.268513 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f697dfb6287b4feeac50690912201da2" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:49.269219 16124 raft_consensus.cc:3060] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:49.269692 16236 leader_election.cc:343] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:49.286803 16124 raft_consensus.cc:2468] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:49.287479 16107 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd3bea4269f4b61adeb12a2cabaca3d (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:49.288102 16237 leader_election.cc:304] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:49.288818 16107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd3bea4269f4b61adeb12a2cabaca3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.290620 16340 raft_consensus.cc:2804] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:49.291131 16340 raft_consensus.cc:697] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:49.291970 16340 consensus_queue.cc:237] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:49.302338 16319 raft_consensus.cc:359] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.303181 16319 raft_consensus.cc:385] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.303496 16319 raft_consensus.cc:740] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.302860 15943 catalog_manager.cc:5697] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:49.311544 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be59fdebe7a44cc9f945fa9793ddfda" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
W20260709 13:04:49.313208 16014 leader_election.cc:343] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:49.283425 16322 leader_election.cc:290] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:49.321595 16188 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd3bea4269f4b61adeb12a2cabaca3d (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:49.323158 16188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd3bea4269f4b61adeb12a2cabaca3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.324558 16258 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd3bea4269f4b61adeb12a2cabaca3d (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:49.328327 16258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd3bea4269f4b61adeb12a2cabaca3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.335244 16181 tablet_service.cc:1511] Processing CreateTablet for tablet d4c2d4bd133442d28d078d6fc088cff4 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:49.336656 16181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4c2d4bd133442d28d078d6fc088cff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.338096 16106 tablet_service.cc:1511] Processing CreateTablet for tablet d4c2d4bd133442d28d078d6fc088cff4 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:49.325831 16030 tablet_service.cc:1511] Processing CreateTablet for tablet d4c2d4bd133442d28d078d6fc088cff4 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:49.339403 16106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4c2d4bd133442d28d078d6fc088cff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.339725 16030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4c2d4bd133442d28d078d6fc088cff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.339795 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be59fdebe7a44cc9f945fa9793ddfda" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
W20260709 13:04:49.342455 16014 leader_election.cc:343] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:49.343010 16014 leader_election.cc:304] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:49.344175 16330 raft_consensus.cc:2749] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:49.341198 16319 consensus_queue.cc:260] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.347446 16319 ts_tablet_manager.cc:1434] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.128s	user 0.006s	sys 0.000s
I20260709 13:04:49.348625 16319 tablet_bootstrap.cc:492] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:49.356182 16326 raft_consensus.cc:493] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.356794 16326 raft_consensus.cc:515] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.360620 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61baecc1a74998a356870a675301ea" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:49.359027 16326 leader_election.cc:290] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
W20260709 13:04:49.362902 16088 leader_election.cc:343] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:49.355818 16322 consensus_queue.cc:1048] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:04:49.364624 16254 tablet_service.cc:1511] Processing CreateTablet for tablet 379913b2ca6a49e9bfd93ca8b06c9fee (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:49.367944 16254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 379913b2ca6a49e9bfd93ca8b06c9fee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.375175 16316 tablet_bootstrap.cc:492] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:49.375788 16316 ts_tablet_manager.cc:1403] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.208s	user 0.012s	sys 0.005s
I20260709 13:04:49.382695 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61baecc1a74998a356870a675301ea" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:49.388728 16111 tablet_service.cc:1511] Processing CreateTablet for tablet 379913b2ca6a49e9bfd93ca8b06c9fee (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 13:04:49.390653 16089 leader_election.cc:343] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:49.391144 16089 leader_election.cc:304] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:49.391965 16326 raft_consensus.cc:2749] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:49.392186 16317 tablet_bootstrap.cc:654] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.392504 16111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 379913b2ca6a49e9bfd93ca8b06c9fee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.386348 16030 tablet_service.cc:1511] Processing CreateTablet for tablet 379913b2ca6a49e9bfd93ca8b06c9fee (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:49.394361 16319 tablet_bootstrap.cc:654] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.395363 16030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 379913b2ca6a49e9bfd93ca8b06c9fee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.402917 16048 raft_consensus.cc:3060] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.424070 16259 tablet_service.cc:1511] Processing CreateTablet for tablet 4b5c33c4000f496f841f99af79e55532 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:49.425386 16259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b5c33c4000f496f841f99af79e55532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.425125 16179 tablet_service.cc:1511] Processing CreateTablet for tablet 4b5c33c4000f496f841f99af79e55532 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:49.426450 16179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b5c33c4000f496f841f99af79e55532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.409333 16326 consensus_queue.cc:1048] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:04:49.429785 16037 tablet_service.cc:1511] Processing CreateTablet for tablet 4b5c33c4000f496f841f99af79e55532 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:49.431298 16037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b5c33c4000f496f841f99af79e55532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.443780 16320 tablet_bootstrap.cc:492] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:49.444360 16320 ts_tablet_manager.cc:1403] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.268s	user 0.013s	sys 0.009s
I20260709 13:04:49.460803 16110 tablet_service.cc:1511] Processing CreateTablet for tablet ae83b44932ca4fd0a40b66c6e8061284 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:49.461114 16182 tablet_service.cc:1511] Processing CreateTablet for tablet ae83b44932ca4fd0a40b66c6e8061284 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:49.462209 16182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae83b44932ca4fd0a40b66c6e8061284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.462216 16110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae83b44932ca4fd0a40b66c6e8061284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.450870 16342 consensus_queue.cc:1048] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
W20260709 13:04:49.465934 16163 consensus_peers.cc:597] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 -> Peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631): Couldn't send request to peer d2e22ad700e94d1095c014708c364bb7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:49.428771 16316 raft_consensus.cc:359] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:49.475307 16316 raft_consensus.cc:385] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.446113 15946 catalog_manager.cc:5697] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 1 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:49.493405 16030 tablet_service.cc:1511] Processing CreateTablet for tablet 430a0b8ad91a40389bde4a2dce852afb (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:49.494701 16030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 430a0b8ad91a40389bde4a2dce852afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.477435 16316 raft_consensus.cc:740] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.497910 16316 consensus_queue.cc:260] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:49.500332 16316 ts_tablet_manager.cc:1434] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.124s	user 0.009s	sys 0.000s
I20260709 13:04:49.502439 16254 tablet_service.cc:1511] Processing CreateTablet for tablet ae83b44932ca4fd0a40b66c6e8061284 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:49.503988 16254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae83b44932ca4fd0a40b66c6e8061284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.477303 16320 raft_consensus.cc:359] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.515399 16316 tablet_bootstrap.cc:492] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:49.523304 16320 raft_consensus.cc:385] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.534699 16320 raft_consensus.cc:740] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.541826 16320 consensus_queue.cc:260] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.545887 16320 ts_tablet_manager.cc:1434] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.101s	user 0.004s	sys 0.007s
I20260709 13:04:49.554919 16110 tablet_service.cc:1511] Processing CreateTablet for tablet 430a0b8ad91a40389bde4a2dce852afb (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:49.555347 16030 tablet_service.cc:1511] Processing CreateTablet for tablet 85079923151849059accd1b7c27d4699 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:49.556214 16110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 430a0b8ad91a40389bde4a2dce852afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.556411 16030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85079923151849059accd1b7c27d4699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.560184 16317 tablet_bootstrap.cc:492] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:49.560707 16317 ts_tablet_manager.cc:1403] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.341s	user 0.014s	sys 0.016s
I20260709 13:04:49.562615 16259 tablet_service.cc:1511] Processing CreateTablet for tablet 85079923151849059accd1b7c27d4699 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:49.563853 16259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85079923151849059accd1b7c27d4699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.563755 16317 raft_consensus.cc:359] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:49.564568 16317 raft_consensus.cc:385] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.567891 16320 tablet_bootstrap.cc:492] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:49.569589 16182 tablet_service.cc:1511] Processing CreateTablet for tablet 430a0b8ad91a40389bde4a2dce852afb (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:49.571015 16182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 430a0b8ad91a40389bde4a2dce852afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.564884 16317 raft_consensus.cc:740] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.558394 16316 tablet_bootstrap.cc:654] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.622781 16037 tablet_service.cc:1511] Processing CreateTablet for tablet eae7099a7350453682514662a4773778 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:49.622943 16030 tablet_service.cc:1511] Processing CreateTablet for tablet 15550bacc7b04df9bc56ec154f31b50b (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:49.624294 16037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae7099a7350453682514662a4773778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.628280 16319 tablet_bootstrap.cc:492] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:49.628897 16319 ts_tablet_manager.cc:1403] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.281s	user 0.030s	sys 0.031s
I20260709 13:04:49.629979 16111 tablet_service.cc:1511] Processing CreateTablet for tablet 85079923151849059accd1b7c27d4699 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:49.631356 16111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85079923151849059accd1b7c27d4699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.632045 16319 raft_consensus.cc:359] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.632794 16319 raft_consensus.cc:385] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.633533 16320 tablet_bootstrap.cc:654] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.636404 16319 raft_consensus.cc:740] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.637796 16030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15550bacc7b04df9bc56ec154f31b50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.639114 16319 consensus_queue.cc:260] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.646251 16182 tablet_service.cc:1511] Processing CreateTablet for tablet 15550bacc7b04df9bc56ec154f31b50b (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:49.646543 16035 tablet_service.cc:1511] Processing CreateTablet for tablet ea7b2b72b2df44e89e8b76fa65501951 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:49.647976 16035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea7b2b72b2df44e89e8b76fa65501951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.648010 16182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15550bacc7b04df9bc56ec154f31b50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.652223 16319 ts_tablet_manager.cc:1434] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:04:49.653406 16319 tablet_bootstrap.cc:492] T 1be59fdebe7a44cc9f945fa9793ddfda P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:49.606499 16317 consensus_queue.cc:260] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:49.659857 16317 ts_tablet_manager.cc:1434] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.099s	user 0.002s	sys 0.005s
I20260709 13:04:49.660936 16317 tablet_bootstrap.cc:492] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:49.666927 16254 tablet_service.cc:1511] Processing CreateTablet for tablet 15550bacc7b04df9bc56ec154f31b50b (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:49.668367 16254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15550bacc7b04df9bc56ec154f31b50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.670060 16259 tablet_service.cc:1511] Processing CreateTablet for tablet 368367d6b6834e7b841b41cd87884744 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:49.671339 16259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 368367d6b6834e7b841b41cd87884744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.674847 16110 tablet_service.cc:1511] Processing CreateTablet for tablet 368367d6b6834e7b841b41cd87884744 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:49.676657 16179 tablet_service.cc:1511] Processing CreateTablet for tablet 368367d6b6834e7b841b41cd87884744 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:49.681171 16110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 368367d6b6834e7b841b41cd87884744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.680513 16179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 368367d6b6834e7b841b41cd87884744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.696242 16384 consensus_queue.cc:1048] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 13:04:49.702349 16236 consensus_peers.cc:597] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:49.706871 16316 tablet_bootstrap.cc:492] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:49.708971 16316 ts_tablet_manager.cc:1403] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.195s	user 0.012s	sys 0.012s
I20260709 13:04:49.726058 16326 raft_consensus.cc:493] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.736393 16326 raft_consensus.cc:515] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:49.738521 16326 leader_election.cc:290] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:49.726969 16181 tablet_service.cc:1511] Processing CreateTablet for tablet eae7099a7350453682514662a4773778 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:49.740477 16181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae7099a7350453682514662a4773778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.740828 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d59706e6f746aca969af7bf2206197" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:49.742157 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d59706e6f746aca969af7bf2206197" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
W20260709 13:04:49.742750 16089 leader_election.cc:343] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:49.744307 16335 consensus_queue.cc:1048] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:49.731019 16111 tablet_service.cc:1511] Processing CreateTablet for tablet eae7099a7350453682514662a4773778 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:49.745849 16111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae7099a7350453682514662a4773778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.747681 16035 tablet_service.cc:1511] Processing CreateTablet for tablet 2fc1bcba29c24ea9b5582464ad0ba47e (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:49.748219 16320 tablet_bootstrap.cc:492] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:49.748840 16320 ts_tablet_manager.cc:1403] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.181s	user 0.016s	sys 0.038s
W20260709 13:04:49.749495 16089 leader_election.cc:343] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:49.750031 16089 leader_election.cc:304] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:49.751358 16326 raft_consensus.cc:2749] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:49.752962 16035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fc1bcba29c24ea9b5582464ad0ba47e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.732501 16110 tablet_service.cc:1511] Processing CreateTablet for tablet ea7b2b72b2df44e89e8b76fa65501951 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:49.731011 16259 tablet_service.cc:1511] Processing CreateTablet for tablet ea7b2b72b2df44e89e8b76fa65501951 (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:49.761999 16259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea7b2b72b2df44e89e8b76fa65501951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.763052 16317 tablet_bootstrap.cc:654] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.765452 16320 raft_consensus.cc:359] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.765898 16316 raft_consensus.cc:359] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:49.766328 16320 raft_consensus.cc:385] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.766633 16316 raft_consensus.cc:385] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.766742 16320 raft_consensus.cc:740] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.767055 16316 raft_consensus.cc:740] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.767848 16320 consensus_queue.cc:260] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.769321 16319 tablet_bootstrap.cc:654] T 1be59fdebe7a44cc9f945fa9793ddfda P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.770934 16320 ts_tablet_manager.cc:1434] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260709 13:04:49.771312 16110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea7b2b72b2df44e89e8b76fa65501951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.772151 16320 tablet_bootstrap.cc:492] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:49.767848 16316 consensus_queue.cc:260] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:49.773231 16182 tablet_service.cc:1511] Processing CreateTablet for tablet 2fc1bcba29c24ea9b5582464ad0ba47e (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:49.779368 16182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fc1bcba29c24ea9b5582464ad0ba47e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:49.779961 16088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 102002us
I20260709 13:04:49.781390 16320 tablet_bootstrap.cc:654] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.782274 16254 tablet_service.cc:1511] Processing CreateTablet for tablet 2fc1bcba29c24ea9b5582464ad0ba47e (DEFAULT_TABLE table=test-workload [id=67ab93adaf24487bae0c3d36858b1b6b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:49.783557 16254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fc1bcba29c24ea9b5582464ad0ba47e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:49.791471 16316 ts_tablet_manager.cc:1434] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:04:49.793654 16316 tablet_bootstrap.cc:492] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:49.799199 16335 raft_consensus.cc:493] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.804298 16330 raft_consensus.cc:493] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.804373 16335 raft_consensus.cc:515] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.805336 16330 raft_consensus.cc:515] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.808153 16330 leader_election.cc:290] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:49.808997 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:49.809762 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:49.810477 16047 raft_consensus.cc:2468] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:49.811594 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
W20260709 13:04:49.812520 16014 leader_election.cc:343] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:49.808960 16335 leader_election.cc:290] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:49.811722 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
W20260709 13:04:49.813375 16163 leader_election.cc:343] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:49.824247 16198 raft_consensus.cc:2468] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 0.
I20260709 13:04:49.825551 16162 leader_election.cc:304] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4
I20260709 13:04:49.836587 16014 leader_election.cc:304] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4
I20260709 13:04:49.840430 16316 tablet_bootstrap.cc:654] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.840881 16322 consensus_queue.cc:1048] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:49.838419 16330 raft_consensus.cc:2804] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:49.845721 16330 raft_consensus.cc:493] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.846091 16330 raft_consensus.cc:3060] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.846640 16317 tablet_bootstrap.cc:492] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:49.847364 16317 ts_tablet_manager.cc:1403] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.187s	user 0.015s	sys 0.021s
I20260709 13:04:49.851475 16317 raft_consensus.cc:359] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.852411 16317 raft_consensus.cc:385] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.852725 16317 raft_consensus.cc:740] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.853874 16317 consensus_queue.cc:260] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.837942 16335 raft_consensus.cc:2804] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:49.862380 16319 tablet_bootstrap.cc:492] T 1be59fdebe7a44cc9f945fa9793ddfda P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:49.862985 16319 ts_tablet_manager.cc:1403] T 1be59fdebe7a44cc9f945fa9793ddfda P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.210s	user 0.016s	sys 0.025s
I20260709 13:04:49.857705 16335 raft_consensus.cc:493] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.864288 16317 ts_tablet_manager.cc:1434] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.003s
I20260709 13:04:49.872365 16316 tablet_bootstrap.cc:492] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:49.872004 16319 raft_consensus.cc:359] T 1be59fdebe7a44cc9f945fa9793ddfda P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.865800 16335 raft_consensus.cc:3060] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.872925 16319 raft_consensus.cc:385] T 1be59fdebe7a44cc9f945fa9793ddfda P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.873013 16316 ts_tablet_manager.cc:1403] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.001s
I20260709 13:04:49.873368 16319 raft_consensus.cc:740] T 1be59fdebe7a44cc9f945fa9793ddfda P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.874236 16319 consensus_queue.cc:260] T 1be59fdebe7a44cc9f945fa9793ddfda P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.877456 16317 tablet_bootstrap.cc:492] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:49.881402 16330 raft_consensus.cc:515] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
W20260709 13:04:49.893668 15994 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:49.889837 16317 tablet_bootstrap.cc:654] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.898281 16330 leader_election.cc:290] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:49.891772 16335 raft_consensus.cc:515] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.898507 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:49.899421 16123 raft_consensus.cc:3060] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.893070 16316 raft_consensus.cc:359] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:49.900862 16335 leader_election.cc:290] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:49.900763 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:49.900787 16316 raft_consensus.cc:385] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.902668 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:49.903944 16320 tablet_bootstrap.cc:492] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:49.904457 16320 ts_tablet_manager.cc:1403] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.133s	user 0.009s	sys 0.005s
I20260709 13:04:49.905228 16198 raft_consensus.cc:2393] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf in current term 1: Already voted for candidate e1e05442c5b44a079dd1de9dd124c990 in this term.
I20260709 13:04:49.906709 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:49.907517 16048 raft_consensus.cc:2393] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e1e05442c5b44a079dd1de9dd124c990 in current term 1: Already voted for candidate ec8b54f5a9e44f428a4d537391138dcf in this term.
I20260709 13:04:49.907331 16320 raft_consensus.cc:359] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:49.908046 16320 raft_consensus.cc:385] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.908356 16320 raft_consensus.cc:740] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.908720 16162 leader_election.cc:304] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:49.910036 16316 raft_consensus.cc:740] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.910959 16316 consensus_queue.cc:260] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:49.915966 16316 ts_tablet_manager.cc:1434] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:04:49.914544 16342 raft_consensus.cc:493] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.917050 16316 tablet_bootstrap.cc:492] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:49.917115 16320 consensus_queue.cc:260] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:49.917480 16342 raft_consensus.cc:515] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:49.919268 16320 ts_tablet_manager.cc:1434] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:04:49.921425 16123 raft_consensus.cc:2468] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:04:49.922940 16014 leader_election.cc:304] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:49.925218 16320 tablet_bootstrap.cc:492] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:49.925719 16330 raft_consensus.cc:2804] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:49.926283 16396 raft_consensus.cc:2749] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:49.933768 16342 leader_election.cc:290] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:49.939152 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc5c10cfdd24c64a4db9e4339808499" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
W20260709 13:04:49.941915 16237 leader_election.cc:343] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:49.937588 16330 raft_consensus.cc:697] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:04:49.946017 16330 consensus_queue.cc:237] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.938314 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc5c10cfdd24c64a4db9e4339808499" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:49.950471 16319 ts_tablet_manager.cc:1434] T 1be59fdebe7a44cc9f945fa9793ddfda P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.087s	user 0.014s	sys 0.008s
I20260709 13:04:49.953437 16319 tablet_bootstrap.cc:492] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:49.950889 16048 raft_consensus.cc:2468] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:49.955312 16317 tablet_bootstrap.cc:492] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:49.958503 16403 raft_consensus.cc:493] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.960873 16403 raft_consensus.cc:515] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.963028 16319 tablet_bootstrap.cc:654] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.963377 16403 leader_election.cc:290] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:49.964336 16317 ts_tablet_manager.cc:1403] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.087s	user 0.029s	sys 0.007s
I20260709 13:04:49.963984 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61baecc1a74998a356870a675301ea" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:49.965785 16316 tablet_bootstrap.cc:654] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.965610 16123 raft_consensus.cc:2468] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 0.
I20260709 13:04:49.967017 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61baecc1a74998a356870a675301ea" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:49.968912 16198 raft_consensus.cc:2468] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 0.
I20260709 13:04:49.968976 16014 leader_election.cc:304] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:49.970938 16403 raft_consensus.cc:2804] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:49.971328 16403 raft_consensus.cc:493] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.971698 16403 raft_consensus.cc:3060] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.972947 16320 tablet_bootstrap.cc:654] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:49.976116 16236 leader_election.cc:304] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:49.977272 16342 raft_consensus.cc:2804] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:49.977679 16342 raft_consensus.cc:493] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.978065 16342 raft_consensus.cc:3060] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.979313 16317 raft_consensus.cc:359] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.980120 16317 raft_consensus.cc:385] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:49.980425 16317 raft_consensus.cc:740] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:49.981194 16317 consensus_queue.cc:260] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.985160 16317 ts_tablet_manager.cc:1434] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:04:49.991209 16403 raft_consensus.cc:515] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:49.992043 16342 raft_consensus.cc:515] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:49.993127 16317 tablet_bootstrap.cc:492] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:49.994524 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61baecc1a74998a356870a675301ea" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:49.995157 16123 raft_consensus.cc:3060] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:49.996912 16319 tablet_bootstrap.cc:492] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:49.997541 16319 ts_tablet_manager.cc:1403] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.001s
I20260709 13:04:50.000988 16316 tablet_bootstrap.cc:492] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:50.001612 16316 ts_tablet_manager.cc:1403] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.085s	user 0.007s	sys 0.008s
I20260709 13:04:50.001235 16319 raft_consensus.cc:359] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.002079 16319 raft_consensus.cc:385] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.002372 16123 raft_consensus.cc:2468] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:04:50.002485 16319 raft_consensus.cc:740] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.003715 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61baecc1a74998a356870a675301ea" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:50.003554 16319 consensus_queue.cc:260] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.004329 16198 raft_consensus.cc:3060] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.008136 16320 tablet_bootstrap.cc:492] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:50.008729 16320 ts_tablet_manager.cc:1403] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.000s
I20260709 13:04:50.010799 16317 tablet_bootstrap.cc:654] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.011906 16320 raft_consensus.cc:359] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:50.012367 16014 leader_election.cc:304] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:49.993188 16403 leader_election.cc:290] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:50.013850 16330 raft_consensus.cc:2804] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:50.011930 16198 raft_consensus.cc:2468] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:04:50.013135 16316 raft_consensus.cc:359] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.014567 16316 raft_consensus.cc:385] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.014876 16316 raft_consensus.cc:740] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.015669 16316 consensus_queue.cc:260] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.016709 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc5c10cfdd24c64a4db9e4339808499" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:50.017891 16316 ts_tablet_manager.cc:1434] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
W20260709 13:04:50.018483 16237 leader_election.cc:343] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:50.019284 16316 tablet_bootstrap.cc:492] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:50.020520 15945 catalog_manager.cc:5697] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 0 to 1, leader changed from <none> to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 1 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:50.022782 16330 raft_consensus.cc:697] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:04:50.023706 16330 consensus_queue.cc:237] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.024132 16319 ts_tablet_manager.cc:1434] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:04:50.025692 16342 leader_election.cc:290] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:50.012849 16320 raft_consensus.cc:385] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.026530 16320 raft_consensus.cc:740] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.026955 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc5c10cfdd24c64a4db9e4339808499" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:50.027642 16048 raft_consensus.cc:3060] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.027320 16320 consensus_queue.cc:260] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:50.032473 16320 ts_tablet_manager.cc:1434] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:04:50.033640 16320 tablet_bootstrap.cc:492] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:50.033813 16316 tablet_bootstrap.cc:654] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.035993 16048 raft_consensus.cc:2468] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:50.037446 16236 leader_election.cc:304] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:50.038813 16342 raft_consensus.cc:2804] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:50.039547 16342 raft_consensus.cc:697] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:50.040804 16320 tablet_bootstrap.cc:654] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.040431 16342 consensus_queue.cc:237] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:50.041155 16319 tablet_bootstrap.cc:492] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:50.049469 16319 tablet_bootstrap.cc:654] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.055305 16316 tablet_bootstrap.cc:492] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:50.055917 16316 ts_tablet_manager.cc:1403] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.004s
I20260709 13:04:50.058480 16316 raft_consensus.cc:359] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:50.058887 16319 tablet_bootstrap.cc:492] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:50.059012 16316 raft_consensus.cc:385] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.059473 16316 raft_consensus.cc:740] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.059584 16319 ts_tablet_manager.cc:1403] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.000s
I20260709 13:04:50.060169 16316 consensus_queue.cc:260] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:50.062723 16316 ts_tablet_manager.cc:1434] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:50.063680 16316 tablet_bootstrap.cc:492] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:50.063985 16319 raft_consensus.cc:359] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.064095 15945 catalog_manager.cc:5697] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 0 to 1, leader changed from <none> to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 1 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:50.065335 16319 raft_consensus.cc:385] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.065836 16319 raft_consensus.cc:740] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.069047 16320 tablet_bootstrap.cc:492] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:50.069516 16317 tablet_bootstrap.cc:492] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:50.069633 16320 ts_tablet_manager.cc:1403] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.000s
I20260709 13:04:50.070065 16317 ts_tablet_manager.cc:1403] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.077s	user 0.020s	sys 0.000s
I20260709 13:04:50.073040 16320 raft_consensus.cc:359] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:50.073452 16317 raft_consensus.cc:359] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.073940 16320 raft_consensus.cc:385] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.074172 16317 raft_consensus.cc:385] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.074275 16320 raft_consensus.cc:740] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.074561 16317 raft_consensus.cc:740] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.067127 16319 consensus_queue.cc:260] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.075349 16317 consensus_queue.cc:260] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.076629 16316 tablet_bootstrap.cc:654] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.076166 16320 consensus_queue.cc:260] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:50.078560 16319 ts_tablet_manager.cc:1434] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:04:50.079933 16319 tablet_bootstrap.cc:492] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:50.081475 16320 ts_tablet_manager.cc:1434] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:04:50.081660 16317 ts_tablet_manager.cc:1434] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:04:50.082456 16320 tablet_bootstrap.cc:492] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:50.082739 16317 tablet_bootstrap.cc:492] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:50.084852 16387 raft_consensus.cc:493] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.085430 16387 raft_consensus.cc:515] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.086164 16319 tablet_bootstrap.cc:654] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.087937 16387 leader_election.cc:290] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:50.089416 16320 tablet_bootstrap.cc:654] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.089582 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c9099428b34e0f9bec85f2159b656e" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:50.090867 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c9099428b34e0f9bec85f2159b656e" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:50.091521 16198 raft_consensus.cc:2468] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:50.094340 16316 tablet_bootstrap.cc:492] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:50.094852 16316 ts_tablet_manager.cc:1403] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.000s
W20260709 13:04:50.097455 16237 leader_election.cc:343] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:50.098088 16316 raft_consensus.cc:359] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:50.099061 16316 raft_consensus.cc:385] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.099354 16316 raft_consensus.cc:740] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.099270 16237 leader_election.cc:304] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4
I20260709 13:04:50.100715 16342 raft_consensus.cc:2804] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:50.100392 16316 consensus_queue.cc:260] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:50.101166 16342 raft_consensus.cc:493] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.101564 16342 raft_consensus.cc:3060] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.102833 16316 ts_tablet_manager.cc:1434] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:50.103936 16316 tablet_bootstrap.cc:492] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:50.114140 16316 tablet_bootstrap.cc:654] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.113900 16342 raft_consensus.cc:515] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.116469 16342 leader_election.cc:290] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:50.117063 16317 tablet_bootstrap.cc:654] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.117341 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c9099428b34e0f9bec85f2159b656e" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:50.119951 16320 tablet_bootstrap.cc:492] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:50.119786 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c9099428b34e0f9bec85f2159b656e" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:50.120455 16320 ts_tablet_manager.cc:1403] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.006s
I20260709 13:04:50.120594 16198 raft_consensus.cc:3060] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.123128 16319 tablet_bootstrap.cc:492] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:50.123881 16319 ts_tablet_manager.cc:1403] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.005s
I20260709 13:04:50.123759 16320 raft_consensus.cc:359] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:50.124553 16320 raft_consensus.cc:385] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.124856 16320 raft_consensus.cc:740] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.125758 16320 consensus_queue.cc:260] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:50.127942 16401 raft_consensus.cc:493] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.128100 16320 ts_tablet_manager.cc:1434] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:50.129110 16320 tablet_bootstrap.cc:492] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:50.128476 16401 raft_consensus.cc:515] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.128430 16319 raft_consensus.cc:359] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.129706 16319 raft_consensus.cc:385] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.130089 16319 raft_consensus.cc:740] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.131374 16319 consensus_queue.cc:260] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.134753 16319 ts_tablet_manager.cc:1434] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:04:50.136723 16320 tablet_bootstrap.cc:654] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.137428 16319 tablet_bootstrap.cc:492] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:50.143880 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d59706e6f746aca969af7bf2206197" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:50.144625 16123 raft_consensus.cc:2468] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:50.144596 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d59706e6f746aca969af7bf2206197" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:50.145480 16272 raft_consensus.cc:2468] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:50.146078 16163 leader_election.cc:304] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:50.136868 16401 leader_election.cc:290] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:50.146927 16401 raft_consensus.cc:2804] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:50.147256 16401 raft_consensus.cc:493] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.147678 16316 tablet_bootstrap.cc:492] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:50.147593 16401 raft_consensus.cc:3060] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.148329 16316 ts_tablet_manager.cc:1403] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.014s
I20260709 13:04:50.151932 16319 tablet_bootstrap.cc:654] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.151670 16316 raft_consensus.cc:359] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.152451 16316 raft_consensus.cc:385] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.152590 16320 tablet_bootstrap.cc:492] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:50.152819 16316 raft_consensus.cc:740] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.153224 16320 ts_tablet_manager.cc:1403] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.006s
I20260709 13:04:50.154049 16316 consensus_queue.cc:260] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
W20260709 13:04:50.154464 16237 leader_election.cc:343] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:50.156447 16316 ts_tablet_manager.cc:1434] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:04:50.156876 16320 raft_consensus.cc:359] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.157639 16320 raft_consensus.cc:385] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.157881 16316 tablet_bootstrap.cc:492] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:50.157918 16320 raft_consensus.cc:740] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.159180 16320 consensus_queue.cc:260] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.161592 16320 ts_tablet_manager.cc:1434] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:50.162539 16320 tablet_bootstrap.cc:492] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:50.164479 16387 raft_consensus.cc:493] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.165005 16387 raft_consensus.cc:515] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:50.165985 16319 tablet_bootstrap.cc:492] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:50.167403 16387 leader_election.cc:290] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:50.168561 16320 tablet_bootstrap.cc:654] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.168874 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ffb334ab54abb8bdb4893844c3b6b" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:50.169700 16048 raft_consensus.cc:2468] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:50.169613 15944 catalog_manager.cc:5697] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 1 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:50.171396 16236 leader_election.cc:304] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:50.172528 16387 raft_consensus.cc:2804] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:50.172945 16387 raft_consensus.cc:493] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.173329 16387 raft_consensus.cc:3060] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.174451 16316 tablet_bootstrap.cc:654] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.166709 16319 ts_tablet_manager.cc:1403] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.001s
I20260709 13:04:50.177722 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ffb334ab54abb8bdb4893844c3b6b" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:50.178697 16123 raft_consensus.cc:2468] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:50.182492 16319 raft_consensus.cc:359] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:50.184758 16330 raft_consensus.cc:493] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.191296 16330 raft_consensus.cc:515] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:50.194139 16330 leader_election.cc:290] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:50.194880 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154f438524734d2599d72ae02e2230e6" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:50.195537 16319 raft_consensus.cc:385] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.194906 16316 tablet_bootstrap.cc:492] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:50.196758 16316 ts_tablet_manager.cc:1403] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.004s
W20260709 13:04:50.197073 16014 leader_election.cc:343] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:50.190011 16387 raft_consensus.cc:515] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:50.196081 16319 raft_consensus.cc:740] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.199674 16387 leader_election.cc:290] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:50.200667 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ffb334ab54abb8bdb4893844c3b6b" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:50.200948 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ffb334ab54abb8bdb4893844c3b6b" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:50.201797 16048 raft_consensus.cc:3060] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.202804 16316 raft_consensus.cc:359] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:50.203565 16316 raft_consensus.cc:385] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.203847 16316 raft_consensus.cc:740] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.197554 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154f438524734d2599d72ae02e2230e6" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:50.201318 16123 raft_consensus.cc:3060] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.205713 16272 raft_consensus.cc:2468] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 0.
I20260709 13:04:50.207301 16014 leader_election.cc:304] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:50.208464 16330 raft_consensus.cc:2804] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:50.208843 16330 raft_consensus.cc:493] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.209203 16330 raft_consensus.cc:3060] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.198673 16319 consensus_queue.cc:260] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:50.215167 16319 ts_tablet_manager.cc:1434] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:04:50.215314 16330 raft_consensus.cc:515] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:50.216614 16319 tablet_bootstrap.cc:492] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:50.217351 16391 raft_consensus.cc:493] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.218361 16396 raft_consensus.cc:493] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.218060 16391 raft_consensus.cc:515] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.218961 16396 raft_consensus.cc:515] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.218137 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154f438524734d2599d72ae02e2230e6" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:50.220911 16396 leader_election.cc:290] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:50.221935 16391 leader_election.cc:290] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:50.187875 16198 raft_consensus.cc:2468] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:50.222741 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6c90e7e1974ef0ade824c72386b5f3" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:50.212628 16123 raft_consensus.cc:2468] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:50.223426 16049 raft_consensus.cc:2468] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:50.224422 16237 leader_election.cc:304] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:04:50.224433 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6c90e7e1974ef0ade824c72386b5f3" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:50.226083 16124 raft_consensus.cc:2468] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:50.228400 16162 leader_election.cc:304] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:50.230077 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6c90e7e1974ef0ade824c72386b5f3" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:50.230695 16049 raft_consensus.cc:2468] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:50.231971 16088 leader_election.cc:304] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
W20260709 13:04:50.233074 16014 leader_election.cc:343] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:50.233886 16396 raft_consensus.cc:2804] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:50.236196 16396 raft_consensus.cc:493] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.237396 16396 raft_consensus.cc:3060] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.239676 16319 tablet_bootstrap.cc:654] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.236907 16391 raft_consensus.cc:2804] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:50.239823 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154f438524734d2599d72ae02e2230e6" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:50.240401 16391 raft_consensus.cc:493] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.241058 16391 raft_consensus.cc:3060] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.235090 16048 raft_consensus.cc:2468] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:50.242621 16401 raft_consensus.cc:515] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.243643 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6c90e7e1974ef0ade824c72386b5f3" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:50.240607 16272 raft_consensus.cc:3060] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.225466 16237 leader_election.cc:304] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4
I20260709 13:04:50.245222 16330 leader_election.cc:290] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:50.245554 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d59706e6f746aca969af7bf2206197" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:50.235807 16320 tablet_bootstrap.cc:492] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:50.236071 16316 consensus_queue.cc:260] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:50.250329 16320 ts_tablet_manager.cc:1403] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.009s
I20260709 13:04:50.250725 16342 raft_consensus.cc:493] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.251318 16342 raft_consensus.cc:515] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:50.254196 16320 raft_consensus.cc:359] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:50.255187 16320 raft_consensus.cc:385] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.255544 16320 raft_consensus.cc:740] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.256409 16320 consensus_queue.cc:260] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:50.248201 16317 tablet_bootstrap.cc:492] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:50.257444 16272 raft_consensus.cc:2468] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:04:50.257793 16317 ts_tablet_manager.cc:1403] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.175s	user 0.035s	sys 0.054s
I20260709 13:04:50.259075 16014 leader_election.cc:304] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:50.260339 16405 raft_consensus.cc:2804] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:50.248145 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d59706e6f746aca969af7bf2206197" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:50.260897 16405 raft_consensus.cc:697] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:04:50.256985 16342 leader_election.cc:290] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:50.261420 16271 raft_consensus.cc:3060] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.250172 16124 raft_consensus.cc:3060] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.262054 16405 consensus_queue.cc:237] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:50.263899 16391 raft_consensus.cc:515] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.265993 16391 leader_election.cc:290] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:50.259101 16320 ts_tablet_manager.cc:1434] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:50.267534 16320 tablet_bootstrap.cc:492] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:50.260772 16317 raft_consensus.cc:359] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:50.269577 16317 raft_consensus.cc:385] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.269923 16317 raft_consensus.cc:740] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.269861 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6c90e7e1974ef0ade824c72386b5f3" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:50.247613 16401 leader_election.cc:290] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:50.271072 16317 consensus_queue.cc:260] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:50.273043 16317 ts_tablet_manager.cc:1434] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.005s
I20260709 13:04:50.241279 16387 raft_consensus.cc:2804] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:50.273393 16320 tablet_bootstrap.cc:654] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.273990 16317 tablet_bootstrap.cc:492] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:50.273937 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6c90e7e1974ef0ade824c72386b5f3" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:50.274789 16047 raft_consensus.cc:3060] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.269040 16271 raft_consensus.cc:2468] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:50.279145 16163 leader_election.cc:304] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:50.280368 16391 raft_consensus.cc:493] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.281394 16401 raft_consensus.cc:2804] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:50.281105 16391 raft_consensus.cc:515] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.282759 16401 raft_consensus.cc:697] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:50.283973 16391 leader_election.cc:290] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:50.283722 16401 consensus_queue.cc:237] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.285895 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be59fdebe7a44cc9f945fa9793ddfda" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:50.286671 16197 raft_consensus.cc:2468] T 1be59fdebe7a44cc9f945fa9793ddfda P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:50.289054 16089 leader_election.cc:304] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:50.290043 16317 tablet_bootstrap.cc:654] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.296451 16319 tablet_bootstrap.cc:492] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:50.297070 16319 ts_tablet_manager.cc:1403] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.009s
I20260709 13:04:50.300235 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be59fdebe7a44cc9f945fa9793ddfda" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:50.300451 16319 raft_consensus.cc:359] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:50.301218 16049 raft_consensus.cc:2468] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:50.301514 16319 raft_consensus.cc:385] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.301995 16319 raft_consensus.cc:740] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.301712 16396 raft_consensus.cc:515] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.303855 16198 raft_consensus.cc:2393] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 in current term 1: Already voted for candidate e1e05442c5b44a079dd1de9dd124c990 in this term.
I20260709 13:04:50.303215 16319 consensus_queue.cc:260] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:50.306581 16319 ts_tablet_manager.cc:1434] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:50.307471 16047 raft_consensus.cc:2468] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:50.309325 16340 raft_consensus.cc:2804] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:50.307847 16319 tablet_bootstrap.cc:492] T fc581e6f2f6741bc9a63c49459198306 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:50.308539 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dfecacf6d204abc99b0b341ab7256b1" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:50.310753 16317 tablet_bootstrap.cc:492] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:50.311252 16317 ts_tablet_manager.cc:1403] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.000s
I20260709 13:04:50.311430 16316 ts_tablet_manager.cc:1434] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.114s	user 0.007s	sys 0.000s
I20260709 13:04:50.317539 16316 tablet_bootstrap.cc:492] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:50.326584 16396 leader_election.cc:290] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:50.326830 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6c90e7e1974ef0ade824c72386b5f3" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:50.324499 16048 raft_consensus.cc:2468] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:50.327651 16123 raft_consensus.cc:2393] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e1e05442c5b44a079dd1de9dd124c990 in current term 1: Already voted for candidate 36b15691c8e648a18b69e98bee3349b4 in this term.
I20260709 13:04:50.334018 16088 leader_election.cc:304] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:50.336030 16382 raft_consensus.cc:2804] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:50.336784 16382 raft_consensus.cc:697] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:04:50.338004 16382 consensus_queue.cc:237] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.316545 16391 raft_consensus.cc:2804] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:50.349112 16342 raft_consensus.cc:493] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.349867 16342 raft_consensus.cc:515] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.350639 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6c90e7e1974ef0ade824c72386b5f3" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:50.351945 16049 raft_consensus.cc:2393] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e1e05442c5b44a079dd1de9dd124c990 in current term 1: Already voted for candidate 36b15691c8e648a18b69e98bee3349b4 in this term.
I20260709 13:04:50.353713 16162 leader_election.cc:304] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:50.320947 16340 raft_consensus.cc:697] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
W20260709 13:04:50.322978 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 96453.4us
I20260709 13:04:50.352741 16342 leader_election.cc:290] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:50.362128 16316 tablet_bootstrap.cc:654] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.364180 16340 consensus_queue.cc:237] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.364910 16396 raft_consensus.cc:2749] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:50.363013 16317 raft_consensus.cc:359] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.347779 16391 raft_consensus.cc:493] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.368710 16317 raft_consensus.cc:385] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.369177 16317 raft_consensus.cc:740] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.381511 16317 consensus_queue.cc:260] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.371992 16391 raft_consensus.cc:3060] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.381505 16319 tablet_bootstrap.cc:654] T fc581e6f2f6741bc9a63c49459198306 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.372583 16124 raft_consensus.cc:2468] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:50.386035 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dfecacf6d204abc99b0b341ab7256b1" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:50.393167 16236 leader_election.cc:304] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:50.394402 16322 raft_consensus.cc:2804] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:50.394801 16322 raft_consensus.cc:493] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.395139 16322 raft_consensus.cc:3060] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.395779 16391 raft_consensus.cc:515] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.399111 16317 ts_tablet_manager.cc:1434] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.088s	user 0.009s	sys 0.000s
I20260709 13:04:50.400019 16317 tablet_bootstrap.cc:492] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:50.384122 16387 raft_consensus.cc:697] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:50.401347 15944 catalog_manager.cc:5697] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 0 to 1, leader changed from <none> to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 1 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:50.402271 16387 consensus_queue.cc:237] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:50.413625 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc581e6f2f6741bc9a63c49459198306" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:50.413982 15943 catalog_manager.cc:5697] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:50.416193 16317 tablet_bootstrap.cc:654] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.419003 16382 raft_consensus.cc:493] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.419525 16382 raft_consensus.cc:515] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:50.425487 16322 raft_consensus.cc:515] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:50.430773 16320 tablet_bootstrap.cc:492] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:50.421689 16048 raft_consensus.cc:3060] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.442047 16320 ts_tablet_manager.cc:1403] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.175s	user 0.068s	sys 0.051s
I20260709 13:04:50.447026 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be59fdebe7a44cc9f945fa9793ddfda" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:50.447759 16049 raft_consensus.cc:3060] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.449188 16382 leader_election.cc:290] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
W20260709 13:04:50.429025 16237 leader_election.cc:343] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:50.450824 16237 leader_election.cc:343] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:50.430461 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc581e6f2f6741bc9a63c49459198306" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:50.434615 16405 consensus_queue.cc:1048] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:04:50.458716 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09412044d26f417da5c842c8acf1149d" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:50.459533 16047 raft_consensus.cc:2468] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:50.458711 15946 catalog_manager.cc:5697] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:50.464363 16396 raft_consensus.cc:493] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.454818 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09412044d26f417da5c842c8acf1149d" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:50.464911 16396 raft_consensus.cc:515] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:50.466454 16322 leader_election.cc:290] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:50.468514 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be59fdebe7a44cc9f945fa9793ddfda" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:50.469115 16197 raft_consensus.cc:3060] T 1be59fdebe7a44cc9f945fa9793ddfda P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.469674 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dfecacf6d204abc99b0b341ab7256b1" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:50.470276 16047 raft_consensus.cc:3060] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.471092 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154f438524734d2599d72ae02e2230e6" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:50.474268 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154f438524734d2599d72ae02e2230e6" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:50.468714 16396 leader_election.cc:290] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:50.475078 16272 raft_consensus.cc:2393] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1e05442c5b44a079dd1de9dd124c990 in current term 1: Already voted for candidate ec8b54f5a9e44f428a4d537391138dcf in this term.
I20260709 13:04:50.466694 16271 raft_consensus.cc:2468] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:50.477994 16089 leader_election.cc:304] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:04:50.478382 16163 leader_election.cc:304] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:50.479040 16382 raft_consensus.cc:2804] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:50.479502 16382 raft_consensus.cc:493] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.479831 16382 raft_consensus.cc:3060] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.481798 16396 raft_consensus.cc:3060] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.485687 16317 tablet_bootstrap.cc:492] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:50.486243 16317 ts_tablet_manager.cc:1403] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.086s	user 0.008s	sys 0.024s
I20260709 13:04:50.489050 16317 raft_consensus.cc:359] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.489181 16322 consensus_queue.cc:1048] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:50.489785 16317 raft_consensus.cc:385] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.491084 16317 raft_consensus.cc:740] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.491757 16317 consensus_queue.cc:260] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.456117 16391 leader_election.cc:290] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
W20260709 13:04:50.492187 16237 leader_election.cc:343] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:50.492960 16237 leader_election.cc:304] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:50.493791 16387 raft_consensus.cc:2749] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:50.496227 16196 raft_consensus.cc:3060] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.497366 16317 ts_tablet_manager.cc:1434] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:04:50.498369 16317 tablet_bootstrap.cc:492] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:50.495180 16320 raft_consensus.cc:359] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:50.499370 16320 raft_consensus.cc:385] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.499626 16320 raft_consensus.cc:740] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.500340 16320 consensus_queue.cc:260] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:50.504199 16047 raft_consensus.cc:2468] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:50.510476 16197 raft_consensus.cc:2468] T 1be59fdebe7a44cc9f945fa9793ddfda P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:50.511798 16089 leader_election.cc:304] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:50.514008 16391 raft_consensus.cc:2804] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:50.514729 16391 raft_consensus.cc:697] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:04:50.515597 16391 consensus_queue.cc:237] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.516232 16049 raft_consensus.cc:2468] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:50.519351 16236 leader_election.cc:304] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:50.520991 16316 tablet_bootstrap.cc:492] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:50.521559 16316 ts_tablet_manager.cc:1403] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.209s	user 0.007s	sys 0.025s
I20260709 13:04:50.523108 16320 ts_tablet_manager.cc:1434] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.081s	user 0.005s	sys 0.001s
I20260709 13:04:50.524123 16320 tablet_bootstrap.cc:492] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:50.506731 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dfecacf6d204abc99b0b341ab7256b1" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:50.521513 16387 raft_consensus.cc:2804] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:50.530661 16396 raft_consensus.cc:2749] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:50.531527 16387 raft_consensus.cc:697] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:50.532805 16387 consensus_queue.cc:237] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
W20260709 13:04:50.538559 16237 leader_election.cc:343] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:50.538843 16431 consensus_queue.cc:1048] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:50.540335 16382 raft_consensus.cc:515] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:50.543732 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09412044d26f417da5c842c8acf1149d" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:50.545287 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09412044d26f417da5c842c8acf1149d" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:50.546123 16271 raft_consensus.cc:3060] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.551255 16330 consensus_queue.cc:1048] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:50.552573 16272 raft_consensus.cc:3060] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.545300 16047 raft_consensus.cc:3060] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.554180 16382 leader_election.cc:290] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:50.570822 16316 raft_consensus.cc:359] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:50.571856 16316 raft_consensus.cc:385] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.572192 16316 raft_consensus.cc:740] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.576309 16316 consensus_queue.cc:260] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:50.579393 16320 tablet_bootstrap.cc:654] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.578290 16322 raft_consensus.cc:493] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.584050 16322 raft_consensus.cc:515] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:50.587289 16317 tablet_bootstrap.cc:654] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.587957 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b6fe9ceac45fb8a980a2feb9cc063" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:50.588701 16049 raft_consensus.cc:2468] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:50.586467 16322 leader_election.cc:290] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:50.589542 16271 raft_consensus.cc:2468] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:50.588892 16047 raft_consensus.cc:2468] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:50.590791 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b6fe9ceac45fb8a980a2feb9cc063" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:50.590907 16089 leader_election.cc:304] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:04:50.591876 16382 raft_consensus.cc:2804] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:50.592355 16382 raft_consensus.cc:697] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:04:50.596617 16316 ts_tablet_manager.cc:1434] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.075s	user 0.009s	sys 0.000s
I20260709 13:04:50.599478 16316 tablet_bootstrap.cc:492] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:50.593175 16382 consensus_queue.cc:237] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
W20260709 13:04:50.599169 16237 leader_election.cc:343] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:50.607844 16236 leader_election.cc:304] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4
I20260709 13:04:50.619803 16316 tablet_bootstrap.cc:654] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.600683 16384 raft_consensus.cc:493] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.621850 16319 tablet_bootstrap.cc:492] T fc581e6f2f6741bc9a63c49459198306 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:50.632189 16319 ts_tablet_manager.cc:1403] T fc581e6f2f6741bc9a63c49459198306 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.325s	user 0.021s	sys 0.006s
I20260709 13:04:50.616962 16387 raft_consensus.cc:2804] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:50.628360 16403 consensus_queue.cc:1048] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:50.622242 15946 catalog_manager.cc:5697] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:50.661473 16319 raft_consensus.cc:359] T fc581e6f2f6741bc9a63c49459198306 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.663640 16319 raft_consensus.cc:385] T fc581e6f2f6741bc9a63c49459198306 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.663968 16319 raft_consensus.cc:740] T fc581e6f2f6741bc9a63c49459198306 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.634115 16387 raft_consensus.cc:493] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.634246 16384 raft_consensus.cc:515] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.666128 16387 raft_consensus.cc:3060] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.655282 16405 consensus_queue.cc:1048] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:04:50.674110 16319 consensus_queue.cc:260] T fc581e6f2f6741bc9a63c49459198306 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.681475 16319 ts_tablet_manager.cc:1434] T fc581e6f2f6741bc9a63c49459198306 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.049s	user 0.010s	sys 0.000s
I20260709 13:04:50.682614 16320 tablet_bootstrap.cc:492] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:50.683355 16320 ts_tablet_manager.cc:1403] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.159s	user 0.015s	sys 0.026s
I20260709 13:04:50.686712 16320 raft_consensus.cc:359] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.690598 16320 raft_consensus.cc:385] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.690950 16320 raft_consensus.cc:740] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.692404 16317 tablet_bootstrap.cc:492] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:50.692878 16317 ts_tablet_manager.cc:1403] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.195s	user 0.019s	sys 0.004s
I20260709 13:04:50.695034 16320 consensus_queue.cc:260] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.697796 16320 ts_tablet_manager.cc:1434] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.002s
I20260709 13:04:50.699047 16320 tablet_bootstrap.cc:492] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:50.706596 16319 tablet_bootstrap.cc:492] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:50.714011 16384 leader_election.cc:290] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:50.715819 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c9099428b34e0f9bec85f2159b656e" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:50.727092 16319 tablet_bootstrap.cc:654] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.717193 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c9099428b34e0f9bec85f2159b656e" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:50.730732 16197 raft_consensus.cc:2393] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 in current term 1: Already voted for candidate d2e22ad700e94d1095c014708c364bb7 in this term.
I20260709 13:04:50.732357 16089 leader_election.cc:304] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:50.737357 16384 raft_consensus.cc:3060] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.747593 15943 catalog_manager.cc:5697] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 1 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:50.749497 15943 catalog_manager.cc:5697] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 1 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:50.751266 15943 catalog_manager.cc:5697] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 1 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:50.756891 16317 raft_consensus.cc:359] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.758075 16317 raft_consensus.cc:385] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.758460 16317 raft_consensus.cc:740] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.760543 16317 consensus_queue.cc:260] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
W20260709 13:04:50.759685 16448 log.cc:927] Time spent T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:04:50.773927 16387 raft_consensus.cc:515] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:50.777572 16316 tablet_bootstrap.cc:492] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:50.778141 16316 ts_tablet_manager.cc:1403] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.180s	user 0.016s	sys 0.015s
I20260709 13:04:50.780833 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b6fe9ceac45fb8a980a2feb9cc063" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:50.782104 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b6fe9ceac45fb8a980a2feb9cc063" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:50.782984 16320 tablet_bootstrap.cc:654] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.783160 16048 raft_consensus.cc:3060] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:50.783687 16237 leader_election.cc:343] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:50.788434 16342 consensus_queue.cc:1048] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:50.800899 16431 raft_consensus.cc:493] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
I20260709 13:04:50.801590 16431 raft_consensus.cc:515] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:50.782330 16317 ts_tablet_manager.cc:1434] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.000s
I20260709 13:04:50.811609 16384 raft_consensus.cc:2749] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:50.814728 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:50.815333 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:50.813203 16431 leader_election.cc:290] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:50.820080 16387 leader_election.cc:290] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:50.820735 16237 leader_election.cc:304] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:50.821614 16317 tablet_bootstrap.cc:492] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:50.823041 16431 raft_consensus.cc:2749] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:50.823302 16320 tablet_bootstrap.cc:492] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:50.823784 16320 ts_tablet_manager.cc:1403] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.012s
I20260709 13:04:50.823725 16431 consensus_queue.cc:1048] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:50.826586 16320 raft_consensus.cc:359] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.831797 16396 consensus_queue.cc:1048] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:50.807428 16048 raft_consensus.cc:2468] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:50.827248 16320 raft_consensus.cc:385] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.842593 16320 raft_consensus.cc:740] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.843544 16320 consensus_queue.cc:260] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.846163 16319 tablet_bootstrap.cc:492] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:50.846731 16319 ts_tablet_manager.cc:1403] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.140s	user 0.012s	sys 0.014s
I20260709 13:04:50.848578 16317 tablet_bootstrap.cc:654] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.849344 16384 consensus_queue.cc:1048] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:50.849798 16319 raft_consensus.cc:359] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.850487 16319 raft_consensus.cc:385] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.850741 15946 catalog_manager.cc:5697] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:50.854105 16404 consensus_queue.cc:1048] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:50.854207 16396 consensus_queue.cc:1048] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:04:50.860124 16316 raft_consensus.cc:359] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.860942 16316 raft_consensus.cc:385] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.861275 16316 raft_consensus.cc:740] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.861928 16316 consensus_queue.cc:260] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.864013 16316 ts_tablet_manager.cc:1434] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.000s
I20260709 13:04:50.850754 16319 raft_consensus.cc:740] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.865067 16316 tablet_bootstrap.cc:492] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:50.871148 16319 consensus_queue.cc:260] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.873921 16319 ts_tablet_manager.cc:1434] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.002s
I20260709 13:04:50.879208 16320 ts_tablet_manager.cc:1434] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.002s
I20260709 13:04:50.883270 16391 consensus_queue.cc:1048] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:50.883523 16236 leader_election.cc:304] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4
I20260709 13:04:50.885520 16342 raft_consensus.cc:2804] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:50.886313 16342 raft_consensus.cc:697] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:50.895174 16319 tablet_bootstrap.cc:492] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:50.899542 16320 tablet_bootstrap.cc:492] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:50.865413 16384 raft_consensus.cc:493] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.910851 16384 raft_consensus.cc:515] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.887666 16342 consensus_queue.cc:237] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:50.912982 16384 leader_election.cc:290] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:50.927516 16387 consensus_queue.cc:1048] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:04:50.930179 16403 consensus_queue.cc:1048] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:50.938645 16320 tablet_bootstrap.cc:654] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.958637 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc581e6f2f6741bc9a63c49459198306" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:50.959520 16197 raft_consensus.cc:2468] T fc581e6f2f6741bc9a63c49459198306 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:50.949488 16404 raft_consensus.cc:493] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.953306 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc581e6f2f6741bc9a63c49459198306" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:50.961800 16272 raft_consensus.cc:2468] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:50.966645 16089 leader_election.cc:304] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:04:50.967549 16384 raft_consensus.cc:2804] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:50.967720 16431 consensus_queue.cc:1048] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:50.968021 16384 raft_consensus.cc:493] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.968555 16384 raft_consensus.cc:3060] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.972839 16317 tablet_bootstrap.cc:492] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:50.973476 16317 ts_tablet_manager.cc:1403] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.152s	user 0.054s	sys 0.038s
I20260709 13:04:50.976446 16317 raft_consensus.cc:359] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.977224 16317 raft_consensus.cc:385] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.960770 16404 raft_consensus.cc:515] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:50.977499 16317 raft_consensus.cc:740] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.977782 16319 tablet_bootstrap.cc:654] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.986625 16404 leader_election.cc:290] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:50.991948 16316 tablet_bootstrap.cc:654] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.984331 16317 consensus_queue.cc:260] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:50.991446 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105468bfb6dc48c28c16d3449c691f6b" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
W20260709 13:04:50.998178 15994 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:50.982156 16431 raft_consensus.cc:493] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.999231 16384 raft_consensus.cc:515] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:51.002538 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105468bfb6dc48c28c16d3449c691f6b" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:51.003336 16384 leader_election.cc:290] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:51.005375 16404 raft_consensus.cc:493] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.006152 16404 raft_consensus.cc:515] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:51.008356 16404 leader_election.cc:290] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
W20260709 13:04:51.005461 16014 leader_election.cc:343] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:51.009363 16014 leader_election.cc:343] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:51.009790 16014 leader_election.cc:304] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:51.000852 16431 raft_consensus.cc:515] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:51.011871 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ba50f699994c75b3a8cc2ea2ba8cc9" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:51.012665 16122 raft_consensus.cc:2468] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 0.
I20260709 13:04:51.013643 16431 leader_election.cc:290] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:51.014155 16404 raft_consensus.cc:2749] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:51.015491 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c283cfd76b4e9aacd796f6ead6e4b8" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:51.017244 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c283cfd76b4e9aacd796f6ead6e4b8" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:51.017741 16122 raft_consensus.cc:2468] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:51.016860 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc581e6f2f6741bc9a63c49459198306" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:51.019012 16271 raft_consensus.cc:3060] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.014856 16014 leader_election.cc:304] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:51.027019 16391 consensus_queue.cc:1048] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:51.030094 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc581e6f2f6741bc9a63c49459198306" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:51.030783 16196 raft_consensus.cc:3060] T fc581e6f2f6741bc9a63c49459198306 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.034897 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ba50f699994c75b3a8cc2ea2ba8cc9" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:51.035640 16198 raft_consensus.cc:2468] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 0.
I20260709 13:04:51.034965 16404 raft_consensus.cc:2804] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:51.038522 16404 raft_consensus.cc:493] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.038849 16404 raft_consensus.cc:3060] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.044952 16237 leader_election.cc:304] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
W20260709 13:04:51.046025 16237 leader_election.cc:343] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:51.056413 16317 ts_tablet_manager.cc:1434] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.083s	user 0.008s	sys 0.000s
I20260709 13:04:51.057829 16317 tablet_bootstrap.cc:492] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:51.053890 16431 raft_consensus.cc:2804] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:51.061730 16431 raft_consensus.cc:493] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.062076 16431 raft_consensus.cc:3060] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.071815 16404 raft_consensus.cc:515] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:51.075678 16404 leader_election.cc:290] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:51.079452 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ba50f699994c75b3a8cc2ea2ba8cc9" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:51.080120 16198 raft_consensus.cc:3060] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.080888 16196 raft_consensus.cc:2468] T fc581e6f2f6741bc9a63c49459198306 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:51.082819 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ba50f699994c75b3a8cc2ea2ba8cc9" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:51.091862 16121 raft_consensus.cc:3060] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.085757 16340 consensus_queue.cc:1048] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:51.090751 16271 raft_consensus.cc:2468] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:51.091334 16316 tablet_bootstrap.cc:492] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:51.084415 16384 consensus_queue.cc:1048] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:51.098748 16316 ts_tablet_manager.cc:1403] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.234s	user 0.035s	sys 0.006s
I20260709 13:04:51.107197 16089 leader_election.cc:304] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:04:51.108240 16384 raft_consensus.cc:2804] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:51.108790 16384 raft_consensus.cc:697] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:04:51.109923 16384 consensus_queue.cc:237] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:51.116078 16320 tablet_bootstrap.cc:492] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:51.116824 16320 ts_tablet_manager.cc:1403] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.218s	user 0.021s	sys 0.011s
I20260709 13:04:51.125468 16316 raft_consensus.cc:359] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:51.126607 16316 raft_consensus.cc:385] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.126989 16316 raft_consensus.cc:740] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.127991 16316 consensus_queue.cc:260] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:51.130913 16198 raft_consensus.cc:2468] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:04:51.133345 16014 leader_election.cc:304] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:51.134320 16403 raft_consensus.cc:2804] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:51.134810 16403 raft_consensus.cc:697] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:04:51.135900 16403 consensus_queue.cc:237] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:51.096657 16431 raft_consensus.cc:515] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:51.150823 16320 raft_consensus.cc:359] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:51.151909 16320 raft_consensus.cc:385] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.152201 16320 raft_consensus.cc:740] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.152643 16320 consensus_queue.cc:260] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:51.154500 16316 ts_tablet_manager.cc:1434] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 13:04:51.156977 16316 tablet_bootstrap.cc:492] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:51.151540 16382 consensus_queue.cc:1048] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:04:51.159457 16320 ts_tablet_manager.cc:1434] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:04:51.161357 16319 tablet_bootstrap.cc:492] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:51.161844 16319 ts_tablet_manager.cc:1403] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.283s	user 0.017s	sys 0.038s
I20260709 13:04:51.163136 16391 consensus_queue.cc:1048] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:51.164549 16319 raft_consensus.cc:359] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:51.165218 16319 raft_consensus.cc:385] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.165503 16319 raft_consensus.cc:740] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.166213 16319 consensus_queue.cc:260] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:51.167989 16319 ts_tablet_manager.cc:1434] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:04:51.168870 16319 tablet_bootstrap.cc:492] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:51.147662 16121 raft_consensus.cc:2468] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:04:51.176211 16320 tablet_bootstrap.cc:492] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:51.190641 16317 tablet_bootstrap.cc:654] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.200299 15945 catalog_manager.cc:5697] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 1 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:51.220395 16320 tablet_bootstrap.cc:654] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.222640 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c283cfd76b4e9aacd796f6ead6e4b8" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:51.223354 16121 raft_consensus.cc:3060] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.214522 16194 raft_consensus.cc:3060] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.209973 16431 leader_election.cc:290] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
W20260709 13:04:51.246464 16163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 72554us
I20260709 13:04:51.259092 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c283cfd76b4e9aacd796f6ead6e4b8" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
W20260709 13:04:51.260763 16237 leader_election.cc:343] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:51.248764 16089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 62479.4us
W20260709 13:04:51.249765 16088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 80356.2us
I20260709 13:04:51.290383 16121 raft_consensus.cc:2468] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:51.322597 16431 consensus_queue.cc:1048] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:51.322757 16237 leader_election.cc:304] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:51.324815 16431 raft_consensus.cc:2804] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:51.325389 16431 raft_consensus.cc:697] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:51.326354 16316 tablet_bootstrap.cc:654] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.326692 16319 tablet_bootstrap.cc:654] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.326932 16320 tablet_bootstrap.cc:492] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:51.327386 16320 ts_tablet_manager.cc:1403] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.152s	user 0.012s	sys 0.042s
I20260709 13:04:51.326311 16431 consensus_queue.cc:237] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:51.330687 16480 raft_consensus.cc:493] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.331264 16480 raft_consensus.cc:515] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:51.332654 16317 tablet_bootstrap.cc:492] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:51.347235 16317 ts_tablet_manager.cc:1403] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.290s	user 0.015s	sys 0.010s
I20260709 13:04:51.332975 15946 catalog_manager.cc:5697] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:51.335412 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dfecacf6d204abc99b0b341ab7256b1" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:51.337857 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dfecacf6d204abc99b0b341ab7256b1" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:51.335523 16480 leader_election.cc:290] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:51.336462 16320 raft_consensus.cc:359] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:51.352205 16320 raft_consensus.cc:385] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.352607 16320 raft_consensus.cc:740] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.359529 16320 consensus_queue.cc:260] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:51.387374 16320 ts_tablet_manager.cc:1434] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.001s
I20260709 13:04:51.388728 16320 tablet_bootstrap.cc:492] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:51.389957 16163 leader_election.cc:304] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:51.397009 16480 raft_consensus.cc:2749] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:51.397343 16317 raft_consensus.cc:359] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:51.398077 16317 raft_consensus.cc:385] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.398449 16317 raft_consensus.cc:740] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.399562 16317 consensus_queue.cc:260] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:51.396276 15945 catalog_manager.cc:5697] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 0 to 1, leader changed from <none> to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 1 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:51.408435 16322 consensus_queue.cc:1048] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:51.411427 16403 raft_consensus.cc:493] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.412019 16403 raft_consensus.cc:515] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:51.414985 16403 leader_election.cc:290] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:51.422539 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f053de7054c4b3786ffa35aa5accb15" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:51.423180 16317 ts_tablet_manager.cc:1434] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.001s
I20260709 13:04:51.424309 16317 tablet_bootstrap.cc:492] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:51.425239 16319 tablet_bootstrap.cc:492] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:51.425786 16319 ts_tablet_manager.cc:1403] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.257s	user 0.020s	sys 0.030s
W20260709 13:04:51.427349 16014 leader_election.cc:343] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:51.427896 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f053de7054c4b3786ffa35aa5accb15" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:51.428813 16319 raft_consensus.cc:359] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
W20260709 13:04:51.429423 16014 leader_election.cc:343] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:51.429643 16319 raft_consensus.cc:385] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.429965 16014 leader_election.cc:304] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:51.430040 16319 raft_consensus.cc:740] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.431157 16403 raft_consensus.cc:2749] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:51.431262 16319 consensus_queue.cc:260] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:51.435132 16319 ts_tablet_manager.cc:1434] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:51.436414 16319 tablet_bootstrap.cc:492] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:51.438174 16317 tablet_bootstrap.cc:654] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.442983 16316 tablet_bootstrap.cc:492] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:51.443612 16316 ts_tablet_manager.cc:1403] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.287s	user 0.019s	sys 0.009s
I20260709 13:04:51.443668 16320 tablet_bootstrap.cc:654] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.447985 16316 raft_consensus.cc:359] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:51.449002 16316 raft_consensus.cc:385] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.449455 16316 raft_consensus.cc:740] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.450387 16316 consensus_queue.cc:260] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:51.452612 16319 tablet_bootstrap.cc:654] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.453012 16316 ts_tablet_manager.cc:1434] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:04:51.454252 16316 tablet_bootstrap.cc:492] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:51.456754 16320 tablet_bootstrap.cc:492] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:51.457486 16320 ts_tablet_manager.cc:1403] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.001s
I20260709 13:04:51.459132 16403 raft_consensus.cc:493] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.459662 16403 raft_consensus.cc:515] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:51.460461 16316 tablet_bootstrap.cc:654] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.461958 16403 leader_election.cc:290] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:51.464358 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6b0df9a4d4b55a27f4ffb956db8d0" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
W20260709 13:04:51.465922 16014 leader_election.cc:343] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:51.469769 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6b0df9a4d4b55a27f4ffb956db8d0" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:51.470664 16271 raft_consensus.cc:2468] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 0.
I20260709 13:04:51.473428 16014 leader_election.cc:304] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:51.474288 16405 raft_consensus.cc:2804] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:51.474676 16405 raft_consensus.cc:493] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.475025 16405 raft_consensus.cc:3060] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.484858 16405 raft_consensus.cc:515] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:51.489454 16320 raft_consensus.cc:359] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:51.490280 16320 raft_consensus.cc:385] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.490531 16317 tablet_bootstrap.cc:492] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:51.490576 16320 raft_consensus.cc:740] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.491192 16317 ts_tablet_manager.cc:1403] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.067s	user 0.025s	sys 0.023s
I20260709 13:04:51.491905 16320 consensus_queue.cc:260] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:51.494258 16121 raft_consensus.cc:3060] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.495113 16405 leader_election.cc:290] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:51.496131 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6b0df9a4d4b55a27f4ffb956db8d0" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:51.496752 16271 raft_consensus.cc:3060] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.499188 15943 catalog_manager.cc:5697] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 1 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:51.494190 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6b0df9a4d4b55a27f4ffb956db8d0" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:51.501142 16483 consensus_queue.cc:1048] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:04:51.504158 16014 leader_election.cc:343] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:51.514216 16316 tablet_bootstrap.cc:492] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:51.514372 16271 raft_consensus.cc:2468] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:04:51.514858 16316 ts_tablet_manager.cc:1403] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.004s
I20260709 13:04:51.515661 16014 leader_election.cc:304] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:51.516474 16405 raft_consensus.cc:2804] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:51.517017 16405 raft_consensus.cc:697] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:04:51.517947 16405 consensus_queue.cc:237] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:51.522231 16317 raft_consensus.cc:359] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:51.522948 16317 raft_consensus.cc:385] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.523203 16317 raft_consensus.cc:740] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.523840 16317 consensus_queue.cc:260] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:51.527652 16322 consensus_queue.cc:1048] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:51.529994 16317 ts_tablet_manager.cc:1434] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:04:51.530516 16319 tablet_bootstrap.cc:492] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:51.531085 16319 ts_tablet_manager.cc:1403] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.095s	user 0.014s	sys 0.020s
I20260709 13:04:51.531817 16316 raft_consensus.cc:359] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:51.534299 16316 raft_consensus.cc:385] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.534664 16316 raft_consensus.cc:740] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.534482 16319 raft_consensus.cc:359] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:51.535415 16319 raft_consensus.cc:385] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.535606 16316 consensus_queue.cc:260] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:51.538507 16319 raft_consensus.cc:740] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.531224 16317 tablet_bootstrap.cc:492] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:51.539448 16319 consensus_queue.cc:260] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:51.542212 16319 ts_tablet_manager.cc:1434] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:04:51.543390 16319 tablet_bootstrap.cc:492] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:51.524327 16320 ts_tablet_manager.cc:1434] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 13:04:51.548301 16320 tablet_bootstrap.cc:492] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:51.550587 16403 consensus_queue.cc:1048] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:51.552608 16316 ts_tablet_manager.cc:1434] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.000s
I20260709 13:04:51.553525 16317 tablet_bootstrap.cc:654] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.556488 16316 tablet_bootstrap.cc:492] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:51.563222 16320 tablet_bootstrap.cc:654] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.563522 16319 tablet_bootstrap.cc:654] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.578729 16316 tablet_bootstrap.cc:654] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.581713 16384 consensus_queue.cc:1048] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:51.619869 16317 tablet_bootstrap.cc:492] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:51.621325 16317 ts_tablet_manager.cc:1403] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.000s
I20260709 13:04:51.603243 15944 catalog_manager.cc:5697] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 0 to 1, leader changed from <none> to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 1 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:51.625033 16317 raft_consensus.cc:359] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:51.631317 16317 raft_consensus.cc:385] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.631598 16317 raft_consensus.cc:740] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.631927 16319 tablet_bootstrap.cc:492] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:51.632413 16319 ts_tablet_manager.cc:1403] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.089s	user 0.019s	sys 0.017s
I20260709 13:04:51.628825 16316 tablet_bootstrap.cc:492] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:51.633613 16316 ts_tablet_manager.cc:1403] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.077s	user 0.021s	sys 0.006s
I20260709 13:04:51.635301 16319 raft_consensus.cc:359] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:51.635959 16319 raft_consensus.cc:385] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.636226 16319 raft_consensus.cc:740] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.636104 16316 raft_consensus.cc:359] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:51.636803 16316 raft_consensus.cc:385] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.637109 16316 raft_consensus.cc:740] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.637149 16319 consensus_queue.cc:260] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:51.632392 16317 consensus_queue.cc:260] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:51.637866 16316 consensus_queue.cc:260] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:51.639832 16316 ts_tablet_manager.cc:1434] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:51.641542 16319 ts_tablet_manager.cc:1434] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:04:51.639775 16317 ts_tablet_manager.cc:1434] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:04:51.647542 16316 tablet_bootstrap.cc:492] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:51.651499 16317 tablet_bootstrap.cc:492] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:51.654403 16403 consensus_queue.cc:1048] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:51.654899 16319 tablet_bootstrap.cc:492] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:51.671628 16316 tablet_bootstrap.cc:654] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.680526 16316 tablet_bootstrap.cc:492] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:51.681061 16316 ts_tablet_manager.cc:1403] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 13:04:51.683279 16319 tablet_bootstrap.cc:654] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.685367 16316 raft_consensus.cc:359] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:51.689157 16317 tablet_bootstrap.cc:654] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.690122 16320 tablet_bootstrap.cc:492] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:51.690696 16320 ts_tablet_manager.cc:1403] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.143s	user 0.018s	sys 0.038s
I20260709 13:04:51.693655 16320 raft_consensus.cc:359] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:51.686708 16316 raft_consensus.cc:385] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.695022 16316 raft_consensus.cc:740] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.694404 16320 raft_consensus.cc:385] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.696671 16320 raft_consensus.cc:740] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.697628 16320 consensus_queue.cc:260] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:51.697590 16316 consensus_queue.cc:260] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:51.700340 16317 tablet_bootstrap.cc:492] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:51.700815 16316 ts_tablet_manager.cc:1434] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.003s
I20260709 13:04:51.700865 16317 ts_tablet_manager.cc:1403] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.002s
I20260709 13:04:51.702951 16322 raft_consensus.cc:493] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.703438 16322 raft_consensus.cc:515] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:51.704180 16320 ts_tablet_manager.cc:1434] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:04:51.705184 16320 tablet_bootstrap.cc:492] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:51.705192 16317 raft_consensus.cc:359] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:51.705964 16317 raft_consensus.cc:385] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.706243 16317 raft_consensus.cc:740] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.706369 16316 tablet_bootstrap.cc:492] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:51.707064 16317 consensus_queue.cc:260] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:51.708638 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522541a48c1647ccaf475543121810d2" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:51.705677 16322 leader_election.cc:290] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:51.710654 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522541a48c1647ccaf475543121810d2" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
W20260709 13:04:51.712167 16237 leader_election.cc:343] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:51.712570 16317 ts_tablet_manager.cc:1434] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:51.713526 16316 tablet_bootstrap.cc:654] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.713730 16317 tablet_bootstrap.cc:492] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:51.715538 16319 tablet_bootstrap.cc:492] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:51.716060 16319 ts_tablet_manager.cc:1403] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.001s
I20260709 13:04:51.718807 16322 raft_consensus.cc:493] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.721485 16320 tablet_bootstrap.cc:654] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.721630 16317 tablet_bootstrap.cc:654] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.721208 16322 raft_consensus.cc:515] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:51.722867 16319 raft_consensus.cc:359] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:51.723666 16319 raft_consensus.cc:385] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.724006 16319 raft_consensus.cc:740] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.724885 16322 leader_election.cc:290] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:51.725435 16316 tablet_bootstrap.cc:492] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:51.724951 16319 consensus_queue.cc:260] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:51.726055 16316 ts_tablet_manager.cc:1403] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.003s
I20260709 13:04:51.728055 16319 ts_tablet_manager.cc:1434] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:04:51.781760 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe849f02803548a48394a1ff9f356f98" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:51.783967 16121 raft_consensus.cc:2468] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:51.784340 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe849f02803548a48394a1ff9f356f98" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:51.785653 16198 raft_consensus.cc:2468] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:51.785161 16316 raft_consensus.cc:359] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:51.786669 16316 raft_consensus.cc:385] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.787110 16316 raft_consensus.cc:740] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.788492 16316 consensus_queue.cc:260] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
W20260709 13:04:51.791033 16236 leader_election.cc:343] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:51.794607 16382 raft_consensus.cc:493] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.797020 16396 raft_consensus.cc:493] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.802569 16237 leader_election.cc:304] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:51.797324 16319 tablet_bootstrap.cc:492] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:51.817408 16382 raft_consensus.cc:515] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:51.822379 16396 raft_consensus.cc:515] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:51.793104 16236 leader_election.cc:304] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:51.829485 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe849f02803548a48394a1ff9f356f98" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:51.830421 16198 raft_consensus.cc:2468] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:51.835505 16387 raft_consensus.cc:2749] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:51.840327 16320 tablet_bootstrap.cc:492] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:51.841614 16320 ts_tablet_manager.cc:1403] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.137s	user 0.014s	sys 0.002s
W20260709 13:04:51.845628 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 43649.8us
I20260709 13:04:51.854521 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c283cfd76b4e9aacd796f6ead6e4b8" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:51.854830 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe849f02803548a48394a1ff9f356f98" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:51.855849 16271 raft_consensus.cc:2468] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:51.856069 16123 raft_consensus.cc:2393] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1e05442c5b44a079dd1de9dd124c990 in current term 1: Already voted for candidate d2e22ad700e94d1095c014708c364bb7 in this term.
I20260709 13:04:51.847610 16320 raft_consensus.cc:359] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:51.857216 16320 raft_consensus.cc:385] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.857602 16320 raft_consensus.cc:740] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.856171 16316 ts_tablet_manager.cc:1434] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.129s	user 0.015s	sys 0.017s
I20260709 13:04:51.859323 16342 raft_consensus.cc:2804] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:51.859174 16320 consensus_queue.cc:260] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:51.852684 16089 leader_election.cc:304] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:51.868185 16484 raft_consensus.cc:2804] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:51.868706 16484 raft_consensus.cc:493] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.859941 16342 raft_consensus.cc:493] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.874289 16342 raft_consensus.cc:3060] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.880435 16396 leader_election.cc:290] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:51.873289 16317 tablet_bootstrap.cc:492] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:51.833516 16382 leader_election.cc:290] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:51.881759 16317 ts_tablet_manager.cc:1403] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.168s	user 0.015s	sys 0.001s
I20260709 13:04:51.882143 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c283cfd76b4e9aacd796f6ead6e4b8" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:51.869107 16484 raft_consensus.cc:3060] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.885594 16163 leader_election.cc:304] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:51.886695 16396 raft_consensus.cc:3060] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.894883 16340 consensus_queue.cc:1048] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:51.896546 16405 raft_consensus.cc:493] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.897397 16405 raft_consensus.cc:515] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:51.903425 16405 leader_election.cc:290] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:51.877951 16316 tablet_bootstrap.cc:492] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:51.906740 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5dc804032442d1a074ba2adaf03311" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:51.907744 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5dc804032442d1a074ba2adaf03311" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
W20260709 13:04:51.909533 16014 leader_election.cc:343] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:51.910338 16014 leader_election.cc:343] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:51.910792 16014 leader_election.cc:304] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:51.913028 16405 raft_consensus.cc:2749] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:51.913515 16319 tablet_bootstrap.cc:654] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.916152 16320 ts_tablet_manager.cc:1434] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.074s	user 0.012s	sys 0.000s
I20260709 13:04:51.918092 16320 tablet_bootstrap.cc:492] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:51.918370 16317 raft_consensus.cc:359] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:51.919610 16317 raft_consensus.cc:385] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.919950 16317 raft_consensus.cc:740] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.920874 16317 consensus_queue.cc:260] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:51.932735 16320 tablet_bootstrap.cc:654] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.933665 16405 raft_consensus.cc:493] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.933825 16342 raft_consensus.cc:515] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:51.934337 16405 raft_consensus.cc:515] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:51.943964 16405 leader_election.cc:290] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:51.954208 16515 raft_consensus.cc:493] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.946691 16396 raft_consensus.cc:2749] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:51.959299 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac8a97b1adc49389919710edf7c5e03" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:51.964564 16316 tablet_bootstrap.cc:654] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.965823 16317 ts_tablet_manager.cc:1434] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.084s	user 0.011s	sys 0.000s
I20260709 13:04:51.967777 16391 raft_consensus.cc:493] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:51.968119 16014 leader_election.cc:343] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:51.968430 16391 raft_consensus.cc:515] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:51.969214 16382 raft_consensus.cc:493] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.969697 16382 raft_consensus.cc:515] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:51.963325 16342 leader_election.cc:290] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:51.971146 16391 leader_election.cc:290] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:51.975283 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac8a97b1adc49389919710edf7c5e03" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:51.978888 16124 raft_consensus.cc:2468] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 0.
I20260709 13:04:51.978801 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f053de7054c4b3786ffa35aa5accb15" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:51.980005 16046 raft_consensus.cc:2468] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:51.980636 16014 leader_election.cc:304] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:51.980926 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f053de7054c4b3786ffa35aa5accb15" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:51.982677 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac8a97b1adc49389919710edf7c5e03" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:51.985877 16088 leader_election.cc:304] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
W20260709 13:04:51.985984 16089 leader_election.cc:343] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:51.987051 16382 leader_election.cc:290] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:51.987942 16382 raft_consensus.cc:2804] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:51.988343 16382 raft_consensus.cc:493] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.988718 16382 raft_consensus.cc:3060] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.988862 16319 tablet_bootstrap.cc:492] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:51.989701 16319 ts_tablet_manager.cc:1403] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.261s	user 0.006s	sys 0.034s
I20260709 13:04:51.983045 16405 raft_consensus.cc:2804] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:51.991947 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac8a97b1adc49389919710edf7c5e03" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:51.997280 16320 tablet_bootstrap.cc:492] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:51.997815 16320 ts_tablet_manager.cc:1403] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.080s	user 0.016s	sys 0.009s
I20260709 13:04:51.991892 16405 raft_consensus.cc:493] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.971158 16515 raft_consensus.cc:515] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:52.008656 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe849f02803548a48394a1ff9f356f98" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:52.009197 16403 consensus_queue.cc:1048] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:04:52.012428 16271 raft_consensus.cc:2468] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:52.014554 16320 raft_consensus.cc:359] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:52.015447 16320 raft_consensus.cc:385] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.015745 16320 raft_consensus.cc:740] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.006506 16405 raft_consensus.cc:3060] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.021615 16319 raft_consensus.cc:359] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.022320 16319 raft_consensus.cc:385] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.024188 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe849f02803548a48394a1ff9f356f98" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:52.024893 16197 raft_consensus.cc:3060] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.027762 16322 consensus_queue.cc:1048] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:52.022578 16319 raft_consensus.cc:740] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.030598 16320 consensus_queue.cc:260] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:52.034050 16319 consensus_queue.cc:260] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.047260 16320 ts_tablet_manager.cc:1434] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.001s
I20260709 13:04:52.060264 16320 tablet_bootstrap.cc:492] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:52.054766 16387 raft_consensus.cc:493] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.065212 16317 tablet_bootstrap.cc:492] T bf5dc804032442d1a074ba2adaf03311 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:52.063931 16387 raft_consensus.cc:515] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:52.068756 16396 raft_consensus.cc:493] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.081733 16387 leader_election.cc:290] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:52.078681 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f053de7054c4b3786ffa35aa5accb15" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:52.079674 16515 leader_election.cc:290] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:52.084215 16047 raft_consensus.cc:2468] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:52.084846 16320 tablet_bootstrap.cc:654] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.085436 16236 leader_election.cc:304] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:52.086493 16515 raft_consensus.cc:2804] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.086906 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f053de7054c4b3786ffa35aa5accb15" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:52.087231 16515 raft_consensus.cc:493] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.090248 16319 ts_tablet_manager.cc:1434] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.100s	user 0.005s	sys 0.005s
I20260709 13:04:52.087615 16515 raft_consensus.cc:3060] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.095373 16319 tablet_bootstrap.cc:492] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:52.070866 16484 raft_consensus.cc:515] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:52.098258 16124 raft_consensus.cc:2393] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 in current term 1: Already voted for candidate 36b15691c8e648a18b69e98bee3349b4 in this term.
I20260709 13:04:52.099139 16484 leader_election.cc:290] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:52.101939 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc73085eee348a0b029b5aa5f51e288" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:52.103826 16316 tablet_bootstrap.cc:492] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:52.104391 16316 ts_tablet_manager.cc:1403] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.227s	user 0.008s	sys 0.027s
I20260709 13:04:52.107635 16316 raft_consensus.cc:359] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:52.108393 16316 raft_consensus.cc:385] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.108273 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe849f02803548a48394a1ff9f356f98" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:52.109167 16396 raft_consensus.cc:515] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.110229 16197 raft_consensus.cc:2468] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:52.108707 16316 raft_consensus.cc:740] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.115674 16317 tablet_bootstrap.cc:654] T bf5dc804032442d1a074ba2adaf03311 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.116050 16405 raft_consensus.cc:515] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:52.121971 16046 raft_consensus.cc:2393] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 in current term 1: Already voted for candidate ec8b54f5a9e44f428a4d537391138dcf in this term.
I20260709 13:04:52.121817 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc73085eee348a0b029b5aa5f51e288" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:52.124531 16088 leader_election.cc:304] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:52.126084 16384 raft_consensus.cc:3060] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.126327 16396 leader_election.cc:290] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
W20260709 13:04:52.108970 16237 leader_election.cc:343] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.143903 16330 raft_consensus.cc:493] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.144480 16316 consensus_queue.cc:260] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:52.145011 16271 raft_consensus.cc:2393] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 in current term 1: Already voted for candidate d2e22ad700e94d1095c014708c364bb7 in this term.
I20260709 13:04:52.147998 16330 raft_consensus.cc:515] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:52.160068 16316 ts_tablet_manager.cc:1434] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.005s
I20260709 13:04:52.161203 16391 raft_consensus.cc:493] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.165437 16391 raft_consensus.cc:515] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.168426 16391 leader_election.cc:290] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:52.168342 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105468bfb6dc48c28c16d3449c691f6b" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:52.161322 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe849f02803548a48394a1ff9f356f98" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:52.175179 16197 raft_consensus.cc:3060] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.180486 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105468bfb6dc48c28c16d3449c691f6b" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:52.176151 16382 raft_consensus.cc:515] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:52.169592 16330 leader_election.cc:290] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:52.182391 16121 raft_consensus.cc:2393] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 in current term 1: Already voted for candidate 36b15691c8e648a18b69e98bee3349b4 in this term.
I20260709 13:04:52.182991 16196 raft_consensus.cc:2393] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 in current term 1: Already voted for candidate d2e22ad700e94d1095c014708c364bb7 in this term.
I20260709 13:04:52.188707 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105468bfb6dc48c28c16d3449c691f6b" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:52.191138 16046 raft_consensus.cc:2468] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:52.192138 16123 raft_consensus.cc:2468] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:52.193580 16162 leader_election.cc:304] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:52.193686 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522541a48c1647ccaf475543121810d2" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:52.194543 16396 raft_consensus.cc:2804] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.194927 16396 raft_consensus.cc:493] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.195308 16396 raft_consensus.cc:3060] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.203343 16396 raft_consensus.cc:515] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.206351 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105468bfb6dc48c28c16d3449c691f6b" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:52.207007 16047 raft_consensus.cc:3060] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.215161 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac8a97b1adc49389919710edf7c5e03" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:52.162948 16237 leader_election.cc:304] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4
I20260709 13:04:52.220573 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522541a48c1647ccaf475543121810d2" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:52.227147 16272 raft_consensus.cc:2468] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 0.
I20260709 13:04:52.228363 16320 tablet_bootstrap.cc:492] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:52.229835 16320 ts_tablet_manager.cc:1403] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.174s	user 0.038s	sys 0.022s
I20260709 13:04:52.206352 16396 leader_election.cc:290] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:52.234380 16316 tablet_bootstrap.cc:492] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:52.227825 16387 raft_consensus.cc:2804] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.229229 16405 leader_election.cc:290] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:52.220144 16047 raft_consensus.cc:2468] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
W20260709 13:04:52.227419 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 66740.3us
I20260709 13:04:52.234365 16342 raft_consensus.cc:493] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.228904 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105468bfb6dc48c28c16d3449c691f6b" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:52.243348 16320 raft_consensus.cc:359] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.244901 16320 raft_consensus.cc:385] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.245236 16320 raft_consensus.cc:740] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.245955 16342 raft_consensus.cc:515] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:52.246510 16320 consensus_queue.cc:260] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.246968 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f053de7054c4b3786ffa35aa5accb15" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:52.247613 16048 raft_consensus.cc:3060] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.238262 16382 leader_election.cc:290] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:52.248126 16342 leader_election.cc:290] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
W20260709 13:04:52.239264 16014 leader_election.cc:343] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.245973 16519 raft_consensus.cc:493] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.249185 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9bf004f8eb4f0f910840561945e386" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:52.249943 16046 raft_consensus.cc:2468] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:52.249807 16519 raft_consensus.cc:515] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:52.251308 16236 leader_election.cc:304] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:52.252143 16322 raft_consensus.cc:2804] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.252511 16322 raft_consensus.cc:493] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.252825 16322 raft_consensus.cc:3060] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.253158 16384 raft_consensus.cc:2749] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.253639 16320 ts_tablet_manager.cc:1434] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:04:52.254918 16320 tablet_bootstrap.cc:492] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
W20260709 13:04:52.255676 16014 leader_election.cc:343] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.256412 16014 leader_election.cc:304] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:52.257048 16317 tablet_bootstrap.cc:492] T bf5dc804032442d1a074ba2adaf03311 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:52.257946 16405 raft_consensus.cc:2804] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.258385 16405 raft_consensus.cc:493] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.257686 16317 ts_tablet_manager.cc:1403] T bf5dc804032442d1a074ba2adaf03311 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.217s	user 0.011s	sys 0.010s
I20260709 13:04:52.251672 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac8a97b1adc49389919710edf7c5e03" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:52.262137 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6b0df9a4d4b55a27f4ffb956db8d0" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:52.263063 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6b0df9a4d4b55a27f4ffb956db8d0" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:52.264590 16519 leader_election.cc:290] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:52.241298 16387 raft_consensus.cc:697] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:52.267189 16515 raft_consensus.cc:515] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:52.268031 16317 raft_consensus.cc:359] T bf5dc804032442d1a074ba2adaf03311 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.258772 16405 raft_consensus.cc:3060] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.268831 16317 raft_consensus.cc:385] T bf5dc804032442d1a074ba2adaf03311 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.265790 16194 raft_consensus.cc:2393] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 in current term 1: Already voted for candidate e1e05442c5b44a079dd1de9dd124c990 in this term.
I20260709 13:04:52.275063 16162 leader_election.cc:304] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:52.276204 16162 leader_election.cc:304] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:52.277732 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f053de7054c4b3786ffa35aa5accb15" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:52.279295 16396 raft_consensus.cc:2749] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:52.279964 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f053de7054c4b3786ffa35aa5accb15" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:52.280334 16480 raft_consensus.cc:2804] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.280934 16480 raft_consensus.cc:697] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:52.269629 16317 raft_consensus.cc:740] T bf5dc804032442d1a074ba2adaf03311 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.264660 16048 raft_consensus.cc:2468] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:52.284873 16515 leader_election.cc:290] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:52.280850 16271 raft_consensus.cc:2393] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 in current term 1: Already voted for candidate d2e22ad700e94d1095c014708c364bb7 in this term.
W20260709 13:04:52.270989 16237 leader_election.cc:343] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.290371 16322 raft_consensus.cc:515] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:52.293689 16480 consensus_queue.cc:237] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.292725 16317 consensus_queue.cc:260] T bf5dc804032442d1a074ba2adaf03311 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
W20260709 13:04:52.293493 15994 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:52.268541 16387 consensus_queue.cc:237] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:52.297847 16123 raft_consensus.cc:2468] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:04:52.300426 16237 leader_election.cc:304] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
W20260709 13:04:52.302353 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 44609.6us
I20260709 13:04:52.303131 16342 raft_consensus.cc:2749] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.293974 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105468bfb6dc48c28c16d3449c691f6b" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:52.304303 16121 raft_consensus.cc:3060] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.305423 16088 leader_election.cc:304] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:52.307312 16382 raft_consensus.cc:2804] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.308144 16382 raft_consensus.cc:697] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:04:52.317518 16317 ts_tablet_manager.cc:1434] T bf5dc804032442d1a074ba2adaf03311 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.001s
I20260709 13:04:52.318085 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9bf004f8eb4f0f910840561945e386" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:52.318677 16317 tablet_bootstrap.cc:492] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:52.318797 16047 raft_consensus.cc:3060] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.312791 16403 consensus_queue.cc:1048] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:04:52.328068 16317 tablet_bootstrap.cc:654] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.328027 16047 raft_consensus.cc:2468] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:52.329524 16236 leader_election.cc:304] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:52.330446 16342 raft_consensus.cc:2804] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.330476 16382 consensus_queue.cc:237] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:52.331164 16342 raft_consensus.cc:697] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:52.332129 16319 tablet_bootstrap.cc:654] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.333786 16320 tablet_bootstrap.cc:654] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.334965 16121 raft_consensus.cc:2468] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:52.335306 16342 consensus_queue.cc:237] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:52.294366 16089 leader_election.cc:304] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:52.364360 16316 tablet_bootstrap.cc:654] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.363675 15943 catalog_manager.cc:5697] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:52.369463 16322 leader_election.cc:290] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:52.377099 16391 raft_consensus.cc:2749] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.382794 16405 raft_consensus.cc:515] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:52.406826 16405 leader_election.cc:290] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
W20260709 13:04:52.390017 16089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 95711.2us
I20260709 13:04:52.411176 16089 leader_election.cc:304] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:52.413528 16391 raft_consensus.cc:2749] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.418275 16396 raft_consensus.cc:493] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.425514 16396 raft_consensus.cc:515] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.431025 16396 leader_election.cc:290] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:52.432174 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5dc804032442d1a074ba2adaf03311" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:52.433192 16047 raft_consensus.cc:2468] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:52.434741 16162 leader_election.cc:304] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:52.394743 16014 leader_election.cc:304] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:52.439982 16317 tablet_bootstrap.cc:492] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:52.440528 16317 ts_tablet_manager.cc:1403] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.122s	user 0.014s	sys 0.023s
W20260709 13:04:52.440575 16014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:45195, user_credentials={real_user=slave}} blocked reactor thread for 50199.6us
I20260709 13:04:52.443568 16317 raft_consensus.cc:359] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:52.444278 16317 raft_consensus.cc:385] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.444536 16317 raft_consensus.cc:740] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.446297 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522541a48c1647ccaf475543121810d2" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:52.446704 16319 tablet_bootstrap.cc:492] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:52.447254 16319 ts_tablet_manager.cc:1403] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.356s	user 0.012s	sys 0.025s
I20260709 13:04:52.448833 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522541a48c1647ccaf475543121810d2" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:52.449574 16271 raft_consensus.cc:3060] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.450150 16319 raft_consensus.cc:359] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:52.450848 16319 raft_consensus.cc:385] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.451115 16319 raft_consensus.cc:740] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.451807 16319 consensus_queue.cc:260] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:52.452844 16519 raft_consensus.cc:493] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.453236 16317 consensus_queue.cc:260] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:52.453524 16519 raft_consensus.cc:515] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:52.455323 16317 ts_tablet_manager.cc:1434] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:04:52.456260 16519 leader_election.cc:290] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:52.457332 16319 ts_tablet_manager.cc:1434] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:04:52.458492 16319 tablet_bootstrap.cc:492] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:52.463127 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522541a48c1647ccaf475543121810d2" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:52.466591 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522541a48c1647ccaf475543121810d2" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:52.467469 16047 raft_consensus.cc:2393] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1e05442c5b44a079dd1de9dd124c990 in current term 1: Already voted for candidate ec8b54f5a9e44f428a4d537391138dcf in this term.
I20260709 13:04:52.468896 16319 tablet_bootstrap.cc:654] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.456401 16317 tablet_bootstrap.cc:492] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:52.469529 16162 leader_election.cc:304] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:52.472935 16519 raft_consensus.cc:3060] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.477919 16396 raft_consensus.cc:2804] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.478425 16396 raft_consensus.cc:493] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.478752 16396 raft_consensus.cc:3060] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.487284 16403 raft_consensus.cc:2804] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.488075 16403 raft_consensus.cc:697] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:04:52.489297 16403 consensus_queue.cc:237] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:52.496153 16342 raft_consensus.cc:493] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.496912 16342 raft_consensus.cc:515] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:52.502349 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44eefc0f2e540b99fa97ec775185660" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
W20260709 13:04:52.504541 16236 leader_election.cc:343] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.505373 16342 leader_election.cc:290] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:52.513005 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f053de7054c4b3786ffa35aa5accb15" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:52.515024 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9bf004f8eb4f0f910840561945e386" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
W20260709 13:04:52.530629 16014 leader_election.cc:343] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:52.521488 16089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 110653us
I20260709 13:04:52.521028 16271 raft_consensus.cc:2468] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:04:52.552553 16317 tablet_bootstrap.cc:654] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.525416 16237 leader_election.cc:304] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:52.560514 16342 raft_consensus.cc:2749] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:04:52.563596 16237 leader_election.cc:343] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.563740 16403 raft_consensus.cc:493] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.564327 16403 raft_consensus.cc:515] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.564973 16319 tablet_bootstrap.cc:492] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:52.565764 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9bf004f8eb4f0f910840561945e386" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:52.566444 16403 leader_election.cc:290] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:52.566593 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44eefc0f2e540b99fa97ec775185660" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:52.569109 16316 tablet_bootstrap.cc:492] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:52.569584 16316 ts_tablet_manager.cc:1403] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.346s	user 0.013s	sys 0.007s
I20260709 13:04:52.569952 16319 ts_tablet_manager.cc:1403] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.112s	user 0.030s	sys 0.009s
I20260709 13:04:52.574347 16320 tablet_bootstrap.cc:492] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:52.574841 16320 ts_tablet_manager.cc:1403] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.320s	user 0.051s	sys 0.080s
I20260709 13:04:52.577394 16316 raft_consensus.cc:359] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:52.570948 16519 raft_consensus.cc:2749] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.577764 16320 raft_consensus.cc:359] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.580361 16319 raft_consensus.cc:359] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:52.578193 16316 raft_consensus.cc:385] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.578591 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5dc804032442d1a074ba2adaf03311" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:52.583058 16121 raft_consensus.cc:2468] T bf5dc804032442d1a074ba2adaf03311 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:52.581944 16319 raft_consensus.cc:385] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.583948 16319 raft_consensus.cc:740] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.584651 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eede189c87343c6a45e71d7cb23c41d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:52.581491 16320 raft_consensus.cc:385] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.584745 16319 consensus_queue.cc:260] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:52.585341 16320 raft_consensus.cc:740] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.582266 16316 raft_consensus.cc:740] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.586206 16320 consensus_queue.cc:260] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.586371 16316 consensus_queue.cc:260] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:52.592674 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eede189c87343c6a45e71d7cb23c41d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:52.593720 16320 ts_tablet_manager.cc:1434] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:04:52.562124 16396 raft_consensus.cc:515] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.595060 16316 ts_tablet_manager.cc:1434] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.001s
I20260709 13:04:52.596392 16319 ts_tablet_manager.cc:1434] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:04:52.596529 16320 tablet_bootstrap.cc:492] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:52.597549 16319 tablet_bootstrap.cc:492] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:52.598743 16317 tablet_bootstrap.cc:492] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:52.599239 16317 ts_tablet_manager.cc:1403] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.143s	user 0.011s	sys 0.006s
I20260709 13:04:52.599860 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5dc804032442d1a074ba2adaf03311" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:52.600584 16047 raft_consensus.cc:3060] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:52.600996 16014 leader_election.cc:343] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.603739 16316 tablet_bootstrap.cc:492] T c32eb3a1727b42348bb90a85f5f0e419 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:52.604907 16396 leader_election.cc:290] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:52.605232 16319 tablet_bootstrap.cc:654] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.608048 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5dc804032442d1a074ba2adaf03311" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:52.608719 16124 raft_consensus.cc:3060] T bf5dc804032442d1a074ba2adaf03311 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.610291 16316 tablet_bootstrap.cc:654] T c32eb3a1727b42348bb90a85f5f0e419 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.616994 16124 raft_consensus.cc:2468] T bf5dc804032442d1a074ba2adaf03311 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
W20260709 13:04:52.617492 16237 leader_election.cc:343] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.624341 16163 leader_election.cc:304] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:52.622776 16237 leader_election.cc:304] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:52.625476 16396 raft_consensus.cc:2804] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.625517 16340 raft_consensus.cc:2749] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.626221 16396 raft_consensus.cc:697] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:52.601852 16014 leader_election.cc:304] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:52.629426 16320 tablet_bootstrap.cc:654] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.627079 16396 consensus_queue.cc:237] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.632835 16330 raft_consensus.cc:2804] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:04:52.635730 16014 leader_election.cc:343] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.635900 16330 raft_consensus.cc:697] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:04:52.636258 16014 leader_election.cc:304] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:52.637185 16404 raft_consensus.cc:2749] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.636826 16330 consensus_queue.cc:237] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
W20260709 13:04:52.632922 16237 leader_election.cc:343] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.633919 16317 raft_consensus.cc:359] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:52.642539 16317 raft_consensus.cc:385] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.642920 16317 raft_consensus.cc:740] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.643916 16317 consensus_queue.cc:260] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:52.641855 16047 raft_consensus.cc:2468] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:52.660040 16316 tablet_bootstrap.cc:492] T c32eb3a1727b42348bb90a85f5f0e419 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:52.660198 16319 tablet_bootstrap.cc:492] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:52.661043 16316 ts_tablet_manager.cc:1403] T c32eb3a1727b42348bb90a85f5f0e419 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.006s
I20260709 13:04:52.661849 16319 ts_tablet_manager.cc:1403] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.027s
I20260709 13:04:52.663348 16320 tablet_bootstrap.cc:492] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:52.665499 16320 ts_tablet_manager.cc:1403] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.071s	user 0.004s	sys 0.014s
I20260709 13:04:52.665639 16316 raft_consensus.cc:359] T c32eb3a1727b42348bb90a85f5f0e419 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:52.666668 16316 raft_consensus.cc:385] T c32eb3a1727b42348bb90a85f5f0e419 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.667008 16316 raft_consensus.cc:740] T c32eb3a1727b42348bb90a85f5f0e419 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.668305 16316 consensus_queue.cc:260] T c32eb3a1727b42348bb90a85f5f0e419 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:52.673461 16319 raft_consensus.cc:359] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:52.674643 16319 raft_consensus.cc:385] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.674966 16319 raft_consensus.cc:740] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.675652 16319 consensus_queue.cc:260] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:52.677021 16317 ts_tablet_manager.cc:1434] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.003s
I20260709 13:04:52.678263 16317 tablet_bootstrap.cc:492] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:52.682204 15946 catalog_manager.cc:5697] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:52.682998 16319 ts_tablet_manager.cc:1434] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:04:52.684470 16319 tablet_bootstrap.cc:492] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:52.697851 16320 raft_consensus.cc:359] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:52.698874 16320 raft_consensus.cc:385] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.696764 15943 catalog_manager.cc:5697] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 1 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.700244 16316 ts_tablet_manager.cc:1434] T c32eb3a1727b42348bb90a85f5f0e419 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.004s
I20260709 13:04:52.701501 16316 tablet_bootstrap.cc:492] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:52.702913 16319 tablet_bootstrap.cc:654] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.707286 16545 consensus_queue.cc:1048] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:52.705564 15943 catalog_manager.cc:5697] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 1 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:52.712437 16316 tablet_bootstrap.cc:654] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.699215 16320 raft_consensus.cc:740] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.713725 16320 consensus_queue.cc:260] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:52.718487 16320 ts_tablet_manager.cc:1434] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.001s
I20260709 13:04:52.720558 16320 tablet_bootstrap.cc:492] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:52.733319 16317 tablet_bootstrap.cc:654] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.737762 16319 tablet_bootstrap.cc:492] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:52.738258 16319 ts_tablet_manager.cc:1403] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.012s
I20260709 13:04:52.739192 15945 catalog_manager.cc:5697] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 0 to 1, leader changed from <none> to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 1 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.741268 16319 raft_consensus.cc:359] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:52.744349 16319 raft_consensus.cc:385] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.744668 16319 raft_consensus.cc:740] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.741195 15945 catalog_manager.cc:5697] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 0 to 1, leader changed from <none> to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 1 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:52.749872 16319 consensus_queue.cc:260] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:52.750355 16322 consensus_queue.cc:1048] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:52.752113 16319 ts_tablet_manager.cc:1434] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:04:52.753234 16319 tablet_bootstrap.cc:492] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:52.760861 16316 tablet_bootstrap.cc:492] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:52.761442 16316 ts_tablet_manager.cc:1403] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.060s	user 0.006s	sys 0.007s
I20260709 13:04:52.760861 16519 consensus_queue.cc:1048] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:04:52.764559 16319 tablet_bootstrap.cc:654] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.764232 16316 raft_consensus.cc:359] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:52.764973 16316 raft_consensus.cc:385] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.766013 16391 raft_consensus.cc:493] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.765287 16316 raft_consensus.cc:740] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.766563 16391 raft_consensus.cc:515] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:52.774618 16391 leader_election.cc:290] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:52.776404 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc73085eee348a0b029b5aa5f51e288" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:52.776840 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc73085eee348a0b029b5aa5f51e288" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:52.777154 16271 raft_consensus.cc:2468] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:52.777516 16196 raft_consensus.cc:2468] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:52.772655 16316 consensus_queue.cc:260] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:52.783625 16089 leader_election.cc:304] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:04:52.784194 16316 ts_tablet_manager.cc:1434] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:04:52.785668 16316 tablet_bootstrap.cc:492] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:52.785569 16382 raft_consensus.cc:2804] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.786126 16382 raft_consensus.cc:493] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.786499 16382 raft_consensus.cc:3060] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.786339 16391 consensus_queue.cc:1048] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.789968 16320 tablet_bootstrap.cc:654] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.787438 15944 catalog_manager.cc:5697] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:52.797293 16342 consensus_queue.cc:1048] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:52.803447 16382 raft_consensus.cc:515] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:52.808357 16317 tablet_bootstrap.cc:492] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:52.809074 16317 ts_tablet_manager.cc:1403] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.131s	user 0.006s	sys 0.008s
I20260709 13:04:52.808360 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc73085eee348a0b029b5aa5f51e288" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:52.817987 16196 raft_consensus.cc:3060] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.816952 16317 raft_consensus.cc:359] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.824159 16317 raft_consensus.cc:385] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.824416 16317 raft_consensus.cc:740] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.826323 16317 consensus_queue.cc:260] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.830754 16519 raft_consensus.cc:493] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.831373 16519 raft_consensus.cc:515] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:52.827319 16480 consensus_queue.cc:1048] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:04:52.837177 16519 leader_election.cc:290] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:52.837886 16316 tablet_bootstrap.cc:654] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.840258 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44eefc0f2e540b99fa97ec775185660" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:52.841887 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44eefc0f2e540b99fa97ec775185660" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:52.840962 16272 raft_consensus.cc:2468] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
W20260709 13:04:52.843185 16162 leader_election.cc:343] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.843942 16163 leader_election.cc:304] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:52.844404 16196 raft_consensus.cc:2468] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:52.844630 16519 raft_consensus.cc:2804] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.857558 16519 raft_consensus.cc:493] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.858116 16519 raft_consensus.cc:3060] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.853817 16317 ts_tablet_manager.cc:1434] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.001s
I20260709 13:04:52.866345 16317 tablet_bootstrap.cc:492] T c32eb3a1727b42348bb90a85f5f0e419 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:52.872953 16519 raft_consensus.cc:515] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:52.853284 16382 leader_election.cc:290] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:52.885943 16330 raft_consensus.cc:493] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.885388 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc73085eee348a0b029b5aa5f51e288" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:52.895416 16519 leader_election.cc:290] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:52.896174 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44eefc0f2e540b99fa97ec775185660" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:52.898582 16319 tablet_bootstrap.cc:492] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:52.899108 16319 ts_tablet_manager.cc:1403] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.146s	user 0.015s	sys 0.003s
I20260709 13:04:52.908447 16317 tablet_bootstrap.cc:654] T c32eb3a1727b42348bb90a85f5f0e419 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:52.908792 16162 leader_election.cc:343] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.883914 16089 leader_election.cc:304] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:52.910396 16391 raft_consensus.cc:2804] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.911031 16391 raft_consensus.cc:697] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:04:52.886626 16330 raft_consensus.cc:515] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.905897 16271 raft_consensus.cc:3060] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.913993 16319 raft_consensus.cc:359] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.924394 16319 raft_consensus.cc:385] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.925452 16124 raft_consensus.cc:3060] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.927815 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44eefc0f2e540b99fa97ec775185660" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:52.924715 16319 raft_consensus.cc:740] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.930043 16319 consensus_queue.cc:260] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.933771 16272 raft_consensus.cc:3060] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.936502 16391 consensus_queue.cc:237] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:52.923897 16382 consensus_queue.cc:1048] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:04:52.961134 16319 ts_tablet_manager.cc:1434] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.000s
I20260709 13:04:52.965211 16330 leader_election.cc:290] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:52.965587 16316 tablet_bootstrap.cc:492] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:52.966101 16316 ts_tablet_manager.cc:1403] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.181s	user 0.026s	sys 0.007s
I20260709 13:04:52.969300 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaad334dede46d888c92db5c932655e" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:52.968858 16316 raft_consensus.cc:359] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:52.970039 16316 raft_consensus.cc:385] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.970320 16316 raft_consensus.cc:740] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.971033 16316 consensus_queue.cc:260] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
W20260709 13:04:52.971035 16014 leader_election.cc:343] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.973094 16316 ts_tablet_manager.cc:1434] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:04:52.974450 16316 tablet_bootstrap.cc:492] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:52.951786 16561 raft_consensus.cc:493] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.977711 16561 raft_consensus.cc:515] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:52.981639 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaad334dede46d888c92db5c932655e" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:52.982748 16561 leader_election.cc:290] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
W20260709 13:04:52.984776 16014 leader_election.cc:343] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.985072 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eede189c87343c6a45e71d7cb23c41d" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:52.985337 16014 leader_election.cc:304] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:52.985834 16048 raft_consensus.cc:2468] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:52.986474 16404 raft_consensus.cc:2749] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.990077 16088 leader_election.cc:304] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:52.990985 16563 raft_consensus.cc:2804] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.991377 16563 raft_consensus.cc:493] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.991710 16563 raft_consensus.cc:3060] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.999491 16319 tablet_bootstrap.cc:492] T aaaad334dede46d888c92db5c932655e P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:53.000062 16322 raft_consensus.cc:493] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.000571 16322 raft_consensus.cc:515] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:52.999831 16403 consensus_queue.cc:1048] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.004808 16342 raft_consensus.cc:493] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.005303 16342 raft_consensus.cc:515] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:53.006393 16545 consensus_queue.cc:1048] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.010324 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac8a97b1adc49389919710edf7c5e03" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:53.011207 16121 raft_consensus.cc:2393] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 in current term 1: Already voted for candidate ec8b54f5a9e44f428a4d537391138dcf in this term.
I20260709 13:04:53.010638 16319 tablet_bootstrap.cc:654] T aaaad334dede46d888c92db5c932655e P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.019797 16320 tablet_bootstrap.cc:492] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:53.020393 16320 ts_tablet_manager.cc:1403] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.300s	user 0.020s	sys 0.011s
I20260709 13:04:52.994831 16272 raft_consensus.cc:2468] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:53.008949 16342 leader_election.cc:290] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:53.010370 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48faa67625c143aa8ce08eb068a3a8dc" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:53.005736 16322 leader_election.cc:290] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:53.025607 16048 raft_consensus.cc:2468] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:53.029186 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eede189c87343c6a45e71d7cb23c41d" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:53.029947 16194 raft_consensus.cc:2468] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:53.030092 16236 leader_election.cc:304] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:53.021502 16271 raft_consensus.cc:2468] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:53.032375 16320 raft_consensus.cc:359] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:53.033146 16320 raft_consensus.cc:385] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.033413 16320 raft_consensus.cc:740] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.033576 16316 tablet_bootstrap.cc:654] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.034207 16320 consensus_queue.cc:260] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:53.034729 16163 leader_election.cc:304] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:53.035943 16519 raft_consensus.cc:2804] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.036425 16519 raft_consensus.cc:697] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:53.036607 16545 raft_consensus.cc:2804] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.037153 16545 raft_consensus.cc:493] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.020974 16563 raft_consensus.cc:515] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.037544 16545 raft_consensus.cc:3060] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.038002 16519 consensus_queue.cc:237] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:53.040257 16563 leader_election.cc:290] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:53.041290 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac8a97b1adc49389919710edf7c5e03" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:53.041532 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eede189c87343c6a45e71d7cb23c41d" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:53.045207 16320 ts_tablet_manager.cc:1434] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:04:53.049369 16317 tablet_bootstrap.cc:492] T c32eb3a1727b42348bb90a85f5f0e419 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:53.050086 16317 ts_tablet_manager.cc:1403] T c32eb3a1727b42348bb90a85f5f0e419 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.184s	user 0.017s	sys 0.004s
I20260709 13:04:53.066519 16320 tablet_bootstrap.cc:492] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:53.073551 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48faa67625c143aa8ce08eb068a3a8dc" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:53.073421 16396 consensus_queue.cc:1048] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:04:53.076433 16320 tablet_bootstrap.cc:654] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.063266 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eede189c87343c6a45e71d7cb23c41d" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:53.077296 16046 raft_consensus.cc:3060] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.077991 16317 raft_consensus.cc:359] T c32eb3a1727b42348bb90a85f5f0e419 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:53.078733 16317 raft_consensus.cc:385] T c32eb3a1727b42348bb90a85f5f0e419 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.079018 16317 raft_consensus.cc:740] T c32eb3a1727b42348bb90a85f5f0e419 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.080386 16317 consensus_queue.cc:260] T c32eb3a1727b42348bb90a85f5f0e419 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:53.082374 16237 leader_election.cc:304] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:53.083441 16317 ts_tablet_manager.cc:1434] T c32eb3a1727b42348bb90a85f5f0e419 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260709 13:04:53.084587 16317 tablet_bootstrap.cc:492] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:53.057366 16194 raft_consensus.cc:3060] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.093689 16322 raft_consensus.cc:3060] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.095697 15946 catalog_manager.cc:5697] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.107548 16545 raft_consensus.cc:515] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:53.121713 16387 raft_consensus.cc:493] T c32eb3a1727b42348bb90a85f5f0e419 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.122506 16387 raft_consensus.cc:515] T c32eb3a1727b42348bb90a85f5f0e419 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:53.123503 16545 leader_election.cc:290] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:53.127758 16387 leader_election.cc:290] T c32eb3a1727b42348bb90a85f5f0e419 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:53.128842 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48faa67625c143aa8ce08eb068a3a8dc" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:53.130115 16049 raft_consensus.cc:3060] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:53.133699 16237 leader_election.cc:343] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.134404 16322 raft_consensus.cc:2749] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:53.128005 16194 raft_consensus.cc:2468] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:53.138304 16089 leader_election.cc:304] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:53.139778 16403 raft_consensus.cc:493] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.140599 16403 raft_consensus.cc:515] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:53.140880 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32eb3a1727b42348bb90a85f5f0e419" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:53.141610 16196 raft_consensus.cc:2468] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:53.142793 16403 leader_election.cc:290] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:53.143375 16396 raft_consensus.cc:493] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.143926 16396 raft_consensus.cc:515] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:53.144985 16317 tablet_bootstrap.cc:654] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.139328 16391 raft_consensus.cc:2804] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.149446 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48faa67625c143aa8ce08eb068a3a8dc" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:53.153919 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32eb3a1727b42348bb90a85f5f0e419" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:53.154592 16270 raft_consensus.cc:2468] T c32eb3a1727b42348bb90a85f5f0e419 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:53.153705 15945 catalog_manager.cc:5697] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.155655 16391 raft_consensus.cc:697] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:04:53.147599 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32eb3a1727b42348bb90a85f5f0e419" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:53.156581 16391 consensus_queue.cc:237] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.146329 16396 leader_election.cc:290] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:53.161494 16319 tablet_bootstrap.cc:492] T aaaad334dede46d888c92db5c932655e P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:53.149605 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32eb3a1727b42348bb90a85f5f0e419" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:53.164157 16319 ts_tablet_manager.cc:1403] T aaaad334dede46d888c92db5c932655e P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.165s	user 0.024s	sys 0.002s
I20260709 13:04:53.164513 16163 leader_election.cc:304] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:53.169454 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44eefc0f2e540b99fa97ec775185660" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:53.164397 16123 raft_consensus.cc:2468] T c32eb3a1727b42348bb90a85f5f0e419 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:53.170987 16396 raft_consensus.cc:2804] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.171486 16396 raft_consensus.cc:493] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.171854 16396 raft_consensus.cc:3060] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.178694 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44eefc0f2e540b99fa97ec775185660" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:53.179603 16270 raft_consensus.cc:2393] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf in current term 1: Already voted for candidate e1e05442c5b44a079dd1de9dd124c990 in this term.
I20260709 13:04:53.160195 16403 consensus_queue.cc:1048] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:04:53.184585 16320 tablet_bootstrap.cc:492] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:53.185127 16320 ts_tablet_manager.cc:1403] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.119s	user 0.012s	sys 0.002s
I20260709 13:04:53.186229 16014 leader_election.cc:304] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:53.187860 16404 raft_consensus.cc:3060] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:53.198915 16237 leader_election.cc:343] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.203922 16049 raft_consensus.cc:2468] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:53.194942 16320 raft_consensus.cc:359] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:53.207276 16320 raft_consensus.cc:385] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.208936 16320 raft_consensus.cc:740] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.218276 16320 consensus_queue.cc:260] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:53.208137 16236 leader_election.cc:304] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4
I20260709 13:04:53.219658 16545 raft_consensus.cc:2804] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.211789 16046 raft_consensus.cc:2468] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:53.182889 16396 raft_consensus.cc:515] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:53.220160 16545 raft_consensus.cc:697] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:53.221033 16545 consensus_queue.cc:237] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:53.213537 16519 consensus_queue.cc:1048] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.224009 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32eb3a1727b42348bb90a85f5f0e419" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:53.224469 16320 ts_tablet_manager.cc:1434] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:04:53.224701 16272 raft_consensus.cc:3060] T c32eb3a1727b42348bb90a85f5f0e419 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.225073 16396 leader_election.cc:290] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:53.225582 16320 tablet_bootstrap.cc:492] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:53.228137 16317 tablet_bootstrap.cc:492] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:53.213546 16319 raft_consensus.cc:359] T aaaad334dede46d888c92db5c932655e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.228688 16317 ts_tablet_manager.cc:1403] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.144s	user 0.007s	sys 0.004s
I20260709 13:04:53.215049 16316 tablet_bootstrap.cc:492] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:53.229559 16316 ts_tablet_manager.cc:1403] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.255s	user 0.013s	sys 0.011s
I20260709 13:04:53.228865 16319 raft_consensus.cc:385] T aaaad334dede46d888c92db5c932655e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.234983 16403 consensus_queue.cc:1048] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:53.200716 16237 leader_election.cc:304] T c32eb3a1727b42348bb90a85f5f0e419 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:04:53.234922 16317 raft_consensus.cc:359] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.236286 16317 raft_consensus.cc:385] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.236114 16316 raft_consensus.cc:359] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:53.236691 16317 raft_consensus.cc:740] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.235296 16319 raft_consensus.cc:740] T aaaad334dede46d888c92db5c932655e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.237928 16317 consensus_queue.cc:260] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.236899 16316 raft_consensus.cc:385] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.239531 16319 consensus_queue.cc:260] T aaaad334dede46d888c92db5c932655e P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.240237 16316 raft_consensus.cc:740] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.242110 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32eb3a1727b42348bb90a85f5f0e419" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:53.242750 16121 raft_consensus.cc:3060] T c32eb3a1727b42348bb90a85f5f0e419 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.242954 16316 consensus_queue.cc:260] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:53.246073 16316 ts_tablet_manager.cc:1434] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:04:53.247130 16316 tablet_bootstrap.cc:492] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:53.222059 15946 catalog_manager.cc:5697] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.244208 16317 ts_tablet_manager.cc:1434] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.002s
I20260709 13:04:53.251338 16317 tablet_bootstrap.cc:492] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:53.253312 16322 raft_consensus.cc:493] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.253856 16322 raft_consensus.cc:515] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:53.256299 16322 leader_election.cc:290] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:53.215850 16404 raft_consensus.cc:2749] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:53.261298 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f21b3c8be8f42be9186b827a2a086e3" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
W20260709 13:04:53.263312 16236 leader_election.cc:343] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.267534 16316 tablet_bootstrap.cc:654] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.268095 16319 ts_tablet_manager.cc:1434] T aaaad334dede46d888c92db5c932655e P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.103s	user 0.006s	sys 0.002s
I20260709 13:04:53.261565 16404 consensus_queue.cc:1048] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:04:53.273794 16319 tablet_bootstrap.cc:492] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:53.241070 16272 raft_consensus.cc:2468] T c32eb3a1727b42348bb90a85f5f0e419 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:53.277992 16387 raft_consensus.cc:2764] T c32eb3a1727b42348bb90a85f5f0e419 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:04:53.282254 16316 tablet_bootstrap.cc:492] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:53.282753 16316 ts_tablet_manager.cc:1403] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.000s
I20260709 13:04:53.283557 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f21b3c8be8f42be9186b827a2a086e3" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
W20260709 13:04:53.289197 16237 leader_election.cc:343] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.289692 16237 leader_election.cc:304] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:53.290416 16342 raft_consensus.cc:2749] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:53.291791 16320 tablet_bootstrap.cc:654] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.296285 16316 raft_consensus.cc:359] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:53.297070 16316 raft_consensus.cc:385] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.297369 16316 raft_consensus.cc:740] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.298252 16163 leader_election.cc:304] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:53.298167 16316 consensus_queue.cc:260] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:53.299436 16480 raft_consensus.cc:2804] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.299955 16480 raft_consensus.cc:697] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:53.300923 16316 ts_tablet_manager.cc:1434] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:04:53.300772 16480 consensus_queue.cc:237] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:53.302690 16316 tablet_bootstrap.cc:492] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:53.275484 16317 tablet_bootstrap.cc:654] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.325201 16319 tablet_bootstrap.cc:654] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.329943 16316 tablet_bootstrap.cc:654] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.321316 15945 catalog_manager.cc:5697] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 1 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.341989 16320 tablet_bootstrap.cc:492] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:53.342639 16320 ts_tablet_manager.cc:1403] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.117s	user 0.010s	sys 0.008s
I20260709 13:04:53.346055 16320 raft_consensus.cc:359] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.346954 16320 raft_consensus.cc:385] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.347254 16320 raft_consensus.cc:740] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.348953 16320 consensus_queue.cc:260] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.354008 16320 ts_tablet_manager.cc:1434] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:04:53.355120 16320 tablet_bootstrap.cc:492] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:53.355197 15946 catalog_manager.cc:5697] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.358072 16121 raft_consensus.cc:2468] T c32eb3a1727b42348bb90a85f5f0e419 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:53.379559 16319 tablet_bootstrap.cc:492] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:53.380152 16319 ts_tablet_manager.cc:1403] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.107s	user 0.010s	sys 0.000s
I20260709 13:04:53.383121 16319 raft_consensus.cc:359] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:53.383930 16316 tablet_bootstrap.cc:492] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:53.386318 16319 raft_consensus.cc:385] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.386574 16316 ts_tablet_manager.cc:1403] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.084s	user 0.010s	sys 0.003s
I20260709 13:04:53.387141 16565 consensus_queue.cc:1048] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.385537 16391 raft_consensus.cc:493] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.386597 16319 raft_consensus.cc:740] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.390115 16319 consensus_queue.cc:260] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:53.389353 16391 raft_consensus.cc:515] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.394984 16316 raft_consensus.cc:359] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:53.395783 16316 raft_consensus.cc:385] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.396075 16316 raft_consensus.cc:740] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.399483 16391 leader_election.cc:290] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:53.401754 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaad334dede46d888c92db5c932655e" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:53.402482 16196 raft_consensus.cc:2468] T aaaad334dede46d888c92db5c932655e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:53.403627 16316 consensus_queue.cc:260] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:53.405440 16089 leader_election.cc:304] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:53.405687 16316 ts_tablet_manager.cc:1434] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:04:53.406865 16316 tablet_bootstrap.cc:492] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:53.409332 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaad334dede46d888c92db5c932655e" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:53.410032 16046 raft_consensus.cc:2468] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:53.416169 16391 raft_consensus.cc:2804] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.416646 16391 raft_consensus.cc:493] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.418073 16391 raft_consensus.cc:3060] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.429527 16317 tablet_bootstrap.cc:492] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:53.430161 16317 ts_tablet_manager.cc:1403] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.179s	user 0.008s	sys 0.007s
I20260709 13:04:53.433809 16317 raft_consensus.cc:359] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:53.434530 16317 raft_consensus.cc:385] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.434859 16317 raft_consensus.cc:740] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.435288 16387 raft_consensus.cc:493] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.435838 16387 raft_consensus.cc:515] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:53.436369 16319 ts_tablet_manager.cc:1434] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.002s
I20260709 13:04:53.437150 16565 consensus_queue.cc:1048] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.436369 16316 tablet_bootstrap.cc:654] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.438210 16320 tablet_bootstrap.cc:654] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.438836 16545 raft_consensus.cc:493] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.439364 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98ba329bddb47c5aec148957811a4c2" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:53.439319 16545 raft_consensus.cc:515] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:53.442004 16545 leader_election.cc:290] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:53.443907 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c600c8f1ec454bc0b4a3716ea85d8499" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:53.444705 16046 raft_consensus.cc:2468] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:53.446607 16236 leader_election.cc:304] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:53.447608 16545 raft_consensus.cc:2804] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.437860 16319 tablet_bootstrap.cc:492] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:53.435534 16317 consensus_queue.cc:260] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
W20260709 13:04:53.449939 16237 leader_election.cc:343] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.448062 16545 raft_consensus.cc:493] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.455763 16545 raft_consensus.cc:3060] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.467407 16317 ts_tablet_manager.cc:1434] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
W20260709 13:04:53.467746 15994 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:53.464926 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c600c8f1ec454bc0b4a3716ea85d8499" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:53.432531 16391 raft_consensus.cc:515] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.478296 16387 leader_election.cc:290] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:53.485962 16316 tablet_bootstrap.cc:492] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:53.486465 16316 ts_tablet_manager.cc:1403] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.004s
W20260709 13:04:53.489355 16237 leader_election.cc:343] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.489621 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98ba329bddb47c5aec148957811a4c2" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
W20260709 13:04:53.492620 16237 leader_election.cc:343] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.493057 16237 leader_election.cc:304] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:53.494076 16586 raft_consensus.cc:2749] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:53.496937 16317 tablet_bootstrap.cc:492] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:53.498070 16545 raft_consensus.cc:515] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:53.498360 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaad334dede46d888c92db5c932655e" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:53.500761 16049 raft_consensus.cc:3060] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.501151 16545 leader_election.cc:290] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:53.503693 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c600c8f1ec454bc0b4a3716ea85d8499" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
W20260709 13:04:53.505053 16237 leader_election.cc:343] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.506325 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c600c8f1ec454bc0b4a3716ea85d8499" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:53.506978 16046 raft_consensus.cc:3060] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.517797 16319 tablet_bootstrap.cc:654] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.518026 16049 raft_consensus.cc:2468] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:53.520723 16088 leader_election.cc:304] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:53.521763 16565 raft_consensus.cc:2804] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.522356 16391 leader_election.cc:290] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:53.519411 16320 tablet_bootstrap.cc:492] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:53.522675 16565 raft_consensus.cc:697] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:04:53.534830 16565 consensus_queue.cc:237] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.529006 16480 consensus_queue.cc:1048] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:04:53.528366 16317 tablet_bootstrap.cc:654] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.523940 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaad334dede46d888c92db5c932655e" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:53.519201 16046 raft_consensus.cc:2468] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:53.540757 16194 raft_consensus.cc:3060] T aaaad334dede46d888c92db5c932655e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.548273 16480 raft_consensus.cc:493] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.548862 16480 raft_consensus.cc:515] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:53.549098 16236 leader_election.cc:304] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4
I20260709 13:04:53.543965 16320 ts_tablet_manager.cc:1403] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.189s	user 0.011s	sys 0.012s
I20260709 13:04:53.552119 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f21b3c8be8f42be9186b827a2a086e3" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:53.552794 16271 raft_consensus.cc:2468] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:53.554652 16163 leader_election.cc:304] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:53.557510 16396 raft_consensus.cc:2804] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.557955 16396 raft_consensus.cc:493] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.558270 16396 raft_consensus.cc:3060] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.558305 16320 raft_consensus.cc:359] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:53.558935 16320 raft_consensus.cc:385] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.559105 16320 raft_consensus.cc:740] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.559636 16320 consensus_queue.cc:260] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:53.542496 16316 raft_consensus.cc:359] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:53.561296 16316 raft_consensus.cc:385] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.561414 16320 ts_tablet_manager.cc:1434] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:53.561606 16316 raft_consensus.cc:740] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.562352 16316 consensus_queue.cc:260] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:53.563077 16545 raft_consensus.cc:2804] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.561455 16194 raft_consensus.cc:2468] T aaaad334dede46d888c92db5c932655e P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:53.563541 16545 raft_consensus.cc:697] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:53.564347 16316 ts_tablet_manager.cc:1434] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.078s	user 0.002s	sys 0.003s
I20260709 13:04:53.564446 16545 consensus_queue.cc:237] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:53.565580 16316 tablet_bootstrap.cc:492] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:53.567230 16317 tablet_bootstrap.cc:492] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:53.567719 16317 ts_tablet_manager.cc:1403] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.000s
I20260709 13:04:53.568734 16480 leader_election.cc:290] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:53.570533 16319 tablet_bootstrap.cc:492] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:53.571046 16319 ts_tablet_manager.cc:1403] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.134s	user 0.021s	sys 0.013s
I20260709 13:04:53.571590 16317 raft_consensus.cc:359] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.572319 16317 raft_consensus.cc:385] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.572570 16317 raft_consensus.cc:740] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.573403 16317 consensus_queue.cc:260] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.573729 16319 raft_consensus.cc:359] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:53.574523 16319 raft_consensus.cc:385] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.574788 16319 raft_consensus.cc:740] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.575479 16319 consensus_queue.cc:260] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:53.577040 16319 ts_tablet_manager.cc:1434] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:53.578527 16396 raft_consensus.cc:515] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:53.581902 16316 tablet_bootstrap.cc:654] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.580559 16317 ts_tablet_manager.cc:1434] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:04:53.583860 16319 tablet_bootstrap.cc:492] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:53.593998 16319 tablet_bootstrap.cc:654] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.595841 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f21b3c8be8f42be9186b827a2a086e3" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:53.596715 16046 raft_consensus.cc:2468] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:53.599982 16480 consensus_queue.cc:1048] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.605335 16317 tablet_bootstrap.cc:492] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:53.609603 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f21b3c8be8f42be9186b827a2a086e3" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:53.610574 16271 raft_consensus.cc:3060] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.613425 16396 leader_election.cc:290] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:53.614720 16045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f21b3c8be8f42be9186b827a2a086e3" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:53.615406 16045 raft_consensus.cc:3060] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.617580 16317 tablet_bootstrap.cc:654] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.626652 16045 raft_consensus.cc:2468] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:53.631213 16162 leader_election.cc:304] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:53.632777 16602 raft_consensus.cc:2804] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.633636 16602 raft_consensus.cc:697] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:53.634657 16602 consensus_queue.cc:237] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:53.642158 16405 raft_consensus.cc:493] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.642951 16405 raft_consensus.cc:515] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.646814 15943 catalog_manager.cc:5697] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.650372 16387 consensus_queue.cc:1048] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:53.653648 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a26858ecdea24ad9bb9b64ee8d133dd2" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:53.656404 16396 raft_consensus.cc:493] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:53.656759 16014 leader_election.cc:343] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.657191 16396 raft_consensus.cc:515] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:53.661024 16405 leader_election.cc:290] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:53.661610 16396 leader_election.cc:290] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:53.663414 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a26858ecdea24ad9bb9b64ee8d133dd2" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:53.664341 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98ba329bddb47c5aec148957811a4c2" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:53.665285 16272 raft_consensus.cc:2468] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
W20260709 13:04:53.665541 16014 leader_election.cc:343] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.666141 16014 leader_election.cc:304] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:53.667112 16163 leader_election.cc:304] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:53.668401 16480 raft_consensus.cc:2804] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.668826 16403 raft_consensus.cc:2749] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:53.668859 16480 raft_consensus.cc:493] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.670228 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98ba329bddb47c5aec148957811a4c2" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:53.670544 16480 raft_consensus.cc:3060] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.676561 16563 raft_consensus.cc:493] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.677425 16563 raft_consensus.cc:515] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
W20260709 13:04:53.680092 16163 leader_election.cc:343] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.684345 16563 leader_election.cc:290] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:53.689540 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48faa67625c143aa8ce08eb068a3a8dc" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:53.690518 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48faa67625c143aa8ce08eb068a3a8dc" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:53.698921 16088 leader_election.cc:304] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:53.712363 16271 raft_consensus.cc:2468] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
W20260709 13:04:53.718283 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 85214.2us
I20260709 13:04:53.720108 16563 raft_consensus.cc:2749] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:53.766978 16391 consensus_queue.cc:1048] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:53.767920 16382 consensus_queue.cc:1048] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.771245 16610 consensus_queue.cc:1048] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.774082 16121 raft_consensus.cc:3060] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.722118 16320 tablet_bootstrap.cc:492] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:53.722702 16317 tablet_bootstrap.cc:492] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:53.747126 16322 raft_consensus.cc:493] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.725709 16480 raft_consensus.cc:515] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:53.749277 15946 catalog_manager.cc:5697] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.781479 16322 raft_consensus.cc:515] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:53.783849 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98ba329bddb47c5aec148957811a4c2" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:53.784374 16480 leader_election.cc:290] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:53.784945 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98ba329bddb47c5aec148957811a4c2" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:53.787058 16342 raft_consensus.cc:493] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.788779 16317 ts_tablet_manager.cc:1403] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.184s	user 0.078s	sys 0.024s
W20260709 13:04:53.788928 16163 leader_election.cc:343] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.790414 16272 raft_consensus.cc:3060] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.788893 16342 raft_consensus.cc:515] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:53.784833 16322 leader_election.cc:290] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:53.796121 16342 leader_election.cc:290] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:53.798471 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d457e5782e42e78f4b0978f2b41dac" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:53.800004 16322 consensus_queue.cc:1048] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.792577 16317 raft_consensus.cc:359] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.807507 16317 raft_consensus.cc:385] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.807934 16317 raft_consensus.cc:740] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.808893 16317 consensus_queue.cc:260] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.810263 16045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3808fd28794c4ce098037730316b2e58" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
W20260709 13:04:53.812780 16236 leader_election.cc:343] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:53.813910 16236 leader_election.cc:343] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.819609 15945 catalog_manager.cc:5697] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 1 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.822151 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3808fd28794c4ce098037730316b2e58" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:53.825398 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d457e5782e42e78f4b0978f2b41dac" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:53.828991 16317 ts_tablet_manager.cc:1434] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:04:53.830344 16317 tablet_bootstrap.cc:492] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:53.833009 16316 tablet_bootstrap.cc:492] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:53.833587 16316 ts_tablet_manager.cc:1403] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.268s	user 0.025s	sys 0.072s
I20260709 13:04:53.840056 16320 tablet_bootstrap.cc:654] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.841935 16319 tablet_bootstrap.cc:492] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:53.842496 16319 ts_tablet_manager.cc:1403] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.259s	user 0.046s	sys 0.050s
I20260709 13:04:53.836551 16316 raft_consensus.cc:359] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:53.845670 16316 raft_consensus.cc:385] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.845981 16316 raft_consensus.cc:740] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.848320 16316 consensus_queue.cc:260] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:53.858173 16316 ts_tablet_manager.cc:1434] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 13:04:53.855261 16319 raft_consensus.cc:359] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.858899 16319 raft_consensus.cc:385] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.859208 16319 raft_consensus.cc:740] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.860085 16319 consensus_queue.cc:260] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.862252 16319 ts_tablet_manager.cc:1434] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:04:53.862655 16317 tablet_bootstrap.cc:654] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.863314 16319 tablet_bootstrap.cc:492] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:53.864421 16316 tablet_bootstrap.cc:492] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
W20260709 13:04:53.870604 16237 leader_election.cc:343] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.871042 16237 leader_election.cc:304] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:53.871652 16322 raft_consensus.cc:2749] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:53.871837 16237 leader_election.cc:343] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.883412 16237 leader_election.cc:304] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:53.884460 16272 raft_consensus.cc:2468] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:53.884876 16545 raft_consensus.cc:2749] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:53.885417 16480 consensus_queue.cc:1048] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:53.892444 16163 leader_election.cc:304] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4
I20260709 13:04:53.898375 16610 raft_consensus.cc:2804] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.898867 16610 raft_consensus.cc:697] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:53.899784 16563 raft_consensus.cc:493] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.899657 16610 consensus_queue.cc:237] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:53.900300 16563 raft_consensus.cc:515] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.902540 16563 leader_election.cc:290] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:53.911597 16563 raft_consensus.cc:493] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.912177 16563 raft_consensus.cc:515] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.914467 16563 leader_election.cc:290] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:53.917222 16320 tablet_bootstrap.cc:492] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:53.917812 16320 ts_tablet_manager.cc:1403] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.196s	user 0.022s	sys 0.008s
I20260709 13:04:53.918727 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb3d9bac364b43abf555b36674a82e" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:53.919992 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb3d9bac364b43abf555b36674a82e" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:53.923496 16319 tablet_bootstrap.cc:654] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:53.924288 16089 leader_election.cc:343] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.927057 16316 tablet_bootstrap.cc:654] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:53.929379 16088 leader_election.cc:343] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.929884 16088 leader_election.cc:304] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:53.930575 16320 raft_consensus.cc:359] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:53.930980 16391 raft_consensus.cc:2749] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:53.931324 16320 raft_consensus.cc:385] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.931663 16320 raft_consensus.cc:740] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.932339 16320 consensus_queue.cc:260] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:53.933951 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a26858ecdea24ad9bb9b64ee8d133dd2" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:53.934670 16196 raft_consensus.cc:2468] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:53.935822 16089 leader_election.cc:304] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:53.936080 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a26858ecdea24ad9bb9b64ee8d133dd2" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:53.936654 16391 raft_consensus.cc:2804] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.936879 16048 raft_consensus.cc:2468] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:53.937047 16391 raft_consensus.cc:493] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.937595 16391 raft_consensus.cc:3060] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.937673 16320 ts_tablet_manager.cc:1434] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:04:53.939174 16320 tablet_bootstrap.cc:492] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:53.948804 16320 tablet_bootstrap.cc:654] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.949069 16317 tablet_bootstrap.cc:492] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:53.949615 16317 ts_tablet_manager.cc:1403] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.120s	user 0.014s	sys 0.004s
I20260709 13:04:53.951005 16316 tablet_bootstrap.cc:492] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:53.951536 16316 ts_tablet_manager.cc:1403] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.087s	user 0.006s	sys 0.004s
I20260709 13:04:53.952358 16317 raft_consensus.cc:359] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:53.953110 16317 raft_consensus.cc:385] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.953406 16317 raft_consensus.cc:740] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.954030 16317 consensus_queue.cc:260] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:53.954870 16391 raft_consensus.cc:515] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.957963 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a26858ecdea24ad9bb9b64ee8d133dd2" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:53.958484 16048 raft_consensus.cc:3060] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.959388 16319 tablet_bootstrap.cc:492] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:53.963835 16319 ts_tablet_manager.cc:1403] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.101s	user 0.011s	sys 0.001s
I20260709 13:04:53.966794 16319 raft_consensus.cc:359] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.967478 16319 raft_consensus.cc:385] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.967509 16317 ts_tablet_manager.cc:1434] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:04:53.967810 16319 raft_consensus.cc:740] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.969419 16317 tablet_bootstrap.cc:492] T 5e6e04804ef846e8b828194d87904eaa P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:53.973299 16319 consensus_queue.cc:260] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:53.954300 16316 raft_consensus.cc:359] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:53.974787 16316 raft_consensus.cc:385] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.975129 16316 raft_consensus.cc:740] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.975912 16316 consensus_queue.cc:260] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:53.978061 16316 ts_tablet_manager.cc:1434] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:04:53.984258 16319 ts_tablet_manager.cc:1434] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:04:53.986056 16319 tablet_bootstrap.cc:492] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:53.986568 16317 tablet_bootstrap.cc:654] T 5e6e04804ef846e8b828194d87904eaa P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.988263 15944 catalog_manager.cc:5697] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.994364 16382 consensus_queue.cc:1048] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:53.996933 16319 tablet_bootstrap.cc:654] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.996671 16563 consensus_queue.cc:1048] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:53.994591 16391 leader_election.cc:290] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:53.994340 16048 raft_consensus.cc:2468] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:53.999186 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a26858ecdea24ad9bb9b64ee8d133dd2" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:53.999823 16196 raft_consensus.cc:3060] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.999990 16088 leader_election.cc:304] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:54.000864 16563 raft_consensus.cc:2804] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.001049 16316 tablet_bootstrap.cc:492] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:54.003124 16563 raft_consensus.cc:697] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:04:54.004051 16563 consensus_queue.cc:237] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:54.007822 16316 tablet_bootstrap.cc:654] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.016999 16196 raft_consensus.cc:2468] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
W20260709 13:04:54.041144 16237 consensus_peers.cc:597] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:54.042021 16565 raft_consensus.cc:493] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.042563 16565 raft_consensus.cc:515] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:54.044691 16565 leader_election.cc:290] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:54.047277 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98ba329bddb47c5aec148957811a4c2" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:54.047639 16320 tablet_bootstrap.cc:492] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:54.048146 16271 raft_consensus.cc:2393] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 in current term 1: Already voted for candidate e1e05442c5b44a079dd1de9dd124c990 in this term.
I20260709 13:04:54.048219 16320 ts_tablet_manager.cc:1403] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.109s	user 0.014s	sys 0.009s
I20260709 13:04:54.049947 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98ba329bddb47c5aec148957811a4c2" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:54.051115 16320 raft_consensus.cc:359] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:54.051826 16320 raft_consensus.cc:385] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.052078 16320 raft_consensus.cc:740] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.052958 16320 consensus_queue.cc:260] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:54.053450 16089 leader_election.cc:304] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:54.054771 16320 ts_tablet_manager.cc:1434] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:04:54.055428 16565 raft_consensus.cc:3060] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.055779 16320 tablet_bootstrap.cc:492] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:54.056610 15946 catalog_manager.cc:5697] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:54.063032 16320 tablet_bootstrap.cc:654] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.065419 16565 raft_consensus.cc:2749] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.068208 16317 tablet_bootstrap.cc:492] T 5e6e04804ef846e8b828194d87904eaa P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:54.070521 16317 ts_tablet_manager.cc:1403] T 5e6e04804ef846e8b828194d87904eaa P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.101s	user 0.004s	sys 0.013s
I20260709 13:04:54.073519 16319 tablet_bootstrap.cc:492] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:54.074268 16319 ts_tablet_manager.cc:1403] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.088s	user 0.007s	sys 0.014s
I20260709 13:04:54.079532 16319 raft_consensus.cc:359] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:54.080402 16319 raft_consensus.cc:385] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.080717 16319 raft_consensus.cc:740] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.070894 16316 tablet_bootstrap.cc:492] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:54.081748 16316 ts_tablet_manager.cc:1403] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.001s
I20260709 13:04:54.091907 16317 raft_consensus.cc:359] T 5e6e04804ef846e8b828194d87904eaa P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:54.092623 16317 raft_consensus.cc:385] T 5e6e04804ef846e8b828194d87904eaa P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.092890 16317 raft_consensus.cc:740] T 5e6e04804ef846e8b828194d87904eaa P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.093564 16317 consensus_queue.cc:260] T 5e6e04804ef846e8b828194d87904eaa P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:54.095731 16317 ts_tablet_manager.cc:1434] T 5e6e04804ef846e8b828194d87904eaa P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
I20260709 13:04:54.096992 16317 tablet_bootstrap.cc:492] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:54.097237 16319 consensus_queue.cc:260] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:54.103353 16319 ts_tablet_manager.cc:1434] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:04:54.104626 16319 tablet_bootstrap.cc:492] T 5e6e04804ef846e8b828194d87904eaa P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:54.105552 16317 tablet_bootstrap.cc:654] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.105624 16316 raft_consensus.cc:359] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:54.106621 16316 raft_consensus.cc:385] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.106968 16316 raft_consensus.cc:740] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.114343 16319 tablet_bootstrap.cc:654] T 5e6e04804ef846e8b828194d87904eaa P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.117453 16316 consensus_queue.cc:260] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:54.120474 16316 ts_tablet_manager.cc:1434] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.006s
I20260709 13:04:54.122283 16316 tablet_bootstrap.cc:492] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:54.129258 16316 tablet_bootstrap.cc:654] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.132584 16317 tablet_bootstrap.cc:492] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:54.133198 16317 ts_tablet_manager.cc:1403] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.007s
I20260709 13:04:54.136443 16317 raft_consensus.cc:359] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:54.137373 16317 raft_consensus.cc:385] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.137639 16317 raft_consensus.cc:740] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.138859 16317 consensus_queue.cc:260] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:54.139330 16404 raft_consensus.cc:493] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.140041 16404 raft_consensus.cc:515] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:54.141188 16317 ts_tablet_manager.cc:1434] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:04:54.142326 16317 tablet_bootstrap.cc:492] T c600c8f1ec454bc0b4a3716ea85d8499 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:54.143350 16404 leader_election.cc:290] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:54.147908 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c51469e614423d8a9cc50e024cf468" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:54.148355 16317 tablet_bootstrap.cc:654] T c600c8f1ec454bc0b4a3716ea85d8499 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.150218 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c51469e614423d8a9cc50e024cf468" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
W20260709 13:04:54.151469 16014 leader_election.cc:343] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:54.152033 16014 leader_election.cc:343] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.152412 16014 leader_election.cc:304] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:54.153025 16404 raft_consensus.cc:2749] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.161131 16342 consensus_queue.cc:1048] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:54.168669 16317 tablet_bootstrap.cc:492] T c600c8f1ec454bc0b4a3716ea85d8499 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:54.169287 16317 ts_tablet_manager.cc:1403] T c600c8f1ec454bc0b4a3716ea85d8499 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.027s	user 0.003s	sys 0.008s
I20260709 13:04:54.170156 16319 tablet_bootstrap.cc:492] T 5e6e04804ef846e8b828194d87904eaa P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:54.170859 16319 ts_tablet_manager.cc:1403] T 5e6e04804ef846e8b828194d87904eaa P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.010s
I20260709 13:04:54.171044 16610 raft_consensus.cc:493] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.171638 16610 raft_consensus.cc:515] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:54.172883 16317 raft_consensus.cc:359] T c600c8f1ec454bc0b4a3716ea85d8499 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:54.173290 16320 tablet_bootstrap.cc:492] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:54.179827 16316 tablet_bootstrap.cc:492] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:54.180334 16316 ts_tablet_manager.cc:1403] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.008s
I20260709 13:04:54.173619 16317 raft_consensus.cc:385] T c600c8f1ec454bc0b4a3716ea85d8499 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.175208 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3808fd28794c4ce098037730316b2e58" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:54.182660 16317 raft_consensus.cc:740] T c600c8f1ec454bc0b4a3716ea85d8499 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.182948 16271 raft_consensus.cc:2468] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:54.183058 16316 raft_consensus.cc:359] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:54.183780 16316 raft_consensus.cc:385] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.184124 16316 raft_consensus.cc:740] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.178303 16320 ts_tablet_manager.cc:1403] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.123s	user 0.022s	sys 0.039s
I20260709 13:04:54.184238 16163 leader_election.cc:304] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:54.185249 16602 raft_consensus.cc:2804] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.185462 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3808fd28794c4ce098037730316b2e58" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:54.185693 16602 raft_consensus.cc:493] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.186168 16048 raft_consensus.cc:2468] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:54.183451 16317 consensus_queue.cc:260] T c600c8f1ec454bc0b4a3716ea85d8499 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:54.186112 16602 raft_consensus.cc:3060] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.188252 16317 ts_tablet_manager.cc:1434] T c600c8f1ec454bc0b4a3716ea85d8499 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:04:54.185957 16319 raft_consensus.cc:359] T 5e6e04804ef846e8b828194d87904eaa P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:54.188995 16319 raft_consensus.cc:385] T 5e6e04804ef846e8b828194d87904eaa P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.189342 16319 raft_consensus.cc:740] T 5e6e04804ef846e8b828194d87904eaa P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.189107 16320 raft_consensus.cc:359] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:54.189858 16320 raft_consensus.cc:385] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.190142 16320 raft_consensus.cc:740] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.184939 16316 consensus_queue.cc:260] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:54.190910 16320 consensus_queue.cc:260] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:54.192183 16609 consensus_queue.cc:1048] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.192569 16316 ts_tablet_manager.cc:1434] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:04:54.193858 16316 tablet_bootstrap.cc:492] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:54.183835 16610 leader_election.cc:290] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:54.190074 16319 consensus_queue.cc:260] T 5e6e04804ef846e8b828194d87904eaa P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:54.200309 16319 ts_tablet_manager.cc:1434] T 5e6e04804ef846e8b828194d87904eaa P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:04:54.200853 16316 tablet_bootstrap.cc:654] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.203788 16319 tablet_bootstrap.cc:492] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:54.218010 16317 tablet_bootstrap.cc:492] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:54.225485 16317 tablet_bootstrap.cc:654] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.229326 16320 ts_tablet_manager.cc:1434] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.003s
I20260709 13:04:54.232671 16602 raft_consensus.cc:515] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:54.230763 16320 tablet_bootstrap.cc:492] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:54.235809 16316 tablet_bootstrap.cc:492] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:54.236352 16316 ts_tablet_manager.cc:1403] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.007s
I20260709 13:04:54.236615 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3808fd28794c4ce098037730316b2e58" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:54.237300 16271 raft_consensus.cc:3060] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.241281 16545 raft_consensus.cc:493] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.241823 16545 raft_consensus.cc:515] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:54.243892 16316 raft_consensus.cc:359] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:54.244709 16316 raft_consensus.cc:385] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.244958 16316 raft_consensus.cc:740] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.245432 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:54.246120 16046 raft_consensus.cc:2468] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:54.247844 16236 leader_election.cc:304] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:54.249020 16342 raft_consensus.cc:2804] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.249584 16342 raft_consensus.cc:493] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.249770 16322 raft_consensus.cc:493] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.249951 16342 raft_consensus.cc:3060] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.250301 16322 raft_consensus.cc:515] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:54.251649 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:54.250670 16320 tablet_bootstrap.cc:654] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.252161 16322 leader_election.cc:290] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:54.252318 16123 raft_consensus.cc:2468] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:54.249253 16545 leader_election.cc:290] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:54.247815 16317 tablet_bootstrap.cc:492] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:54.257242 16317 ts_tablet_manager.cc:1403] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.007s
I20260709 13:04:54.257632 16602 leader_election.cc:290] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:54.258971 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589ea61d3c14d5da5f955ac6d719881" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:54.258916 16271 raft_consensus.cc:2468] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:54.260239 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3808fd28794c4ce098037730316b2e58" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:54.260871 16317 raft_consensus.cc:359] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
W20260709 13:04:54.267733 16237 leader_election.cc:343] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.280412 16317 raft_consensus.cc:385] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.280928 16317 raft_consensus.cc:740] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.266031 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589ea61d3c14d5da5f955ac6d719881" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:54.279598 16342 raft_consensus.cc:515] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:54.261253 16046 raft_consensus.cc:3060] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.245671 16316 consensus_queue.cc:260] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:54.287216 16317 consensus_queue.cc:260] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:54.290951 16046 raft_consensus.cc:2468] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:54.292462 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:54.307126 16047 raft_consensus.cc:3060] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.290195 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:54.294905 16342 leader_election.cc:290] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:54.309495 16123 raft_consensus.cc:3060] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.309773 16342 raft_consensus.cc:493] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.310479 16342 raft_consensus.cc:515] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:54.313146 16342 leader_election.cc:290] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:54.297582 16319 tablet_bootstrap.cc:654] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.305773 16317 ts_tablet_manager.cc:1434] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:04:54.324744 16317 tablet_bootstrap.cc:492] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:54.336683 16317 tablet_bootstrap.cc:654] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.262158 16163 leader_election.cc:304] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:54.351054 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6e04804ef846e8b828194d87904eaa" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:54.352136 16121 raft_consensus.cc:2468] T 5e6e04804ef846e8b828194d87904eaa P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:54.353252 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6e04804ef846e8b828194d87904eaa" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:54.354190 16196 raft_consensus.cc:2468] T 5e6e04804ef846e8b828194d87904eaa P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:54.356523 16319 tablet_bootstrap.cc:492] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:54.358968 16319 ts_tablet_manager.cc:1403] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.155s	user 0.013s	sys 0.002s
I20260709 13:04:54.359791 16545 raft_consensus.cc:493] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.360486 16545 raft_consensus.cc:515] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:54.362793 16319 raft_consensus.cc:359] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:54.364818 16545 leader_election.cc:290] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
W20260709 13:04:54.365012 16163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 102972us
I20260709 13:04:54.363830 16319 raft_consensus.cc:385] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.380005 16319 raft_consensus.cc:740] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.368064 16609 raft_consensus.cc:493] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.381681 16609 raft_consensus.cc:515] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:54.383760 16609 leader_election.cc:290] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:54.383960 16317 tablet_bootstrap.cc:492] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:54.384228 16123 raft_consensus.cc:2468] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:54.384727 16317 ts_tablet_manager.cc:1403] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.005s
I20260709 13:04:54.386977 16047 raft_consensus.cc:2468] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:54.364101 16044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c51469e614423d8a9cc50e024cf468" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:54.388643 16044 raft_consensus.cc:2468] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:54.366473 16610 raft_consensus.cc:2804] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.388042 16319 consensus_queue.cc:260] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:54.389858 16236 leader_election.cc:304] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:54.391716 16610 raft_consensus.cc:697] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:54.394037 16610 consensus_queue.cc:237] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:54.395673 16317 raft_consensus.cc:359] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:54.400651 16545 raft_consensus.cc:2804] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.401191 16545 raft_consensus.cc:493] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.401543 16545 raft_consensus.cc:3060] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.426312 16237 leader_election.cc:304] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:04:54.427809 16342 raft_consensus.cc:2804] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.428239 16342 raft_consensus.cc:493] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.428591 16342 raft_consensus.cc:3060] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.428617 16609 consensus_queue.cc:1048] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:54.437289 16322 raft_consensus.cc:493] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.437856 16322 raft_consensus.cc:515] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:54.437985 16342 raft_consensus.cc:515] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:54.438726 16319 ts_tablet_manager.cc:1434] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.000s
I20260709 13:04:54.439869 16322 leader_election.cc:290] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:54.440104 16319 tablet_bootstrap.cc:492] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:54.440522 16342 leader_election.cc:290] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:54.452677 16237 leader_election.cc:304] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
W20260709 13:04:54.454015 16237 leader_election.cc:343] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.454502 16237 leader_election.cc:304] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:54.396706 16317 raft_consensus.cc:385] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.465529 16317 raft_consensus.cc:740] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.468017 16317 consensus_queue.cc:260] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:54.469316 16342 raft_consensus.cc:2804] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.473997 16342 raft_consensus.cc:697] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:54.475345 16342 consensus_queue.cc:237] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:54.479028 16316 ts_tablet_manager.cc:1434] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.242s	user 0.021s	sys 0.022s
I20260709 13:04:54.479187 16317 ts_tablet_manager.cc:1434] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.094s	user 0.009s	sys 0.000s
I20260709 13:04:54.488602 16639 raft_consensus.cc:2749] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.492401 16317 tablet_bootstrap.cc:492] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:54.674351 16316 tablet_bootstrap.cc:492] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
W20260709 13:04:55.354365 16087 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.014s	sys 0.001s
W20260709 13:04:55.354777 16087 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.014s	sys 0.001s
I20260709 13:04:55.357517 15945 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59466 (request call id 57) took 1041 ms. Trace:
I20260709 13:04:55.357976 15945 rpcz_store.cc:276] 0709 13:04:54.315979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.316156 (+   177us) service_pool.cc:224] Handling call
0709 13:04:55.357424 (+1041268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23263,"reported_tablets":1}
W20260709 13:04:55.361814 16090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.007s	sys 0.008s
W20260709 13:04:55.362279 16090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.008s	sys 0.008s
I20260709 13:04:55.363968 16316 tablet_bootstrap.cc:654] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:55.365466 16014 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.010s	sys 0.005s
I20260709 13:04:55.365413 16651 raft_consensus.cc:493] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
W20260709 13:04:55.365726 16015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.000s	sys 0.008s
W20260709 13:04:55.366345 16015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.000s	sys 0.009s
W20260709 13:04:55.366036 16014 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.010s	sys 0.005s
I20260709 13:04:55.366328 16651 raft_consensus.cc:515] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:55.370159 16651 leader_election.cc:290] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:55.367658 16646 raft_consensus.cc:493] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.370922 16646 raft_consensus.cc:515] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:55.370285 16645 raft_consensus.cc:493] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.373404 16646 leader_election.cc:290] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:55.373530 16645 raft_consensus.cc:515] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:55.375195 16319 tablet_bootstrap.cc:654] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.376233 16480 raft_consensus.cc:493] T a07d00d6ed2e42308d7de0f098fa286c P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.376572 16645 leader_election.cc:290] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:55.376848 16480 raft_consensus.cc:515] T a07d00d6ed2e42308d7de0f098fa286c P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:55.379601 16480 leader_election.cc:290] T a07d00d6ed2e42308d7de0f098fa286c P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:55.388672 16319 tablet_bootstrap.cc:492] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:55.389277 16319 ts_tablet_manager.cc:1403] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.949s	user 0.023s	sys 0.003s
I20260709 13:04:55.389798 16480 raft_consensus.cc:493] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:04:55.390314 16480 raft_consensus.cc:515] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:55.392390 16480 leader_election.cc:290] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:55.392445 16044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1713f6b73c3463c87e7eb5c94959eb0" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:55.397616 16319 raft_consensus.cc:359] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:55.398370 16319 raft_consensus.cc:385] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.398628 16319 raft_consensus.cc:740] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.399564 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c51469e614423d8a9cc50e024cf468" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:55.399571 16319 consensus_queue.cc:260] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:55.404043 16319 ts_tablet_manager.cc:1434] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:04:55.405433 16319 tablet_bootstrap.cc:492] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:55.406976 16316 tablet_bootstrap.cc:492] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:55.407737 16316 ts_tablet_manager.cc:1403] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.734s	user 0.015s	sys 0.013s
I20260709 13:04:55.411530 16316 raft_consensus.cc:359] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:55.412420 16316 raft_consensus.cc:385] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.412760 16316 raft_consensus.cc:740] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.413826 16319 tablet_bootstrap.cc:654] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.450420 16648 raft_consensus.cc:493] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
I20260709 13:04:55.451262 16648 raft_consensus.cc:515] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:55.458124 16648 leader_election.cc:290] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
W20260709 13:04:55.502445 15978 debug-util.cc:398] Leaking SignalData structure 0x7b08003c93c0 after lost signal to thread 7274
W20260709 13:04:55.504019 15978 debug-util.cc:398] Leaking SignalData structure 0x7b08003cbaa0 after lost signal to thread 15981
I20260709 13:04:55.534282 16644 raft_consensus.cc:493] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.535125 16644 raft_consensus.cc:515] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:55.540578 16647 raft_consensus.cc:493] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
I20260709 13:04:55.541414 16644 leader_election.cc:290] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:55.541374 16647 raft_consensus.cc:515] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:55.542227 16644 raft_consensus.cc:493] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
I20260709 13:04:55.542876 16644 raft_consensus.cc:515] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:55.544116 16647 leader_election.cc:290] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:55.581019 16382 raft_consensus.cc:493] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.581900 16382 raft_consensus.cc:515] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:55.584563 16382 leader_election.cc:290] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:55.585446 16480 raft_consensus.cc:493] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:04:55.586206 16480 raft_consensus.cc:515] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:55.588742 16480 leader_election.cc:290] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:55.590760 16480 raft_consensus.cc:493] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:04:55.591401 16480 raft_consensus.cc:515] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:55.593959 16480 leader_election.cc:290] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:55.544786 16647 raft_consensus.cc:493] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:04:55.603511 16647 raft_consensus.cc:515] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:55.614992 16649 raft_consensus.cc:493] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.615803 16649 raft_consensus.cc:515] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:55.625528 16650 raft_consensus.cc:493] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:04:55.626322 16650 raft_consensus.cc:515] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:55.629364 16650 leader_election.cc:290] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:55.630020 16650 raft_consensus.cc:493] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.630625 16650 raft_consensus.cc:515] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:55.633055 16650 leader_election.cc:290] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:55.633351 16382 raft_consensus.cc:493] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:04:55.651755 16382 raft_consensus.cc:515] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:55.652511 16649 leader_election.cc:290] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:55.653643 16644 leader_election.cc:290] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:55.648988 16648 raft_consensus.cc:493] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:04:55.654528 16648 raft_consensus.cc:515] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:55.657660 16382 leader_election.cc:290] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:55.658527 16319 tablet_bootstrap.cc:492] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:55.659065 16319 ts_tablet_manager.cc:1403] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.254s	user 0.017s	sys 0.050s
I20260709 13:04:55.659355 16648 leader_election.cc:290] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:55.659898 16647 leader_election.cc:290] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:55.662056 16319 raft_consensus.cc:359] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:55.662621 16319 raft_consensus.cc:385] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.662853 16319 raft_consensus.cc:740] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.663470 16319 consensus_queue.cc:260] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:55.665795 16319 ts_tablet_manager.cc:1434] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:04:55.666523 16319 tablet_bootstrap.cc:492] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
W20260709 13:04:55.667945 15994 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:55.672767 16319 tablet_bootstrap.cc:654] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.679908 16649 raft_consensus.cc:493] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:04:55.680732 16319 tablet_bootstrap.cc:492] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:55.680490 16649 raft_consensus.cc:515] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:55.681299 16319 ts_tablet_manager.cc:1403] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:04:55.682639 16649 leader_election.cc:290] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
W20260709 13:04:55.697978  7276 debug-util.cc:398] Leaking SignalData structure 0x7b080004af40 after lost signal to thread 16237
W20260709 13:04:55.698625  7276 kernel_stack_watchdog.cc:198] Thread 16237 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 243ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:04:55.705173 16647 raft_consensus.cc:493] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.705950 16647 raft_consensus.cc:515] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:55.710610 16648 raft_consensus.cc:493] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.711315 16648 raft_consensus.cc:515] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:55.713824 16648 leader_election.cc:290] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:55.717568 16648 raft_consensus.cc:493] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:04:55.718225 16648 raft_consensus.cc:515] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:55.722618 16648 leader_election.cc:290] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:55.728554 16319 raft_consensus.cc:359] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:55.732434 16647 leader_election.cc:290] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:55.733026 16319 raft_consensus.cc:385] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.733403 16319 raft_consensus.cc:740] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.734123 16319 consensus_queue.cc:260] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:55.736308 16319 ts_tablet_manager.cc:1434] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.000s
I20260709 13:04:55.737751 16646 raft_consensus.cc:493] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.738312 16645 raft_consensus.cc:493] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.738323 16646 raft_consensus.cc:515] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:55.738914 16645 raft_consensus.cc:515] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:55.740012 16646 leader_election.cc:290] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:55.740538 16645 leader_election.cc:290] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:55.741055 16319 tablet_bootstrap.cc:492] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:55.741511 16646 raft_consensus.cc:493] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:04:55.742020 16646 raft_consensus.cc:515] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:55.744019 16646 leader_election.cc:290] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:55.744532 16646 raft_consensus.cc:493] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.744956 16646 raft_consensus.cc:515] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:55.748343 16646 leader_election.cc:290] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:55.748783 16646 raft_consensus.cc:493] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.750972 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb3d9bac364b43abf555b36674a82e" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:55.751659 16123 raft_consensus.cc:2468] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:55.751999 16191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589ea61d3c14d5da5f955ac6d719881" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:55.752629 16191 raft_consensus.cc:2468] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:55.753275 16382 raft_consensus.cc:493] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:04:55.753774 16382 raft_consensus.cc:515] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:55.754776 16191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:55.755893 16382 leader_election.cc:290] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:55.757145 16649 raft_consensus.cc:493] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:04:55.757375 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c283cfd76b4e9aacd796f6ead6e4b8" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:55.757675 16649 raft_consensus.cc:515] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:55.758005 16196 raft_consensus.cc:2468] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:55.759485 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61baecc1a74998a356870a675301ea" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:55.759764 16649 leader_election.cc:290] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:55.760105 16196 raft_consensus.cc:2468] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:55.760138 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c9099428b34e0f9bec85f2159b656e" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:55.761037 16191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ba50f699994c75b3a8cc2ea2ba8cc9" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:55.761328 16194 raft_consensus.cc:2468] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:55.749457 16646 raft_consensus.cc:515] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:55.763401 16649 raft_consensus.cc:493] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.763852 16646 leader_election.cc:290] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:55.764120 16649 raft_consensus.cc:515] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:55.756882 15946 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59494 (request call id 60) took 1462 ms. Trace:
I20260709 13:04:55.765134 15946 rpcz_store.cc:276] 0709 13:04:54.294883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.399117 (+104234us) service_pool.cc:224] Handling call
0709 13:04:55.756797 (+1357680us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:04:55.766427 16649 leader_election.cc:290] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:55.761710 16191 raft_consensus.cc:2468] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:55.768446 16089 leader_election.cc:304] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:55.770392 16647 raft_consensus.cc:493] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
I20260709 13:04:55.771047 16646 raft_consensus.cc:2804] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.771636 16646 raft_consensus.cc:493] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.772102 16089 leader_election.cc:304] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:55.772554 16646 raft_consensus.cc:3060] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.773595 16319 tablet_bootstrap.cc:654] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:55.775100 16047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43906 (request call id 95) took 1489 ms (client timeout 1884 ms). Trace:
W20260709 13:04:55.775624 16047 rpcz_store.cc:269] 0709 13:04:54.285588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.292166 (+  6578us) service_pool.cc:224] Handling call
0709 13:04:55.775013 (+1482847us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:55.776458 16645 raft_consensus.cc:2804] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:55.776906 16645 raft_consensus.cc:493] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.771143 16647 raft_consensus.cc:515] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:55.777302 16645 raft_consensus.cc:3060] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.777746 16089 leader_election.cc:304] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:55.778621 16563 raft_consensus.cc:2804] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:55.778769 16089 leader_election.cc:304] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:55.779058 16563 raft_consensus.cc:493] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:04:54.491017 16545 raft_consensus.cc:515] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:55.779633 16563 raft_consensus.cc:3060] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.780056 16089 leader_election.cc:304] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:55.781216 16545 leader_election.cc:290] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:55.783340 16651 raft_consensus.cc:2804] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:55.783751 16651 raft_consensus.cc:493] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.783932 16319 tablet_bootstrap.cc:492] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:55.784138 16651 raft_consensus.cc:3060] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.784482 16319 ts_tablet_manager.cc:1403] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.000s
I20260709 13:04:55.784917 16645 raft_consensus.cc:515] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:55.787555 16319 raft_consensus.cc:359] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:55.787909 16191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c283cfd76b4e9aacd796f6ead6e4b8" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:55.788255 16319 raft_consensus.cc:385] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.788560 16191 raft_consensus.cc:3060] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.788615 16319 raft_consensus.cc:740] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.789544 16319 consensus_queue.cc:260] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
W20260709 13:04:55.790419 16237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.335s	user 0.010s	sys 0.018s
W20260709 13:04:55.790925 16237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.336s	user 0.010s	sys 0.018s
W20260709 13:04:55.793316 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 1.33922e+06us
I20260709 13:04:55.798939 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eede189c87343c6a45e71d7cb23c41d" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:55.799454 16391 raft_consensus.cc:2804] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:55.799898 16391 raft_consensus.cc:493] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:04:55.800432 16391 raft_consensus.cc:3060] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.800907 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc73085eee348a0b029b5aa5f51e288" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:55.803200 16648 raft_consensus.cc:493] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:04:55.803755 16648 raft_consensus.cc:515] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:55.804152 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6e04804ef846e8b828194d87904eaa" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:55.804761 16122 raft_consensus.cc:3060] T 5e6e04804ef846e8b828194d87904eaa P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.806303 16648 leader_election.cc:290] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:55.806525 16644 raft_consensus.cc:493] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.806918 16648 raft_consensus.cc:493] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.807127 16644 raft_consensus.cc:515] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:55.807443 16648 raft_consensus.cc:515] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:55.809449 16391 raft_consensus.cc:515] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:55.810966 16124 raft_consensus.cc:1240] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Rejecting Update request from peer d2e22ad700e94d1095c014708c364bb7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:55.811172 16120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c51469e614423d8a9cc50e024cf468" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:55.816061 16195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe849f02803548a48394a1ff9f356f98" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:55.816689 16648 leader_election.cc:290] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:55.817269 16648 raft_consensus.cc:493] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:04:55.819588 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1713f6b73c3463c87e7eb5c94959eb0" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:55.820312 16194 raft_consensus.cc:2468] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:55.792145 16649 consensus_queue.cc:1048] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.817358 16644 leader_election.cc:290] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:55.818805 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6e04804ef846e8b828194d87904eaa" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:55.821316 16609 raft_consensus.cc:493] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.821475 16650 raft_consensus.cc:493] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.821930 16196 raft_consensus.cc:3060] T 5e6e04804ef846e8b828194d87904eaa P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.822124 16650 raft_consensus.cc:515] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:55.824285 16650 leader_election.cc:290] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:55.825505 16163 leader_election.cc:304] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:55.826805 16610 raft_consensus.cc:2804] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.827293 16610 raft_consensus.cc:493] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.827649 16610 raft_consensus.cc:3060] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.828161 16120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c9099428b34e0f9bec85f2159b656e" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:55.819610 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61baecc1a74998a356870a675301ea" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:55.819952 16648 raft_consensus.cc:515] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:55.832268 16644 raft_consensus.cc:493] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:04:55.832890 16644 raft_consensus.cc:515] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:55.834523 16405 raft_consensus.cc:493] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.835078 16405 raft_consensus.cc:515] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:55.838881 16654 raft_consensus.cc:493] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:04:55.839143 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb3d9bac364b43abf555b36674a82e" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:55.839534 16654 raft_consensus.cc:515] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:55.840073 16648 leader_election.cc:290] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:55.841807 16196 raft_consensus.cc:2468] T 5e6e04804ef846e8b828194d87904eaa P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:55.831601 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:55.843786 16545 raft_consensus.cc:493] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:04:55.844250 16124 raft_consensus.cc:2468] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:55.844354 16545 raft_consensus.cc:515] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:55.843113 16644 leader_election.cc:290] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:55.845422 16659 raft_consensus.cc:493] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:04:55.854154 16659 raft_consensus.cc:515] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:55.855474 16480 raft_consensus.cc:493] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:04:55.856077 16480 raft_consensus.cc:515] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:55.856838 16602 raft_consensus.cc:493] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.857435 16602 raft_consensus.cc:515] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:55.858301 16480 leader_election.cc:290] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:55.858702 16664 raft_consensus.cc:493] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.859516 16602 leader_election.cc:290] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:55.859282 16664 raft_consensus.cc:515] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:55.855206 16545 leader_election.cc:290] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:55.846103 16654 leader_election.cc:290] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:55.865851 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:55.866581 16124 raft_consensus.cc:2468] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:55.846706 16658 raft_consensus.cc:493] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.821892 16609 raft_consensus.cc:515] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:55.820880 16651 raft_consensus.cc:515] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:55.871673 16120 raft_consensus.cc:2393] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1e05442c5b44a079dd1de9dd124c990 in current term 2: Already voted for candidate 36b15691c8e648a18b69e98bee3349b4 in this term.
I20260709 13:04:55.872005 16609 leader_election.cc:290] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:55.870958 16666 raft_consensus.cc:493] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.873301 16666 raft_consensus.cc:515] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:55.874552 16610 raft_consensus.cc:515] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:55.849848 16382 raft_consensus.cc:493] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:04:55.875744 16382 raft_consensus.cc:515] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:55.831590 16320 tablet_bootstrap.cc:492] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:55.877765 16320 ts_tablet_manager.cc:1403] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 1.647s	user 0.075s	sys 0.094s
I20260709 13:04:55.878068 16644 raft_consensus.cc:493] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.878613 16322 raft_consensus.cc:493] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.878168 16405 leader_election.cc:290] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:55.878767 16644 raft_consensus.cc:515] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:55.881127 16666 leader_election.cc:290] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:55.879091 16322 raft_consensus.cc:515] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:55.871954 16122 raft_consensus.cc:2468] T 5e6e04804ef846e8b828194d87904eaa P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:55.886370 16644 leader_election.cc:290] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:55.791764 16319 ts_tablet_manager.cc:1434] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:04:55.869951 16645 leader_election.cc:290] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:55.893404 16654 raft_consensus.cc:493] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
I20260709 13:04:55.906544 16659 leader_election.cc:290] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:55.910326 16644 raft_consensus.cc:493] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
I20260709 13:04:55.912426 16644 raft_consensus.cc:515] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:55.911440 16319 tablet_bootstrap.cc:492] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
W20260709 13:04:55.908812 15978 debug-util.cc:398] Leaking SignalData structure 0x7b08003f9640 after lost signal to thread 16073
I20260709 13:04:55.913939 16320 raft_consensus.cc:359] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:55.914703 16320 raft_consensus.cc:385] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.914997 16320 raft_consensus.cc:740] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.896202 16545 raft_consensus.cc:493] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:04:55.917200 16163 leader_election.cc:304] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:55.917338 16545 raft_consensus.cc:515] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:55.918239 16163 leader_election.cc:304] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:55.919140 16382 leader_election.cc:290] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:55.919541 16545 leader_election.cc:290] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:55.919834 16654 raft_consensus.cc:515] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:55.920796 16322 leader_election.cc:290] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:55.922518 16654 leader_election.cc:290] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:55.923964 16644 leader_election.cc:290] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:55.920258 16650 raft_consensus.cc:493] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.924826 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:55.925592 16197 raft_consensus.cc:2468] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:55.925458 16650 raft_consensus.cc:515] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:55.927129 16089 leader_election.cc:304] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:55.927418 16319 tablet_bootstrap.cc:654] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.928094 16565 raft_consensus.cc:2804] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:55.928231 16602 consensus_queue.cc:1048] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.928570 16565 raft_consensus.cc:493] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.929001 16565 raft_consensus.cc:3060] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.929852 16602 raft_consensus.cc:2804] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:55.930315 16602 raft_consensus.cc:493] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:04:55.930683 16602 raft_consensus.cc:3060] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.932435 16651 leader_election.cc:290] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:55.933247 16649 raft_consensus.cc:2804] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:55.933706 16649 raft_consensus.cc:493] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.934132 16649 raft_consensus.cc:3060] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.936028 16316 consensus_queue.cc:260] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:55.938304 15946 catalog_manager.cc:5697] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.940660 16120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496077ee29374b90a7c924539c590475" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:55.941433 16120 raft_consensus.cc:2468] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:55.945012 16192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496077ee29374b90a7c924539c590475" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:55.944815 16320 consensus_queue.cc:260] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:55.945735 16192 raft_consensus.cc:2468] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:55.946714 16320 ts_tablet_manager.cc:1434] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.000s
I20260709 13:04:55.947903 16320 tablet_bootstrap.cc:492] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:55.948477 16659 raft_consensus.cc:493] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.951470 16317 tablet_bootstrap.cc:654] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:55.952129 15978 debug-util.cc:398] Leaking SignalData structure 0x7b08000592e0 after lost signal to thread 16148
I20260709 13:04:55.952968 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe849f02803548a48394a1ff9f356f98" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:55.954641 16647 leader_election.cc:290] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:55.946735 16391 leader_election.cc:290] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:55.956594 16480 raft_consensus.cc:493] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:55.957055 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b6fe9ceac45fb8a980a2feb9cc063" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:55.957239 16480 raft_consensus.cc:515] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:55.958352 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589ea61d3c14d5da5f955ac6d719881" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:55.958999 16272 raft_consensus.cc:2468] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:55.959254 16480 leader_election.cc:290] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:55.960407 16650 leader_election.cc:290] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
W20260709 13:04:55.960690 15978 debug-util.cc:398] Leaking SignalData structure 0x7b08000eb960 after lost signal to thread 16222
W20260709 13:04:55.961923 15978 debug-util.cc:398] Leaking SignalData structure 0x7b08000b3b80 after lost signal to thread 16296
W20260709 13:04:55.962236 15978 debug-util.cc:398] Leaking SignalData structure 0x7b08000eb1a0 after lost signal to thread 16297
I20260709 13:04:55.948957 16659 raft_consensus.cc:515] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:55.966249 16089 leader_election.cc:304] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:55.967675 16391 raft_consensus.cc:2804] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.967940 16316 ts_tablet_manager.cc:1434] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.560s	user 0.010s	sys 0.004s
I20260709 13:04:55.968166 16391 raft_consensus.cc:493] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.799888 16563 raft_consensus.cc:515] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:55.968698 16391 raft_consensus.cc:3060] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.868916 16658 raft_consensus.cc:515] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
W20260709 13:04:55.974431 16237 leader_election.cc:343] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:55.968451 16316 ts_tablet_manager.cc:1467] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7: Tablet startup took 560ms
I20260709 13:04:55.991505 16322 consensus_queue.cc:1059] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:55.993021 16322 raft_consensus.cc:3055] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:04:55.994184 16237 leader_election.cc:343] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.983382 16610 leader_election.cc:290] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:55.993398 16322 raft_consensus.cc:740] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:55.997099 16237 leader_election.cc:304] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:04:55.980649 16654 raft_consensus.cc:493] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
I20260709 13:04:55.998778 16654 raft_consensus.cc:515] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:55.999276 16667 raft_consensus.cc:2804] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.999807 16667 raft_consensus.cc:697] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:56.001353 16660 raft_consensus.cc:493] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:56.001865 16660 raft_consensus.cc:515] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:56.003925 16660 leader_election.cc:290] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:56.000586 16667 consensus_queue.cc:237] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:55.996526 16322 consensus_queue.cc:260] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:55.916975 16668 consensus_queue.cc:1048] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.077s
I20260709 13:04:56.004902 16320 tablet_bootstrap.cc:654] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.978091 16645 raft_consensus.cc:493] T c600c8f1ec454bc0b4a3716ea85d8499 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.027763 16322 raft_consensus.cc:3060] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.979748 16545 raft_consensus.cc:493] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
W20260709 13:04:55.981881 16316 ts_tablet_manager.cc:1469] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7: Trace:
0709 13:04:49.363406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.363578 (+   172us) service_pool.cc:224] Handling call
0709 13:04:49.367448 (+  3870us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:04:49.367568 (+   120us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:49.403681 (+ 36113us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:49.463801 (+ 60120us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:49.464270 (+   469us) inbound_call.cc:177] Queueing success response
0709 13:04:54.491243 (+5026973us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:04:55.408074 (+916831us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:04:55.408746 (+   672us) tablet_replica.cc:261] Starting instrumentation
0709 13:04:55.409558 (+   812us) tablet_replica.cc:280] Starting consensus
0709 13:04:55.935691 (+526133us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b4c00235e80. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c6751a20 00007f36c6762a29 00007f36c6728644 00007f36c674ff2d 00007f36c674fb93 00007f36c848018b 00007f36c8480cb5 00007f36c847bf30 00007f36c847ac40 00007f36cbe77b2e 00007f36cd499d8a
Metrics: {"raft.queue_time_us":6184,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"spinlock_wait_cycles":1129234176,"tablet-open.queue_time_us":5018130}
I20260709 13:04:55.984131 16192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c9099428b34e0f9bec85f2159b656e" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:56.005172 16268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c9099428b34e0f9bec85f2159b656e" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:56.000906 16654 leader_election.cc:290] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:56.007405 16658 leader_election.cc:290] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:56.009285 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f697dfb6287b4feeac50690912201da2" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.045611 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44eefc0f2e540b99fa97ec775185660" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.046223 16263 raft_consensus.cc:2468] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:04:56.047101 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ffb334ab54abb8bdb4893844c3b6b" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.007692 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c9099428b34e0f9bec85f2159b656e" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.048357 16563 leader_election.cc:290] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:56.008747 16264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c283cfd76b4e9aacd796f6ead6e4b8" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:56.006599 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c283cfd76b4e9aacd796f6ead6e4b8" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.007171 16267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ffb334ab54abb8bdb4893844c3b6b" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.041592 16391 raft_consensus.cc:515] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:56.052801 16316 tablet_bootstrap.cc:492] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:56.008239 16265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9bf004f8eb4f0f910840561945e386" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.009644 16193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ba50f699994c75b3a8cc2ea2ba8cc9" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:56.030978 16664 leader_election.cc:290] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:56.040133 16192 raft_consensus.cc:3060] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.042101 16121 raft_consensus.cc:2393] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1e05442c5b44a079dd1de9dd124c990 in current term 2: Already voted for candidate 36b15691c8e648a18b69e98bee3349b4 in this term.
I20260709 13:04:56.071201 16267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.072544 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d59706e6f746aca969af7bf2206197" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:56.073442 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6b0df9a4d4b55a27f4ffb956db8d0" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.074218 16195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154f438524734d2599d72ae02e2230e6" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:56.075168 16045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dfecacf6d204abc99b0b341ab7256b1" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.087867 16195 raft_consensus.cc:2468] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:56.088171 16045 raft_consensus.cc:2468] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:56.089689 16089 leader_election.cc:304] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:56.090910 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07d00d6ed2e42308d7de0f098fa286c" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.093597 16647 raft_consensus.cc:493] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.093829 16268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09412044d26f417da5c842c8acf1149d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.094260 16647 raft_consensus.cc:515] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:56.094681 16660 raft_consensus.cc:2749] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.095194 16268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9bf004f8eb4f0f910840561945e386" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.075058 16190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc73085eee348a0b029b5aa5f51e288" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:56.096504 16268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b6fe9ceac45fb8a980a2feb9cc063" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.076088 16042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1713f6b73c3463c87e7eb5c94959eb0" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.076288 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eede189c87343c6a45e71d7cb23c41d" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
W20260709 13:04:56.048903 16162 leader_election.cc:343] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.076591 16040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc5c10cfdd24c64a4db9e4339808499" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.077006 16041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522541a48c1647ccaf475543121810d2" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.077256 16043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61baecc1a74998a356870a675301ea" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.076107 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f697dfb6287b4feeac50690912201da2" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.077818 16189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc581e6f2f6741bc9a63c49459198306" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:56.078495 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154f438524734d2599d72ae02e2230e6" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.079267 16317 tablet_bootstrap.cc:492] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:56.000955 16163 leader_election.cc:304] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:56.054461 16120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe849f02803548a48394a1ff9f356f98" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.141744 16319 tablet_bootstrap.cc:492] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:56.142313 16319 ts_tablet_manager.cc:1403] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.237s	user 0.026s	sys 0.010s
I20260709 13:04:56.143707 16602 raft_consensus.cc:515] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:56.085376 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.085909 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98ba329bddb47c5aec148957811a4c2" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:56.147394 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496077ee29374b90a7c924539c590475" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:56.148259 16196 raft_consensus.cc:3060] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.087106 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb3d9bac364b43abf555b36674a82e" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:56.096658 16647 leader_election.cc:290] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:56.075678 16044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07d00d6ed2e42308d7de0f098fa286c" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.149502 16565 raft_consensus.cc:515] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:56.097244 16045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496077ee29374b90a7c924539c590475" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.100152 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98ba329bddb47c5aec148957811a4c2" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.151904 16565 leader_election.cc:290] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:56.152624 16120 raft_consensus.cc:1240] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Rejecting Update request from peer d2e22ad700e94d1095c014708c364bb7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:56.137245 16040 raft_consensus.cc:2468] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:56.119657 16191 raft_consensus.cc:2468] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 2.
I20260709 13:04:56.155790 16194 raft_consensus.cc:1240] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Rejecting Update request from peer d2e22ad700e94d1095c014708c364bb7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:56.101393 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc581e6f2f6741bc9a63c49459198306" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.101683 16117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc73085eee348a0b029b5aa5f51e288" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.102813 16116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f053de7054c4b3786ffa35aa5accb15" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.103804 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f21b3c8be8f42be9186b827a2a086e3" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.105741 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac8a97b1adc49389919710edf7c5e03" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.165030 16119 raft_consensus.cc:1240] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Rejecting Update request from peer d2e22ad700e94d1095c014708c364bb7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:56.165436 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc5c10cfdd24c64a4db9e4339808499" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
W20260709 13:04:56.149588 16162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 100723us
I20260709 13:04:56.034801 16645 raft_consensus.cc:515] T c600c8f1ec454bc0b4a3716ea85d8499 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:56.036211 16545 raft_consensus.cc:515] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:56.170744 16545 leader_election.cc:290] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:56.093719 16014 leader_election.cc:304] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:56.171011 16649 raft_consensus.cc:515] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:56.171165 16645 leader_election.cc:290] T c600c8f1ec454bc0b4a3716ea85d8499 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
W20260709 13:04:56.171890 16014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 78267.7us
I20260709 13:04:56.110389 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d59706e6f746aca969af7bf2206197" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.173934 16647 raft_consensus.cc:2804] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:56.174333 16647 raft_consensus.cc:493] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
I20260709 13:04:56.174683 16647 raft_consensus.cc:3060] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.177570 16040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b6fe9ceac45fb8a980a2feb9cc063" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.178476 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48faa67625c143aa8ce08eb068a3a8dc" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.178980 16118 raft_consensus.cc:3060] T c600c8f1ec454bc0b4a3716ea85d8499 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.110996 16190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61baecc1a74998a356870a675301ea" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:56.092622 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dfecacf6d204abc99b0b341ab7256b1" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.116387 16237 leader_election.cc:304] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:56.119864 16391 leader_election.cc:290] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:56.122622 16317 ts_tablet_manager.cc:1403] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 1.630s	user 0.012s	sys 0.026s
I20260709 13:04:56.100732 16646 raft_consensus.cc:515] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:56.124434 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa51a24c3524741836e9666f1b4babe" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.124653 16265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48faa67625c143aa8ce08eb068a3a8dc" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.125543 16268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c600c8f1ec454bc0b4a3716ea85d8499" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.124434 16041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d457e5782e42e78f4b0978f2b41dac" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.130857 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f053de7054c4b3786ffa35aa5accb15" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.134907 16189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d457e5782e42e78f4b0978f2b41dac" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:56.080438 16193 raft_consensus.cc:3060] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.156791 16322 raft_consensus.cc:493] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.238219 16322 raft_consensus.cc:515] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:56.149451 16046 raft_consensus.cc:3060] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.066778 16659 leader_election.cc:290] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
W20260709 13:04:56.181488 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 65224.7us
I20260709 13:04:56.182922 16089 leader_election.cc:304] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:56.178486 16040 raft_consensus.cc:2468] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:56.171340 16267 raft_consensus.cc:2468] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:04:56.190585 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.187012 16545 raft_consensus.cc:2804] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.191481 16662 raft_consensus.cc:493] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.194397 16316 tablet_bootstrap.cc:654] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.196347 16264 raft_consensus.cc:2468] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 2.
W20260709 13:04:56.161911 16163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:45195, user_credentials={real_user=slave}} blocked reactor thread for 159874us
W20260709 13:04:56.197625 16236 leader_election.cc:343] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:56.253695 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 56105.1us
I20260709 13:04:56.255026 16267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dfecacf6d204abc99b0b341ab7256b1" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.197781 16192 raft_consensus.cc:2468] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 2.
I20260709 13:04:56.180646 16649 leader_election.cc:290] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:56.256361 16267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.256853 16198 raft_consensus.cc:1240] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Rejecting Update request from peer d2e22ad700e94d1095c014708c364bb7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:56.173945 16663 consensus_queue.cc:1048] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:04:56.204241 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:56.258306 16264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522541a48c1647ccaf475543121810d2" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.208197 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ffb334ab54abb8bdb4893844c3b6b" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.258610 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc5c10cfdd24c64a4db9e4339808499" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.259135 16048 raft_consensus.cc:2468] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:56.259464 16264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6b0df9a4d4b55a27f4ffb956db8d0" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.259909 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1713f6b73c3463c87e7eb5c94959eb0" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.260085 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac8a97b1adc49389919710edf7c5e03" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.250401 16545 raft_consensus.cc:493] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.261343 16545 raft_consensus.cc:3060] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.209270 16041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ba50f699994c75b3a8cc2ea2ba8cc9" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.263911 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9bf004f8eb4f0f910840561945e386" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.265170 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b6fe9ceac45fb8a980a2feb9cc063" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.265606 16014 leader_election.cc:304] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:56.266232 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa51a24c3524741836e9666f1b4babe" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.266763 16644 raft_consensus.cc:2804] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:56.267158 16644 raft_consensus.cc:493] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
I20260709 13:04:56.267235 16320 tablet_bootstrap.cc:492] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:56.267590 16644 raft_consensus.cc:3060] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.267817 16320 ts_tablet_manager.cc:1403] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.320s	user 0.033s	sys 0.027s
I20260709 13:04:56.209466 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496077ee29374b90a7c924539c590475" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.183882 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:56.275472 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:56.276273 16196 raft_consensus.cc:2468] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:56.276640 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe849f02803548a48394a1ff9f356f98" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.210397 16042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9bf004f8eb4f0f910840561945e386" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.278512 16042 raft_consensus.cc:2468] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:56.278957 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d457e5782e42e78f4b0978f2b41dac" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.210757 16045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.211153 16043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61baecc1a74998a356870a675301ea" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.188897 16190 raft_consensus.cc:3060] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.280294 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154f438524734d2599d72ae02e2230e6" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.280860 16043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3808fd28794c4ce098037730316b2e58" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.281435 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.281543 16043 raft_consensus.cc:2468] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:56.282559 16043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d457e5782e42e78f4b0978f2b41dac" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.279572 16266 raft_consensus.cc:2468] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:56.168823 16162 leader_election.cc:304] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:56.212906 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc73085eee348a0b029b5aa5f51e288" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.214502 16646 leader_election.cc:290] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:56.217156 16189 raft_consensus.cc:2468] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 0.
I20260709 13:04:56.221832 16647 raft_consensus.cc:515] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:56.222236 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154f438524734d2599d72ae02e2230e6" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.225495 16044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f697dfb6287b4feeac50690912201da2" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.226066 16651 consensus_queue.cc:1048] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.226869 16124 raft_consensus.cc:1240] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Rejecting Update request from peer ec8b54f5a9e44f428a4d537391138dcf for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:56.200701 16317 raft_consensus.cc:359] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:56.291600 16317 raft_consensus.cc:385] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.228791 16117 raft_consensus.cc:1240] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Rejecting Update request from peer ec8b54f5a9e44f428a4d537391138dcf for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:56.229429 16119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105468bfb6dc48c28c16d3449c691f6b" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.230192 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09412044d26f417da5c842c8acf1149d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.230281 16116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaad334dede46d888c92db5c932655e" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.230576 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f697dfb6287b4feeac50690912201da2" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.231081 16120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ffb334ab54abb8bdb4893844c3b6b" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.231245 16602 leader_election.cc:290] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:56.231981 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6c90e7e1974ef0ade824c72386b5f3" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.232848 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f053de7054c4b3786ffa35aa5accb15" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.237555 16265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c9099428b34e0f9bec85f2159b656e" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.156520 16319 raft_consensus.cc:359] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:56.239691 16268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c600c8f1ec454bc0b4a3716ea85d8499" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.241454 16322 leader_election.cc:290] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
W20260709 13:04:56.244671 16089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 61858.9us
I20260709 13:04:56.245698 16237 leader_election.cc:304] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:56.251529 16040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c51469e614423d8a9cc50e024cf468" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:56.252261 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.271152 16320 raft_consensus.cc:359] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:56.313831 16320 raft_consensus.cc:385] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.314146 16320 raft_consensus.cc:740] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.259753 16662 raft_consensus.cc:515] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:56.271898 16041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44eefc0f2e540b99fa97ec775185660" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.248998 16565 raft_consensus.cc:2804] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.210224 16195 raft_consensus.cc:1240] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Rejecting Update request from peer d2e22ad700e94d1095c014708c364bb7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:56.276805 16610 raft_consensus.cc:2764] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:04:56.248405 16193 raft_consensus.cc:2468] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 2.
I20260709 13:04:56.277431 16046 raft_consensus.cc:2468] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:56.291898 16317 raft_consensus.cc:740] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
W20260709 13:04:56.294102 16162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 125377us
I20260709 13:04:56.318500 16119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:56.318913 16040 raft_consensus.cc:3060] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.319139 16317 consensus_queue.cc:260] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:56.319731 16119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb3d9bac364b43abf555b36674a82e" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:56.320188 16162 leader_election.cc:304] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:56.321496 16317 ts_tablet_manager.cc:1434] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.140s	user 0.007s	sys 0.001s
I20260709 13:04:56.321585 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:56.322527 16115 raft_consensus.cc:2393] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e1e05442c5b44a079dd1de9dd124c990 in current term 2: Already voted for candidate 36b15691c8e648a18b69e98bee3349b4 in this term.
I20260709 13:04:56.322623 16317 tablet_bootstrap.cc:492] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:56.323366 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5dc804032442d1a074ba2adaf03311" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.324503 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be59fdebe7a44cc9f945fa9793ddfda" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.297027 16120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c600c8f1ec454bc0b4a3716ea85d8499" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.297051 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f053de7054c4b3786ffa35aa5accb15" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.326467 16189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589ea61d3c14d5da5f955ac6d719881" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:56.327039 16189 raft_consensus.cc:3060] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:56.329380 16163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 54033.6us
I20260709 13:04:56.329314 16644 raft_consensus.cc:515] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:56.330756 16662 leader_election.cc:290] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:56.331440 16644 leader_election.cc:290] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:56.267333 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48faa67625c143aa8ce08eb068a3a8dc" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.279579 16042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ba50f699994c75b3a8cc2ea2ba8cc9" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:56.297829 16116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.303442 16319 raft_consensus.cc:385] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.335247 16319 raft_consensus.cc:740] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
W20260709 13:04:56.308282 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 62660us
I20260709 13:04:56.308775 16322 raft_consensus.cc:2804] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:56.310792 16014 leader_election.cc:304] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:56.320447 16119 raft_consensus.cc:3060] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.295544 16649 raft_consensus.cc:2804] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:56.280750 16545 raft_consensus.cc:515] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:56.332811 16089 leader_election.cc:304] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:56.347361 16089 leader_election.cc:304] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:56.332490 16320 consensus_queue.cc:260] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:56.336941 16322 raft_consensus.cc:493] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:04:56.342317 16014 leader_election.cc:304] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:56.348343 16322 raft_consensus.cc:3060] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.332909 16658 raft_consensus.cc:493] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.343977 16043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48faa67625c143aa8ce08eb068a3a8dc" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.349524 16658 raft_consensus.cc:515] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:56.349296 16404 raft_consensus.cc:2749] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.349954 16044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61baecc1a74998a356870a675301ea" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:56.350628 16047 raft_consensus.cc:2468] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:56.350843 16267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589ea61d3c14d5da5f955ac6d719881" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:56.345346 16648 raft_consensus.cc:2749] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.345275 16116 raft_consensus.cc:2468] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:04:56.351485 16267 raft_consensus.cc:3060] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.352432 16647 leader_election.cc:290] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:56.335045 16565 raft_consensus.cc:697] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [term 2 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:04:56.353678 16565 consensus_queue.cc:237] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:56.340543 16319 consensus_queue.cc:260] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:56.356114 16319 ts_tablet_manager.cc:1434] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.214s	user 0.006s	sys 0.004s
I20260709 13:04:56.349018 16014 leader_election.cc:304] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:56.358742 16014 leader_election.cc:304] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:56.357157 16237 leader_election.cc:304] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:56.362301 16320 ts_tablet_manager.cc:1434] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.000s
I20260709 13:04:56.367542 16322 raft_consensus.cc:515] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:56.365365 16404 raft_consensus.cc:2749] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.369671 16405 consensus_queue.cc:1059] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.370733 16405 raft_consensus.cc:3055] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.371074 16405 raft_consensus.cc:740] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:04:56.371809 16405 consensus_queue.cc:260] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:56.344858 16649 raft_consensus.cc:493] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:56.361529 16645 raft_consensus.cc:2804] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.332181 16163 leader_election.cc:304] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:56.365965 16647 raft_consensus.cc:2749] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.368970 16662 consensus_queue.cc:1059] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:04:56.396785 16119 raft_consensus.cc:2468] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:56.401927 16319 tablet_bootstrap.cc:492] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:56.386852 16322 leader_election.cc:290] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:56.387912 16263 raft_consensus.cc:2393] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1e05442c5b44a079dd1de9dd124c990 in current term 1: Already voted for candidate d2e22ad700e94d1095c014708c364bb7 in this term.
I20260709 13:04:56.388532 16190 raft_consensus.cc:2468] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 2.
I20260709 13:04:56.365540 16651 raft_consensus.cc:2749] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.374513 16659 consensus_queue.cc:1059] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:04:56.392534 16116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379913b2ca6a49e9bfd93ca8b06c9fee" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.394955 16645 raft_consensus.cc:697] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [term 2 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:04:56.375219 16405 raft_consensus.cc:3060] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.396267 16040 raft_consensus.cc:2468] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:56.368511 16667 raft_consensus.cc:2804] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.420588 16189 raft_consensus.cc:2468] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:56.421926 16320 tablet_bootstrap.cc:492] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:56.374917 16162 leader_election.cc:304] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:56.415304 16609 raft_consensus.cc:2749] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.387177 16649 raft_consensus.cc:3060] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.415726 16602 raft_consensus.cc:2749] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.436764 16610 raft_consensus.cc:2749] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.436501 16316 tablet_bootstrap.cc:492] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:56.392587 16267 raft_consensus.cc:2468] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:56.441272 16316 ts_tablet_manager.cc:1403] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.389s	user 0.020s	sys 0.015s
I20260709 13:04:56.435204 16667 raft_consensus.cc:493] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.434438 16654 raft_consensus.cc:3055] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:04:56.431861 16163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 99764.7us
W20260709 13:04:56.436969 16162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 75494us
I20260709 13:04:56.475356 16163 leader_election.cc:304] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:56.476315 16610 raft_consensus.cc:2749] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.444416 16654 raft_consensus.cc:740] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:56.477207 16191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44eefc0f2e540b99fa97ec775185660" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:56.472798 16645 consensus_queue.cc:237] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:56.472872 16545 leader_election.cc:290] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:56.501206 16190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:56.502282 16162 leader_election.cc:304] T a07d00d6ed2e42308d7de0f098fa286c P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:56.503814 16609 raft_consensus.cc:2749] T a07d00d6ed2e42308d7de0f098fa286c P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.445053 16667 raft_consensus.cc:3060] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.508263 16317 tablet_bootstrap.cc:654] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.477620 16654 consensus_queue.cc:260] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:56.510802 16654 raft_consensus.cc:3060] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.514541 16320 tablet_bootstrap.cc:654] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.514925 16658 leader_election.cc:290] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:56.518935 16163 leader_election.cc:304] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:56.520264 16163 leader_election.cc:304] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:56.521260 16163 leader_election.cc:304] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:56.521301 16609 raft_consensus.cc:2749] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.477566 16236 leader_election.cc:304] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:56.525992 16190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3808fd28794c4ce098037730316b2e58" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
W20260709 13:04:56.526230 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 48747.4us
W20260709 13:04:56.527172 16236 leader_election.cc:343] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.528290 16545 raft_consensus.cc:2804] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:56.528654 16545 raft_consensus.cc:493] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.529106 16545 raft_consensus.cc:3060] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.529449 16649 raft_consensus.cc:515] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:56.531559 16649 leader_election.cc:290] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:56.535895 16089 leader_election.cc:304] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:56.536859 16089 leader_election.cc:304] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:56.537561 16646 raft_consensus.cc:2804] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.537663 16089 leader_election.cc:304] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:56.538161 16646 raft_consensus.cc:697] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:04:56.538998 16646 consensus_queue.cc:237] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:56.545619 16319 tablet_bootstrap.cc:654] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.528683 16659 raft_consensus.cc:3055] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.554348 16651 raft_consensus.cc:2804] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.545809 16089 leader_election.cc:304] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:56.537174 16480 raft_consensus.cc:2804] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.563166 16316 raft_consensus.cc:359] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:56.563884 16316 raft_consensus.cc:385] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.564152 16316 raft_consensus.cc:740] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.562649 16480 raft_consensus.cc:493] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.547715 16609 raft_consensus.cc:2749] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.548574 16660 raft_consensus.cc:2804] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.566668 16316 consensus_queue.cc:260] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
W20260709 13:04:56.537312 16162 leader_election.cc:343] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.549377 16659 raft_consensus.cc:740] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
W20260709 13:04:56.571391 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:45195, user_credentials={real_user=slave}} blocked reactor thread for 195560us
I20260709 13:04:56.565763 16480 raft_consensus.cc:3060] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.555449 16649 consensus_queue.cc:1048] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:04:56.569286 16565 raft_consensus.cc:2804] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.572750 16237 leader_election.cc:304] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:56.576761 16322 raft_consensus.cc:2749] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.577648 16322 consensus_queue.cc:1059] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.577875 16237 leader_election.cc:304] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:56.579754 16322 raft_consensus.cc:2749] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.579949 16237 leader_election.cc:304] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:56.566658 16163 leader_election.cc:304] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:56.581899 16237 leader_election.cc:304] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:56.584244 16316 ts_tablet_manager.cc:1434] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.143s	user 0.007s	sys 0.001s
W20260709 13:04:56.585022 16237 leader_election.cc:343] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.586841 16320 tablet_bootstrap.cc:492] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:56.589520 16320 ts_tablet_manager.cc:1403] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.168s	user 0.017s	sys 0.007s
I20260709 13:04:56.581590 16662 raft_consensus.cc:2749] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.583789 16162 leader_election.cc:304] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:56.588008 16609 raft_consensus.cc:2749] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.592443 16609 raft_consensus.cc:2804] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:56.592753 16162 leader_election.cc:343] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.592779 16609 raft_consensus.cc:493] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:56.593540 16609 raft_consensus.cc:3060] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.605562 16661 raft_consensus.cc:2749] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.609761 16316 tablet_bootstrap.cc:492] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
W20260709 13:04:56.593686 16162 leader_election.cc:343] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.618278 16659 consensus_queue.cc:260] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:56.619047 16014 leader_election.cc:304] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:56.620514 16014 leader_election.cc:304] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:56.620898 16658 raft_consensus.cc:2749] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.621651 16658 raft_consensus.cc:2749] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.617142 16660 raft_consensus.cc:697] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [term 2 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:04:56.622815 16660 consensus_queue.cc:237] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:56.590654 16667 raft_consensus.cc:515] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:56.628736 15944 catalog_manager.cc:5697] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 1 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.617664 16163 leader_election.cc:304] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:56.632618 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:56.633246 16602 raft_consensus.cc:2749] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.638296 16609 raft_consensus.cc:515] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:56.639688 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44eefc0f2e540b99fa97ec775185660" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:56.613476 16651 raft_consensus.cc:697] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 2 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:04:56.648800 16191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1713f6b73c3463c87e7eb5c94959eb0" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:56.649031 16667 leader_election.cc:290] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
W20260709 13:04:56.644271 16162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 49169.6us
I20260709 13:04:56.649731 16659 raft_consensus.cc:3060] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.650334 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154f438524734d2599d72ae02e2230e6" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:56.669987 16196 raft_consensus.cc:3060] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.673203 16040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154f438524734d2599d72ae02e2230e6" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:56.673491 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1713f6b73c3463c87e7eb5c94959eb0" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:56.674520 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d457e5782e42e78f4b0978f2b41dac" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:56.658789 16405 consensus_queue.cc:1059] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:04:56.675700 16041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496077ee29374b90a7c924539c590475" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:56.676046 16045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c600c8f1ec454bc0b4a3716ea85d8499" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.676187 16405 raft_consensus.cc:3055] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.676725 16405 raft_consensus.cc:740] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:04:56.677564 16405 consensus_queue.cc:260] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:56.678735 16405 raft_consensus.cc:3060] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.679831 16162 leader_election.cc:304] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:56.681035 16602 raft_consensus.cc:2804] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.681522 16602 raft_consensus.cc:697] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:56.682308 16602 consensus_queue.cc:237] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:56.657487 16609 leader_election.cc:290] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:56.685580 16088 leader_election.cc:304] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:56.686864 16088 leader_election.cc:304] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:56.687033 16193 raft_consensus.cc:1240] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Rejecting Update request from peer ec8b54f5a9e44f428a4d537391138dcf for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:56.681537 16320 raft_consensus.cc:359] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:56.662418 16317 tablet_bootstrap.cc:492] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:56.688467 16320 raft_consensus.cc:385] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.688714 16317 ts_tablet_manager.cc:1403] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.366s	user 0.026s	sys 0.007s
I20260709 13:04:56.688769 16320 raft_consensus.cc:740] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.689025 16195 raft_consensus.cc:1240] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Rejecting Update request from peer ec8b54f5a9e44f428a4d537391138dcf for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:56.689633 16320 consensus_queue.cc:260] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:56.663297 16014 leader_election.cc:304] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
W20260709 13:04:56.665763 16089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 120054us
I20260709 13:04:56.667815 16191 raft_consensus.cc:3060] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.691315 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105468bfb6dc48c28c16d3449c691f6b" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:56.692307 16014 leader_election.cc:304] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:56.693069 16391 raft_consensus.cc:2804] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:56.693470 16644 raft_consensus.cc:2749] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.693683 16664 raft_consensus.cc:2804] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:56.693884 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:56.694162 16664 raft_consensus.cc:493] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:56.694545 16664 raft_consensus.cc:3060] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.694651 16644 raft_consensus.cc:2749] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.695137 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44eefc0f2e540b99fa97ec775185660" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:56.676257 16041 raft_consensus.cc:3060] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.687980 16189 raft_consensus.cc:1240] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Rejecting Update request from peer ec8b54f5a9e44f428a4d537391138dcf for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:56.687858 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379913b2ca6a49e9bfd93ca8b06c9fee" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:56.654737 16163 leader_election.cc:304] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
W20260709 13:04:56.698618 16163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 43970.4us
I20260709 13:04:56.693516 16391 raft_consensus.cc:493] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:56.700205 16391 raft_consensus.cc:3060] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:56.700414  7276 debug-util.cc:398] Leaking SignalData structure 0x7b0800082e80 after lost signal to thread 16237
I20260709 13:04:56.701259 16236 leader_election.cc:304] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:56.702826 16342 raft_consensus.cc:2749] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.702912 16163 leader_election.cc:304] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:56.704559 16649 raft_consensus.cc:2749] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.706925 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dfecacf6d204abc99b0b341ab7256b1" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:56.707736 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc5c10cfdd24c64a4db9e4339808499" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:56.708196 16195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaad334dede46d888c92db5c932655e" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:56.711427 16697 raft_consensus.cc:493] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.711607 16317 raft_consensus.cc:359] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:56.711997 16697 raft_consensus.cc:515] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:56.712447 16317 raft_consensus.cc:385] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.689982 16545 raft_consensus.cc:515] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:56.696306 16014 leader_election.cc:304] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:56.713976 16658 raft_consensus.cc:2804] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:56.714319 16697 leader_election.cc:290] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:56.714354 16658 raft_consensus.cc:493] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.714722 16545 leader_election.cc:290] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:56.714990 16658 raft_consensus.cc:3060] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.715643 16267 raft_consensus.cc:1240] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Rejecting Update request from peer e1e05442c5b44a079dd1de9dd124c990 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:04:56.721102 16191 raft_consensus.cc:2468] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:56.666482 16565 raft_consensus.cc:697] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:04:56.721956 16014 leader_election.cc:304] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:56.724546 16236 leader_election.cc:304] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4
I20260709 13:04:56.713007 16317 raft_consensus.cc:740] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.726701 16391 raft_consensus.cc:515] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:56.658823 16316 tablet_bootstrap.cc:654] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:56.740129 16236 leader_election.cc:343] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:56.741058 16236 leader_election.cc:343] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.739054 16317 consensus_queue.cc:260] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:56.749814 16391 leader_election.cc:290] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:56.751873 15945 catalog_manager.cc:5697] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 1 to 2, leader changed from d2e22ad700e94d1095c014708c364bb7 (127.7.25.196) to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.755688 16317 ts_tablet_manager.cc:1434] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.000s
I20260709 13:04:56.757745 16320 ts_tablet_manager.cc:1434] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.168s	user 0.007s	sys 0.000s
I20260709 13:04:56.737799 16663 raft_consensus.cc:2749] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.743608 16694 raft_consensus.cc:2804] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:04:56.760381 16015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.775830 16694 raft_consensus.cc:697] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:56.776738 16694 consensus_queue.cc:237] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:56.745249 16644 raft_consensus.cc:2749] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.736908 16565 consensus_queue.cc:237] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:56.742964 16654 consensus_queue.cc:1048] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
W20260709 13:04:56.790443 16236 leader_election.cc:343] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.793744 16236 leader_election.cc:304] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:56.795717 16267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c51469e614423d8a9cc50e024cf468" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.795953 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b6fe9ceac45fb8a980a2feb9cc063" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:56.754460 16193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc5c10cfdd24c64a4db9e4339808499" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:56.801743 16320 tablet_bootstrap.cc:492] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:56.743341 16650 consensus_queue.cc:1059] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260709 13:04:56.803829 16650 raft_consensus.cc:3055] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.804203 16650 raft_consensus.cc:740] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:56.805990 16191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6c90e7e1974ef0ade824c72386b5f3" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:56.742635 16088 leader_election.cc:304] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:56.801604 16196 raft_consensus.cc:2468] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 2.
I20260709 13:04:56.814224 16391 raft_consensus.cc:2749] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:56.813262 15994 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:56.815850 16317 tablet_bootstrap.cc:492] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:56.801673 16689 raft_consensus.cc:2749] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.820062 16391 raft_consensus.cc:493] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.820523 16391 raft_consensus.cc:515] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:56.800230 16480 raft_consensus.cc:515] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:56.819545 16190 raft_consensus.cc:1240] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Rejecting Update request from peer ec8b54f5a9e44f428a4d537391138dcf for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:56.821755 16658 raft_consensus.cc:515] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:56.808887 16651 consensus_queue.cc:237] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:56.832852 16041 raft_consensus.cc:2468] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
W20260709 13:04:56.824451 16088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 120411us
I20260709 13:04:56.835078 16088 leader_election.cc:304] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:56.836740 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:56.851202 16391 leader_election.cc:290] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:56.855767 16195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dfecacf6d204abc99b0b341ab7256b1" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:56.857347 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb3d9bac364b43abf555b36674a82e" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:56.858683 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5dc804032442d1a074ba2adaf03311" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:56.858886 16193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f21b3c8be8f42be9186b827a2a086e3" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:56.858726 16189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44eefc0f2e540b99fa97ec775185660" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:56.841543 16645 raft_consensus.cc:2804] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:56.863004 16319 tablet_bootstrap.cc:492] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:56.863565 16319 ts_tablet_manager.cc:1403] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.482s	user 0.021s	sys 0.010s
I20260709 13:04:56.863910 16650 consensus_queue.cc:260] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:56.865756 16650 raft_consensus.cc:3060] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.867514 16014 leader_election.cc:304] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:56.867633 16609 raft_consensus.cc:493] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.868222 16609 raft_consensus.cc:515] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:56.869293 16648 consensus_queue.cc:1059] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.865844 16044 raft_consensus.cc:1240] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Rejecting Update request from peer d2e22ad700e94d1095c014708c364bb7 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:04:56.878584 16014 leader_election.cc:304] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:56.861006 16645 raft_consensus.cc:493] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:56.884701 16237 leader_election.cc:304] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:56.888351 16342 raft_consensus.cc:2749] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.863055 16189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd3bea4269f4b61adeb12a2cabaca3d" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:56.889360 16237 leader_election.cc:304] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:56.836833 16088 leader_election.cc:304] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:56.880120 16647 raft_consensus.cc:2749] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.869985 16664 raft_consensus.cc:515] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:56.894481 16267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd3bea4269f4b61adeb12a2cabaca3d" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.895702 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:56.895879 16189 raft_consensus.cc:2468] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:56.898502 16319 raft_consensus.cc:359] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:56.883666 16645 raft_consensus.cc:3060] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.910372 16319 raft_consensus.cc:385] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.899603 16237 leader_election.cc:304] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:56.889565 16191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be59fdebe7a44cc9f945fa9793ddfda" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:56.890806 16119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd3bea4269f4b61adeb12a2cabaca3d" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:56.910897 16319 raft_consensus.cc:740] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
W20260709 13:04:56.917673 16701 log.cc:927] Time spent T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:04:56.920631 16320 tablet_bootstrap.cc:654] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.922726 16647 raft_consensus.cc:2749] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.927798 16089 leader_election.cc:304] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:56.937417 16264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd3bea4269f4b61adeb12a2cabaca3d" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:56.923846 16480 leader_election.cc:290] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:56.938870 16664 leader_election.cc:290] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:56.925226 16195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3808fd28794c4ce098037730316b2e58" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:56.925956 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dfecacf6d204abc99b0b341ab7256b1" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:56.929037 16662 raft_consensus.cc:2804] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.891949 16667 raft_consensus.cc:2749] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.913522 16646 raft_consensus.cc:2749] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.930096 16040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc5c10cfdd24c64a4db9e4339808499" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:56.941010 16662 raft_consensus.cc:697] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:56.930466 16045 raft_consensus.cc:1240] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Rejecting Update request from peer e1e05442c5b44a079dd1de9dd124c990 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:56.942049 16662 consensus_queue.cc:237] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:56.943909 16658 leader_election.cc:290] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:56.944690 16162 leader_election.cc:304] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:56.945802 16045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d457e5782e42e78f4b0978f2b41dac" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:56.946507 16045 raft_consensus.cc:3060] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.946990 16663 raft_consensus.cc:2749] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.947849 16317 tablet_bootstrap.cc:654] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:56.948160 16163 leader_election.cc:343] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.949290 16189 raft_consensus.cc:1240] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Rejecting Update request from peer d2e22ad700e94d1095c014708c364bb7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:56.946111 16162 leader_election.cc:304] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:56.950487 16649 raft_consensus.cc:2749] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.950851 16162 leader_election.cc:304] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:56.951730 16480 raft_consensus.cc:2749] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.952337 16480 consensus_queue.cc:1059] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.953354 16480 raft_consensus.cc:3055] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:04:56.932178 16088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 95436.9us
I20260709 13:04:56.954421 16088 leader_election.cc:304] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:56.954515 16645 raft_consensus.cc:515] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:56.932366 16237 leader_election.cc:304] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:56.930909 16193 raft_consensus.cc:1240] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Rejecting Update request from peer d2e22ad700e94d1095c014708c364bb7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:56.925853 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d457e5782e42e78f4b0978f2b41dac" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:56.898828 16041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3808fd28794c4ce098037730316b2e58" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:56.934158 16043 raft_consensus.cc:1240] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Rejecting Update request from peer e1e05442c5b44a079dd1de9dd124c990 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:56.934633 16119 raft_consensus.cc:2468] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:56.936048 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d457e5782e42e78f4b0978f2b41dac" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:56.978976 16264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ffb334ab54abb8bdb4893844c3b6b" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:56.979378 16263 raft_consensus.cc:2393] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e1e05442c5b44a079dd1de9dd124c990 in current term 1: Already voted for candidate d2e22ad700e94d1095c014708c364bb7 in this term.
W20260709 13:04:56.960070 16089 leader_election.cc:343] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.932200 16319 consensus_queue.cc:260] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:56.970970 16667 raft_consensus.cc:2804] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.953935 16480 raft_consensus.cc:740] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:56.900699 16609 leader_election.cc:290] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
W20260709 13:04:56.975425 16014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 96952.7us
I20260709 13:04:56.961450 16563 raft_consensus.cc:2749] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.978646 16391 raft_consensus.cc:2804] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.982863 16014 leader_election.cc:304] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:56.985273 16196 raft_consensus.cc:2393] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 in current term 1: Already voted for candidate e1e05442c5b44a079dd1de9dd124c990 in this term.
I20260709 13:04:56.984854 16480 consensus_queue.cc:260] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:56.976964 16659 consensus_queue.cc:1059] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:04:56.986302 16480 raft_consensus.cc:3060] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.989363 16195 raft_consensus.cc:2410] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:04:56.990423 16405 raft_consensus.cc:2749] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:56.990799 16659 raft_consensus.cc:3055] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.990316 16609 consensus_queue.cc:1059] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.991170 16659 raft_consensus.cc:740] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:56.991827 16609 raft_consensus.cc:3055] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.992244 16609 raft_consensus.cc:740] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:56.992022 16659 consensus_queue.cc:260] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:56.993184 16667 raft_consensus.cc:697] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [term 2 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:56.993060 16609 consensus_queue.cc:260] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:56.994431 16609 raft_consensus.cc:3060] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.994191 16667 consensus_queue.cc:237] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:56.995327 16319 ts_tablet_manager.cc:1434] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.131s	user 0.008s	sys 0.004s
I20260709 13:04:56.997130 16645 leader_election.cc:290] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:56.998322 16014 leader_election.cc:304] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:57.000299 16045 raft_consensus.cc:2468] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:57.000800 16644 raft_consensus.cc:2749] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:57.000944 16014 leader_election.cc:304] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
W20260709 13:04:57.001531 16654 consensus_queue.cc:1175] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "36b15691c8e648a18b69e98bee3349b4" responder_term: 1 status { last_received { term: 0 index: 0 } last_committed_idx: 0 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:04:57.000615 16264 raft_consensus.cc:1275] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Refusing update from remote peer 36b15691c8e648a18b69e98bee3349b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.002789 16162 leader_election.cc:304] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:57.002229 16644 raft_consensus.cc:2749] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:57.002271 16014 leader_election.cc:304] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:57.004251 16659 raft_consensus.cc:3060] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.005525 16014 leader_election.cc:304] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:57.006312 16715 raft_consensus.cc:2749] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:57.006670 16644 raft_consensus.cc:2749] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:57.007395 16014 leader_election.cc:304] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:57.008481 16405 raft_consensus.cc:2749] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:57.008541 16014 leader_election.cc:304] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:57.009451 16405 raft_consensus.cc:2749] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:57.009765 16391 raft_consensus.cc:493] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.009891 16715 consensus_queue.cc:1059] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.010221 16391 raft_consensus.cc:3060] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.010792 16014 leader_election.cc:304] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:57.012420 16163 leader_election.cc:304] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:57.016664 16563 consensus_queue.cc:1048] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.017838 16404 raft_consensus.cc:3055] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:57.018241 16404 raft_consensus.cc:740] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:04:57.019093 16663 raft_consensus.cc:2804] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:57.019563 16663 raft_consensus.cc:493] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.019053 16404 consensus_queue.cc:260] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:57.019886 16663 raft_consensus.cc:3060] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.024374 16319 tablet_bootstrap.cc:492] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:57.028721 16649 raft_consensus.cc:2804] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:57.029738 16644 raft_consensus.cc:3055] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:57.033413 16644 raft_consensus.cc:740] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:04:57.034404 16404 raft_consensus.cc:3060] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.034324 16644 consensus_queue.cc:260] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:57.035152 16645 consensus_queue.cc:1048] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.035761 16644 raft_consensus.cc:3060] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.045325 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9bf004f8eb4f0f910840561945e386" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:57.054625 16391 raft_consensus.cc:515] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
W20260709 13:04:57.055910 16014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 45186.3us
W20260709 13:04:57.058089 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:45195, user_credentials={real_user=slave}} blocked reactor thread for 74477.3us
I20260709 13:04:57.060390 16342 raft_consensus.cc:493] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.053135 16649 raft_consensus.cc:697] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:57.054103 16715 raft_consensus.cc:2749] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:57.063268 16649 consensus_queue.cc:237] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:57.060837 16342 raft_consensus.cc:515] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:57.068439 16342 leader_election.cc:290] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:56.955783 16088 leader_election.cc:304] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
W20260709 13:04:57.070040 16088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 114353us
I20260709 13:04:57.071821 16119 raft_consensus.cc:1240] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Rejecting Update request from peer d2e22ad700e94d1095c014708c364bb7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:57.060489 15944 catalog_manager.cc:5697] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.072912 16650 raft_consensus.cc:493] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.079450 16650 raft_consensus.cc:515] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:57.084735 16391 leader_election.cc:290] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:57.093235 16689 consensus_queue.cc:1048] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.094353 16662 consensus_queue.cc:1059] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.095366 16662 raft_consensus.cc:3055] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:57.095670 16662 raft_consensus.cc:740] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:57.096494 16662 consensus_queue.cc:260] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:57.097843 16662 raft_consensus.cc:3060] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.101255 16650 leader_election.cc:290] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:57.101293 16480 consensus_queue.cc:1048] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:57.105858 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae83b44932ca4fd0a40b66c6e8061284" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
W20260709 13:04:57.107860 16163 leader_election.cc:343] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.092024 16237 leader_election.cc:304] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:57.081178 16645 raft_consensus.cc:2749] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:57.123459 16342 raft_consensus.cc:2749] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.125061 16319 tablet_bootstrap.cc:654] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.127523 16116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae83b44932ca4fd0a40b66c6e8061284" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
W20260709 13:04:57.132051 16012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.122572 16045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c33c4000f496f841f99af79e55532" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:57.196561 16316 tablet_bootstrap.cc:492] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:57.197163 16316 ts_tablet_manager.cc:1403] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.608s	user 0.013s	sys 0.009s
I20260709 13:04:57.199239 16237 leader_election.cc:304] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:57.195914 16480 raft_consensus.cc:493] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.204994 16342 consensus_queue.cc:1048] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.208701 16342 consensus_queue.cc:1059] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.210274 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd3bea4269f4b61adeb12a2cabaca3d" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:57.211002 16480 raft_consensus.cc:515] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:57.212852 16342 raft_consensus.cc:3055] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:57.212709 16316 raft_consensus.cc:359] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:57.213318 16342 raft_consensus.cc:740] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:57.213491 16316 raft_consensus.cc:385] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.213613 16267 raft_consensus.cc:1240] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [term 2 LEADER]: Rejecting Update request from peer ec8b54f5a9e44f428a4d537391138dcf for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:57.213846 16316 raft_consensus.cc:740] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.214673 16342 consensus_queue.cc:260] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:57.209517 16667 raft_consensus.cc:2749] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:57.217629 16267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:57.218072 16043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2d4bd133442d28d078d6fc088cff4" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:57.219926 16663 raft_consensus.cc:515] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:57.220542 16342 raft_consensus.cc:3060] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.221230 16316 consensus_queue.cc:260] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
W20260709 13:04:57.222389 16162 leader_election.cc:343] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.224946 16316 ts_tablet_manager.cc:1434] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:04:57.227886 16316 tablet_bootstrap.cc:492] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:57.213200 16480 leader_election.cc:290] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:57.129055 16088 leader_election.cc:304] T c600c8f1ec454bc0b4a3716ea85d8499 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
W20260709 13:04:57.233407 16163 leader_election.cc:343] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.238862 16163 leader_election.cc:304] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:57.241012 16189 raft_consensus.cc:1240] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Rejecting Update request from peer d2e22ad700e94d1095c014708c364bb7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:57.248310 16190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c33c4000f496f841f99af79e55532" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:57.254827 16342 consensus_queue.cc:1059] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:57.255885 16320 tablet_bootstrap.cc:492] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:57.256608 16320 ts_tablet_manager.cc:1403] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.467s	user 0.042s	sys 0.055s
I20260709 13:04:57.259372 16342 raft_consensus.cc:3055] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:57.232069 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd3bea4269f4b61adeb12a2cabaca3d" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:57.262081 16317 tablet_bootstrap.cc:492] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:57.262595 16317 ts_tablet_manager.cc:1403] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.450s	user 0.017s	sys 0.019s
I20260709 13:04:57.262246 16119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2d4bd133442d28d078d6fc088cff4" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:57.259423 16651 raft_consensus.cc:2749] T c600c8f1ec454bc0b4a3716ea85d8499 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.265344 16197 raft_consensus.cc:2393] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 in current term 1: Already voted for candidate e1e05442c5b44a079dd1de9dd124c990 in this term.
I20260709 13:04:57.265659 16266 raft_consensus.cc:3060] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.267328 16267 raft_consensus.cc:2410] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:04:57.270432 16602 consensus_queue.cc:1048] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.272867 15946 catalog_manager.cc:5697] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 1 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.259886 16342 raft_consensus.cc:740] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
W20260709 13:04:57.275970 16236 leader_election.cc:343] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.276533 16342 consensus_queue.cc:260] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:57.277251 16317 raft_consensus.cc:359] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:57.278709 16317 raft_consensus.cc:385] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.278985 16317 raft_consensus.cc:740] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.283861 16317 consensus_queue.cc:260] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:57.295163 16342 raft_consensus.cc:3060] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:57.295313 16237 leader_election.cc:343] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.297475 16317 ts_tablet_manager.cc:1434] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:04:57.259140 16650 raft_consensus.cc:2749] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.293521 15946 catalog_manager.cc:5697] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 1 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.292706 16320 raft_consensus.cc:359] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:57.302624 16320 raft_consensus.cc:385] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.295970 16237 leader_election.cc:304] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:57.312502 16662 raft_consensus.cc:2749] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:57.316507 16163 leader_election.cc:343] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.317418 16163 leader_election.cc:304] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
W20260709 13:04:57.276940 16088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 154073us
I20260709 13:04:57.312001 16320 raft_consensus.cc:740] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.318107 16317 tablet_bootstrap.cc:492] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:57.293846 16663 leader_election.cc:290] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:57.318632 16320 consensus_queue.cc:260] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:57.331547 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd3bea4269f4b61adeb12a2cabaca3d" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:57.325275 16119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd3bea4269f4b61adeb12a2cabaca3d" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:57.333786 16316 tablet_bootstrap.cc:654] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.336951 16118 raft_consensus.cc:1240] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Rejecting Update request from peer d2e22ad700e94d1095c014708c364bb7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:57.337612 16124 raft_consensus.cc:3060] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.338757 16266 raft_consensus.cc:2468] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:57.343034 16320 ts_tablet_manager.cc:1434] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.000s
I20260709 13:04:57.322229 16650 raft_consensus.cc:2749] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.333868 16119 raft_consensus.cc:2393] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e1e05442c5b44a079dd1de9dd124c990 in current term 1: Already voted for candidate 36b15691c8e648a18b69e98bee3349b4 in this term.
I20260709 13:04:57.356288 16089 leader_election.cc:304] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:57.363168 16195 raft_consensus.cc:1275] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Refusing update from remote peer 36b15691c8e648a18b69e98bee3349b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.365952 16563 raft_consensus.cc:2804] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:57.366524 16563 raft_consensus.cc:697] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:04:57.361471 16667 consensus_queue.cc:1059] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:04:57.374665 16667 raft_consensus.cc:3055] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:57.375088 16667 raft_consensus.cc:740] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:57.375958 16667 consensus_queue.cc:260] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:57.380522 16195 raft_consensus.cc:1275] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Refusing update from remote peer 36b15691c8e648a18b69e98bee3349b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.384907 16190 raft_consensus.cc:1275] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Refusing update from remote peer 36b15691c8e648a18b69e98bee3349b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.367388 16563 consensus_queue.cc:237] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:57.391553 16320 tablet_bootstrap.cc:492] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:57.391492 16342 consensus_queue.cc:1048] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:04:57.399577 16317 tablet_bootstrap.cc:654] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.403151 16342 consensus_queue.cc:1048] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.408281 16163 leader_election.cc:304] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:57.412839 16602 raft_consensus.cc:2749] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.401968 16667 raft_consensus.cc:3060] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.423604 16320 tablet_bootstrap.cc:654] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.427098 16120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:57.428056 16120 raft_consensus.cc:3060] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.428905 16124 raft_consensus.cc:1240] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Rejecting Update request from peer d2e22ad700e94d1095c014708c364bb7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:57.433425 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b6fe9ceac45fb8a980a2feb9cc063" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:57.434140 16342 consensus_queue.cc:1059] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.436728 16040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c51469e614423d8a9cc50e024cf468" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:57.437985 16689 raft_consensus.cc:3055] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:57.444415 16689 raft_consensus.cc:740] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:57.444955 16118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb3d9bac364b43abf555b36674a82e" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:57.445683 16118 raft_consensus.cc:2468] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:04:57.445284 16689 consensus_queue.cc:260] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:57.442728 15945 catalog_manager.cc:5697] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.448688 15945 catalog_manager.cc:5697] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.450652 15945 catalog_manager.cc:5697] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 1 to 2, leader changed from d2e22ad700e94d1095c014708c364bb7 (127.7.25.196) to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.453444 16319 tablet_bootstrap.cc:492] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:57.453954 16319 ts_tablet_manager.cc:1403] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.430s	user 0.034s	sys 0.020s
I20260709 13:04:57.456388 16190 raft_consensus.cc:1275] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Refusing update from remote peer 36b15691c8e648a18b69e98bee3349b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.457769 16689 raft_consensus.cc:3060] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.452445 15945 catalog_manager.cc:5697] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 1 to 2, leader changed from ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193) to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.460851 15945 catalog_manager.cc:5697] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 1 to 2, leader changed from ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193) to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:57.461757 16089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 54400.2us
I20260709 13:04:57.474077 16565 consensus_queue.cc:1048] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.474798 16316 tablet_bootstrap.cc:492] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:57.475489 16316 ts_tablet_manager.cc:1403] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.250s	user 0.020s	sys 0.000s
I20260709 13:04:57.476747 16565 consensus_queue.cc:1048] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.479666 16565 consensus_queue.cc:1048] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.469235 16646 consensus_queue.cc:1048] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:04:57.480805 16042 raft_consensus.cc:3060] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.483237 16040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ffb334ab54abb8bdb4893844c3b6b" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:57.484243 16045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9bf004f8eb4f0f910840561945e386" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:57.486277 16043 raft_consensus.cc:1275] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Refusing update from remote peer 36b15691c8e648a18b69e98bee3349b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.493808 16120 raft_consensus.cc:2468] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:04:57.468530 16660 consensus_queue.cc:1048] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 13:04:57.542112 16014 leader_election.cc:304] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:57.550688 16405 raft_consensus.cc:2804] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:57.571338 16316 raft_consensus.cc:359] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:57.572868 16316 raft_consensus.cc:385] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.573167 16316 raft_consensus.cc:740] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.574396 16316 consensus_queue.cc:260] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:57.587905 16405 raft_consensus.cc:493] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
I20260709 13:04:57.588466 16405 raft_consensus.cc:3060] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.589732 16319 raft_consensus.cc:359] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:57.590556 16319 raft_consensus.cc:385] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.590847 16319 raft_consensus.cc:740] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.592192 16319 consensus_queue.cc:260] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:57.592700 16644 raft_consensus.cc:493] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.615226 16316 ts_tablet_manager.cc:1434] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.139s	user 0.011s	sys 0.000s
I20260709 13:04:57.617182 16319 ts_tablet_manager.cc:1434] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.163s	user 0.007s	sys 0.003s
I20260709 13:04:57.627058 16319 tablet_bootstrap.cc:492] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:57.658387 16198 raft_consensus.cc:1275] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Refusing update from remote peer d2e22ad700e94d1095c014708c364bb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.604951 16644 raft_consensus.cc:515] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:57.606379 16659 consensus_queue.cc:1048] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:04:57.672832 16316 tablet_bootstrap.cc:492] T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:57.677697 16319 tablet_bootstrap.cc:654] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.680248 16689 consensus_queue.cc:1048] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.681429 16320 tablet_bootstrap.cc:492] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:57.681967 16320 ts_tablet_manager.cc:1403] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.324s	user 0.023s	sys 0.000s
I20260709 13:04:57.613238 16088 leader_election.cc:304] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:57.681248 16404 raft_consensus.cc:493] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.695297 16042 raft_consensus.cc:1275] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Refusing update from remote peer d2e22ad700e94d1095c014708c364bb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:57.699657 16163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:45195, user_credentials={real_user=slave}} blocked reactor thread for 126447us
I20260709 13:04:57.711813 16320 raft_consensus.cc:359] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:57.712544 16320 raft_consensus.cc:385] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.712842 16320 raft_consensus.cc:740] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.701315 16664 raft_consensus.cc:2749] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:57.722077 15946 catalog_manager.cc:5697] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 1 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.723869 15946 catalog_manager.cc:5697] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 1 to 2, leader changed from ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193) to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 2 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.732249 16320 consensus_queue.cc:260] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:57.735479 16667 raft_consensus.cc:493] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.736040 16667 raft_consensus.cc:515] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:57.729919 16662 consensus_queue.cc:1048] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:04:57.699740 16404 raft_consensus.cc:515] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:57.738782 16404 leader_election.cc:290] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:57.743837 16649 consensus_queue.cc:1048] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:57.712577 16405 raft_consensus.cc:515] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:57.747385 16405 leader_election.cc:290] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:57.748111 16644 leader_election.cc:290] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:57.748347 16317 tablet_bootstrap.cc:492] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:57.748435 16706 consensus_queue.cc:1048] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:57.749136 16317 ts_tablet_manager.cc:1403] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.438s	user 0.051s	sys 0.044s
I20260709 13:04:57.757592 15943 catalog_manager.cc:5697] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.758607 16316 tablet_bootstrap.cc:654] T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.762169 16667 leader_election.cc:290] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
W20260709 13:04:57.763051 16088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 159766us
I20260709 13:04:57.763428 16320 ts_tablet_manager.cc:1434] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.000s
I20260709 13:04:57.763851 16088 leader_election.cc:304] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:57.764401 16320 tablet_bootstrap.cc:492] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:57.764710 16727 raft_consensus.cc:2749] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.766206 16267 raft_consensus.cc:1275] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Refusing update from remote peer 36b15691c8e648a18b69e98bee3349b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.767767 16088 leader_election.cc:304] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:57.768092 16727 consensus_queue.cc:1048] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:57.768955 16646 raft_consensus.cc:2749] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:04:57.795384 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 77509.7us
I20260709 13:04:57.773008 16664 consensus_queue.cc:1048] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:04:57.779644 16088 leader_election.cc:304] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:57.809783 16667 consensus_queue.cc:1048] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:04:57.845016 16654 raft_consensus.cc:493] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.866604 16391 raft_consensus.cc:2749] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:57.851590 16267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1713f6b73c3463c87e7eb5c94959eb0" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:57.870103 16317 raft_consensus.cc:359] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:57.870966 16317 raft_consensus.cc:385] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.871294 16317 raft_consensus.cc:740] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.871836 16317 consensus_queue.cc:260] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:57.869012 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61baecc1a74998a356870a675301ea" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:57.873924 16042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85079923151849059accd1b7c27d4699" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:57.879889 16189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb3d9bac364b43abf555b36674a82e" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:57.871657 16654 raft_consensus.cc:515] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
W20260709 13:04:57.872588 16747 log.cc:927] Time spent T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:04:57.885387 16317 ts_tablet_manager.cc:1434] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.136s	user 0.006s	sys 0.002s
W20260709 13:04:57.877478 16088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 98326us
I20260709 13:04:57.897332 16697 consensus_queue.cc:1048] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:57.897338 16236 leader_election.cc:343] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.897601 16480 raft_consensus.cc:493] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.900416 16480 raft_consensus.cc:515] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:57.900794 16014 leader_election.cc:304] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:57.901582 16316 tablet_bootstrap.cc:492] T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:57.902083 16316 ts_tablet_manager.cc:1403] T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.230s	user 0.011s	sys 0.013s
I20260709 13:04:57.902555 16480 leader_election.cc:290] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:57.905427 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85079923151849059accd1b7c27d4699" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:57.906751 16044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430a0b8ad91a40389bde4a2dce852afb" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:57.904881 16316 raft_consensus.cc:359] T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:57.908438 16316 raft_consensus.cc:385] T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.908820 16316 raft_consensus.cc:740] T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
W20260709 13:04:57.908813 16162 leader_election.cc:343] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:57.909180 16237 leader_election.cc:343] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.909695 16237 leader_election.cc:304] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:57.911316 16342 raft_consensus.cc:2749] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.915498 16320 tablet_bootstrap.cc:654] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.909708 16316 consensus_queue.cc:260] T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:57.935734 16316 ts_tablet_manager.cc:1434] T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:04:57.937896 16317 tablet_bootstrap.cc:492] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:57.915333 16045 raft_consensus.cc:1240] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Rejecting Update request from peer e1e05442c5b44a079dd1de9dd124c990 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:57.908375 16189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1713f6b73c3463c87e7eb5c94959eb0" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:57.926054 16405 raft_consensus.cc:2804] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:57.936379 16654 leader_election.cc:290] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:57.936779 16727 raft_consensus.cc:493] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.967046 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb3d9bac364b43abf555b36674a82e" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:57.976750 16119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430a0b8ad91a40389bde4a2dce852afb" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:57.972463 16405 raft_consensus.cc:697] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 2 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:04:57.970827 16727 raft_consensus.cc:515] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:57.984388 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c9099428b34e0f9bec85f2159b656e" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:58.011416 16045 raft_consensus.cc:1275] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Refusing update from remote peer 36b15691c8e648a18b69e98bee3349b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:58.012800 16014 leader_election.cc:304] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:58.018976 16715 raft_consensus.cc:2749] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:58.022073 16195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c9099428b34e0f9bec85f2159b656e" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:58.023239 16405 consensus_queue.cc:237] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
W20260709 13:04:58.031236 16163 leader_election.cc:343] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.031953 16163 leader_election.cc:304] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:58.029989 16237 leader_election.cc:304] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:58.034854 16391 consensus_queue.cc:1048] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:58.036903 16391 consensus_queue.cc:1048] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:58.038882 16162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 52193.1us
I20260709 13:04:58.039853 16404 raft_consensus.cc:493] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.040314 16663 consensus_queue.cc:1059] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:58.040607 16195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae83b44932ca4fd0a40b66c6e8061284" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:58.040385 16404 raft_consensus.cc:515] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:58.041401 16195 raft_consensus.cc:2468] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:58.041503 16706 raft_consensus.cc:3055] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:58.041939 16706 raft_consensus.cc:740] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:58.042516 16014 leader_election.cc:304] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:58.042881 16404 leader_election.cc:290] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:58.042761 16706 consensus_queue.cc:260] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:58.044147 16706 raft_consensus.cc:3060] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.015921 16727 leader_election.cc:290] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:58.045439 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae83b44932ca4fd0a40b66c6e8061284" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:58.046121 16263 raft_consensus.cc:2468] T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:58.046903 16609 raft_consensus.cc:2749] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:58.058589 16480 raft_consensus.cc:493] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.067284 16480 raft_consensus.cc:515] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:58.071026 16089 leader_election.cc:304] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:58.079231 16391 raft_consensus.cc:2804] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:58.079644 16391 raft_consensus.cc:493] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.080216 16391 raft_consensus.cc:3060] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.091076 16317 tablet_bootstrap.cc:654] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.099735 16480 leader_election.cc:290] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:58.100553 16727 consensus_queue.cc:1048] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:04:58.120795 16391 raft_consensus.cc:515] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:58.132881 16391 leader_election.cc:290] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
W20260709 13:04:58.134881 16089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 64019.4us
I20260709 13:04:58.135406 16342 raft_consensus.cc:2749] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:58.139367 16118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2d4bd133442d28d078d6fc088cff4" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
W20260709 13:04:58.142096 16014 leader_election.cc:343] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.152778 16193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae83b44932ca4fd0a40b66c6e8061284" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:58.153581 16193 raft_consensus.cc:3060] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.156677 16320 tablet_bootstrap.cc:492] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:58.157250 16320 ts_tablet_manager.cc:1403] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.393s	user 0.020s	sys 0.000s
I20260709 13:04:58.146617 16192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2d4bd133442d28d078d6fc088cff4" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:58.148499 16766 consensus_queue.cc:1048] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:04:58.159101 16192 raft_consensus.cc:2468] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 0.
I20260709 13:04:58.160605 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae83b44932ca4fd0a40b66c6e8061284" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:58.172868 16271 raft_consensus.cc:3060] T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.177070 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3808fd28794c4ce098037730316b2e58" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:58.170058 16320 raft_consensus.cc:359] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:58.178856 16320 raft_consensus.cc:385] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.179239 16320 raft_consensus.cc:740] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.186959 16320 consensus_queue.cc:260] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:58.189146 16271 raft_consensus.cc:2468] T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:58.191648 16404 raft_consensus.cc:2749] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:58.302968 16320 ts_tablet_manager.cc:1434] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.145s	user 0.014s	sys 0.000s
I20260709 13:04:58.185586 16269 raft_consensus.cc:2468] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 2.
W20260709 13:04:58.312985 16089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 117114us
I20260709 13:04:58.303361 16044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3808fd28794c4ce098037730316b2e58" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:58.309408 16654 raft_consensus.cc:493] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.337355 16320 tablet_bootstrap.cc:492] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:58.311348 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61baecc1a74998a356870a675301ea" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:58.346948 16654 raft_consensus.cc:515] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:58.347612 16089 leader_election.cc:304] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:04:58.348379 16391 raft_consensus.cc:2804] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:58.348820 16391 raft_consensus.cc:697] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:04:58.353533 16391 consensus_queue.cc:237] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:58.349113 16654 leader_election.cc:290] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:58.350639 16192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589ea61d3c14d5da5f955ac6d719881" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:58.351233 16319 tablet_bootstrap.cc:492] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:58.359273 16319 ts_tablet_manager.cc:1403] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.732s	user 0.023s	sys 0.025s
I20260709 13:04:58.361657 16163 leader_election.cc:304] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:58.362514 16744 raft_consensus.cc:2804] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:58.362922 16744 raft_consensus.cc:493] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.363265 16744 raft_consensus.cc:3060] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.352707 16316 tablet_bootstrap.cc:492] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:58.352484 16014 leader_election.cc:304] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4
I20260709 13:04:58.371073 16316 tablet_bootstrap.cc:654] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.372365 16405 raft_consensus.cc:2804] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:58.372808 16405 raft_consensus.cc:493] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.373196 16405 raft_consensus.cc:3060] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.362198 16319 raft_consensus.cc:359] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:58.377364 16319 raft_consensus.cc:385] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.377827 16319 raft_consensus.cc:740] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.378506 16319 consensus_queue.cc:260] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:58.379715 16193 raft_consensus.cc:2468] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:58.380462 16405 raft_consensus.cc:515] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:58.409576 16342 raft_consensus.cc:493] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.410367 16342 raft_consensus.cc:515] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:58.393260 15944 catalog_manager.cc:5697] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.415939 16405 leader_election.cc:290] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:58.418586 16755 raft_consensus.cc:493] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:58.417807 16342 leader_election.cc:290] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:58.415555 16644 raft_consensus.cc:493] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.400707 16748 raft_consensus.cc:493] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.429255 16391 raft_consensus.cc:493] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.433862 16391 raft_consensus.cc:515] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:58.438279 16319 ts_tablet_manager.cc:1434] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.009s
I20260709 13:04:58.444108 16715 raft_consensus.cc:493] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
I20260709 13:04:58.444739 16715 raft_consensus.cc:515] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
W20260709 13:04:58.434558 16770 log.cc:927] Time spent T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:04:58.451261 16317 tablet_bootstrap.cc:492] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:58.453014 16317 ts_tablet_manager.cc:1403] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.529s	user 0.015s	sys 0.012s
I20260709 13:04:58.427317 16044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ffb334ab54abb8bdb4893844c3b6b" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:58.455926 16391 leader_election.cc:290] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:58.447517 16744 raft_consensus.cc:515] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:58.460036 16744 leader_election.cc:290] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:58.464535 16319 tablet_bootstrap.cc:492] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
W20260709 13:04:58.466562 15994 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:58.436553 16644 raft_consensus.cc:515] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:58.467669 16744 raft_consensus.cc:493] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.469547 16744 raft_consensus.cc:515] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:58.426105 16755 raft_consensus.cc:515] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:58.488572 16044 raft_consensus.cc:2468] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:58.490536 16118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589ea61d3c14d5da5f955ac6d719881" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:58.491071 16120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ffb334ab54abb8bdb4893844c3b6b" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:58.491765 16120 raft_consensus.cc:2468] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 2.
I20260709 13:04:58.437690 16748 raft_consensus.cc:515] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:58.496923 16748 leader_election.cc:290] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:58.500792 16193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3808fd28794c4ce098037730316b2e58" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:58.501754 16193 raft_consensus.cc:2368] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf for earlier term 2. Current term is 3.
I20260709 13:04:58.476176 16744 leader_election.cc:290] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
W20260709 13:04:58.479305 16771 log.cc:927] Time spent T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:04:58.446976 16715 leader_election.cc:290] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:58.501848 16267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3808fd28794c4ce098037730316b2e58" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:58.512033 16045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3808fd28794c4ce098037730316b2e58" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:58.515584 16014 leader_election.cc:400] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Vote denied by peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725) with higher term. Message: Invalid argument: T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf for earlier term 2. Current term is 3.
I20260709 13:04:58.512920 16045 raft_consensus.cc:3060] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.516140 16014 leader_election.cc:403] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:58.516675 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379913b2ca6a49e9bfd93ca8b06c9fee" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:58.517427 16271 raft_consensus.cc:2468] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:58.508054 16602 raft_consensus.cc:493] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.528434 16316 tablet_bootstrap.cc:492] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:58.529289 16316 ts_tablet_manager.cc:1403] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.177s	user 0.023s	sys 0.026s
I20260709 13:04:58.518227 16267 raft_consensus.cc:3060] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.532051 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c33c4000f496f841f99af79e55532" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:58.520442 16192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2d4bd133442d28d078d6fc088cff4" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:58.519897 16715 raft_consensus.cc:493] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.546747 16237 leader_election.cc:304] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:58.550021 16237 leader_election.cc:304] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:04:58.552778 16320 tablet_bootstrap.cc:654] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.554136 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:58.554906 16115 raft_consensus.cc:2468] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 2.
I20260709 13:04:58.548758 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:58.548039 16715 raft_consensus.cc:515] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:58.563468 16342 raft_consensus.cc:2804] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:58.563928 16342 raft_consensus.cc:493] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.564258 16342 raft_consensus.cc:3060] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.532858 16602 raft_consensus.cc:515] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:58.546912 16192 raft_consensus.cc:3060] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.566983 16405 raft_consensus.cc:493] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:58.540827 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c33c4000f496f841f99af79e55532" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:58.569242 16405 raft_consensus.cc:515] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:58.575086 16263 raft_consensus.cc:2468] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:58.567831 16654 raft_consensus.cc:493] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.591454 16342 raft_consensus.cc:515] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:58.570684 16776 raft_consensus.cc:493] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.594699 16196 raft_consensus.cc:2468] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 2.
I20260709 13:04:58.599020 16316 raft_consensus.cc:359] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:58.599833 16316 raft_consensus.cc:385] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.600096 16316 raft_consensus.cc:740] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.603984 16749 raft_consensus.cc:493] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
I20260709 13:04:58.604492 16319 tablet_bootstrap.cc:654] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.607205 16776 raft_consensus.cc:515] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:58.595839 16654 raft_consensus.cc:515] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:58.611304 16654 leader_election.cc:290] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:58.612807 16644 leader_election.cc:290] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:58.604611 16749 raft_consensus.cc:515] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:58.615782 16749 leader_election.cc:290] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:58.616406 16267 raft_consensus.cc:2468] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 3.
I20260709 13:04:58.616712 16776 leader_election.cc:290] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:58.618505 16602 leader_election.cc:290] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:58.619582 16317 raft_consensus.cc:359] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:58.633824 16317 raft_consensus.cc:385] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.623193 16045 raft_consensus.cc:2468] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 3.
I20260709 13:04:58.624718 16755 leader_election.cc:290] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
W20260709 13:04:58.625406 16162 leader_election.cc:343] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.625949 16715 leader_election.cc:290] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:58.626492 16342 leader_election.cc:290] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:58.581476 16545 raft_consensus.cc:2749] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:58.600790 16316 consensus_queue.cc:260] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:58.634116 16317 raft_consensus.cc:740] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.662299 16405 leader_election.cc:290] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:58.630553 16404 raft_consensus.cc:493] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:58.662460 16317 consensus_queue.cc:260] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:58.634106 16237 leader_election.cc:304] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:04:58.663895 16163 leader_election.cc:304] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:58.664597 16342 raft_consensus.cc:2804] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:58.665021 16342 raft_consensus.cc:493] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.665493 16342 raft_consensus.cc:3060] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.632159 16663 raft_consensus.cc:493] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.630577 16118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
W20260709 13:04:58.669850 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 110295us
I20260709 13:04:58.650545 16756 raft_consensus.cc:2749] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725) with higher term. Message: Invalid argument: T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf for earlier term 2. Current term is 3.
I20260709 13:04:58.641577 16644 raft_consensus.cc:493] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:58.673694 16317 ts_tablet_manager.cc:1434] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.220s	user 0.007s	sys 0.000s
I20260709 13:04:58.669044 16404 raft_consensus.cc:515] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:58.674491 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:58.675637 16316 ts_tablet_manager.cc:1434] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.146s	user 0.007s	sys 0.000s
I20260709 13:04:58.676200 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:58.680456 16044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:58.690213 16404 leader_election.cc:290] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:58.690410 16046 raft_consensus.cc:2393] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 in current term 2: Already voted for candidate ec8b54f5a9e44f428a4d537391138dcf in this term.
I20260709 13:04:58.693249 16120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:58.694005 16120 raft_consensus.cc:2468] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 2.
I20260709 13:04:58.695061 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ffb334ab54abb8bdb4893844c3b6b" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:58.695726 16124 raft_consensus.cc:3060] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.669019 16706 raft_consensus.cc:493] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.687947 16644 raft_consensus.cc:515] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:58.698042 16316 tablet_bootstrap.cc:492] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:58.699676 16644 leader_election.cc:290] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:58.668380 16744 raft_consensus.cc:2804] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:58.670789 16163 leader_election.cc:304] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:58.701490 16317 tablet_bootstrap.cc:492] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:58.686055 16342 raft_consensus.cc:515] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:58.716881 16342 leader_election.cc:290] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:58.717964 16014 leader_election.cc:304] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:58.686635 16118 raft_consensus.cc:2468] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 2.
I20260709 13:04:58.719987 16644 raft_consensus.cc:2749] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:58.713053 16744 raft_consensus.cc:493] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.696841 16706 raft_consensus.cc:515] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:58.674115 16663 raft_consensus.cc:515] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:58.714116 16480 raft_consensus.cc:2804] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:58.713327 16192 raft_consensus.cc:2468] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:04:58.715862 16045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ffb334ab54abb8bdb4893844c3b6b" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:58.751116 16706 leader_election.cc:290] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:58.751868 16191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dfecacf6d204abc99b0b341ab7256b1" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:58.752063 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:58.741395 16744 raft_consensus.cc:3060] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.752801 16269 raft_consensus.cc:2393] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1e05442c5b44a079dd1de9dd124c990 in current term 3: Already voted for candidate d2e22ad700e94d1095c014708c364bb7 in this term.
I20260709 13:04:58.753269 16198 raft_consensus.cc:2468] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 2.
I20260709 13:04:58.754601 16045 raft_consensus.cc:3060] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.751905 16189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:58.756424 16189 raft_consensus.cc:2468] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:04:58.744692 16480 raft_consensus.cc:697] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 3 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:58.758015 16480 consensus_queue.cc:237] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:58.759078 16041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:58.759985 16041 raft_consensus.cc:2468] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 2.
I20260709 13:04:58.752768 16191 raft_consensus.cc:2393] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf in current term 2: Already voted for candidate e1e05442c5b44a079dd1de9dd124c990 in this term.
I20260709 13:04:58.766698 16014 leader_election.cc:304] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:58.753357 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc5c10cfdd24c64a4db9e4339808499" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:58.770627 16044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379913b2ca6a49e9bfd93ca8b06c9fee" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:58.771037 16237 leader_election.cc:304] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:58.775498 16163 leader_election.cc:304] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:58.751248 16195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:58.782397 16117 raft_consensus.cc:1275] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:58.785176 16237 leader_election.cc:304] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:58.770644 16194 raft_consensus.cc:2393] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf in current term 2: Already voted for candidate e1e05442c5b44a079dd1de9dd124c990 in this term.
I20260709 13:04:58.784993 16320 tablet_bootstrap.cc:492] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:58.786608 16320 ts_tablet_manager.cc:1403] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.450s	user 0.016s	sys 0.006s
I20260709 13:04:58.791839 16783 raft_consensus.cc:2804] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:58.792377 16783 raft_consensus.cc:493] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.792707 16783 raft_consensus.cc:3060] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.793740 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:58.797447 16780 raft_consensus.cc:2804] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:58.800736 16780 raft_consensus.cc:493] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
I20260709 13:04:58.789067 16195 raft_consensus.cc:2468] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:04:58.790549 16116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:58.802848 16116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9bf004f8eb4f0f910840561945e386" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:58.803722 16116 raft_consensus.cc:2393] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf in current term 2: Already voted for candidate 36b15691c8e648a18b69e98bee3349b4 in this term.
I20260709 13:04:58.786300 16044 raft_consensus.cc:2468] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:04:58.791886 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ffb334ab54abb8bdb4893844c3b6b" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:58.801174 16780 raft_consensus.cc:3060] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.809767 16088 leader_election.cc:304] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:58.812470 16267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3808fd28794c4ce098037730316b2e58" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:58.812906 16124 raft_consensus.cc:2468] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 3.
I20260709 13:04:58.813295 16651 raft_consensus.cc:2804] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:58.813849 16651 raft_consensus.cc:493] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.814247 16651 raft_consensus.cc:3060] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.814357 16745 raft_consensus.cc:493] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.814803 16745 raft_consensus.cc:515] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:58.815234 16404 consensus_queue.cc:1048] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:58.813475 16267 raft_consensus.cc:2368] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf for earlier term 2. Current term is 3.
I20260709 13:04:58.821655 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:58.822475 16267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44eefc0f2e540b99fa97ec775185660" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:58.822494 16237 leader_election.cc:304] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:04:58.823267 16267 raft_consensus.cc:2468] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:58.824244 16779 raft_consensus.cc:2804] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:58.824743 16779 raft_consensus.cc:697] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 3 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:58.822762 16124 raft_consensus.cc:3060] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.825675 16779 consensus_queue.cc:237] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:58.829404 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ffb334ab54abb8bdb4893844c3b6b" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:58.824720 16163 leader_election.cc:304] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:58.831027 16602 raft_consensus.cc:2804] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:58.831401 16602 raft_consensus.cc:493] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.831754 16602 raft_consensus.cc:3060] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.791460 16706 raft_consensus.cc:2804] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:58.841106 16124 raft_consensus.cc:2468] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 3.
I20260709 13:04:58.816859 16745 leader_election.cc:290] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:58.849751 16316 tablet_bootstrap.cc:654] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.834255 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379913b2ca6a49e9bfd93ca8b06c9fee" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:58.854962 16162 leader_election.cc:304] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:58.843251 16706 raft_consensus.cc:493] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.852281 16014 leader_election.cc:304] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:58.863917 16237 leader_election.cc:304] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:04:58.865218 16663 leader_election.cc:290] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:58.872587 16043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:58.874239 16043 raft_consensus.cc:2468] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 2.
I20260709 13:04:58.866856 16044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44eefc0f2e540b99fa97ec775185660" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:58.875356 16044 raft_consensus.cc:2468] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 2.
I20260709 13:04:58.868597 16120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2d4bd133442d28d078d6fc088cff4" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:58.868927 16602 raft_consensus.cc:515] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:58.876607 16120 raft_consensus.cc:3060] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.860316 16480 raft_consensus.cc:2804] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:58.877949 16480 raft_consensus.cc:493] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.878304 16480 raft_consensus.cc:3060] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.880753 16317 tablet_bootstrap.cc:654] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.881313 16781 raft_consensus.cc:493] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:58.833063 16744 raft_consensus.cc:515] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:58.883225 16781 raft_consensus.cc:515] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:58.884127 16778 raft_consensus.cc:2804] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:58.884805 16404 raft_consensus.cc:2804] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:58.885253 16782 raft_consensus.cc:2804] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:58.885648 16162 leader_election.cc:304] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:58.886096 16014 leader_election.cc:304] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4
I20260709 13:04:58.886518 16264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379913b2ca6a49e9bfd93ca8b06c9fee" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:58.886889 16267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:58.887365 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:58.887634 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dfecacf6d204abc99b0b341ab7256b1" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:58.888756 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc5c10cfdd24c64a4db9e4339808499" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:58.889133 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9bf004f8eb4f0f910840561945e386" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:58.888186 16120 raft_consensus.cc:2468] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:04:58.898036 16783 raft_consensus.cc:515] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:58.861505 16706 raft_consensus.cc:3060] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.900298 16265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44eefc0f2e540b99fa97ec775185660" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:58.906165 16667 raft_consensus.cc:493] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.904232 16780 raft_consensus.cc:515] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:58.910579 16644 raft_consensus.cc:2804] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:58.913316 16778 raft_consensus.cc:697] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 3 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:58.910737 16271 raft_consensus.cc:2468] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:04:58.912216 16014 leader_election.cc:400] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Vote denied by peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631) with higher term. Message: Invalid argument: T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf for earlier term 2. Current term is 3.
I20260709 13:04:58.916847 16266 raft_consensus.cc:2468] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:04:58.914377 16404 raft_consensus.cc:697] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:04:58.917241 16272 raft_consensus.cc:2468] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:04:58.914800 16610 raft_consensus.cc:2804] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:58.903110 16602 leader_election.cc:290] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:58.899811 16480 raft_consensus.cc:515] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:58.919600 16265 raft_consensus.cc:3060] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.927769 16014 leader_election.cc:304] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:58.923158 16644 raft_consensus.cc:493] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.915879 16264 raft_consensus.cc:2468] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 0.
I20260709 13:04:58.917280 16041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44eefc0f2e540b99fa97ec775185660" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:58.920583 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:58.923352 16263 raft_consensus.cc:1275] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:04:58.927698 16766 raft_consensus.cc:493] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:04:58.931011 16610 raft_consensus.cc:493] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.923099 16667 raft_consensus.cc:515] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:58.935220 16269 raft_consensus.cc:2468] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 2.
I20260709 13:04:58.955427 16404 consensus_queue.cc:237] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:58.948496 16263 pending_rounds.cc:85] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7: Aborting all ops after (but not including) 0
I20260709 13:04:58.956974 16263 pending_rounds.cc:107] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:04:58.957371 16263 raft_consensus.cc:2889] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:58.959206 16778 consensus_queue.cc:237] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:58.946201 16644 raft_consensus.cc:3060] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.967746 16320 raft_consensus.cc:359] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:58.967782 16663 raft_consensus.cc:493] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.970173 16663 raft_consensus.cc:515] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:58.972203 16663 leader_election.cc:290] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:58.972678 16320 raft_consensus.cc:385] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.972963 16320 raft_consensus.cc:740] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.973654 16320 consensus_queue.cc:260] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:58.975539 16265 raft_consensus.cc:2468] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 3.
I20260709 13:04:58.977754 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc5c10cfdd24c64a4db9e4339808499" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:58.978585 16049 raft_consensus.cc:2468] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:58.979009 16667 leader_election.cc:290] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:58.980172 16162 leader_election.cc:304] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:58.981453 16649 raft_consensus.cc:2804] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:58.950518 16041 raft_consensus.cc:3060] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.981798 16649 raft_consensus.cc:493] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.982213 16649 raft_consensus.cc:3060] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.984935 16319 tablet_bootstrap.cc:492] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:58.985683 16163 leader_election.cc:304] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:58.985680 16319 ts_tablet_manager.cc:1403] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.534s	user 0.016s	sys 0.010s
I20260709 13:04:58.993265 16780 leader_election.cc:290] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:58.993918 16193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:58.994776 16193 raft_consensus.cc:2368] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 for earlier term 2. Current term is 3.
I20260709 13:04:58.995110 16744 leader_election.cc:290] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
W20260709 13:04:59.001371 16790 log.cc:927] Time spent T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:04:59.001995 16237 leader_election.cc:400] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 election: Vote denied by peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725) with higher term. Message: Invalid argument: T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 for earlier term 2. Current term is 3.
I20260709 13:04:59.002331 16237 leader_election.cc:403] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:04:59.004097 16781 leader_election.cc:290] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:59.005267 16116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b6fe9ceac45fb8a980a2feb9cc063" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:59.005736 16783 leader_election.cc:290] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:59.006103 16116 raft_consensus.cc:2393] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf in current term 2: Already voted for candidate 36b15691c8e648a18b69e98bee3349b4 in this term.
I20260709 13:04:59.007241 16320 ts_tablet_manager.cc:1434] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.220s	user 0.002s	sys 0.004s
I20260709 13:04:59.008253 16320 tablet_bootstrap.cc:492] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:59.008531 16193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:59.009368 16193 raft_consensus.cc:2393] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf in current term 3: Already voted for candidate e1e05442c5b44a079dd1de9dd124c990 in this term.
I20260709 13:04:59.004932 16319 raft_consensus.cc:359] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:59.018394 16319 raft_consensus.cc:385] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.960500 16610 raft_consensus.cc:3060] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:58.962560 16782 raft_consensus.cc:493] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.018697 16319 raft_consensus.cc:740] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.026894 16342 raft_consensus.cc:3060] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.025442 16319 consensus_queue.cc:260] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:59.019407 16663 raft_consensus.cc:2804] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:59.030588 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c33c4000f496f841f99af79e55532" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:59.038409 16265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc5c10cfdd24c64a4db9e4339808499" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:59.043124 16265 raft_consensus.cc:2468] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 2.
I20260709 13:04:58.962805 16766 raft_consensus.cc:515] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:59.050221 16663 raft_consensus.cc:697] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 3 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:59.050652 16040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b6fe9ceac45fb8a980a2feb9cc063" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:59.055835 16646 consensus_queue.cc:1048] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:59.048792 16272 raft_consensus.cc:3060] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.044731 16045 raft_consensus.cc:2468] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 3.
I20260709 13:04:59.027933 16782 raft_consensus.cc:3060] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.069634 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c33c4000f496f841f99af79e55532" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:59.070756 16480 leader_election.cc:290] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:59.077179 16042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:59.082968 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:59.087910 16602 raft_consensus.cc:493] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.093626 16342 raft_consensus.cc:2749] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725) with higher term. Message: Invalid argument: T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 for earlier term 2. Current term is 3.
I20260709 13:04:59.119980 16405 raft_consensus.cc:2749] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:59.125442 16124 raft_consensus.cc:2468] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:59.163676 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b6fe9ceac45fb8a980a2feb9cc063" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:59.164718 16124 raft_consensus.cc:2468] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 2.
I20260709 13:04:59.120007 16040 raft_consensus.cc:2468] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:04:59.137792 15946 catalog_manager.cc:5697] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 1 to 2, leader changed from d2e22ad700e94d1095c014708c364bb7 (127.7.25.196) to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 2 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:59.119517 16651 raft_consensus.cc:515] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:59.178500 16237 leader_election.cc:304] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:04:59.175578 16042 raft_consensus.cc:2368] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 for earlier term 2. Current term is 3.
I20260709 13:04:59.183569 16342 raft_consensus.cc:2804] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:59.183948 16342 raft_consensus.cc:493] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.184315 16342 raft_consensus.cc:3060] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.190604 16316 tablet_bootstrap.cc:492] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:59.191192 16316 ts_tablet_manager.cc:1403] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.493s	user 0.017s	sys 0.022s
I20260709 13:04:59.192255 16649 raft_consensus.cc:515] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:59.193732 16319 ts_tablet_manager.cc:1434] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.205s	user 0.048s	sys 0.045s
I20260709 13:04:59.195011 16319 tablet_bootstrap.cc:492] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:04:59.176548 16663 consensus_queue.cc:237] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:59.195459 16265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc5c10cfdd24c64a4db9e4339808499" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:59.196082 16265 raft_consensus.cc:3060] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.197430 16040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:59.198323 16040 raft_consensus.cc:2393] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e1e05442c5b44a079dd1de9dd124c990 in current term 3: Already voted for candidate ec8b54f5a9e44f428a4d537391138dcf in this term.
W20260709 13:04:59.203356 16162 leader_election.cc:343] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.203795 16766 leader_election.cc:290] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:59.204528 16014 leader_election.cc:304] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:59.205763 16320 tablet_bootstrap.cc:654] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.205708 16014 leader_election.cc:304] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:59.206133 16317 tablet_bootstrap.cc:492] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:59.154037 16602 raft_consensus.cc:515] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:59.206651 16317 ts_tablet_manager.cc:1403] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.518s	user 0.014s	sys 0.008s
I20260709 13:04:59.207351 16014 leader_election.cc:304] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4
I20260709 13:04:59.207885 16405 raft_consensus.cc:2804] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:59.209923 16405 raft_consensus.cc:493] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:59.210314 16405 raft_consensus.cc:3060] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:59.226274 16342 raft_consensus.cc:515] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:59.228266 16014 leader_election.cc:304] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:59.200697 16706 raft_consensus.cc:515] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:59.238224 16265 raft_consensus.cc:2468] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 3.
I20260709 13:04:59.231663 16783 raft_consensus.cc:2804] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.239346 16783 raft_consensus.cc:493] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.239307 16781 consensus_queue.cc:1048] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:59.240013 16783 raft_consensus.cc:3060] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.241771 16123 raft_consensus.cc:2393] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf in current term 1: Already voted for candidate 36b15691c8e648a18b69e98bee3349b4 in this term.
I20260709 13:04:59.242404 16651 leader_election.cc:290] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:59.243050 16195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:59.251008 16163 leader_election.cc:304] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:59.252322 16272 raft_consensus.cc:2468] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:59.253125 16480 raft_consensus.cc:2804] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:59.253695 16480 raft_consensus.cc:697] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 3 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:59.258579 16163 leader_election.cc:304] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:59.259312 16236 leader_election.cc:400] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 election: Vote denied by peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491) with higher term. Message: Invalid argument: T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 for earlier term 2. Current term is 3.
I20260709 13:04:59.257722 16316 raft_consensus.cc:359] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:59.270699 16316 raft_consensus.cc:385] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.271107 16316 raft_consensus.cc:740] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.227406 16404 raft_consensus.cc:2804] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:59.271871 16316 consensus_queue.cc:260] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:59.231738 16756 raft_consensus.cc:2804] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:59.281759 16342 leader_election.cc:290] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:59.291339 16198 raft_consensus.cc:2393] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 in current term 3: Already voted for candidate e1e05442c5b44a079dd1de9dd124c990 in this term.
I20260709 13:04:59.276858 16744 raft_consensus.cc:2804] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.293479 16269 raft_consensus.cc:2468] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 3.
I20260709 13:04:59.294677 16706 leader_election.cc:290] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:59.295265 16602 leader_election.cc:290] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:59.285028 16756 raft_consensus.cc:493] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:59.296276 16756 raft_consensus.cc:3060] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:59.261983 16545 raft_consensus.cc:493] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.300148 16610 raft_consensus.cc:515] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:59.300207 16545 raft_consensus.cc:515] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:59.285594 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379913b2ca6a49e9bfd93ca8b06c9fee" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:59.301955 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b6fe9ceac45fb8a980a2feb9cc063" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:59.302678 16272 raft_consensus.cc:2368] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf for earlier term 2. Current term is 3.
I20260709 13:04:59.276202 16040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:59.302896 16545 leader_election.cc:290] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:59.304745 16043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b6fe9ceac45fb8a980a2feb9cc063" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:59.305449 16264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:59.305619 16043 raft_consensus.cc:3060] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.306314 16264 raft_consensus.cc:2393] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf in current term 3: Already voted for candidate e1e05442c5b44a079dd1de9dd124c990 in this term.
I20260709 13:04:59.293479 16041 raft_consensus.cc:2468] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 3.
I20260709 13:04:59.290261 16405 raft_consensus.cc:515] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
W20260709 13:04:59.312544 16089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 101055us
I20260709 13:04:59.308353 16480 consensus_queue.cc:237] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:59.286917 16649 leader_election.cc:290] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:59.317405 16745 raft_consensus.cc:493] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.281245 16404 raft_consensus.cc:493] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:04:59.322901 16404 raft_consensus.cc:3060] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:59.322801 16745 raft_consensus.cc:515] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:59.325343 16120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368367d6b6834e7b841b41cd87884744" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:04:59.326660 16610 leader_election.cc:290] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:59.330827 16316 ts_tablet_manager.cc:1434] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.139s	user 0.007s	sys 0.001s
I20260709 13:04:59.333897 16405 leader_election.cc:290] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
W20260709 13:04:59.335668 16237 leader_election.cc:343] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.324879 16745 leader_election.cc:290] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:59.346683 16319 tablet_bootstrap.cc:654] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.347546 16163 leader_election.cc:304] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:59.317667 16744 raft_consensus.cc:697] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:59.343750 16119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b6fe9ceac45fb8a980a2feb9cc063" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:59.345906 16042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc5c10cfdd24c64a4db9e4339808499" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:59.352095 16195 raft_consensus.cc:2368] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 for earlier term 2. Current term is 3.
I20260709 13:04:59.370563 16014 leader_election.cc:400] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Vote denied by peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631) with higher term. Message: Invalid argument: T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf for earlier term 2. Current term is 3.
I20260709 13:04:59.370939 16014 leader_election.cc:403] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:59.375195 16744 consensus_queue.cc:237] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:59.355513 16049 raft_consensus.cc:1275] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Refusing update from remote peer e1e05442c5b44a079dd1de9dd124c990: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:59.355654 16649 raft_consensus.cc:2804] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:59.353776 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc5c10cfdd24c64a4db9e4339808499" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:59.371977 16042 raft_consensus.cc:3060] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.384456 16044 raft_consensus.cc:1275] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Refusing update from remote peer d2e22ad700e94d1095c014708c364bb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:59.371621 16119 raft_consensus.cc:3060] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.390370 16317 raft_consensus.cc:359] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:59.390916 16045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dfecacf6d204abc99b0b341ab7256b1" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:59.367594 16782 raft_consensus.cc:515] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:59.391373 16317 raft_consensus.cc:385] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.393213 16317 raft_consensus.cc:740] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.393249 16265 raft_consensus.cc:1240] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Rejecting Update request from peer ec8b54f5a9e44f428a4d537391138dcf for earlier term 2. Current term is 3. Ops: [2.1-2.1]
I20260709 13:04:59.394203 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368367d6b6834e7b841b41cd87884744" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:59.394479 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:59.394920 16272 raft_consensus.cc:2468] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:04:59.396467 16264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dfecacf6d204abc99b0b341ab7256b1" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:04:59.397506 16264 raft_consensus.cc:2468] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 2.
I20260709 13:04:59.396497 16317 consensus_queue.cc:260] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:59.399537 16756 raft_consensus.cc:515] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:59.404255 16043 raft_consensus.cc:2468] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 3.
I20260709 13:04:59.406067 16120 raft_consensus.cc:1275] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Refusing update from remote peer d2e22ad700e94d1095c014708c364bb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:59.408247 16405 raft_consensus.cc:2749] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631) with higher term. Message: Invalid argument: T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf for earlier term 2. Current term is 3.
I20260709 13:04:59.410988 16756 leader_election.cc:290] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:59.384820 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:59.419329 16014 leader_election.cc:304] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:04:59.418586 16780 raft_consensus.cc:493] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.423928 16780 raft_consensus.cc:515] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:59.426280 16780 leader_election.cc:290] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:59.349056 16644 raft_consensus.cc:515] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:59.428781 16040 raft_consensus.cc:2368] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 for earlier term 2. Current term is 3.
I20260709 13:04:59.430454 16644 leader_election.cc:290] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:59.433411 16545 consensus_queue.cc:1048] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:59.434369 16236 leader_election.cc:304] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:04:59.434958 16163 leader_election.cc:304] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:59.435796 16545 raft_consensus.cc:2804] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:59.436465 16545 raft_consensus.cc:697] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 3 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:04:59.435671 16779 consensus_queue.cc:1048] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:59.437196 16649 raft_consensus.cc:697] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 3 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:59.438208 16649 consensus_queue.cc:237] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:59.439958 16189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15550bacc7b04df9bc56ec154f31b50b" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:59.442672 16163 leader_election.cc:304] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:59.442994 16088 leader_election.cc:400] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491) with higher term. Message: Invalid argument: T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 for earlier term 2. Current term is 3.
I20260709 13:04:59.443967 16663 consensus_queue.cc:1048] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:59.444244 16088 leader_election.cc:403] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:59.444685 16745 raft_consensus.cc:2804] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.445182 16745 raft_consensus.cc:493] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.445555 16745 raft_consensus.cc:3060] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:59.446115 16237 leader_election.cc:343] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.446745 16783 raft_consensus.cc:515] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:59.448179 16046 raft_consensus.cc:2393] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 in current term 1: Already voted for candidate ec8b54f5a9e44f428a4d537391138dcf in this term.
I20260709 13:04:59.449026 16391 raft_consensus.cc:3060] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.452665 16783 leader_election.cc:290] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:59.453727 16545 consensus_queue.cc:237] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:59.455875 16272 raft_consensus.cc:1275] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Refusing update from remote peer e1e05442c5b44a079dd1de9dd124c990: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:59.457669 16660 raft_consensus.cc:493] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
I20260709 13:04:59.507766 16391 raft_consensus.cc:2749] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491) with higher term. Message: Invalid argument: T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 for earlier term 2. Current term is 3.
I20260709 13:04:59.459231 16756 raft_consensus.cc:2749] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:59.444185 16191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368367d6b6834e7b841b41cd87884744" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:59.510988 16317 ts_tablet_manager.cc:1434] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.302s	user 0.008s	sys 0.000s
I20260709 13:04:59.460597 16119 raft_consensus.cc:2468] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 3.
I20260709 13:04:59.461485 16755 raft_consensus.cc:493] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:59.462534 16799 log.cc:927] Time spent T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:04:59.463725 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:59.520128 16745 raft_consensus.cc:515] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:59.521481 16264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc5c10cfdd24c64a4db9e4339808499" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:59.522486 16264 raft_consensus.cc:2368] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf for earlier term 2. Current term is 3.
I20260709 13:04:59.524533 16745 leader_election.cc:290] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:59.464507 16116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379913b2ca6a49e9bfd93ca8b06c9fee" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:59.525223 16267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379913b2ca6a49e9bfd93ca8b06c9fee" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:59.525776 16116 raft_consensus.cc:2393] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf in current term 1: Already voted for candidate 36b15691c8e648a18b69e98bee3349b4 in this term.
I20260709 13:04:59.525975 16267 raft_consensus.cc:3060] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.526830 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379913b2ca6a49e9bfd93ca8b06c9fee" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:59.465749 16041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15550bacc7b04df9bc56ec154f31b50b" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:59.468641 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:59.470124 16405 consensus_queue.cc:1048] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:59.472127 16120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9bf004f8eb4f0f910840561945e386" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:04:59.423494 16316 tablet_bootstrap.cc:492] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:04:59.445592 16663 raft_consensus.cc:2804] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:59.475734 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:04:59.467319 16782 leader_election.cc:290] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
W20260709 13:04:59.493364 16089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 137043us
I20260709 13:04:59.458920 16320 tablet_bootstrap.cc:492] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:04:59.517993 16317 tablet_bootstrap.cc:492] T 368367d6b6834e7b841b41cd87884744 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:04:59.515555 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:04:59.515290 16667 raft_consensus.cc:493] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.544473 16320 ts_tablet_manager.cc:1403] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.536s	user 0.017s	sys 0.015s
I20260709 13:04:59.551111 16120 raft_consensus.cc:2393] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf in current term 2: Already voted for candidate 36b15691c8e648a18b69e98bee3349b4 in this term.
I20260709 13:04:59.551882 16191 raft_consensus.cc:2393] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 in current term 1: Already voted for candidate e1e05442c5b44a079dd1de9dd124c990 in this term.
I20260709 13:04:59.554101 16667 raft_consensus.cc:515] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:59.540982 16663 raft_consensus.cc:493] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.513109 16660 raft_consensus.cc:515] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
W20260709 13:04:59.579944 16236 leader_election.cc:343] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.595515 16236 leader_election.cc:304] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
W20260709 13:04:59.592664 15994 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:59.601799 16014 leader_election.cc:400] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Vote denied by peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631) with higher term. Message: Invalid argument: T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf for earlier term 2. Current term is 3.
I20260709 13:04:59.602243 16014 leader_election.cc:403] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:04:59.549256 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9bf004f8eb4f0f910840561945e386" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:59.531107 16755 raft_consensus.cc:515] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:59.607928 16320 raft_consensus.cc:359] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:59.612699 16320 raft_consensus.cc:385] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.613006 16320 raft_consensus.cc:740] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.603487 16194 raft_consensus.cc:2393] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf in current term 3: Already voted for candidate e1e05442c5b44a079dd1de9dd124c990 in this term.
I20260709 13:04:59.611677 16014 leader_election.cc:304] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:04:59.615325 16320 consensus_queue.cc:260] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:59.597380 16663 raft_consensus.cc:3060] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.601070 16780 raft_consensus.cc:2749] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.617946 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85079923151849059accd1b7c27d4699" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:59.619000 16236 leader_election.cc:304] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:04:59.594508 16565 consensus_queue.cc:1048] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 13:04:59.594681 16756 consensus_queue.cc:1059] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 13:04:59.632473 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368367d6b6834e7b841b41cd87884744" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:59.644129 16269 raft_consensus.cc:3060] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.622733 16776 raft_consensus.cc:2749] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.628557 16745 consensus_queue.cc:1048] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:04:59.645268 16404 raft_consensus.cc:515] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:59.647572 16404 leader_election.cc:290] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:59.648557 16123 raft_consensus.cc:2468] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 3.
I20260709 13:04:59.649096 16755 leader_election.cc:290] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:59.649782 16780 raft_consensus.cc:2749] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:59.654147 16756 raft_consensus.cc:3055] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:59.654590 16756 raft_consensus.cc:740] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:04:59.655516 16756 consensus_queue.cc:260] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:59.656678 16756 raft_consensus.cc:3060] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.657168 16317 tablet_bootstrap.cc:654] T 368367d6b6834e7b841b41cd87884744 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.638800 16049 raft_consensus.cc:1275] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Refusing update from remote peer e1e05442c5b44a079dd1de9dd124c990: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:59.639484 16667 leader_election.cc:290] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:59.639881 16660 leader_election.cc:290] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:04:59.663064 16316 tablet_bootstrap.cc:654] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:59.681825 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 62887.5us
W20260709 13:04:59.685721 16236 leader_election.cc:343] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.688416 16319 tablet_bootstrap.cc:492] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:04:59.690227 16319 ts_tablet_manager.cc:1403] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.495s	user 0.028s	sys 0.044s
I20260709 13:04:59.670205 16045 raft_consensus.cc:2468] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 2.
I20260709 13:04:59.702610 16197 raft_consensus.cc:1275] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Refusing update from remote peer d2e22ad700e94d1095c014708c364bb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:59.689733 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430a0b8ad91a40389bde4a2dce852afb" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:04:59.741963 16667 consensus_queue.cc:1048] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:04:59.776132 16663 raft_consensus.cc:515] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:59.778003 16194 raft_consensus.cc:2468] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 0.
I20260709 13:04:59.779208 16649 raft_consensus.cc:493] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.789533 16649 raft_consensus.cc:515] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:04:59.791930 16649 leader_election.cc:290] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:04:59.795760 16663 leader_election.cc:290] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:04:59.799086 16266 raft_consensus.cc:2468] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:04:59.784520 16269 raft_consensus.cc:2468] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:04:59.744143 16267 raft_consensus.cc:2468] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:04:59.803754 16320 ts_tablet_manager.cc:1434] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.255s	user 0.004s	sys 0.003s
I20260709 13:04:59.835618 16320 tablet_bootstrap.cc:492] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:04:59.838083 16163 leader_election.cc:304] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:59.840277 16480 raft_consensus.cc:2804] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.846868 16480 raft_consensus.cc:697] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:59.847651 16480 consensus_queue.cc:237] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:59.910792 16317 tablet_bootstrap.cc:492] T 368367d6b6834e7b841b41cd87884744 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:04:59.911352 16317 ts_tablet_manager.cc:1403] T 368367d6b6834e7b841b41cd87884744 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.394s	user 0.012s	sys 0.008s
I20260709 13:04:59.913914 16404 raft_consensus.cc:493] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.914489 16404 raft_consensus.cc:515] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:59.916620 16404 leader_election.cc:290] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:04:59.917152 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dfecacf6d204abc99b0b341ab7256b1" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:04:59.917932 16272 raft_consensus.cc:3060] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:59.918000 16319 raft_consensus.cc:359] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:59.919148 16319 raft_consensus.cc:385] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.919498 16319 raft_consensus.cc:740] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.922125 16319 consensus_queue.cc:260] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:59.937072 16272 raft_consensus.cc:2468] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 3.
I20260709 13:04:59.939548 16269 raft_consensus.cc:1275] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Refusing update from remote peer e1e05442c5b44a079dd1de9dd124c990: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:59.944191 16320 tablet_bootstrap.cc:654] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.949613 16269 raft_consensus.cc:1275] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Refusing update from remote peer e1e05442c5b44a079dd1de9dd124c990: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:59.949656 16163 leader_election.cc:304] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:04:59.952348 16610 raft_consensus.cc:2804] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:59.953261 16602 consensus_queue.cc:1048] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:59.952881 16610 raft_consensus.cc:697] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 3 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:04:59.958686 16319 ts_tablet_manager.cc:1434] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.222s	user 0.006s	sys 0.002s
I20260709 13:04:59.960844 16610 consensus_queue.cc:237] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:04:59.964429 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb3d9bac364b43abf555b36674a82e" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:04:59.967823 16048 raft_consensus.cc:2468] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 2.
I20260709 13:04:59.965975 16317 raft_consensus.cc:359] T 368367d6b6834e7b841b41cd87884744 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:59.968844 16602 consensus_queue.cc:1048] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:59.969364 16317 raft_consensus.cc:385] T 368367d6b6834e7b841b41cd87884744 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.969771 16317 raft_consensus.cc:740] T 368367d6b6834e7b841b41cd87884744 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.970546 16316 tablet_bootstrap.cc:492] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:04:59.971046 16316 ts_tablet_manager.cc:1403] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.548s	user 0.046s	sys 0.059s
I20260709 13:04:59.972216 16317 consensus_queue.cc:260] T 368367d6b6834e7b841b41cd87884744 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:04:59.989019 16317 ts_tablet_manager.cc:1434] T 368367d6b6834e7b841b41cd87884744 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.000s
I20260709 13:04:59.989382 16316 raft_consensus.cc:359] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:04:59.990298 16316 raft_consensus.cc:385] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.990648 16316 raft_consensus.cc:740] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.999413 16316 consensus_queue.cc:260] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:00.002804 16316 ts_tablet_manager.cc:1434] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:05:00.006276 16320 tablet_bootstrap.cc:492] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:05:00.006879 16320 ts_tablet_manager.cc:1403] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.186s	user 0.014s	sys 0.010s
W20260709 13:05:00.049110 16042 consensus_meta.cc:287] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf: Time spent flushing consensus metadata: real 0.663s	user 0.016s	sys 0.000s
I20260709 13:05:00.049634 16042 raft_consensus.cc:2468] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 3.
I20260709 13:05:00.065616 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85079923151849059accd1b7c27d4699" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
W20260709 13:05:00.113464 16013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:00.249491 16405 raft_consensus.cc:2749] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631) with higher term. Message: Invalid argument: T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf for earlier term 2. Current term is 3.
I20260709 13:05:00.258986 16043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dfecacf6d204abc99b0b341ab7256b1" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:05:00.263185 16829 raft_consensus.cc:493] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.263892 16829 raft_consensus.cc:515] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:00.266223 16829 leader_election.cc:290] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
W20260709 13:05:00.279399 16090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.013s	sys 0.020s
W20260709 13:05:00.279843 16090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.013s	sys 0.021s
W20260709 13:05:00.285470 16088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.006s	sys 0.013s
W20260709 13:05:00.285904 16088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.006s	sys 0.013s
W20260709 13:05:00.286181 16088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 692544us
I20260709 13:05:00.289288 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dfecacf6d204abc99b0b341ab7256b1" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:05:00.292990 16817 raft_consensus.cc:493] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.293252 16818 raft_consensus.cc:493] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
I20260709 13:05:00.293689 16817 raft_consensus.cc:515] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:00.293892 16818 raft_consensus.cc:515] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:00.296391 16817 leader_election.cc:290] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:00.296917 16820 raft_consensus.cc:493] T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.297531 16820 raft_consensus.cc:515] T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:00.299642 16820 leader_election.cc:290] T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:00.301354 16041 raft_consensus.cc:3060] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.303941 16043 raft_consensus.cc:1275] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Refusing update from remote peer e1e05442c5b44a079dd1de9dd124c990: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:00.308954 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2d4bd133442d28d078d6fc088cff4" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:00.310017 16162 leader_election.cc:304] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:00.311805 16829 raft_consensus.cc:2804] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:00.315351 16829 raft_consensus.cc:493] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.313037 16663 consensus_queue.cc:1048] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.315871 16818 leader_election.cc:290] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:00.316704 16829 raft_consensus.cc:3060] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.318300 16116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430a0b8ad91a40389bde4a2dce852afb" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:00.319114 16116 raft_consensus.cc:2468] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 0.
I20260709 13:05:00.321830 16043 raft_consensus.cc:1275] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Refusing update from remote peer e1e05442c5b44a079dd1de9dd124c990: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:00.324251 16663 raft_consensus.cc:493] T fc581e6f2f6741bc9a63c49459198306 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:00.324837 16663 raft_consensus.cc:515] T fc581e6f2f6741bc9a63c49459198306 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:00.327389 16663 leader_election.cc:290] T fc581e6f2f6741bc9a63c49459198306 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:05:00.336012 16663 raft_consensus.cc:493] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.336733 16319 tablet_bootstrap.cc:492] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:05:00.336511 16663 raft_consensus.cc:515] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:00.337267 16706 consensus_queue.cc:1048] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.338915 16706 consensus_queue.cc:1048] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.339183 16663 leader_election.cc:290] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:00.341426 16829 raft_consensus.cc:515] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:00.344396 16829 leader_election.cc:290] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:00.367062 16319 tablet_bootstrap.cc:654] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.370393 16818 raft_consensus.cc:493] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
I20260709 13:05:00.372828 16818 raft_consensus.cc:515] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:00.377429 16818 leader_election.cc:290] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
W20260709 13:05:00.379778 16162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 45618.6us
I20260709 13:05:00.383337 16191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37786 (request call id 141) took 1025 ms. Trace:
I20260709 13:05:00.383821 16191 rpcz_store.cc:276] 0709 13:04:59.357982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.363653 (+  5671us) service_pool.cc:224] Handling call
0709 13:04:59.443994 (+ 80341us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b58007c6898. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c5360b71 00007f36c5360a22 00007f36ce279c09 00007f36cd3d3ee0 00007f36cd49d0ab 00007f36cd49d131 00007f36cd44b0a0 00007f36cd44a984 00007f36c69c56d4 00007f36c69c5662
0709 13:05:00.383144 (+939150us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b54009b4bd4. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ee571 00007f36c84892fa 00007f36cd44ab17 00007f36c69c56d4 00007f36c69c5662 00007f36c69c5591 00007f36c69c550c 00007f36c69c47c2 00007f36c67c048c 00007f36c67bf8c6 00007f36c67bf26f
0709 13:05:00.383282 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59098752}
I20260709 13:05:00.386690 16043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb3d9bac364b43abf555b36674a82e" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:05:00.387583 16041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15550bacc7b04df9bc56ec154f31b50b" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
W20260709 13:05:00.388556 16089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.001s	sys 0.012s
W20260709 13:05:00.389045 16089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.001s	sys 0.012s
I20260709 13:05:00.388549 16043 raft_consensus.cc:3060] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.392292 16116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:00.393349 16116 raft_consensus.cc:2393] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e1e05442c5b44a079dd1de9dd124c990 in current term 3: Already voted for candidate d2e22ad700e94d1095c014708c364bb7 in this term.
I20260709 13:05:00.401439 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dfecacf6d204abc99b0b341ab7256b1" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:00.402438 16263 raft_consensus.cc:2368] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf for earlier term 2. Current term is 3.
W20260709 13:05:00.403216 16162 leader_election.cc:343] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:00.403360 16319 tablet_bootstrap.cc:492] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:05:00.404114 16319 ts_tablet_manager.cc:1403] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.000s
I20260709 13:05:00.405840 16316 tablet_bootstrap.cc:492] T 2fc1bcba29c24ea9b5582464ad0ba47e P d2e22ad700e94d1095c014708c364bb7: Bootstrap starting.
I20260709 13:05:00.406958 16319 raft_consensus.cc:359] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:00.407704 16319 raft_consensus.cc:385] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.407958 16319 raft_consensus.cc:740] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.408610 16319 consensus_queue.cc:260] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:00.410903 16830 raft_consensus.cc:493] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:00.411530 16043 raft_consensus.cc:2468] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 3.
I20260709 13:05:00.412246 15945 catalog_manager.cc:5697] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:00.413223 16162 leader_election.cc:304] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:00.414395 15945 catalog_manager.cc:5697] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.415881 16827 raft_consensus.cc:493] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:05:00.416484 16827 raft_consensus.cc:515] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:00.418584 16827 leader_election.cc:290] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:05:00.419369 16829 raft_consensus.cc:2804] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:00.419919 16829 raft_consensus.cc:697] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 3 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:05:00.424733 16264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc581e6f2f6741bc9a63c49459198306" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:00.427582 16040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105468bfb6dc48c28c16d3449c691f6b" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:00.428352 16044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9bf004f8eb4f0f910840561945e386" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:00.428953 16044 raft_consensus.cc:2468] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 2.
I20260709 13:05:00.411566 16830 raft_consensus.cc:515] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:00.430541 16268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15550bacc7b04df9bc56ec154f31b50b" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:00.431181 16268 raft_consensus.cc:2468] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:05:00.431890 16043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb3d9bac364b43abf555b36674a82e" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:00.432675 16043 raft_consensus.cc:2368] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 for earlier term 2. Current term is 3.
I20260709 13:05:00.431470 16319 ts_tablet_manager.cc:1434] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:05:00.433548 16830 leader_election.cc:290] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:00.434293 16319 tablet_bootstrap.cc:492] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990: Bootstrap starting.
I20260709 13:05:00.437179 16778 raft_consensus.cc:493] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:00.437736 16778 raft_consensus.cc:515] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:00.441156 16706 consensus_queue.cc:1048] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:00.445482 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae83b44932ca4fd0a40b66c6e8061284" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:00.446100 16319 tablet_bootstrap.cc:654] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.451524 16189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae83b44932ca4fd0a40b66c6e8061284" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:00.420783 16829 consensus_queue.cc:237] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:00.453677 16118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368367d6b6834e7b841b41cd87884744" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:00.454159 16119 raft_consensus.cc:1275] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Refusing update from remote peer d2e22ad700e94d1095c014708c364bb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:00.454401 16118 raft_consensus.cc:2468] T 368367d6b6834e7b841b41cd87884744 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:05:00.456162 16120 raft_consensus.cc:1275] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Refusing update from remote peer d2e22ad700e94d1095c014708c364bb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:00.460812 16040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ba50f699994c75b3a8cc2ea2ba8cc9" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:00.464232 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c33c4000f496f841f99af79e55532" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:00.466284 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154f438524734d2599d72ae02e2230e6" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:00.468029 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c33c4000f496f841f99af79e55532" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:00.469027 16271 raft_consensus.cc:2393] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf in current term 1: Already voted for candidate e1e05442c5b44a079dd1de9dd124c990 in this term.
I20260709 13:05:00.470896 16014 leader_election.cc:304] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:00.472448 16405 raft_consensus.cc:2804] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:00.474067 16014 leader_election.cc:304] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:00.474380 16048 raft_consensus.cc:1275] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Refusing update from remote peer d2e22ad700e94d1095c014708c364bb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:00.472910 16405 raft_consensus.cc:697] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 3 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:00.504073 16405 consensus_queue.cc:237] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:00.504504 16014 leader_election.cc:304] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4
I20260709 13:05:00.505750 16014 leader_election.cc:400] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Vote denied by peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631) with higher term. Message: Invalid argument: T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf for earlier term 2. Current term is 3.
I20260709 13:05:00.506028 16014 leader_election.cc:403] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:05:00.475236 16118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:00.479424 16163 leader_election.cc:304] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:00.509268 16801 raft_consensus.cc:2804] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:00.509652 16801 raft_consensus.cc:493] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.509963 16801 raft_consensus.cc:3060] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.510000 16120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb3d9bac364b43abf555b36674a82e" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:00.510800 16120 raft_consensus.cc:2468] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:05:00.514405 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368367d6b6834e7b841b41cd87884744" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:00.515133 16115 raft_consensus.cc:3060] T 368367d6b6834e7b841b41cd87884744 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.515422 16272 raft_consensus.cc:1275] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Refusing update from remote peer e1e05442c5b44a079dd1de9dd124c990: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:00.516192 16391 raft_consensus.cc:493] T c32eb3a1727b42348bb90a85f5f0e419 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
I20260709 13:05:00.489347 16778 leader_election.cc:290] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:00.516683 16391 raft_consensus.cc:515] T c32eb3a1727b42348bb90a85f5f0e419 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:00.471276 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154f438524734d2599d72ae02e2230e6" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
W20260709 13:05:00.491125 16237 leader_election.cc:343] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:00.517616 16237 leader_election.cc:304] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:00.518626 16801 raft_consensus.cc:515] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:00.519351 16391 leader_election.cc:290] T c32eb3a1727b42348bb90a85f5f0e419 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:05:00.526202 16316 tablet_bootstrap.cc:654] T 2fc1bcba29c24ea9b5582464ad0ba47e P d2e22ad700e94d1095c014708c364bb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.530925 16342 consensus_queue.cc:1048] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.535693 16119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2d4bd133442d28d078d6fc088cff4" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:00.563223 16319 tablet_bootstrap.cc:492] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990: No bootstrap required, opened a new log
I20260709 13:05:00.539202 16014 leader_election.cc:304] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:00.589586 16319 ts_tablet_manager.cc:1403] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990: Time spent bootstrapping tablet: real 0.156s	user 0.021s	sys 0.021s
I20260709 13:05:00.539669 16480 raft_consensus.cc:493] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.592208 16317 tablet_bootstrap.cc:492] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:05:00.546190 16801 leader_election.cc:290] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:00.529393 16779 raft_consensus.cc:2749] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:00.510190 16706 consensus_queue.cc:1048] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.086s
I20260709 13:05:00.598048 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ba50f699994c75b3a8cc2ea2ba8cc9" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:00.598389 16089 leader_election.cc:400] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725) with higher term. Message: Invalid argument: T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 for earlier term 2. Current term is 3.
I20260709 13:05:00.551213 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15550bacc7b04df9bc56ec154f31b50b" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:00.537536 16644 raft_consensus.cc:3060] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.551466 16118 raft_consensus.cc:2393] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e1e05442c5b44a079dd1de9dd124c990 in current term 3: Already voted for candidate ec8b54f5a9e44f428a4d537391138dcf in this term.
I20260709 13:05:00.590837 16480 raft_consensus.cc:515] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:00.534060 16848 raft_consensus.cc:2804] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.504499 16847 raft_consensus.cc:2804] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:00.547535 16041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15550bacc7b04df9bc56ec154f31b50b" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:05:00.624187 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9bf004f8eb4f0f910840561945e386" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:00.631970 16271 raft_consensus.cc:2468] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 2.
I20260709 13:05:00.567459 16120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb3d9bac364b43abf555b36674a82e" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:00.627751 16163 leader_election.cc:304] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:05:00.547960 16602 raft_consensus.cc:493] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:00.599884 16266 raft_consensus.cc:3060] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.651486 16405 raft_consensus.cc:2749] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:00.546066 16745 consensus_queue.cc:1048] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.088s
I20260709 13:05:00.601166 16744 raft_consensus.cc:493] T 1be59fdebe7a44cc9f945fa9793ddfda P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:00.655014 16480 leader_election.cc:290] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:00.550192 16837 consensus_queue.cc:1048] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:05:00.614158 16119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc581e6f2f6741bc9a63c49459198306" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:00.625522 16847 raft_consensus.cc:493] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.614537 16801 raft_consensus.cc:493] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
W20260709 13:05:00.692020 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:45195, user_credentials={real_user=slave}} blocked reactor thread for 170196us
I20260709 13:05:00.690522 16163 leader_election.cc:304] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:00.649626 16830 raft_consensus.cc:2749] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:00.659395 16120 raft_consensus.cc:3060] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.699311 16163 leader_election.cc:304] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:00.703774 16480 raft_consensus.cc:2749] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:00.670749 16191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb3d9bac364b43abf555b36674a82e" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:00.687525 16045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09412044d26f417da5c842c8acf1149d" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:00.671459 16264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98ba329bddb47c5aec148957811a4c2" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:00.660480 16602 raft_consensus.cc:515] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:00.691598 16847 raft_consensus.cc:3060] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.720113 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32eb3a1727b42348bb90a85f5f0e419" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:00.706696 16610 raft_consensus.cc:2749] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:00.740144 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 88720.2us
W20260709 13:05:00.741226 16088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 85108.6us
I20260709 13:05:00.686172 16744 raft_consensus.cc:515] T 1be59fdebe7a44cc9f945fa9793ddfda P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:00.742534 16088 leader_election.cc:304] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:00.744782 16317 tablet_bootstrap.cc:654] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.693544 16801 raft_consensus.cc:515] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:00.746892 16088 leader_election.cc:400] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491) with higher term. Message: Invalid argument: T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 for earlier term 2. Current term is 3.
I20260709 13:05:00.713984 16706 raft_consensus.cc:493] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:00.743465 16320 raft_consensus.cc:359] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:00.751045 16320 raft_consensus.cc:385] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.751430 16320 raft_consensus.cc:740] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.729648 16602 leader_election.cc:290] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:05:00.748759 16088 leader_election.cc:403] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:00.759773 16320 consensus_queue.cc:260] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:00.741348 16745 raft_consensus.cc:493] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:00.762105 16342 raft_consensus.cc:493] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:00.784013 16342 raft_consensus.cc:515] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:00.804569 16320 ts_tablet_manager.cc:1434] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.797s	user 0.013s	sys 0.002s
I20260709 13:05:00.750414 16766 raft_consensus.cc:2804] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:00.805217 16320 ts_tablet_manager.cc:1467] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf: Tablet startup took 798ms
I20260709 13:05:00.749703 16044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae7099a7350453682514662a4773778" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:00.815685 16319 raft_consensus.cc:359] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:00.816641 16319 raft_consensus.cc:385] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.818836 16744 leader_election.cc:290] T 1be59fdebe7a44cc9f945fa9793ddfda P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:00.775301 16266 raft_consensus.cc:2468] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:05:00.819562 16852 raft_consensus.cc:493] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:00.747539 16848 raft_consensus.cc:697] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 2 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:00.810264 16342 leader_election.cc:290] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:00.753365 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32eb3a1727b42348bb90a85f5f0e419" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:00.820453 16852 raft_consensus.cc:515] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:00.820983 16848 consensus_queue.cc:237] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:00.823048 16852 leader_election.cc:290] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:00.816987 16319 raft_consensus.cc:740] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.866902 16319 consensus_queue.cc:260] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:00.870203 15946 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59466 (request call id 68) took 2147 ms. Trace:
I20260709 13:05:00.776005 16115 raft_consensus.cc:2468] T 368367d6b6834e7b841b41cd87884744 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:05:00.874785 16342 raft_consensus.cc:493] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:00.876551 16342 raft_consensus.cc:515] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:00.783337 16801 leader_election.cc:290] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:00.767951 16782 consensus_queue.cc:1048] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.097s
I20260709 13:05:00.812548 16766 raft_consensus.cc:493] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.788359 16745 raft_consensus.cc:515] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:00.748929 16706 raft_consensus.cc:515] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
W20260709 13:05:00.912021 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:45195, user_credentials={real_user=slave}} blocked reactor thread for 217675us
W20260709 13:05:00.848028 16320 ts_tablet_manager.cc:1469] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf: Trace:
0709 13:04:49.546668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.554594 (+  7926us) service_pool.cc:224] Handling call
0709 13:04:49.556052 (+  1458us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:04:49.556125 (+    73us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:49.577355 (+ 21230us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:49.586681 (+  9326us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:49.587386 (+   705us) inbound_call.cc:177] Queueing success response
0709 13:04:59.817803 (+10230417us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:05:00.007159 (+189356us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:05:00.007681 (+   522us) tablet_replica.cc:261] Starting instrumentation
0709 13:05:00.008183 (+   502us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":733,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":27509,"tablet-open.queue_time_us":10230707}
I20260709 13:05:00.915103 16319 ts_tablet_manager.cc:1434] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990: Time spent starting tablet: real 0.325s	user 0.008s	sys 0.001s
I20260709 13:05:00.917349 16342 leader_election.cc:290] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:00.881289 16819 raft_consensus.cc:493] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
W20260709 13:05:00.925942 16162 leader_election.cc:343] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:00.913201 16766 raft_consensus.cc:3060] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:00.926947 16162 leader_election.cc:343] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:00.933267 16316 tablet_bootstrap.cc:492] T 2fc1bcba29c24ea9b5582464ad0ba47e P d2e22ad700e94d1095c014708c364bb7: No bootstrap required, opened a new log
I20260709 13:05:00.936821 16316 ts_tablet_manager.cc:1403] T 2fc1bcba29c24ea9b5582464ad0ba47e P d2e22ad700e94d1095c014708c364bb7: Time spent bootstrapping tablet: real 0.531s	user 0.010s	sys 0.004s
I20260709 13:05:00.916556 16863 raft_consensus.cc:493] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.870656 15946 rpcz_store.cc:276] 0709 13:04:58.717453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.717613 (+   160us) service_pool.cc:224] Handling call
0709 13:04:58.870781 (+153168us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b540075fb54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ef090 00007f36c848df3a 00007f36ce2441cc 00007f36ce34237e 00007f36cc8032a4 00007f36cc803232 00007f36cc803161 00007f36cc8030dc 00007f36cc802392 00007f36c67c048c 00007f36c67bf8c6
0709 13:05:00.864856 (+1994075us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:59.325567 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:59.326133 (+   566us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:59.326174 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:04:59.326187 (+    13us) tablet.cc:662] Decoding operations
0709 13:04:59.326542 (+   355us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:59.326598 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:59.326625 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:59.326813 (+   188us) tablet.cc:701] Row locks acquired
0709 13:04:59.326827 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:04:59.326979 (+   152us) write_op.cc:270] Start()
0709 13:04:59.327096 (+   117us) write_op.cc:276] Timestamp: P: 1783602299326930 usec, L: 0
0709 13:04:59.327113 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:04:59.367657 (+ 40544us) log.cc:844] Serialized 537 byte log entry
0709 13:04:59.636837 (+269180us) op_driver.cc:464] REPLICATION: finished
0709 13:04:59.912052 (+275215us) write_op.cc:301] APPLY: starting
0709 13:04:59.921563 (+  9511us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:59.933788 (+ 12225us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:59.937589 (+  3801us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:59.937792 (+   203us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:59.937945 (+   153us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:04:59.937986 (+    41us) write_op.cc:312] APPLY: finished
0709 13:04:59.938163 (+   177us) log.cc:844] Serialized 22 byte log entry
0709 13:04:59.938342 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:59.938423 (+    81us) write_op.cc:454] Released schema lock
0709 13:04:59.938463 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:59.938803 (+   340us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:59.938830 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"spinlock_wait_cycles":67001216,"child_traces":[["op",{"apply.queue_time_us":246612,"apply.run_cpu_time_us":1698,"apply.run_wall_time_us":28517,"num_ops":1,"prepare.queue_time_us":149153,"prepare.run_cpu_time_us":2904,"prepare.run_wall_time_us":52955,"replication_time_us":293984,"thread_start_us":249598,"threads_started":2}]]}
I20260709 13:05:00.930640 16819 raft_consensus.cc:515] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:00.954947 16819 leader_election.cc:290] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:00.934293 16043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac8a97b1adc49389919710edf7c5e03" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:00.958280 16766 raft_consensus.cc:515] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:00.924078 16545 consensus_queue.cc:1048] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:05:00.960424 16865 raft_consensus.cc:493] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:00.961143 16865 raft_consensus.cc:515] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:00.962304 16120 raft_consensus.cc:2468] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 3.
I20260709 13:05:00.963321 16865 leader_election.cc:290] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:00.963418 16664 raft_consensus.cc:493] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:05:00.964089 16664 raft_consensus.cc:515] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:00.930006 16859 raft_consensus.cc:493] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:05:00.965700 16859 raft_consensus.cc:515] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:00.968166 16859 leader_election.cc:290] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:00.969332 16320 tablet_bootstrap.cc:492] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:00.969638 16706 leader_election.cc:290] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:05:00.971144 16745 leader_election.cc:290] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
W20260709 13:05:00.971829 16014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 463640us
I20260709 13:05:00.973038 16190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105468bfb6dc48c28c16d3449c691f6b" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:00.974810 16043 raft_consensus.cc:1275] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Refusing update from remote peer e1e05442c5b44a079dd1de9dd124c990: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:00.976950 16802 consensus_queue.cc:1048] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.979405 16664 leader_election.cc:290] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:00.979641 16563 raft_consensus.cc:2749] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491) with higher term. Message: Invalid argument: T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 for earlier term 2. Current term is 3.
I20260709 13:05:00.960363 16044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be59fdebe7a44cc9f945fa9793ddfda" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:00.981280 16848 consensus_queue.cc:1048] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.981585 16644 raft_consensus.cc:2749] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631) with higher term. Message: Invalid argument: T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf for earlier term 2. Current term is 3.
W20260709 13:05:00.983446 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 50430.5us
I20260709 13:05:00.985499 16320 tablet_bootstrap.cc:654] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.987639 16041 raft_consensus.cc:1275] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Refusing update from remote peer e1e05442c5b44a079dd1de9dd124c990: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:00.989571 16847 raft_consensus.cc:515] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:00.990149 16195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98ba329bddb47c5aec148957811a4c2" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:00.990561 16766 leader_election.cc:290] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 3 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:00.992264 16014 leader_election.cc:304] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
W20260709 13:05:01.001547 16089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 309524us
I20260709 13:05:00.980926 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6c90e7e1974ef0ade824c72386b5f3" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:01.010035 16480 raft_consensus.cc:493] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
W20260709 13:05:01.006263 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 54315.1us
I20260709 13:05:01.011818 16272 raft_consensus.cc:1275] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Refusing update from remote peer e1e05442c5b44a079dd1de9dd124c990: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:01.012732 16480 raft_consensus.cc:515] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:01.026242 16089 leader_election.cc:304] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:00.995059 16801 raft_consensus.cc:493] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:01.001648 16859 raft_consensus.cc:2749] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:01.013257 16237 leader_election.cc:304] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:01.030607 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c600c8f1ec454bc0b4a3716ea85d8499" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:01.032191 16163 leader_election.cc:304] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:00.992755 16829 raft_consensus.cc:493] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.028417 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6c90e7e1974ef0ade824c72386b5f3" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.031347 16046 raft_consensus.cc:2468] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:05:01.043255 16317 tablet_bootstrap.cc:492] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:05:01.043852 16317 ts_tablet_manager.cc:1403] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.452s	user 0.019s	sys 0.011s
I20260709 13:05:01.034969 16800 raft_consensus.cc:2804] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:01.045647 16800 raft_consensus.cc:697] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:05:01.038407 16802 raft_consensus.cc:2804] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:01.047187 16802 raft_consensus.cc:697] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:05:01.046618 16800 consensus_queue.cc:237] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:01.048105 16802 consensus_queue.cc:237] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
W20260709 13:05:01.049281 16145 debug-util.cc:398] Leaking SignalData structure 0x7b08002edf60 after lost signal to thread 7274
W20260709 13:05:01.050477 16145 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee640 after lost signal to thread 15981
I20260709 13:05:01.050531 16317 raft_consensus.cc:359] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:01.051443 16317 raft_consensus.cc:385] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.054579 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eede189c87343c6a45e71d7cb23c41d" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:01.055357 16480 leader_election.cc:290] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:01.037426 16237 leader_election.cc:304] T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:01.054396 16163 leader_election.cc:304] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:01.059334 16480 raft_consensus.cc:2749] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:01.051777 16317 raft_consensus.cc:740] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
W20260709 13:05:01.052053 16145 debug-util.cc:398] Leaking SignalData structure 0x7b08000c1140 after lost signal to thread 16073
I20260709 13:05:01.070428 16316 raft_consensus.cc:359] T 2fc1bcba29c24ea9b5582464ad0ba47e P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:01.071237 16316 raft_consensus.cc:385] T 2fc1bcba29c24ea9b5582464ad0ba47e P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.071596 16316 raft_consensus.cc:740] T 2fc1bcba29c24ea9b5582464ad0ba47e P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Initialized, Role: FOLLOWER
W20260709 13:05:01.073334 15994 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:01.075229 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09412044d26f417da5c842c8acf1149d" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.069907 16162 leader_election.cc:304] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:01.059799 16163 leader_election.cc:304] T fc581e6f2f6741bc9a63c49459198306 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:05:01.066152 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9bf004f8eb4f0f910840561945e386" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:01.079890 16272 raft_consensus.cc:3060] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:00.952095 16863 raft_consensus.cc:515] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:01.068148 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ffb334ab54abb8bdb4893844c3b6b" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:01.035351 16853 raft_consensus.cc:2749] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:01.031267 16044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ffb334ab54abb8bdb4893844c3b6b" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:01.079207 16480 raft_consensus.cc:2804] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:01.081478 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc73085eee348a0b029b5aa5f51e288" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.072474 16316 consensus_queue.cc:260] T 2fc1bcba29c24ea9b5582464ad0ba47e P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:01.092979 16480 raft_consensus.cc:493] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:01.093425 16480 raft_consensus.cc:3060] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:01.096295 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac8a97b1adc49389919710edf7c5e03" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
W20260709 13:05:01.126014 16163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:45195, user_credentials={real_user=slave}} blocked reactor thread for 66323.7us
I20260709 13:05:01.129148 16317 consensus_queue.cc:260] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:01.032938 16801 raft_consensus.cc:515] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:01.153860 16272 raft_consensus.cc:2468] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 3.
I20260709 13:05:01.079092 16820 raft_consensus.cc:493] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:01.164708 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589ea61d3c14d5da5f955ac6d719881" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:01.166772 16316 ts_tablet_manager.cc:1434] T 2fc1bcba29c24ea9b5582464ad0ba47e P d2e22ad700e94d1095c014708c364bb7: Time spent starting tablet: real 0.227s	user 0.009s	sys 0.000s
I20260709 13:05:01.175187 16237 leader_election.cc:304] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:01.036896 16829 raft_consensus.cc:515] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:01.137679 16865 raft_consensus.cc:2749] T fc581e6f2f6741bc9a63c49459198306 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:01.181908 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c283cfd76b4e9aacd796f6ead6e4b8" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.149678 16192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc73085eee348a0b029b5aa5f51e288" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:01.183248 16317 ts_tablet_manager.cc:1434] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.139s	user 0.010s	sys 0.000s
I20260709 13:05:01.179236 16847 leader_election.cc:290] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:01.173920 16820 raft_consensus.cc:515] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:01.176963 16045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a26858ecdea24ad9bb9b64ee8d133dd2" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:01.180840 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430a0b8ad91a40389bde4a2dce852afb" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:01.316285 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c283cfd76b4e9aacd796f6ead6e4b8" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:01.313521 16480 raft_consensus.cc:515] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
W20260709 13:05:01.210304 16145 debug-util.cc:398] Leaking SignalData structure 0x7b08000b4040 after lost signal to thread 16148
I20260709 13:05:01.166419 16837 raft_consensus.cc:493] T aaaad334dede46d888c92db5c932655e P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:01.316493 16272 raft_consensus.cc:2468] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:05:01.161602 16610 raft_consensus.cc:493] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:01.228277 16867 raft_consensus.cc:493] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:01.303355 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:45195, user_credentials={real_user=slave}} blocked reactor thread for 85007.5us
I20260709 13:05:01.318321 16237 leader_election.cc:304] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:01.324023 16121 raft_consensus.cc:3060] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.324926 16820 leader_election.cc:290] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:01.325625 16610 raft_consensus.cc:515] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:01.326536 16480 leader_election.cc:290] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:01.329991 16342 raft_consensus.cc:2749] T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:01.331261 16237 leader_election.cc:304] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:01.335161 16610 leader_election.cc:290] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:05:01.336161 16264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae83b44932ca4fd0a40b66c6e8061284" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:01.336356 16124 raft_consensus.cc:1275] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:01.311503 16664 raft_consensus.cc:493] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
W20260709 13:05:01.327699 16145 debug-util.cc:398] Leaking SignalData structure 0x7b0800349fc0 after lost signal to thread 16149
I20260709 13:05:01.343626 16868 raft_consensus.cc:2749] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:01.343534 16864 raft_consensus.cc:2749] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:01.347507 16124 raft_consensus.cc:1240] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Rejecting Update request from peer ec8b54f5a9e44f428a4d537391138dcf for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:01.329172 16867 raft_consensus.cc:515] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:01.333577 16819 raft_consensus.cc:2749] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:01.352563 16163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:45195, user_credentials={real_user=slave}} blocked reactor thread for 197173us
I20260709 13:05:01.340387 16866 raft_consensus.cc:493] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:01.358263 16320 tablet_bootstrap.cc:492] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:05:01.358378 16863 leader_election.cc:290] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:05:01.362285 16320 ts_tablet_manager.cc:1403] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.393s	user 0.014s	sys 0.017s
W20260709 13:05:01.354990 16145 debug-util.cc:398] Leaking SignalData structure 0x7b08001bd3a0 after lost signal to thread 16222
I20260709 13:05:01.329111 16837 raft_consensus.cc:515] T aaaad334dede46d888c92db5c932655e P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:01.368698 16089 leader_election.cc:304] T c32eb3a1727b42348bb90a85f5f0e419 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:01.370122 16801 leader_election.cc:290] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
W20260709 13:05:01.371068 16878 log.cc:927] Time spent T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:05:01.371557 16829 leader_election.cc:290] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:01.344681 16664 raft_consensus.cc:515] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
W20260709 13:05:01.365510 16145 debug-util.cc:398] Leaking SignalData structure 0x7b08001bd340 after lost signal to thread 16223
I20260709 13:05:01.363902 16819 raft_consensus.cc:493] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:01.381327 16089 leader_election.cc:304] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:01.364367 16866 raft_consensus.cc:515] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:01.389343 16320 raft_consensus.cc:359] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:01.390252 16320 raft_consensus.cc:385] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.390539 16320 raft_consensus.cc:740] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.392132 16320 consensus_queue.cc:260] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:01.394784 16320 ts_tablet_manager.cc:1434] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:05:01.397363 16320 tablet_bootstrap.cc:492] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:01.378522 16563 raft_consensus.cc:2749] T c32eb3a1727b42348bb90a85f5f0e419 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:01.402873 16837 leader_election.cc:290] T aaaad334dede46d888c92db5c932655e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:01.407645 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c9099428b34e0f9bec85f2159b656e" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:01.408666 16045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc1bcba29c24ea9b5582464ad0ba47e" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:01.409423 16042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaad334dede46d888c92db5c932655e" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:01.410516 16121 raft_consensus.cc:2468] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:05:01.411000 16116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f053de7054c4b3786ffa35aa5accb15" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.409000 16118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589ea61d3c14d5da5f955ac6d719881" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.395778 16819 raft_consensus.cc:515] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:01.417939 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430a0b8ad91a40389bde4a2dce852afb" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:05:01.418605 16044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6c90e7e1974ef0ade824c72386b5f3" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:05:01.419274 16044 raft_consensus.cc:3060] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:01.419608 16819 leader_election.cc:290] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:01.420675 16847 raft_consensus.cc:493] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.420893 16118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd3bea4269f4b61adeb12a2cabaca3d" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.418643 16198 raft_consensus.cc:3060] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.421265 16847 raft_consensus.cc:515] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:01.422320 16664 leader_election.cc:290] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:01.423202 16267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc73085eee348a0b029b5aa5f51e288" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:01.425786 16189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589ea61d3c14d5da5f955ac6d719881" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:01.427083 16189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd3bea4269f4b61adeb12a2cabaca3d" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:01.428714 16847 leader_election.cc:290] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:01.430593 16237 leader_election.cc:304] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:01.431952 16237 leader_election.cc:304] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:01.412400 16646 raft_consensus.cc:2749] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:01.434123 16118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.434798 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7b2b72b2df44e89e8b76fa65501951" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
W20260709 13:05:01.436091 16145 debug-util.cc:398] Leaking SignalData structure 0x7b080014e420 after lost signal to thread 16296
W20260709 13:05:01.436160 16162 leader_election.cc:343] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:01.436769 16145 debug-util.cc:398] Leaking SignalData structure 0x7b080014e500 after lost signal to thread 16297
I20260709 13:05:01.441520 16320 tablet_bootstrap.cc:654] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.447383 16342 raft_consensus.cc:2749] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:01.409432 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc1bcba29c24ea9b5582464ad0ba47e" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:01.448654 16263 raft_consensus.cc:2468] T 2fc1bcba29c24ea9b5582464ad0ba47e P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 0.
I20260709 13:05:01.449585 16779 raft_consensus.cc:2749] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:01.452167 16237 leader_election.cc:343] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.446170 16801 consensus_queue.cc:1048] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 13:05:01.474961 16874 log.cc:927] Time spent T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:05:01.486397 16191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c283cfd76b4e9aacd796f6ead6e4b8" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:01.489977 16745 consensus_queue.cc:1048] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.490804 16237 leader_election.cc:304] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:01.491626 16819 raft_consensus.cc:2749] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:01.493461 16163 leader_election.cc:304] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:01.494369 16830 raft_consensus.cc:2804] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:01.497255 16163 leader_election.cc:304] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:05:01.467980 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9bf004f8eb4f0f910840561945e386" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:05:01.494771 16830 raft_consensus.cc:493] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.493870 16198 raft_consensus.cc:2468] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
W20260709 13:05:01.501392 16089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 100745us
I20260709 13:05:01.503218 16089 leader_election.cc:304] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:01.499851 16829 raft_consensus.cc:2804] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:01.499732 16830 raft_consensus.cc:3060] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.508112 16829 raft_consensus.cc:493] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:01.510954 16829 raft_consensus.cc:3060] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:01.511627 16563 raft_consensus.cc:493] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.512158 16563 raft_consensus.cc:515] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:01.504906 16646 raft_consensus.cc:2749] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:01.528364 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589ea61d3c14d5da5f955ac6d719881" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.532222 16116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be59fdebe7a44cc9f945fa9793ddfda" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.532498 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae83b44932ca4fd0a40b66c6e8061284" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.533488 16116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6c90e7e1974ef0ade824c72386b5f3" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:01.533829 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6c90e7e1974ef0ade824c72386b5f3" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.534662 16116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a26858ecdea24ad9bb9b64ee8d133dd2" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.535548 16195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6c90e7e1974ef0ade824c72386b5f3" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:01.538061 16118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eede189c87343c6a45e71d7cb23c41d" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.538767 16124 raft_consensus.cc:1275] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Refusing update from remote peer e1e05442c5b44a079dd1de9dd124c990: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:01.539418 16118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c9099428b34e0f9bec85f2159b656e" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.539806 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaad334dede46d888c92db5c932655e" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.541507 16195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:01.540288 16116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc73085eee348a0b029b5aa5f51e288" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.544629 16195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:01.523864 16563 leader_election.cc:290] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:01.545284 16195 raft_consensus.cc:2468] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 3.
I20260709 13:05:01.547089 16163 leader_election.cc:304] T 1be59fdebe7a44cc9f945fa9793ddfda P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:01.548718 16119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c600c8f1ec454bc0b4a3716ea85d8499" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.550824 16163 leader_election.cc:304] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:05:01.552574 16865 raft_consensus.cc:2749] T 1be59fdebe7a44cc9f945fa9793ddfda P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:01.553771 16885 raft_consensus.cc:493] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.554304 16885 raft_consensus.cc:515] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:01.555897 16883 raft_consensus.cc:2749] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:01.556414 16885 leader_election.cc:290] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:01.560338 16163 leader_election.cc:304] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:01.561236 16089 leader_election.cc:304] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:05:01.561923 16317 tablet_bootstrap.cc:492] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:05:01.562069 16885 raft_consensus.cc:2804] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:01.562547 16885 raft_consensus.cc:493] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.562538 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76c283cfd76b4e9aacd796f6ead6e4b8" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.562973 16885 raft_consensus.cc:3060] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:01.564244 16865 raft_consensus.cc:2749] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:01.565979 16163 leader_election.cc:304] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:01.573904 16163 leader_election.cc:304] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:05:01.545706 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae7099a7350453682514662a4773778" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.579720 16163 leader_election.cc:304] T aaaad334dede46d888c92db5c932655e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:01.522085 16044 raft_consensus.cc:2468] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 2.
I20260709 13:05:01.583842 16480 raft_consensus.cc:2749] T aaaad334dede46d888c92db5c932655e P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:01.585170 16888 log.cc:927] Time spent T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:05:01.586833 16163 leader_election.cc:304] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:05:01.578433 16802 raft_consensus.cc:2749] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:01.584719 16801 raft_consensus.cc:2749] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:01.582054 16744 consensus_queue.cc:1048] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:05:01.594197 16163 leader_election.cc:304] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
W20260709 13:05:01.598280 16887 log.cc:927] Time spent T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:05:01.594605 16706 raft_consensus.cc:2749] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:01.606148 16867 leader_election.cc:290] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:01.611287 16644 raft_consensus.cc:493] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.611883 16644 raft_consensus.cc:515] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:01.613494 16040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7b2b72b2df44e89e8b76fa65501951" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:01.614041 16644 leader_election.cc:290] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
W20260709 13:05:01.616168 16163 leader_election.cc:343] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.616822 16163 leader_election.cc:304] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:01.618078 16706 raft_consensus.cc:2749] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:01.623592 16236 leader_election.cc:343] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:01.624056 16236 leader_election.cc:304] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:01.615592 16041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f053de7054c4b3786ffa35aa5accb15" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:01.597461 16745 raft_consensus.cc:2749] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:01.632396 16782 raft_consensus.cc:2749] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:01.633298 16866 leader_election.cc:290] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:01.633800 16317 tablet_bootstrap.cc:654] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:01.634968 16320 tablet_bootstrap.cc:492] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:05:01.635701 16320 ts_tablet_manager.cc:1403] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.239s	user 0.008s	sys 0.030s
I20260709 13:05:01.576885 16829 raft_consensus.cc:515] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:01.644623 16045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac8a97b1adc49389919710edf7c5e03" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:01.646369 16041 raft_consensus.cc:1240] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Rejecting Update request from peer 36b15691c8e648a18b69e98bee3349b4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:01.647905 16236 leader_election.cc:304] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:01.659346 16829 leader_election.cc:290] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:05:01.661473 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589ea61d3c14d5da5f955ac6d719881" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:01.661671 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589ea61d3c14d5da5f955ac6d719881" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:01.662384 16266 raft_consensus.cc:3060] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:01.652868 16867 raft_consensus.cc:2749] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:01.680976 16089 leader_election.cc:304] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:01.682127 16391 raft_consensus.cc:2804] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:01.682317 16089 leader_election.cc:304] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:01.682564 16391 raft_consensus.cc:697] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 3 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:05:01.670248 16885 raft_consensus.cc:515] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:01.683362 16391 consensus_queue.cc:237] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:01.685295 16825 raft_consensus.cc:2749] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:01.703567 16320 raft_consensus.cc:359] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:01.704872 16320 raft_consensus.cc:385] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.705425 16320 raft_consensus.cc:740] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.705992 16320 consensus_queue.cc:260] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:01.714550 16014 leader_election.cc:304] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:01.717711 16859 raft_consensus.cc:2804] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:01.717903 16195 raft_consensus.cc:1275] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:01.719203 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85079923151849059accd1b7c27d4699" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:01.719892 16123 raft_consensus.cc:2468] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 0.
I20260709 13:05:01.720384 16162 leader_election.cc:304] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4
I20260709 13:05:01.718967 16014 leader_election.cc:304] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:05:01.737329 15945 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59494 (request call id 65) took 2463 ms. Trace:
I20260709 13:05:01.742115 16267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85079923151849059accd1b7c27d4699" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:01.742874 16267 raft_consensus.cc:2468] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 0.
I20260709 13:05:01.743144 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:01.727108 16867 raft_consensus.cc:493] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.744649 16867 raft_consensus.cc:515] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:01.752297 16320 ts_tablet_manager.cc:1434] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.116s	user 0.006s	sys 0.002s
I20260709 13:05:01.737143 16883 raft_consensus.cc:2804] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:01.762046 16089 leader_election.cc:304] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:05:01.738045 15945 rpcz_store.cc:276] 0709 13:04:59.294881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.295094 (+   213us) service_pool.cc:224] Handling call
0709 13:05:01.737233 (+2442139us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:00.883784 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:00.884578 (+   794us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:00.884627 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:05:00.884652 (+    25us) tablet.cc:662] Decoding operations
0709 13:05:00.885220 (+   568us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:00.885298 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:00.885339 (+    41us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:05:00.885765 (+   426us) tablet.cc:701] Row locks acquired
0709 13:05:00.885791 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:05:00.885968 (+   177us) write_op.cc:270] Start()
0709 13:05:00.886129 (+   161us) write_op.cc:276] Timestamp: P: 1783602300885914 usec, L: 0
0709 13:05:00.886164 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:05:00.887114 (+   950us) log.cc:844] Serialized 922 byte log entry
0709 13:05:01.182042 (+294928us) op_driver.cc:464] REPLICATION: finished
0709 13:05:01.408118 (+226076us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b4400022b4c. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c5220db1 00007f36c52bec85 00007f36c52bf6a2 00007f36c80311db 00007f36c802caaf 00007f36c537b0ac 00007f36ce1d5ab9 00007f36c539769b 00007f36c539593f 00007f36c5397c02 00007f36cbebbef0
0709 13:05:01.509904 (+101786us) write_op.cc:301] APPLY: starting
0709 13:05:01.510058 (+   154us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:01.510214 (+   156us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:01.510255 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:01.510720 (+   465us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:01.510951 (+   231us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:05:01.511017 (+    66us) write_op.cc:312] APPLY: finished
0709 13:05:01.511329 (+   312us) log.cc:844] Serialized 28 byte log entry
0709 13:05:01.511517 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:01.511608 (+    91us) write_op.cc:454] Released schema lock
0709 13:05:01.511646 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:01.511973 (+   327us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:01.512004 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":128613,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":197860,"apply.run_cpu_time_us":2090,"apply.run_wall_time_us":2091,"num_ops":2,"prepare.queue_time_us":348721,"prepare.run_cpu_time_us":3804,"prepare.run_wall_time_us":22417,"replication_time_us":276965,"spinlock_wait_cycles":2342272,"thread_start_us":389395,"threads_started":2}]]}
I20260709 13:05:01.745368 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac8a97b1adc49389919710edf7c5e03" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:01.745044 16267 raft_consensus.cc:1240] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Rejecting Update request from peer ec8b54f5a9e44f428a4d537391138dcf for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:01.782169 16320 tablet_bootstrap.cc:492] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:01.737478 16848 consensus_queue.cc:1059] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:05:01.782908 15947 catalog_manager.cc:5697] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:01.785059 16901 log.cc:927] Time spent T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:05:01.789453 16867 leader_election.cc:290] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:01.745616 16269 raft_consensus.cc:2468] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 3.
I20260709 13:05:01.730594 16852 consensus_queue.cc:1048] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:05:01.790452 16818 raft_consensus.cc:2804] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:01.810870 16818 raft_consensus.cc:493] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.811332 16818 raft_consensus.cc:3060] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.791975 16317 tablet_bootstrap.cc:492] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:05:01.813491 16317 ts_tablet_manager.cc:1403] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.252s	user 0.023s	sys 0.006s
I20260709 13:05:01.815829 16800 raft_consensus.cc:493] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:01.729892 16871 consensus_queue.cc:1059] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:05:01.816448 16800 raft_consensus.cc:515] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:01.802318 16644 raft_consensus.cc:2749] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:01.789939 16894 log.cc:927] Time spent T 368367d6b6834e7b841b41cd87884744 P 36b15691c8e648a18b69e98bee3349b4: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:05:01.820720 16885 leader_election.cc:290] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 4 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:01.821339 16800 leader_election.cc:290] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:01.798630 16883 raft_consensus.cc:697] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:05:01.822999 16883 consensus_queue.cc:237] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:01.827673 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85079923151849059accd1b7c27d4699" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:01.828400 16270 raft_consensus.cc:2468] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 0.
I20260709 13:05:01.832386 16852 raft_consensus.cc:3055] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:01.832892 16852 raft_consensus.cc:740] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:01.816459 16317 raft_consensus.cc:359] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:01.835469 16317 raft_consensus.cc:385] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.835736 16317 raft_consensus.cc:740] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
W20260709 13:05:01.847239 16014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:45195, user_credentials={real_user=slave}} blocked reactor thread for 130162us
I20260709 13:05:01.850421 16014 leader_election.cc:304] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:01.869719 16124 raft_consensus.cc:1240] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 4 FOLLOWER]: Rejecting Update request from peer ec8b54f5a9e44f428a4d537391138dcf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:05:01.869058 16317 consensus_queue.cc:260] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:01.872417 16891 consensus_queue.cc:1048] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:01.810021 16848 raft_consensus.cc:493] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.853865 16859 raft_consensus.cc:697] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:02.015904 16906 raft_consensus.cc:493] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.981031 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:05:02.016577 16906 raft_consensus.cc:515] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:02.017827 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:02.018683 16046 raft_consensus.cc:2410] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 for term 4 because replica has last-logged OpId of term: 2 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:05:02.020138 16610 raft_consensus.cc:493] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:02.020675 16610 raft_consensus.cc:515] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:02.023041 16610 leader_election.cc:290] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:02.026407 16266 raft_consensus.cc:2468] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 2.
I20260709 13:05:02.029449 16043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:02.031510 16391 raft_consensus.cc:493] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d2e22ad700e94d1095c014708c364bb7)
I20260709 13:05:02.032140 16391 raft_consensus.cc:515] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:02.032567 16272 raft_consensus.cc:1240] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Rejecting Update request from peer 36b15691c8e648a18b69e98bee3349b4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:02.033464 16089 leader_election.cc:304] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:02.034050 16391 leader_election.cc:290] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:02.034547 16391 raft_consensus.cc:2749] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.035745 16047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85079923151849059accd1b7c27d4699" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:02.036737 16563 consensus_queue.cc:1059] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:02.036986 16268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:02.037722 16766 raft_consensus.cc:3055] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:02.038085 16766 raft_consensus.cc:740] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:05:02.038847 16766 consensus_queue.cc:260] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:01.886133 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:05:02.039947 16766 raft_consensus.cc:3060] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.040272 16198 raft_consensus.cc:3060] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:01.883394 16848 raft_consensus.cc:515] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:02.044078 16848 leader_election.cc:290] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:01.886539 16852 consensus_queue.cc:260] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:01.876965 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:02.046653 16270 raft_consensus.cc:2393] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 in current term 3: Already voted for candidate d2e22ad700e94d1095c014708c364bb7 in this term.
I20260709 13:05:02.034588 16910 raft_consensus.cc:2804] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:02.018745 16906 leader_election.cc:290] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
W20260709 13:05:02.050978 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:45195, user_credentials={real_user=slave}} blocked reactor thread for 237047us
W20260709 13:05:02.051684 16830 consensus_meta.cc:287] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.000s
I20260709 13:05:02.052103 16830 raft_consensus.cc:515] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:02.054348 16089 leader_election.cc:304] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:02.056546 16320 tablet_bootstrap.cc:654] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:02.057610 16891 raft_consensus.cc:2749] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:02.058457 16163 leader_election.cc:304] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4
I20260709 13:05:02.059329 16829 raft_consensus.cc:2804] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:02.059818 16829 raft_consensus.cc:697] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:05:02.060611 16910 raft_consensus.cc:493] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.061025 16910 raft_consensus.cc:3060] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.067032 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:02.067724 16048 raft_consensus.cc:2468] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 3.
I20260709 13:05:02.077423 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:02.060634 16829 consensus_queue.cc:237] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:02.078522 16115 raft_consensus.cc:2410] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 for term 4 because replica has last-logged OpId of term: 2 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:05:02.079416 16852 raft_consensus.cc:3060] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:02.097865 16859 consensus_queue.cc:237] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:02.113408 16317 ts_tablet_manager.cc:1434] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.300s	user 0.017s	sys 0.005s
I20260709 13:05:02.130622 16317 tablet_bootstrap.cc:492] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4: Bootstrap starting.
I20260709 13:05:02.141477 16192 raft_consensus.cc:1240] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Rejecting Update request from peer 36b15691c8e648a18b69e98bee3349b4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:02.143563 16264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6b0df9a4d4b55a27f4ffb956db8d0" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
W20260709 13:05:02.181360 16909 log.cc:927] Time spent T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:05:02.182989 16910 raft_consensus.cc:515] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
W20260709 13:05:02.221765 16015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:02.225652 16014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 291936us
I20260709 13:05:02.227692 16014 leader_election.cc:304] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:02.230732 16047 raft_consensus.cc:2393] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 in current term 1: Already voted for candidate ec8b54f5a9e44f428a4d537391138dcf in this term.
I20260709 13:05:02.231115 16049 raft_consensus.cc:3060] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.240653 16043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6b0df9a4d4b55a27f4ffb956db8d0" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:02.252002 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379913b2ca6a49e9bfd93ca8b06c9fee" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:02.257858 16189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae7099a7350453682514662a4773778" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:02.259021 16189 raft_consensus.cc:2468] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 0.
I20260709 13:05:02.260370 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae7099a7350453682514662a4773778" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:02.261507 16122 raft_consensus.cc:2468] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 0.
W20260709 13:05:02.261587 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:45195, user_credentials={real_user=slave}} blocked reactor thread for 120960us
I20260709 13:05:02.271139 16264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379913b2ca6a49e9bfd93ca8b06c9fee" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:02.297910 16264 raft_consensus.cc:2468] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:05:02.277796 16317 tablet_bootstrap.cc:654] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:02.291663 16236 leader_election.cc:304] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:02.144716 16818 raft_consensus.cc:515] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:02.306855 16847 consensus_queue.cc:1048] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:02.309497 16905 raft_consensus.cc:493] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:02.310511 16910 leader_election.cc:290] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:02.310460 16905 raft_consensus.cc:515] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:02.310545 16818 leader_election.cc:290] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:02.339419 16864 raft_consensus.cc:2749] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:02.347307 16646 raft_consensus.cc:3055] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:02.347967 16646 raft_consensus.cc:740] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:05:02.356647 16830 leader_election.cc:290] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:02.358587 16918 raft_consensus.cc:2749] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.308889 16848 raft_consensus.cc:493] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:02.363874 16848 raft_consensus.cc:515] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:02.365404 16270 raft_consensus.cc:1275] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Refusing update from remote peer 36b15691c8e648a18b69e98bee3349b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:02.367254 16848 leader_election.cc:290] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
W20260709 13:05:02.370347 16896 log.cc:927] Time spent T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:05:02.385394 16602 consensus_queue.cc:1048] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:02.388010 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85079923151849059accd1b7c27d4699" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
W20260709 13:05:02.388396 16088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 91376.7us
I20260709 13:05:02.389348 16263 raft_consensus.cc:3060] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.390771 16088 leader_election.cc:304] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7
I20260709 13:05:02.398231 16045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc1bcba29c24ea9b5582464ad0ba47e" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:05:02.399552 16905 leader_election.cc:290] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
W20260709 13:05:02.385383 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 94169.4us
I20260709 13:05:02.411295 16859 raft_consensus.cc:493] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.412145 16859 raft_consensus.cc:515] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:02.416584 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c51469e614423d8a9cc50e024cf468" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:02.420234 16644 consensus_queue.cc:1059] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:02.408564 16014 leader_election.cc:304] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:02.399726 15944 catalog_manager.cc:5697] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:02.443233 16014 leader_election.cc:304] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4
I20260709 13:05:02.449451 16905 raft_consensus.cc:2804] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:02.450202 16905 raft_consensus.cc:493] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.450799 16905 raft_consensus.cc:3060] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.450263 15944 catalog_manager.cc:5697] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:02.457372 16042 raft_consensus.cc:1240] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Rejecting Update request from peer 36b15691c8e648a18b69e98bee3349b4 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:02.460609 16162 leader_election.cc:343] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:02.461596 16646 consensus_queue.cc:260] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:02.462996 16646 raft_consensus.cc:3060] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.466950 16859 leader_election.cc:290] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:05:02.468171 16871 raft_consensus.cc:2804] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:02.468683 16871 raft_consensus.cc:493] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:02.469125 16871 raft_consensus.cc:3060] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:02.444936 16014 leader_election.cc:304] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4
I20260709 13:05:02.506418 16048 raft_consensus.cc:1275] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Refusing update from remote peer e1e05442c5b44a079dd1de9dd124c990: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:02.486512 16644 raft_consensus.cc:2804] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:02.487675 15944 catalog_manager.cc:5697] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:02.522706 16918 raft_consensus.cc:2804] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:02.532672 16320 tablet_bootstrap.cc:492] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:05:02.532984 16918 raft_consensus.cc:493] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.533385 16663 consensus_queue.cc:1048] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:02.541745 16263 raft_consensus.cc:2468] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:05:02.523043 16644 raft_consensus.cc:493] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.543424 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6c51469e614423d8a9cc50e024cf468" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:02.543802 16644 raft_consensus.cc:3060] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:02.525647 16848 raft_consensus.cc:3055] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:02.545411 16848 raft_consensus.cc:740] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:02.546566 16848 consensus_queue.cc:260] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
W20260709 13:05:02.549104 16089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.549646 16848 raft_consensus.cc:3060] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:02.533507 16918 raft_consensus.cc:3060] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.579375 16089 leader_election.cc:304] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:05:02.581791 16884 raft_consensus.cc:2804] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:02.582361 16884 raft_consensus.cc:697] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:05:02.580178 16818 consensus_queue.cc:1048] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:02.583546 16884 consensus_queue.cc:237] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
W20260709 13:05:02.586979 16089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:02.587566 16088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 197078us
I20260709 13:05:02.565392 16320 ts_tablet_manager.cc:1403] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.794s	user 0.018s	sys 0.018s
I20260709 13:05:02.590611 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85079923151849059accd1b7c27d4699" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
W20260709 13:05:02.614805 16014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 169985us
I20260709 13:05:02.622931 16317 tablet_bootstrap.cc:492] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4: No bootstrap required, opened a new log
I20260709 13:05:02.623754 16317 ts_tablet_manager.cc:1403] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4: Time spent bootstrapping tablet: real 0.493s	user 0.071s	sys 0.091s
I20260709 13:05:02.627801 16317 raft_consensus.cc:359] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:02.628618 16317 raft_consensus.cc:385] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:02.628942 16317 raft_consensus.cc:740] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.629619 16317 consensus_queue.cc:260] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:02.631513 16317 ts_tablet_manager.cc:1434] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:05:02.632365 16193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eede189c87343c6a45e71d7cb23c41d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:02.636857 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85079923151849059accd1b7c27d4699" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:02.637660 16049 raft_consensus.cc:2393] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 in current term 1: Already voted for candidate ec8b54f5a9e44f428a4d537391138dcf in this term.
I20260709 13:05:02.637779 16272 raft_consensus.cc:2393] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf in current term 1: Already voted for candidate 36b15691c8e648a18b69e98bee3349b4 in this term.
I20260709 13:05:02.647630 16320 raft_consensus.cc:359] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:02.650619 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15550bacc7b04df9bc56ec154f31b50b" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:02.654753 16905 raft_consensus.cc:515] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:02.656878 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09412044d26f417da5c842c8acf1149d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:02.661244 16163 leader_election.cc:304] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:02.663280 16320 raft_consensus.cc:385] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:02.680481 16320 raft_consensus.cc:740] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.661290 16268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15550bacc7b04df9bc56ec154f31b50b" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:02.684727 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc1bcba29c24ea9b5582464ad0ba47e" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:02.685734 16263 raft_consensus.cc:3060] T 2fc1bcba29c24ea9b5582464ad0ba47e P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.688001 16905 leader_election.cc:290] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
W20260709 13:05:02.690925 16198 consensus_meta.cc:287] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990: Time spent flushing consensus metadata: real 0.650s	user 0.010s	sys 0.011s
I20260709 13:05:02.691443 16198 raft_consensus.cc:2468] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 4.
W20260709 13:05:02.698726 16014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 55695.8us
W20260709 13:05:02.700291 16163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 88401.8us
I20260709 13:05:02.701009 16830 raft_consensus.cc:2749] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.696539 16320 consensus_queue.cc:260] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:02.705987 16268 raft_consensus.cc:2468] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:05:02.715963 16191 raft_consensus.cc:1240] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 4 FOLLOWER]: Rejecting Update request from peer ec8b54f5a9e44f428a4d537391138dcf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:05:02.738504 16602 consensus_queue.cc:1048] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:02.740043 16192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae7099a7350453682514662a4773778" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
W20260709 13:05:02.740456 16766 consensus_meta.cc:287] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4: Time spent flushing consensus metadata: real 0.692s	user 0.006s	sys 0.012s
I20260709 13:05:02.740957 16192 raft_consensus.cc:3060] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.750583 16196 raft_consensus.cc:1240] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Rejecting Update request from peer 36b15691c8e648a18b69e98bee3349b4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:02.751380 16014 leader_election.cc:304] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:02.757880 16847 raft_consensus.cc:2804] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:02.760511 16847 raft_consensus.cc:493] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
I20260709 13:05:02.760876 16847 raft_consensus.cc:3060] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.762919 16263 raft_consensus.cc:2468] T 2fc1bcba29c24ea9b5582464ad0ba47e P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:05:02.765323 16818 consensus_queue.cc:1048] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:02.758952 16859 consensus_queue.cc:1048] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:05:02.771746 15944 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59484 (request call id 72) took 3161 ms. Trace:
I20260709 13:05:02.772256 15944 rpcz_store.cc:276] 0709 13:04:59.621173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.623103 (+  1930us) service_pool.cc:224] Handling call
0709 13:05:00.482095 (+858992us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b540075fb54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ef090 00007f36c848df3a 00007f36ce2441cc 00007f36ce34237e 00007f36cc8032a4 00007f36cc803232 00007f36cc803161 00007f36cc8030dc 00007f36cc802392 00007f36c67c048c 00007f36c67bf8c6
0709 13:05:02.771624 (+2289529us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:02.605167 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:02.606087 (+   920us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:02.606145 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:05:02.606182 (+    37us) tablet.cc:662] Decoding operations
0709 13:05:02.707466 (+101284us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:02.727220 (+ 19754us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:02.728938 (+  1718us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:05:02.739721 (+ 10783us) tablet.cc:701] Row locks acquired
0709 13:05:02.739771 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:05:02.739970 (+   199us) write_op.cc:270] Start()
0709 13:05:02.740123 (+   153us) write_op.cc:276] Timestamp: P: 1783602302739895 usec, L: 0
0709 13:05:02.740149 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:05:02.741022 (+   873us) log.cc:844] Serialized 1307 byte log entry
0709 13:05:02.743115 (+  2093us) op_driver.cc:464] REPLICATION: finished
0709 13:05:02.743489 (+   374us) write_op.cc:301] APPLY: starting
0709 13:05:02.743588 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:02.743741 (+   153us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:02.743863 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:02.744420 (+   557us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:02.744622 (+   202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:05:02.744669 (+    47us) write_op.cc:312] APPLY: finished
0709 13:05:02.744893 (+   224us) log.cc:844] Serialized 34 byte log entry
0709 13:05:02.745058 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:02.745217 (+   159us) write_op.cc:454] Released schema lock
0709 13:05:02.745277 (+    60us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":10274,"reported_tablets":4,"spinlock_wait_cycles":1961958272,"child_traces":[["op",{"apply.queue_time_us":137,"apply.run_cpu_time_us":2134,"apply.run_wall_time_us":3270,"num_ops":3,"prepare.queue_time_us":1316,"prepare.run_cpu_time_us":4527,"prepare.run_wall_time_us":141778,"replication_time_us":2811}]]}
I20260709 13:05:02.787670 16644 raft_consensus.cc:515] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:02.775599 16088 leader_election.cc:304] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:02.789919 16818 raft_consensus.cc:2749] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.791895 16089 leader_election.cc:304] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:02.794493 16766 raft_consensus.cc:2804] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:05:02.795006 16927 log.cc:927] Time spent T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:05:02.795040 16766 raft_consensus.cc:697] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 4 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:05:02.796398 16766 consensus_queue.cc:237] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:02.809870 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09412044d26f417da5c842c8acf1149d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:02.813735 16320 ts_tablet_manager.cc:1434] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.215s	user 0.008s	sys 0.001s
I20260709 13:05:02.811161 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85079923151849059accd1b7c27d4699" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:02.820578 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eede189c87343c6a45e71d7cb23c41d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:02.823868 16163 leader_election.cc:304] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:02.828413 16124 raft_consensus.cc:1275] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Refusing update from remote peer e1e05442c5b44a079dd1de9dd124c990: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:02.833029 16119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae7099a7350453682514662a4773778" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:02.833839 16119 raft_consensus.cc:3060] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:02.777881 16871 raft_consensus.cc:515] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:02.839812 16014 leader_election.cc:304] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:05:02.842600 16859 raft_consensus.cc:2749] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.846697 16745 raft_consensus.cc:2804] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:02.847298 16745 raft_consensus.cc:697] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:05:02.848330 16745 consensus_queue.cc:237] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:02.854372 16014 leader_election.cc:304] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:05:02.855348 16859 raft_consensus.cc:2749] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:02.859990 16014 leader_election.cc:304] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:02.874367 16271 raft_consensus.cc:1275] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Refusing update from remote peer e1e05442c5b44a079dd1de9dd124c990: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:02.861635 16859 raft_consensus.cc:2749] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:02.853022 16918 raft_consensus.cc:515] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
W20260709 13:05:02.886155 16852 consensus_meta.cc:287] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf: Time spent flushing consensus metadata: real 0.718s	user 0.010s	sys 0.010s
I20260709 13:05:02.883584 16663 consensus_queue.cc:1048] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:05:02.895242 16913 consensus_queue.cc:1048] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:02.907997 16320 tablet_bootstrap.cc:492] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:02.910828 16042 raft_consensus.cc:1240] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Rejecting Update request from peer 36b15691c8e648a18b69e98bee3349b4 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:05:02.911365 16045 raft_consensus.cc:1275] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Refusing update from remote peer 36b15691c8e648a18b69e98bee3349b4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:05:02.911804 16045 pending_rounds.cc:85] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf: Aborting all ops after (but not including) 1
I20260709 13:05:02.912084 16045 pending_rounds.cc:107] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:05:02.912389 16045 raft_consensus.cc:2889] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:02.919121 16871 leader_election.cc:290] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 3 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:02.962697 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:02.963469 16115 raft_consensus.cc:3060] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:02.966002 16120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379913b2ca6a49e9bfd93ca8b06c9fee" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:02.967903 16320 tablet_bootstrap.cc:654] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:02.950947 16847 raft_consensus.cc:515] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:03.000072 16847 leader_election.cc:290] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:05:02.939478 16046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:05:02.940339 16644 leader_election.cc:290] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 4 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:02.941620 16918 leader_election.cc:290] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:03.012166 16046 raft_consensus.cc:2368] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 for earlier term 3. Current term is 4.
I20260709 13:05:03.014087 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15550bacc7b04df9bc56ec154f31b50b" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:05:03.015858 16817 consensus_queue.cc:1059] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:05:03.021281 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379913b2ca6a49e9bfd93ca8b06c9fee" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:03.021922 16267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:03.032809 16267 raft_consensus.cc:3060] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:03.038380 16817 raft_consensus.cc:3055] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:03.038862 16817 raft_consensus.cc:740] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:05:03.039891 16817 consensus_queue.cc:260] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:03.041069 16817 raft_consensus.cc:3060] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:03.045189 16930 log.cc:927] Time spent T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:05:03.052065 16816 consensus_queue.cc:1048] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:03.054833 16088 leader_election.cc:400] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 3 election: Vote denied by peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491) with higher term. Message: Invalid argument: T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 for earlier term 3. Current term is 4.
I20260709 13:05:03.055266 16088 leader_election.cc:403] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:05:03.055594 16644 raft_consensus.cc:493] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.056267 16644 raft_consensus.cc:515] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:03.022276 16119 raft_consensus.cc:2468] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:05:03.059827 16014 leader_election.cc:304] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
W20260709 13:05:03.062654 16163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 158096us
I20260709 13:05:03.055856 16267 raft_consensus.cc:2468] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 4.
I20260709 13:05:03.074473 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15550bacc7b04df9bc56ec154f31b50b" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:03.084793 16644 leader_election.cc:290] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:03.084872 15947 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59482 (request call id 65) took 3506 ms. Trace:
I20260709 13:05:03.087379 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7b2b72b2df44e89e8b76fa65501951" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:03.068451 16918 raft_consensus.cc:2804] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:03.088296 16124 raft_consensus.cc:2468] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 0.
I20260709 13:05:03.093658 16014 leader_election.cc:304] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:03.103508 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7b2b72b2df44e89e8b76fa65501951" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
W20260709 13:05:03.097368 15994 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:03.099761 16644 raft_consensus.cc:2804] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:03.110904 16644 raft_consensus.cc:493] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.092761 16192 raft_consensus.cc:2468] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:05:03.106230 16271 raft_consensus.cc:2468] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 0.
I20260709 13:05:03.111307 16644 raft_consensus.cc:3060] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:03.117424 15946 catalog_manager.cc:5697] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 0 to 1, leader changed from <none> to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 1 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.101099 16918 raft_consensus.cc:697] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:03.119364 15946 catalog_manager.cc:5697] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } }
I20260709 13:05:03.120055 16918 consensus_queue.cc:237] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:03.085740 15947 rpcz_store.cc:276] 0709 13:04:59.578004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.578156 (+   152us) service_pool.cc:224] Handling call
0709 13:04:59.971345 (+393189us) spinlock_profiling.cc:243] Waited 74.8 ms on lock 0x7b540075fb54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ef090 00007f36c848df3a 00007f36ce2441cc 00007f36ce34237e 00007f36cc8032a4 00007f36cc803232 00007f36cc803161 00007f36cc8030dc 00007f36cc802392 00007f36c67c048c 00007f36c67bf8c6
0709 13:05:03.084685 (+3113340us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:02.175545 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:02.181267 (+  5722us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:02.181293 (+    26us) write_op.cc:435] Acquired schema lock
0709 13:05:02.181308 (+    15us) tablet.cc:662] Decoding operations
0709 13:05:02.181573 (+   265us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:02.181629 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:02.181647 (+    18us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:02.181851 (+   204us) tablet.cc:701] Row locks acquired
0709 13:05:02.181863 (+    12us) write_op.cc:260] PREPARE: finished
0709 13:05:02.182005 (+   142us) write_op.cc:270] Start()
0709 13:05:02.182089 (+    84us) write_op.cc:276] Timestamp: P: 1783602302181959 usec, L: 0
0709 13:05:02.182106 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:05:02.182674 (+   568us) log.cc:844] Serialized 537 byte log entry
0709 13:05:02.457669 (+274995us) op_driver.cc:464] REPLICATION: finished
0709 13:05:02.653009 (+195340us) write_op.cc:301] APPLY: starting
0709 13:05:02.653199 (+   190us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:02.653348 (+   149us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:02.677874 (+ 24526us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:02.700582 (+ 22708us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:02.700899 (+   317us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:05:02.700956 (+    57us) write_op.cc:312] APPLY: finished
0709 13:05:02.701305 (+   349us) log.cc:844] Serialized 22 byte log entry
0709 13:05:02.701516 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:02.701618 (+   102us) write_op.cc:454] Released schema lock
0709 13:05:02.701682 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:02.702123 (+   441us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:02.702153 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":75783,"reported_tablets":11,"spinlock_wait_cycles":172049152,"child_traces":[["op",{"apply.queue_time_us":194784,"apply.run_cpu_time_us":2614,"apply.run_wall_time_us":49167,"num_ops":1,"prepare.queue_time_us":352262,"prepare.run_cpu_time_us":2447,"prepare.run_wall_time_us":12353,"replication_time_us":275282,"thread_start_us":507847,"threads_started":2}]]}
I20260709 13:05:03.127883 16115 raft_consensus.cc:2468] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 4.
I20260709 13:05:03.141059 15946 catalog_manager.cc:5697] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } }
I20260709 13:05:03.160175 16320 tablet_bootstrap.cc:492] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf: No bootstrap required, opened a new log
I20260709 13:05:03.160831 16320 ts_tablet_manager.cc:1403] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.280s	user 0.017s	sys 0.007s
I20260709 13:05:03.158824 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:03.167564 16271 raft_consensus.cc:2368] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 for earlier term 3. Current term is 4.
I20260709 13:05:03.170198 16014 leader_election.cc:304] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:03.162694 15946 catalog_manager.cc:5697] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 1 to 3, leader changed from d2e22ad700e94d1095c014708c364bb7 (127.7.25.196) to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 3 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } }
I20260709 13:05:03.159545 16816 raft_consensus.cc:2749] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491) with higher term. Message: Invalid argument: T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 for earlier term 3. Current term is 4.
I20260709 13:05:03.176942 16847 raft_consensus.cc:2804] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:03.169198 16830 consensus_queue.cc:1048] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:05:03.184646 16847 raft_consensus.cc:697] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 4 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:03.205598 16014 leader_election.cc:304] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:05:03.207019 16852 raft_consensus.cc:2749] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:03.207252 16014 leader_election.cc:304] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:03.214385 15946 catalog_manager.cc:5697] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.208181 16852 raft_consensus.cc:2749] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:03.220250 16847 consensus_queue.cc:237] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:03.231243 15946 catalog_manager.cc:5697] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } }
I20260709 13:05:03.233180 16049 raft_consensus.cc:1240] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Rejecting Update request from peer e1e05442c5b44a079dd1de9dd124c990 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:03.233232 15946 catalog_manager.cc:5697] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 1 to 2, leader changed from d2e22ad700e94d1095c014708c364bb7 (127.7.25.196) to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 2 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.238099 16663 consensus_queue.cc:1059] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:03.243916 16089 leader_election.cc:400] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 3 election: Vote denied by peer d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631) with higher term. Message: Invalid argument: T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 36b15691c8e648a18b69e98bee3349b4 for earlier term 3. Current term is 4.
I20260709 13:05:03.262540 16884 consensus_queue.cc:1048] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:03.262941 16644 raft_consensus.cc:515] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:03.276607 16766 consensus_queue.cc:1048] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:03.281600 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7b2b72b2df44e89e8b76fa65501951" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:03.282431 16263 raft_consensus.cc:3060] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:03.286137 16320 raft_consensus.cc:359] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:03.286942 16320 raft_consensus.cc:385] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:03.293865 16320 raft_consensus.cc:740] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:03.295331 16320 consensus_queue.cc:260] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:03.361855 16644 leader_election.cc:290] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:03.369164 16320 ts_tablet_manager.cc:1434] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.208s	user 0.003s	sys 0.010s
I20260709 13:05:03.355393 16847 raft_consensus.cc:493] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.370879 16847 raft_consensus.cc:515] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:03.376389 16847 leader_election.cc:290] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:05:03.377717 16649 raft_consensus.cc:3055] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:03.379550 16041 raft_consensus.cc:3060] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:03.391636 16949 log.cc:927] Time spent T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:05:03.400573 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc1bcba29c24ea9b5582464ad0ba47e" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:03.399682 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7b2b72b2df44e89e8b76fa65501951" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:03.402958 16124 raft_consensus.cc:3060] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:03.410308 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc1bcba29c24ea9b5582464ad0ba47e" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:03.411250 16271 raft_consensus.cc:2393] T 2fc1bcba29c24ea9b5582464ad0ba47e P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec8b54f5a9e44f428a4d537391138dcf in current term 1: Already voted for candidate e1e05442c5b44a079dd1de9dd124c990 in this term.
I20260709 13:05:03.414659 16919 consensus_queue.cc:1048] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:03.419610 16263 raft_consensus.cc:2468] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:05:03.395179 16649 raft_consensus.cc:740] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:05:03.425570 16649 consensus_queue.cc:260] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:03.426905 16649 raft_consensus.cc:3060] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.433319 16014 leader_election.cc:304] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:03.455449 16014 leader_election.cc:304] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:03.456466 16848 raft_consensus.cc:2804] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:03.456970 16848 raft_consensus.cc:697] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:03.457903 16848 consensus_queue.cc:237] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:03.471302 16196 raft_consensus.cc:1275] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 4 FOLLOWER]: Refusing update from remote peer 36b15691c8e648a18b69e98bee3349b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:05:03.490269 16644 raft_consensus.cc:2749] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:03.493173 16919 consensus_queue.cc:1048] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:03.500824 16646 consensus_queue.cc:1048] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:03.504251 16045 raft_consensus.cc:1275] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Refusing update from remote peer 36b15691c8e648a18b69e98bee3349b4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:05:03.504690 16045 pending_rounds.cc:85] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf: Aborting all ops after (but not including) 1
I20260709 13:05:03.504976 16045 pending_rounds.cc:107] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:05:03.505257 16045 raft_consensus.cc:2889] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:03.510078 16884 consensus_queue.cc:1048] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:03.548287 16124 raft_consensus.cc:2468] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 1.
I20260709 13:05:03.586514 15946 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59466 (request call id 69) took 1869 ms. Trace:
I20260709 13:05:03.586985 15946 rpcz_store.cc:276] 0709 13:05:01.717398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.718486 (+  1088us) service_pool.cc:224] Handling call
0709 13:05:03.586433 (+1867947us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:03.370283 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:03.370907 (+   624us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:03.370942 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:05:03.370963 (+    21us) tablet.cc:662] Decoding operations
0709 13:05:03.371921 (+   958us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:03.372010 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:03.372053 (+    43us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:05:03.374894 (+  2841us) tablet.cc:701] Row locks acquired
0709 13:05:03.374920 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:05:03.375104 (+   184us) write_op.cc:270] Start()
0709 13:05:03.379236 (+  4132us) write_op.cc:276] Timestamp: P: 1783602303375062 usec, L: 0
0709 13:05:03.379260 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:05:03.379914 (+   654us) log.cc:844] Serialized 2848 byte log entry
0709 13:05:03.401358 (+ 21444us) op_driver.cc:464] REPLICATION: finished
0709 13:05:03.520480 (+119122us) write_op.cc:301] APPLY: starting
0709 13:05:03.520559 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:03.552871 (+ 32312us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:03.553004 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:03.553842 (+   838us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:03.554025 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:05:03.554549 (+   524us) write_op.cc:312] APPLY: finished
0709 13:05:03.561832 (+  7283us) log.cc:844] Serialized 58 byte log entry
0709 13:05:03.562018 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:03.562129 (+   111us) write_op.cc:454] Released schema lock
0709 13:05:03.562178 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:03.568645 (+  6467us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:03.568686 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32805,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":118888,"apply.run_cpu_time_us":2645,"apply.run_wall_time_us":48139,"num_ops":7,"prepare.queue_time_us":118738,"prepare.run_cpu_time_us":3992,"prepare.run_wall_time_us":11679,"replication_time_us":21942,"thread_start_us":226163,"threads_started":2}]]}
I20260709 13:05:03.617933 15945 catalog_manager.cc:5697] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 1 to 3, leader changed from d2e22ad700e94d1095c014708c364bb7 (127.7.25.196) to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 3 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } }
I20260709 13:05:03.623284 15945 catalog_manager.cc:5697] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } }
I20260709 13:05:03.659482 15947 catalog_manager.cc:5697] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.713074 16266 raft_consensus.cc:1275] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:05:03.714875 16848 consensus_queue.cc:1048] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:03.718278 15947 catalog_manager.cc:5697] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:03.723115 15945 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59494 (request call id 66) took 1171 ms. Trace:
I20260709 13:05:03.720973 15947 catalog_manager.cc:5697] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 1 to 2, leader changed from 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194) to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 2 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.730990 16848 consensus_queue.cc:1048] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:03.733682 15947 catalog_manager.cc:5697] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 1 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } }
I20260709 13:05:03.743708 16848 consensus_queue.cc:1048] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:03.735262 15947 catalog_manager.cc:5697] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 1 to 2, leader changed from 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194) to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 2 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:03.723737 15945 rpcz_store.cc:276] 0709 13:05:02.551610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.553280 (+  1670us) service_pool.cc:224] Handling call
0709 13:05:02.714688 (+161408us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b540075fb54. stack: 00007f36c5366343 00007f36c5366240 00007f36c4cf51d4 00007f36cea33304 00007f36cea33299 00007f36c83ef090 00007f36c848df3a 00007f36ce2441cc 00007f36ce34237e 00007f36cc8032a4 00007f36cc803232 00007f36cc803161 00007f36cc8030dc 00007f36cc802392 00007f36c67c048c 00007f36c67bf8c6
0709 13:05:03.723048 (+1008360us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:03.638991 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:03.639501 (+   510us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:03.639531 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:05:03.639547 (+    16us) tablet.cc:662] Decoding operations
0709 13:05:03.639911 (+   364us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:03.639964 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:03.639994 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:05:03.640318 (+   324us) tablet.cc:701] Row locks acquired
0709 13:05:03.640337 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:05:03.640491 (+   154us) write_op.cc:270] Start()
0709 13:05:03.640594 (+   103us) write_op.cc:276] Timestamp: P: 1783602303640442 usec, L: 0
0709 13:05:03.640614 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:05:03.641218 (+   604us) log.cc:844] Serialized 922 byte log entry
0709 13:05:03.643993 (+  2775us) op_driver.cc:464] REPLICATION: finished
0709 13:05:03.644346 (+   353us) write_op.cc:301] APPLY: starting
0709 13:05:03.644435 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:03.644569 (+   134us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:03.644662 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:03.645013 (+   351us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:03.645223 (+   210us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:05:03.645279 (+    56us) write_op.cc:312] APPLY: finished
0709 13:05:03.645475 (+   196us) log.cc:844] Serialized 28 byte log entry
0709 13:05:03.645651 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:03.645744 (+    93us) write_op.cc:454] Released schema lock
0709 13:05:03.645787 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:03.646138 (+   351us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:03.646173 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":57973,"reported_tablets":14,"spinlock_wait_cycles":94920448,"child_traces":[["op",{"apply.queue_time_us":107,"apply.run_cpu_time_us":1743,"apply.run_wall_time_us":1742,"num_ops":2,"prepare.queue_time_us":3770,"prepare.run_cpu_time_us":2496,"prepare.run_wall_time_us":2500,"replication_time_us":3266}]]}
I20260709 13:05:03.779687 16121 raft_consensus.cc:1275] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 4 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:05:03.781543 16848 consensus_queue.cc:1048] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:03.792068 15944 catalog_manager.cc:5697] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:03.795807 15944 catalog_manager.cc:5697] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 3 to 4, leader changed from ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193) to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 4 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.802057 15944 catalog_manager.cc:5697] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 2 to 3, leader changed from ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193) to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 3 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:03.829147 15946 catalog_manager.cc:5697] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.842209 15946 catalog_manager.cc:5697] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 0 to 1, leader changed from <none> to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 1 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.844316 15946 catalog_manager.cc:5697] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 0 to 1, leader changed from <none> to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 1 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.898720 15947 catalog_manager.cc:5697] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } }
I20260709 13:05:03.928177 16848 consensus_queue.cc:1048] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:03.994650 16848 consensus_queue.cc:1048] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:04.356876 16972 raft_consensus.cc:493] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:04.357422 16972 raft_consensus.cc:515] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:04.360821 16045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379913b2ca6a49e9bfd93ca8b06c9fee" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:04.361107 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379913b2ca6a49e9bfd93ca8b06c9fee" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:04.361683 16045 raft_consensus.cc:2393] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 in current term 2: Already voted for candidate ec8b54f5a9e44f428a4d537391138dcf in this term.
I20260709 13:05:04.361780 16124 raft_consensus.cc:2468] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 2.
I20260709 13:05:04.365171 16237 leader_election.cc:304] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:04.373667 16867 raft_consensus.cc:2804] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:04.373685 16972 leader_election.cc:290] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:04.374181 16867 raft_consensus.cc:493] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36b15691c8e648a18b69e98bee3349b4)
I20260709 13:05:04.374595 16867 raft_consensus.cc:3060] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.382771 16867 raft_consensus.cc:515] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:04.385895 16045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379913b2ca6a49e9bfd93ca8b06c9fee" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:05:04.388226 16045 raft_consensus.cc:2393] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 in current term 2: Already voted for candidate ec8b54f5a9e44f428a4d537391138dcf in this term.
I20260709 13:05:04.390286 16867 leader_election.cc:290] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:04.391561 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379913b2ca6a49e9bfd93ca8b06c9fee" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:04.408929 16124 raft_consensus.cc:2468] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 2.
I20260709 13:05:04.413537 16237 leader_election.cc:304] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:04.416517 16972 raft_consensus.cc:2804] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:04.417026 16972 raft_consensus.cc:697] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 2 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:05:04.417862 16972 consensus_queue.cc:237] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:04.445880 15944 catalog_manager.cc:5697] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 1 to 2, leader changed from 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194) to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 2 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:04.773777 16920 raft_consensus.cc:493] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.774394 16920 raft_consensus.cc:515] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:04.778173 16972 raft_consensus.cc:493] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1e05442c5b44a079dd1de9dd124c990)
I20260709 13:05:04.778805 16972 raft_consensus.cc:515] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:04.781863 16042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15550bacc7b04df9bc56ec154f31b50b" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:04.782761 16042 raft_consensus.cc:2468] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 2.
I20260709 13:05:04.783967 16162 leader_election.cc:304] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:04.784817 16649 raft_consensus.cc:2804] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:04.784852 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15550bacc7b04df9bc56ec154f31b50b" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:04.785305 16649 raft_consensus.cc:493] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.785684 16649 raft_consensus.cc:3060] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.785717 16271 raft_consensus.cc:2468] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:05:04.791695 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15550bacc7b04df9bc56ec154f31b50b" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:04.796240 16972 leader_election.cc:290] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:04.797878 16042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15550bacc7b04df9bc56ec154f31b50b" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf" is_pre_election: true
I20260709 13:05:04.798736 16042 raft_consensus.cc:2393] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 in current term 2: Already voted for candidate ec8b54f5a9e44f428a4d537391138dcf in this term.
I20260709 13:05:04.800451 16920 leader_election.cc:290] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:04.793787 16649 raft_consensus.cc:515] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:04.807471 16194 raft_consensus.cc:2368] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 for earlier term 2. Current term is 3.
I20260709 13:05:04.810644 16237 leader_election.cc:400] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725) with higher term. Message: Invalid argument: T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 for earlier term 2. Current term is 3.
I20260709 13:05:04.810994 16237 leader_election.cc:403] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:04.811921 16972 raft_consensus.cc:3060] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.820329 16972 raft_consensus.cc:2749] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725) with higher term. Message: Invalid argument: T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2e22ad700e94d1095c014708c364bb7 for earlier term 2. Current term is 3.
I20260709 13:05:04.823112 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15550bacc7b04df9bc56ec154f31b50b" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:04.831414 16271 raft_consensus.cc:2468] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 3.
I20260709 13:05:04.833647 16042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15550bacc7b04df9bc56ec154f31b50b" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
I20260709 13:05:04.834738 16042 raft_consensus.cc:3060] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.852231 16042 raft_consensus.cc:2468] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 3.
I20260709 13:05:04.853660 16162 leader_election.cc:304] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:04.854696 16920 raft_consensus.cc:2804] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:04.855306 16920 raft_consensus.cc:697] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 3 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:05:04.856209 16920 consensus_queue.cc:237] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:04.834203 16649 leader_election.cc:290] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 3 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:04.863692 16121 raft_consensus.cc:1275] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Refusing update from remote peer d2e22ad700e94d1095c014708c364bb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:04.866612 16867 consensus_queue.cc:1048] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:04.925418 15945 catalog_manager.cc:5697] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:04.926261 16045 raft_consensus.cc:1275] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Refusing update from remote peer d2e22ad700e94d1095c014708c364bb7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:04.928222 16973 consensus_queue.cc:1048] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:05.084009  7271 tablet_server.cc:179] TabletServer@127.7.25.193:0 shutting down...
W20260709 13:05:05.092342 16236 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:05:05.134534 16236 consensus_peers.cc:597] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.149168 16162 consensus_peers.cc:597] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.153645 16162 consensus_peers.cc:597] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.169157 16162 consensus_peers.cc:597] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.174013 16088 consensus_peers.cc:597] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.174707 16088 consensus_peers.cc:597] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.175230 16088 consensus_peers.cc:597] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.175756 16088 consensus_peers.cc:597] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.176192 16088 consensus_peers.cc:597] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.181586 16088 consensus_peers.cc:597] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.184722 16236 consensus_peers.cc:597] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.187489  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:05.188596  7271 tablet_replica.cc:333] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.189694  7271 raft_consensus.cc:2243] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.190229  7271 pending_rounds.cc:70] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf: Trying to abort 1 pending ops.
I20260709 13:05:05.190505  7271 pending_rounds.cc:77] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635026505449472 op_type: NO_OP noop_request { }
I20260709 13:05:05.190832  7271 raft_consensus.cc:2889] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:05:05.191227  7271 raft_consensus.cc:2272] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.193591  7271 tablet_replica.cc:333] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.194298  7271 raft_consensus.cc:2243] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.194756  7271 raft_consensus.cc:2272] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.196841  7271 tablet_replica.cc:333] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.197975  7271 raft_consensus.cc:2243] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.198540  7271 raft_consensus.cc:2272] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.202971  7271 tablet_replica.cc:333] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.203892  7271 raft_consensus.cc:2243] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:05.205015  7271 raft_consensus.cc:2272] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.207935  7271 tablet_replica.cc:333] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.209117  7271 raft_consensus.cc:2243] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.209617  7271 raft_consensus.cc:2272] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:05.216632 16236 consensus_peers.cc:597] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.217344  7271 tablet_replica.cc:333] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.218569  7271 raft_consensus.cc:2243] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.219122  7271 raft_consensus.cc:2272] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:05.219586 16088 consensus_peers.cc:597] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.221864  7271 tablet_replica.cc:333] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.222694  7271 raft_consensus.cc:2243] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.223301  7271 raft_consensus.cc:2272] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.225726  7271 tablet_replica.cc:333] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.226336  7271 raft_consensus.cc:2243] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:05.227120  7271 raft_consensus.cc:2272] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.229378  7271 tablet_replica.cc:333] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.229960  7271 raft_consensus.cc:2243] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.230440  7271 raft_consensus.cc:2272] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.233008  7271 tablet_replica.cc:333] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.233657  7271 raft_consensus.cc:2243] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:05.234551  7271 raft_consensus.cc:2272] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.236698  7271 tablet_replica.cc:333] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.237498  7271 raft_consensus.cc:2243] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.238004  7271 raft_consensus.cc:2272] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.240159  7271 tablet_replica.cc:333] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.240904  7271 raft_consensus.cc:2243] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.241395  7271 raft_consensus.cc:2272] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.244293  7271 tablet_replica.cc:333] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.245064  7271 raft_consensus.cc:2243] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.245611  7271 raft_consensus.cc:2272] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:05.246874 16088 consensus_peers.cc:597] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.248334  7271 tablet_replica.cc:333] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.249223  7271 raft_consensus.cc:2243] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.250870  7271 raft_consensus.cc:2272] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.264216  7271 tablet_replica.cc:333] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.265116  7271 raft_consensus.cc:2243] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.265666  7271 raft_consensus.cc:2272] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.268452  7271 tablet_replica.cc:333] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.269253  7271 raft_consensus.cc:2243] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:05.269759 16162 consensus_peers.cc:597] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.271536  7271 raft_consensus.cc:2272] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.274495  7271 tablet_replica.cc:333] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.276222  7271 raft_consensus.cc:2243] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:05.277314  7271 raft_consensus.cc:2272] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:05.277702 16162 consensus_peers.cc:597] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.280009  7271 tablet_replica.cc:333] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.280910  7271 raft_consensus.cc:2243] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.281530  7271 raft_consensus.cc:2272] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:05.284123 16088 consensus_peers.cc:597] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.287249  7271 tablet_replica.cc:333] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
W20260709 13:05:05.289629 16088 consensus_peers.cc:597] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.288475  7271 raft_consensus.cc:2243] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.293059  7271 raft_consensus.cc:2272] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.295914  7271 tablet_replica.cc:333] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.296509  7271 raft_consensus.cc:2243] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:05.297617  7271 raft_consensus.cc:2272] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.300288  7271 tablet_replica.cc:333] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.301043  7271 raft_consensus.cc:2243] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.301584  7271 raft_consensus.cc:2272] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.306169  7271 tablet_replica.cc:333] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.307024  7271 raft_consensus.cc:2243] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.307561  7271 raft_consensus.cc:2272] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.310752  7271 tablet_replica.cc:333] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.311527  7271 raft_consensus.cc:2243] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.312112  7271 raft_consensus.cc:2272] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.314918  7271 tablet_replica.cc:333] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.315757  7271 raft_consensus.cc:2243] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.316232  7271 raft_consensus.cc:2272] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.319232  7271 tablet_replica.cc:333] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.320127  7271 raft_consensus.cc:2243] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.320658  7271 raft_consensus.cc:2272] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:05.326619 16236 consensus_peers.cc:597] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.329624  7271 tablet_replica.cc:333] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.330539  7271 raft_consensus.cc:2243] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:05.331596 16271 raft_consensus.cc:1275] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Refusing update from remote peer e1e05442c5b44a079dd1de9dd124c990: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:05.333012 16920 consensus_queue.cc:1048] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:05.340433 16236 consensus_peers.cc:597] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.372660  7271 raft_consensus.cc:2272] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.375702  7271 tablet_replica.cc:333] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
W20260709 13:05:05.388077 16162 consensus_peers.cc:597] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.389899  7271 raft_consensus.cc:2243] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:05.390900  7271 raft_consensus.cc:2272] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:05.396417 16162 consensus_peers.cc:597] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.402335  7271 tablet_replica.cc:333] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.403497  7271 raft_consensus.cc:2243] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.404132  7271 raft_consensus.cc:2272] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.407735  7271 tablet_replica.cc:333] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.408727  7271 raft_consensus.cc:2243] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.409379  7271 raft_consensus.cc:2272] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.416971  7271 tablet_replica.cc:333] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
W20260709 13:05:05.423390 16162 consensus_peers.cc:597] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.418025  7271 raft_consensus.cc:2243] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.424294  7271 raft_consensus.cc:2272] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.427639  7271 tablet_replica.cc:333] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.428514  7271 raft_consensus.cc:2243] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.429036  7271 raft_consensus.cc:2272] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:05.544790 16162 consensus_peers.cc:597] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.545410 16162 consensus_peers.cc:597] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.554579 16089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 124629us
W20260709 13:05:05.563216 16162 consensus_peers.cc:597] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.588881  7271 tablet_replica.cc:333] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.589867  7271 raft_consensus.cc:2243] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.590420  7271 raft_consensus.cc:2272] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:05.592473 16162 consensus_peers.cc:597] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.593182 16162 consensus_peers.cc:597] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.611375  7271 tablet_replica.cc:333] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.612367  7271 raft_consensus.cc:2243] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:05.621487 16162 consensus_peers.cc:597] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.612969  7271 raft_consensus.cc:2272] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.631412  7271 tablet_replica.cc:333] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.634951  7271 raft_consensus.cc:2243] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:05.612988 16236 consensus_peers.cc:597] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.662407 16089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 45750.6us
I20260709 13:05:05.635632  7271 raft_consensus.cc:2272] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:05.686789 16236 consensus_peers.cc:597] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.688855  7271 tablet_replica.cc:333] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
W20260709 13:05:05.697747 16088 consensus_peers.cc:597] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.710075 16236 consensus_peers.cc:597] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:05.711796 16236 consensus_peers.cc:597] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.713070  7271 raft_consensus.cc:2243] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.716521  7271 raft_consensus.cc:2272] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:05.713474 16236 consensus_peers.cc:597] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.719578  7271 tablet_replica.cc:333] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.728207  7271 raft_consensus.cc:2243] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:05:05.728771 16088 consensus_peers.cc:597] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.729241  7271 raft_consensus.cc:2272] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:05.729492 16088 consensus_peers.cc:597] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.732072  7271 tablet_replica.cc:333] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.733609  7271 raft_consensus.cc:2243] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.736881  7271 raft_consensus.cc:2272] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.739957  7271 tablet_replica.cc:333] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.740736  7271 raft_consensus.cc:2243] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.741353  7271 raft_consensus.cc:2272] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.747745  7271 tablet_replica.cc:333] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.748489  7271 raft_consensus.cc:2243] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.749027  7271 raft_consensus.cc:2272] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.751547  7271 tablet_replica.cc:333] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.752275  7271 raft_consensus.cc:2243] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.752844  7271 raft_consensus.cc:2272] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.755648  7271 tablet_replica.cc:333] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.756439  7271 raft_consensus.cc:2243] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.757306  7271 raft_consensus.cc:2272] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.760228  7271 tablet_replica.cc:333] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.761272  7271 raft_consensus.cc:2243] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.762208  7271 raft_consensus.cc:2272] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.765453  7271 tablet_replica.cc:333] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.773345  7271 raft_consensus.cc:2243] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.774013  7271 raft_consensus.cc:2272] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.779014  7271 tablet_replica.cc:333] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.779953  7271 raft_consensus.cc:2243] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.780628  7271 raft_consensus.cc:2272] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.783881  7271 tablet_replica.cc:333] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf: stopping tablet replica
I20260709 13:05:05.784719  7271 raft_consensus.cc:2243] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.785610  7271 raft_consensus.cc:2272] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.907289  7271 tablet_server.cc:196] TabletServer@127.7.25.193:0 shutdown complete.
I20260709 13:05:06.151862  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:06.185900 16998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:06.198221 16999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:06.201263 17001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:06.218855  7271 server_base.cc:1061] running on GCE node
I20260709 13:05:06.222451  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:06.222816  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:06.223063  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602306223045 us; error 0 us; skew 500 ppm
I20260709 13:05:06.223973  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:06.237555  7271 webserver.cc:533] Webserver started at http://127.7.25.193:37899/ using document root <none> and password file <none>
I20260709 13:05:06.238390  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:06.238665  7271 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:05:06.274080  7271 fs_manager.cc:714] Time spent opening directory manager: real 0.034s	user 0.031s	sys 0.004s
I20260709 13:05:06.280210 16800 raft_consensus.cc:493] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.280815 16800 raft_consensus.cc:515] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:06.286247 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
W20260709 13:05:06.291525 16088 leader_election.cc:336] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:06.291987 16088 leader_election.cc:304] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:06.293763 16994 raft_consensus.cc:2749] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:06.294566 16800 leader_election.cc:290] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:06.298708 17006 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:06.300004  7271 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:05:06.300446  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-0-root
uuid: "ec8b54f5a9e44f428a4d537391138dcf"
format_stamp: "Formatted at 2026-07-09 13:04:46 on dist-test-slave-z1zn"
I20260709 13:05:06.302361  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602011513864-7271-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:06.366078  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:06.367965  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:06.370019  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:06.380476 17013 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:05:06.412448 16972 raft_consensus.cc:493] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.413057 16972 raft_consensus.cc:515] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:06.415180 16972 leader_election.cc:290] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:06.419214 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:06.419987 16115 raft_consensus.cc:2468] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 4.
I20260709 13:05:06.421803 16237 leader_election.cc:304] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
W20260709 13:05:06.424042 16236 leader_election.cc:336] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:06.428486 16973 raft_consensus.cc:2804] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:06.429049 16973 raft_consensus.cc:493] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.429493 16973 raft_consensus.cc:3060] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:06.432461 16993 raft_consensus.cc:493] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.433037 16993 raft_consensus.cc:515] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:06.437132 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae7099a7350453682514662a4773778" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:06.437845 16973 raft_consensus.cc:515] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:06.449193 16994 raft_consensus.cc:493] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.449815 16994 raft_consensus.cc:515] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:06.450812 16973 leader_election.cc:290] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 5 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:06.451877 16994 leader_election.cc:290] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
W20260709 13:05:06.457794 16088 leader_election.cc:336] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:06.459882 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac8a97b1adc49389919710edf7c5e03" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:06.464360 16089 leader_election.cc:304] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:06.464768 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc93f8cfc444912a0c7ef667a931a5c" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:06.465437 16115 raft_consensus.cc:3060] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:06.465605 16994 raft_consensus.cc:2749] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:06.437300 16993 leader_election.cc:290] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:06.446583 16800 raft_consensus.cc:493] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.471943 16800 raft_consensus.cc:515] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:06.473016 16115 raft_consensus.cc:2468] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 5.
I20260709 13:05:06.474362 16237 leader_election.cc:304] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:05:06.475189 16973 raft_consensus.cc:2804] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:06.475718 16973 raft_consensus.cc:697] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 5 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:05:06.476578 16867 raft_consensus.cc:493] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.477880 16867 raft_consensus.cc:515] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:06.478740 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae7099a7350453682514662a4773778" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:06.479387 16194 raft_consensus.cc:2468] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:05:06.480108 16867 leader_election.cc:290] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:06.476665 16973 consensus_queue.cc:237] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:06.481619 16994 raft_consensus.cc:493] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.485540 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6b0df9a4d4b55a27f4ffb956db8d0" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:06.485540 16800 leader_election.cc:290] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:06.484128 16994 raft_consensus.cc:515] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:06.481253 16089 leader_election.cc:304] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:05:06.494526 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2d4bd133442d28d078d6fc088cff4" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
W20260709 13:05:06.489873 16162 leader_election.cc:336] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:06.496236 16162 leader_election.cc:304] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:06.495219 16800 raft_consensus.cc:2804] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:06.495606 16088 leader_election.cc:336] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:06.496999 16649 raft_consensus.cc:2749] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:06.488799 16236 leader_election.cc:336] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:06.497022 16800 raft_consensus.cc:493] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.500667 16800 raft_consensus.cc:3060] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.492394 16994 leader_election.cc:290] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
W20260709 13:05:06.504666 16236 leader_election.cc:336] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:06.505201 16236 leader_election.cc:304] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:06.505921 16973 raft_consensus.cc:2749] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:06.513581 16649 raft_consensus.cc:493] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
W20260709 13:05:06.513777 16088 leader_election.cc:336] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:06.514151 16649 raft_consensus.cc:515] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:06.516010 16649 leader_election.cc:290] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:06.515472 15944 catalog_manager.cc:5697] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 4 to 5, leader changed from ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193) to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 5 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.523306 16089 leader_election.cc:304] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:06.524300 16975 raft_consensus.cc:2749] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:06.524988 16162 leader_election.cc:336] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:06.526940 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6b0df9a4d4b55a27f4ffb956db8d0" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:06.527674 16263 raft_consensus.cc:2468] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:05:06.529120 16163 leader_election.cc:304] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:06.530504 16649 raft_consensus.cc:2804] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:06.530859 16649 raft_consensus.cc:493] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.531193 16649 raft_consensus.cc:3060] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.542922 16800 raft_consensus.cc:515] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:06.546458 16800 leader_election.cc:290] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:06.547946 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae7099a7350453682514662a4773778" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:05:06.552054 16194 raft_consensus.cc:3060] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.550873 16973 raft_consensus.cc:493] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.552680 16973 raft_consensus.cc:515] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:06.554961 16973 leader_election.cc:290] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:06.557523 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522541a48c1647ccaf475543121810d2" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
W20260709 13:05:06.560029 16088 leader_election.cc:336] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:06.563506 16991 raft_consensus.cc:493] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.564251 16991 raft_consensus.cc:515] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:06.566583 16991 leader_election.cc:290] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:06.566709 16194 raft_consensus.cc:2468] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 2.
I20260709 13:05:06.568488 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2d4bd133442d28d078d6fc088cff4" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:06.569262 16115 raft_consensus.cc:2468] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:05:06.571941 16089 leader_election.cc:304] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
W20260709 13:05:06.572453 16162 leader_election.cc:336] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:06.572773 16800 raft_consensus.cc:2804] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:06.573354 16800 raft_consensus.cc:697] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [term 2 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:05:06.574167 16800 consensus_queue.cc:237] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
W20260709 13:05:06.580940 16236 leader_election.cc:336] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:06.581717 16236 leader_election.cc:304] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:06.582464 16973 raft_consensus.cc:2749] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:06.569759 16649 raft_consensus.cc:515] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:06.592126 16649 leader_election.cc:290] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:06.595469 16163 leader_election.cc:304] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:06.595937 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6b0df9a4d4b55a27f4ffb956db8d0" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:06.596554 16263 raft_consensus.cc:3060] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.598390 16991 raft_consensus.cc:2804] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:06.598829 16991 raft_consensus.cc:493] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.599189 16991 raft_consensus.cc:3060] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:06.604440 16162 leader_election.cc:336] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:06.621098 16991 raft_consensus.cc:515] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:06.630771 16991 leader_election.cc:290] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:06.626106 16263 raft_consensus.cc:2468] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 2.
I20260709 13:05:06.632165 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2d4bd133442d28d078d6fc088cff4" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:06.634941 16115 raft_consensus.cc:3060] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:06.635983 16162 leader_election.cc:336] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:06.643957 16163 leader_election.cc:304] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:06.645951 16649 raft_consensus.cc:2804] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:06.646411 16649 raft_consensus.cc:697] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:05:06.647164 16649 consensus_queue.cc:237] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:06.649199 16800 raft_consensus.cc:493] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.649802 16800 raft_consensus.cc:515] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:06.651700 16800 leader_election.cc:290] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:06.653861 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430a0b8ad91a40389bde4a2dce852afb" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
W20260709 13:05:06.664362 16088 leader_election.cc:336] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:06.664841 16088 leader_election.cc:304] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:06.665704 16975 raft_consensus.cc:2749] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:06.669278 15947 catalog_manager.cc:5697] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 1 to 2, leader changed from ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193) to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.691409 16115 raft_consensus.cc:2468] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 2.
I20260709 13:05:06.693135 16163 leader_election.cc:304] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:06.694458 16991 raft_consensus.cc:2804] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:06.695415 16991 raft_consensus.cc:697] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:05:06.697928 16991 consensus_queue.cc:237] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:06.711807 15947 catalog_manager.cc:5697] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 1 to 2, leader changed from ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193) to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 2 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.744710 15944 catalog_manager.cc:5697] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 1 to 2, leader changed from ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193) to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 2 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:06.753010 16991 raft_consensus.cc:493] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.753767 16991 raft_consensus.cc:515] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:06.757831 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522541a48c1647ccaf475543121810d2" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:06.758572 16271 raft_consensus.cc:2468] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:05:06.761430 16163 leader_election.cc:304] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:05:06.762290 16649 raft_consensus.cc:2804] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:06.762674 16649 raft_consensus.cc:493] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.762962 16991 leader_election.cc:290] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:06.763011 16649 raft_consensus.cc:3060] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.777025 16993 raft_consensus.cc:493] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.777675 16993 raft_consensus.cc:515] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:06.780320 16649 raft_consensus.cc:515] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:06.783835 16649 leader_election.cc:290] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:06.785020 16993 leader_election.cc:290] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
W20260709 13:05:06.787592 16162 leader_election.cc:336] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:06.788218 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522541a48c1647ccaf475543121810d2" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:06.788818 16271 raft_consensus.cc:3060] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.797024 16271 raft_consensus.cc:2468] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 2.
I20260709 13:05:06.798413 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430a0b8ad91a40389bde4a2dce852afb" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:06.799294 16163 leader_election.cc:304] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:05:06.799299 16121 raft_consensus.cc:2468] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 1.
I20260709 13:05:06.801031 16649 raft_consensus.cc:2804] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:06.801584 16649 raft_consensus.cc:697] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:05:06.801710 16163 leader_election.cc:304] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:05:06.802381 16649 consensus_queue.cc:237] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
W20260709 13:05:06.805581 16162 leader_election.cc:336] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
W20260709 13:05:06.806900 16162 leader_election.cc:336] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:06.805892 16972 raft_consensus.cc:493] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.807590 16972 raft_consensus.cc:515] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
W20260709 13:05:06.816781 16236 leader_election.cc:336] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:06.821187 16972 leader_election.cc:290] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:06.802949 16993 raft_consensus.cc:2804] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:06.822024 16993 raft_consensus.cc:493] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.822508 16993 raft_consensus.cc:3060] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.822695 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7b2b72b2df44e89e8b76fa65501951" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:06.824477 16237 leader_election.cc:304] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:06.825649 16972 raft_consensus.cc:2749] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:06.840757 16993 raft_consensus.cc:515] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:06.843115 16993 leader_election.cc:290] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
W20260709 13:05:06.848404 16162 leader_election.cc:336] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:06.856341 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430a0b8ad91a40389bde4a2dce852afb" candidate_uuid: "e1e05442c5b44a079dd1de9dd124c990" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:06.857539 16115 raft_consensus.cc:3060] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.859066 15944 catalog_manager.cc:5697] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 1 to 2, leader changed from ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193) to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 2 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.868362 16115 raft_consensus.cc:2468] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e05442c5b44a079dd1de9dd124c990 in term 2.
I20260709 13:05:06.869783 16163 leader_election.cc:304] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:06.870889 16993 raft_consensus.cc:2804] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:06.871367 16993 raft_consensus.cc:697] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Becoming Leader. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:05:06.872288 16993 consensus_queue.cc:237] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:06.897627 16972 raft_consensus.cc:493] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.898247 16972 raft_consensus.cc:515] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:06.900519 16972 leader_election.cc:290] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:06.906287 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac8a97b1adc49389919710edf7c5e03" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:06.907008 16115 raft_consensus.cc:2468] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 1.
I20260709 13:05:06.916162 16237 leader_election.cc:304] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:05:06.917913 16867 raft_consensus.cc:2804] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:06.918340 16867 raft_consensus.cc:493] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:06.918716 16867 raft_consensus.cc:3060] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:06.926004 16236 leader_election.cc:336] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:06.927253 16867 raft_consensus.cc:515] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:06.934384 16867 leader_election.cc:290] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 election: Requested vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:06.939738 16121 raft_consensus.cc:1275] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 5 FOLLOWER]: Refusing update from remote peer d2e22ad700e94d1095c014708c364bb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:06.942591 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac8a97b1adc49389919710edf7c5e03" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:06.943244 16115 raft_consensus.cc:3060] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.946573 15944 catalog_manager.cc:5697] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 reported cstate change: term changed from 1 to 2, leader changed from ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193) to e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195). New cstate: current_term: 2 leader_uuid: "e1e05442c5b44a079dd1de9dd124c990" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:06.947306 16973 consensus_queue.cc:1048] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:06.975673 16194 raft_consensus.cc:1275] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Refusing update from remote peer 36b15691c8e648a18b69e98bee3349b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:06.977262 16975 consensus_queue.cc:1048] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:07.042203 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:44725, user_credentials={real_user=slave}} blocked reactor thread for 54737us
I20260709 13:05:07.054558 16115 raft_consensus.cc:2468] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 2.
I20260709 13:05:07.056275 16237 leader_election.cc:304] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:05:07.063588 16973 raft_consensus.cc:2804] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:07.064618 16973 raft_consensus.cc:697] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [term 2 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:05:07.065742 16973 consensus_queue.cc:237] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
W20260709 13:05:07.083647 16236 leader_election.cc:336] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:07.108665 16800 raft_consensus.cc:493] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:07.109233 16800 raft_consensus.cc:515] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:07.111181 16800 leader_election.cc:290] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:07.123224 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7b2b72b2df44e89e8b76fa65501951" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:07.123997 16271 raft_consensus.cc:2468] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 1.
I20260709 13:05:07.133522 16089 leader_election.cc:304] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:05:07.134331 16800 raft_consensus.cc:2804] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:07.134745 16800 raft_consensus.cc:493] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:07.135149 16800 raft_consensus.cc:3060] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:07.143136 16088 leader_election.cc:336] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
W20260709 13:05:07.148815 16162 consensus_peers.cc:597] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:07.152352 16088 consensus_peers.cc:597] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:07.157878 15947 catalog_manager.cc:5697] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 1 to 2, leader changed from ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193) to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 2 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:07.157797 16236 consensus_peers.cc:597] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:07.152313 16800 raft_consensus.cc:515] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:07.164909 16800 leader_election.cc:290] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:07.167222  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:05:07.167610  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.793s	user 0.009s	sys 0.004s
I20260709 13:05:07.167968  7271 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:05:07.168399 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7b2b72b2df44e89e8b76fa65501951" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:07.169024 16271 raft_consensus.cc:3060] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:07.174296 16162 consensus_peers.cc:597] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:07.177100 16271 raft_consensus.cc:2468] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 2.
W20260709 13:05:07.179410 16088 leader_election.cc:336] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:07.180779 16089 leader_election.cc:304] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:07.181463 17013 tablet_bootstrap.cc:492] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:07.182461 17034 raft_consensus.cc:2804] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:07.183022 17034 raft_consensus.cc:697] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [term 2 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:05:07.184518 16263 raft_consensus.cc:1275] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Refusing update from remote peer e1e05442c5b44a079dd1de9dd124c990: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.185833 17034 consensus_queue.cc:237] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:07.186406 16991 consensus_queue.cc:1048] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.211061 16115 raft_consensus.cc:1275] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Refusing update from remote peer e1e05442c5b44a079dd1de9dd124c990: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.213670 16991 consensus_queue.cc:1048] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.220431 15947 catalog_manager.cc:5697] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 1 to 2, leader changed from ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193) to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:07.243127 17013 tablet_bootstrap.cc:492] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:07.244196 17013 tablet_bootstrap.cc:492] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:07.244876 17013 ts_tablet_manager.cc:1403] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.006s
I20260709 13:05:07.250826 17013 raft_consensus.cc:359] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:07.251711 17013 raft_consensus.cc:740] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.258718 17013 consensus_queue.cc:260] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:07.284795 17013 ts_tablet_manager.cc:1434] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:05:07.285722 17013 tablet_bootstrap.cc:492] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:07.291736 16263 raft_consensus.cc:1275] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Refusing update from remote peer e1e05442c5b44a079dd1de9dd124c990: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.296785 16991 consensus_queue.cc:1048] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:07.312018 16162 consensus_peers.cc:597] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:07.337536 16162 consensus_peers.cc:597] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:07.354075 17013 tablet_bootstrap.cc:492] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:07.355101 17013 tablet_bootstrap.cc:492] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:07.379678 17013 ts_tablet_manager.cc:1403] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.094s	user 0.016s	sys 0.004s
I20260709 13:05:07.382345 17013 raft_consensus.cc:359] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:07.383054 17013 raft_consensus.cc:740] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.383876 17013 consensus_queue.cc:260] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:07.388868 17013 ts_tablet_manager.cc:1434] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:07.389933 17013 tablet_bootstrap.cc:492] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
W20260709 13:05:07.423897 16088 consensus_peers.cc:597] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.449291 16088 consensus_peers.cc:597] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:07.462486 17013 tablet_bootstrap.cc:492] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:07.463536 17013 tablet_bootstrap.cc:492] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:07.464205 17013 ts_tablet_manager.cc:1403] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.074s	user 0.018s	sys 0.004s
I20260709 13:05:07.488420 16124 raft_consensus.cc:1275] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Refusing update from remote peer e1e05442c5b44a079dd1de9dd124c990: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.494096 16649 consensus_queue.cc:1048] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:07.498186 16236 consensus_peers.cc:597] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.506533 16236 consensus_peers.cc:597] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.540494 16088 consensus_peers.cc:597] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.541070 16088 consensus_peers.cc:597] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.565171 16088 consensus_peers.cc:597] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.571290 16236 consensus_peers.cc:597] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:07.576134 17013 raft_consensus.cc:359] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:07.576927 17013 raft_consensus.cc:740] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.579675 16271 raft_consensus.cc:1275] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Refusing update from remote peer 36b15691c8e648a18b69e98bee3349b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.609917 17013 consensus_queue.cc:260] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
W20260709 13:05:07.618070 16088 consensus_peers.cc:597] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.628857 16162 consensus_peers.cc:597] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.636199 16162 consensus_peers.cc:597] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:07.652040 17013 ts_tablet_manager.cc:1434] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.188s	user 0.009s	sys 0.000s
I20260709 13:05:07.652992 17013 tablet_bootstrap.cc:492] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:07.661839 17015 consensus_queue.cc:1048] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:07.686460 16162 consensus_peers.cc:597] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.721158 16088 consensus_peers.cc:597] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:07.721638  7271 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:05:07.722095  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.554s	user 0.294s	sys 0.000s
I20260709 13:05:07.735033 16124 raft_consensus.cc:1275] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Refusing update from remote peer d2e22ad700e94d1095c014708c364bb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:05:07.741940 16162 consensus_peers.cc:597] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:07.742906 16973 consensus_queue.cc:1048] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:07.767768 17013 tablet_bootstrap.cc:492] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:07.771670 17013 tablet_bootstrap.cc:492] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:07.773278 17013 ts_tablet_manager.cc:1403] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.120s	user 0.018s	sys 0.000s
W20260709 13:05:07.775429 16236 consensus_peers.cc:597] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:07.776314 17013 raft_consensus.cc:359] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:07.781508 17013 raft_consensus.cc:740] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.782367 17013 consensus_queue.cc:260] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
W20260709 13:05:07.783696 16088 consensus_peers.cc:597] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:07.784647 17013 ts_tablet_manager.cc:1434] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:05:07.789498 17013 tablet_bootstrap.cc:492] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
W20260709 13:05:07.809216 16162 consensus_peers.cc:597] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.824988 16162 consensus_peers.cc:597] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:07.838405 17013 tablet_bootstrap.cc:492] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:07.847055 17013 tablet_bootstrap.cc:492] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
W20260709 13:05:07.846793 16088 consensus_peers.cc:597] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:07.850217 17013 ts_tablet_manager.cc:1403] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.008s
W20260709 13:05:07.860759 16236 consensus_peers.cc:597] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:07.862568 17013 raft_consensus.cc:359] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:07.864679 17013 raft_consensus.cc:740] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.867250 17013 consensus_queue.cc:260] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:07.870958 17013 ts_tablet_manager.cc:1434] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:05:07.873744 17013 tablet_bootstrap.cc:492] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
W20260709 13:05:07.888906 16162 consensus_peers.cc:597] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.908788 16088 consensus_peers.cc:597] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.912824 16088 consensus_peers.cc:597] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.930614 16236 consensus_peers.cc:597] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.939369 16088 consensus_peers.cc:597] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.940956 16162 consensus_peers.cc:597] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.964629 16162 consensus_peers.cc:597] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.967248 16088 consensus_peers.cc:597] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:07.970616 17013 tablet_bootstrap.cc:492] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:07.971680 17013 tablet_bootstrap.cc:492] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:07.972349 17013 ts_tablet_manager.cc:1403] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.099s	user 0.015s	sys 0.005s
I20260709 13:05:07.975066 17013 raft_consensus.cc:359] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:07.975723 17013 raft_consensus.cc:740] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.976500 17013 consensus_queue.cc:260] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:07.978677 17013 ts_tablet_manager.cc:1434] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:07.979451 17013 tablet_bootstrap.cc:492] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
W20260709 13:05:07.997531 16162 consensus_peers.cc:597] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:08.013648 16236 consensus_peers.cc:597] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:08.025842 17013 tablet_bootstrap.cc:492] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.026978 17013 tablet_bootstrap.cc:492] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:08.027654 17013 ts_tablet_manager.cc:1403] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.004s
I20260709 13:05:08.030406 17013 raft_consensus.cc:359] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:08.031138 17013 raft_consensus.cc:740] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
W20260709 13:05:08.036211 16162 consensus_peers.cc:597] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:08.039477 17013 consensus_queue.cc:260] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
W20260709 13:05:08.038975 16162 consensus_peers.cc:597] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:08.043284 17013 ts_tablet_manager.cc:1434] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:05:08.044644 17013 tablet_bootstrap.cc:492] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:08.086238 17013 tablet_bootstrap.cc:492] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=1 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.087651 17013 tablet_bootstrap.cc:492] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:08.088429 17013 ts_tablet_manager.cc:1403] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.012s
I20260709 13:05:08.091022 17013 raft_consensus.cc:359] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:08.091708 17013 raft_consensus.cc:740] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.092551 17013 consensus_queue.cc:260] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:08.094691 17013 ts_tablet_manager.cc:1434] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:08.095527 17013 tablet_bootstrap.cc:492] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
W20260709 13:05:08.115788 16236 consensus_peers.cc:597] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:08.125687 17013 tablet_bootstrap.cc:492] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.133309 17013 tablet_bootstrap.cc:492] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:08.134253 17013 ts_tablet_manager.cc:1403] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.004s
I20260709 13:05:08.137815 17013 raft_consensus.cc:359] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:08.149602 17013 raft_consensus.cc:740] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.151108 17013 consensus_queue.cc:260] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:08.154192 17013 ts_tablet_manager.cc:1434] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:05:08.155335 17013 tablet_bootstrap.cc:492] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
W20260709 13:05:08.174301 16236 consensus_peers.cc:597] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:08.182003 16162 consensus_peers.cc:597] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:08.199165 16162 consensus_peers.cc:597] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:08.214015 17013 tablet_bootstrap.cc:492] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.215040 17013 tablet_bootstrap.cc:492] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:08.215674 17013 ts_tablet_manager.cc:1403] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.012s
W20260709 13:05:08.231392 16236 consensus_peers.cc:597] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:08.244424 16236 consensus_peers.cc:597] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:08.246201 17013 raft_consensus.cc:359] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:08.247022 17013 raft_consensus.cc:740] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.247772 17013 consensus_queue.cc:260] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:08.249910 17013 ts_tablet_manager.cc:1434] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:05:08.250728 17013 tablet_bootstrap.cc:492] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:08.269814 17013 tablet_bootstrap.cc:492] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.270767 17013 tablet_bootstrap.cc:492] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:08.271433 17013 ts_tablet_manager.cc:1403] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:05:08.273993 17013 raft_consensus.cc:359] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:08.274693 17013 raft_consensus.cc:740] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.275627 17013 consensus_queue.cc:260] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:08.277864 17013 ts_tablet_manager.cc:1434] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:05:08.278710 17013 tablet_bootstrap.cc:492] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:08.306020 17013 tablet_bootstrap.cc:492] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.307037 17013 tablet_bootstrap.cc:492] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:08.307753 17013 ts_tablet_manager.cc:1403] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.000s
I20260709 13:05:08.310537 17013 raft_consensus.cc:359] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:08.315546 17013 raft_consensus.cc:740] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.316509 17013 consensus_queue.cc:260] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:08.319178 17013 ts_tablet_manager.cc:1434] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:05:08.320765 17013 tablet_bootstrap.cc:492] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
W20260709 13:05:08.343284 16088 consensus_peers.cc:597] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:08.417245 17013 tablet_bootstrap.cc:492] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:05:08.419286 17013 tablet_bootstrap.cc:492] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:08.422783 17013 ts_tablet_manager.cc:1403] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.102s	user 0.017s	sys 0.007s
I20260709 13:05:08.426860 17013 raft_consensus.cc:359] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:08.428220 17013 raft_consensus.cc:740] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.429289 17013 consensus_queue.cc:260] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:08.445117 17013 ts_tablet_manager.cc:1434] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260709 13:05:08.448232 17013 tablet_bootstrap.cc:492] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:08.498077 17013 tablet_bootstrap.cc:492] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.499120 17013 tablet_bootstrap.cc:492] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:08.499927 17013 ts_tablet_manager.cc:1403] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.000s
I20260709 13:05:08.502552 17013 raft_consensus.cc:359] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:08.503444 17013 raft_consensus.cc:740] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.504321 17013 consensus_queue.cc:260] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:08.507721 17013 ts_tablet_manager.cc:1434] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:08.509497 17013 tablet_bootstrap.cc:492] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:08.559686 17039 raft_consensus.cc:493] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.560207 17039 raft_consensus.cc:515] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:08.566498 17039 leader_election.cc:290] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:08.610173 17013 tablet_bootstrap.cc:492] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=1 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.611649 17013 tablet_bootstrap.cc:492] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:08.612532 17013 ts_tablet_manager.cc:1403] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.104s	user 0.020s	sys 0.003s
I20260709 13:05:08.621790 17013 raft_consensus.cc:359] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:08.624689 17013 raft_consensus.cc:740] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.625650 17013 consensus_queue.cc:260] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:08.628551 17013 ts_tablet_manager.cc:1434] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:05:08.633725 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5dc804032442d1a074ba2adaf03311" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:08.635020 17013 tablet_bootstrap.cc:492] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:08.669135 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5dc804032442d1a074ba2adaf03311" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:08.671181 17009 leader_election.cc:304] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:08.672161 17039 raft_consensus.cc:2749] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:08.691845 17013 tablet_bootstrap.cc:492] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.692974 17013 tablet_bootstrap.cc:492] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:08.693691 17013 ts_tablet_manager.cc:1403] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.004s
I20260709 13:05:08.696485 17013 raft_consensus.cc:359] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:08.704771 17013 raft_consensus.cc:740] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.705833 17013 consensus_queue.cc:260] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:08.708084 17013 ts_tablet_manager.cc:1434] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:05:08.708941 17013 tablet_bootstrap.cc:492] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:08.747575 17013 tablet_bootstrap.cc:492] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.748579 17013 tablet_bootstrap.cc:492] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:08.749291 17013 ts_tablet_manager.cc:1403] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.008s
I20260709 13:05:08.752178 17013 raft_consensus.cc:359] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:08.752902 17013 raft_consensus.cc:740] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.754459 17013 consensus_queue.cc:260] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:08.756974 17013 ts_tablet_manager.cc:1434] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:08.757886 17013 tablet_bootstrap.cc:492] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:08.831377 17013 tablet_bootstrap.cc:492] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.832552 17013 tablet_bootstrap.cc:492] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:08.834641 17013 ts_tablet_manager.cc:1403] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.077s	user 0.020s	sys 0.004s
I20260709 13:05:08.837356 17013 raft_consensus.cc:359] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:08.838058 17013 raft_consensus.cc:740] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.838893 17013 consensus_queue.cc:260] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:08.842638 17013 ts_tablet_manager.cc:1434] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:08.843432 17013 tablet_bootstrap.cc:492] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:08.869248 17013 tablet_bootstrap.cc:492] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.870360 17013 tablet_bootstrap.cc:492] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:08.871047 17013 ts_tablet_manager.cc:1403] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.028s	user 0.022s	sys 0.000s
I20260709 13:05:08.873484 17013 raft_consensus.cc:359] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:08.874136 17013 raft_consensus.cc:740] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.874907 17013 consensus_queue.cc:260] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:08.877039 17013 ts_tablet_manager.cc:1434] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:08.877839 17013 tablet_bootstrap.cc:492] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:08.932364 17013 tablet_bootstrap.cc:492] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.933413 17013 tablet_bootstrap.cc:492] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:08.934090 17013 ts_tablet_manager.cc:1403] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.056s	user 0.037s	sys 0.015s
I20260709 13:05:08.936698 17013 raft_consensus.cc:359] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:08.937373 17013 raft_consensus.cc:740] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.938166 17013 consensus_queue.cc:260] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:08.940513 17013 ts_tablet_manager.cc:1434] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:08.941354 17013 tablet_bootstrap.cc:492] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:08.969305 17013 tablet_bootstrap.cc:492] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.971632 17013 tablet_bootstrap.cc:492] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:08.972329 17013 ts_tablet_manager.cc:1403] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.004s
I20260709 13:05:08.975041 17013 raft_consensus.cc:359] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:08.975757 17013 raft_consensus.cc:740] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.976679 17013 consensus_queue.cc:260] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:08.979364 17013 ts_tablet_manager.cc:1434] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:08.980448 17013 tablet_bootstrap.cc:492] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:08.991564 17039 raft_consensus.cc:493] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.992192 17039 raft_consensus.cc:515] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:08.994719 17039 leader_election.cc:290] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:08.998814 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac8a97b1adc49389919710edf7c5e03" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:09.019760 17039 raft_consensus.cc:493] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.020401 17039 raft_consensus.cc:515] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:09.023635 17039 leader_election.cc:290] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:05:09.025254 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c33c4000f496f841f99af79e55532" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:09.037933  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.193:44491
I20260709 13:05:09.038656 17126 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.193:44491 every 8 connection(s)
I20260709 13:05:09.044329 17013 tablet_bootstrap.cc:492] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:09.045512 17013 tablet_bootstrap.cc:492] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:09.046303 17013 ts_tablet_manager.cc:1403] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.066s	user 0.029s	sys 0.016s
I20260709 13:05:09.050217 17013 raft_consensus.cc:359] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:09.050953 17013 raft_consensus.cc:740] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.058380 17013 consensus_queue.cc:260] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:09.061053 17013 ts_tablet_manager.cc:1434] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:05:09.079962 17013 tablet_bootstrap.cc:492] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:09.151868 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c33c4000f496f841f99af79e55532" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:09.151311 16264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac8a97b1adc49389919710edf7c5e03" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:09.154996 17009 leader_election.cc:304] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:09.156332 17009 leader_election.cc:304] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7
I20260709 13:05:09.157378 17039 raft_consensus.cc:2749] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:09.158041 17039 raft_consensus.cc:2749] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:09.190328 17088 raft_consensus.cc:3060] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.196175 17039 raft_consensus.cc:493] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.196797 17039 raft_consensus.cc:515] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:09.198843 17039 leader_election.cc:290] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
W20260709 13:05:09.220752 17009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 64510.8us
I20260709 13:05:09.223172 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6b0df9a4d4b55a27f4ffb956db8d0" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:09.223289 16264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6b0df9a4d4b55a27f4ffb956db8d0" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d2e22ad700e94d1095c014708c364bb7" is_pre_election: true
I20260709 13:05:09.231079 17009 leader_election.cc:304] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:09.232298 17135 raft_consensus.cc:2749] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:09.232748 17130 heartbeater.cc:344] Connected to a master server at 127.7.25.254:39391
I20260709 13:05:09.233263 17130 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:09.234225 17130 heartbeater.cc:507] Master 127.7.25.254:39391 requested a full tablet report, sending...
I20260709 13:05:09.243647 17135 raft_consensus.cc:493] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.244230 17135 raft_consensus.cc:515] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:09.246436 17135 leader_election.cc:290] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:09.247946 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6c90e7e1974ef0ade824c72386b5f3" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:09.250242 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6c90e7e1974ef0ade824c72386b5f3" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:09.254192 17009 leader_election.cc:304] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:09.255148 17135 raft_consensus.cc:2749] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:09.258754 17135 raft_consensus.cc:493] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.259263 17135 raft_consensus.cc:515] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:09.262885 17013 tablet_bootstrap.cc:492] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:09.267470 17135 leader_election.cc:290] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:09.270720 17084 raft_consensus.cc:3060] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.272653 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105468bfb6dc48c28c16d3449c691f6b" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36b15691c8e648a18b69e98bee3349b4" is_pre_election: true
I20260709 13:05:09.273029 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105468bfb6dc48c28c16d3449c691f6b" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1e05442c5b44a079dd1de9dd124c990" is_pre_election: true
I20260709 13:05:09.275362 17009 leader_election.cc:304] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec8b54f5a9e44f428a4d537391138dcf; no voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990
I20260709 13:05:09.276554 17135 raft_consensus.cc:2749] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:09.286384 15944 ts_manager.cc:194] Re-registered known tserver with Master: ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:09.292362 17013 tablet_bootstrap.cc:492] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:09.294579 17013 ts_tablet_manager.cc:1403] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.215s	user 0.017s	sys 0.001s
I20260709 13:05:09.298435 17013 raft_consensus.cc:359] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:09.299217 17013 raft_consensus.cc:740] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.300096 17013 consensus_queue.cc:260] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:09.303197 17088 raft_consensus.cc:3060] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.305572 17013 ts_tablet_manager.cc:1434] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:05:09.306459 17013 tablet_bootstrap.cc:492] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:09.323706 17086 raft_consensus.cc:3060] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.357681 17013 tablet_bootstrap.cc:492] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:09.358805 17013 tablet_bootstrap.cc:492] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:09.359462 17013 ts_tablet_manager.cc:1403] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.053s	user 0.024s	sys 0.008s
I20260709 13:05:09.366309 17013 raft_consensus.cc:359] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:09.367079 17013 raft_consensus.cc:740] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.367827 17013 consensus_queue.cc:260] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:09.377519 17013 ts_tablet_manager.cc:1434] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:05:09.378477 17013 tablet_bootstrap.cc:492] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:09.400758 17013 tablet_bootstrap.cc:492] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:09.401808 17013 tablet_bootstrap.cc:492] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:09.402452 17013 ts_tablet_manager.cc:1403] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.008s
I20260709 13:05:09.405228 17013 raft_consensus.cc:359] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:09.405973 17013 raft_consensus.cc:740] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.406703 17013 consensus_queue.cc:260] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:09.409235 17013 ts_tablet_manager.cc:1434] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:09.409893 15944 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59162
I20260709 13:05:09.410136 17013 tablet_bootstrap.cc:492] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:09.416673 17130 heartbeater.cc:499] Master 127.7.25.254:39391 was elected leader, sending a full tablet report...
I20260709 13:05:09.437736 17013 tablet_bootstrap.cc:492] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:09.438760 17013 tablet_bootstrap.cc:492] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:09.439455 17013 ts_tablet_manager.cc:1403] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.016s
I20260709 13:05:09.442117 17013 raft_consensus.cc:359] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:09.442896 17013 raft_consensus.cc:740] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.443602 17013 consensus_queue.cc:260] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:09.445869 17013 ts_tablet_manager.cc:1434] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:09.446769 17013 tablet_bootstrap.cc:492] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:09.482502 17013 tablet_bootstrap.cc:492] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:09.483497 17013 tablet_bootstrap.cc:492] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:09.484160 17013 ts_tablet_manager.cc:1403] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.008s
I20260709 13:05:09.488796 17013 raft_consensus.cc:359] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:09.489894 17013 raft_consensus.cc:740] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.490741 17013 consensus_queue.cc:260] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:09.495508 17013 ts_tablet_manager.cc:1434] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:05:09.496367 17013 tablet_bootstrap.cc:492] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
W20260709 13:05:09.513928 16088 consensus_peers.cc:597] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:09.535101 17013 tablet_bootstrap.cc:492] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:09.540292 17013 tablet_bootstrap.cc:492] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:09.541352 17013 ts_tablet_manager.cc:1403] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.000s
I20260709 13:05:09.544066 17013 raft_consensus.cc:359] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:09.544811 17013 raft_consensus.cc:740] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
W20260709 13:05:09.550395 16236 consensus_peers.cc:597] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:09.545650 17013 consensus_queue.cc:260] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:09.554001 17013 ts_tablet_manager.cc:1434] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:05:09.555317 17013 tablet_bootstrap.cc:492] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:09.601351 17013 tablet_bootstrap.cc:492] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:09.602416 17013 tablet_bootstrap.cc:492] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:09.603108 17013 ts_tablet_manager.cc:1403] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.004s
I20260709 13:05:09.605630 17013 raft_consensus.cc:359] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:09.606324 17013 raft_consensus.cc:740] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.607105 17013 consensus_queue.cc:260] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:09.610910 17013 ts_tablet_manager.cc:1434] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:09.611800 17013 tablet_bootstrap.cc:492] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:09.658425 17013 tablet_bootstrap.cc:492] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:09.659444 17013 tablet_bootstrap.cc:492] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:09.660137 17013 ts_tablet_manager.cc:1403] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.016s
I20260709 13:05:09.662688 17013 raft_consensus.cc:359] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:09.663421 17013 raft_consensus.cc:740] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.664306 17013 consensus_queue.cc:260] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:09.667883 17013 ts_tablet_manager.cc:1434] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:09.704546 17013 tablet_bootstrap.cc:492] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:09.756454 17013 tablet_bootstrap.cc:492] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:09.757625 17013 tablet_bootstrap.cc:492] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:09.758368 17013 ts_tablet_manager.cc:1403] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.018s
I20260709 13:05:09.761387 17013 raft_consensus.cc:359] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:09.762181 17013 raft_consensus.cc:740] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.762965 17013 consensus_queue.cc:260] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:09.765303 17013 ts_tablet_manager.cc:1434] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:09.766459 17013 tablet_bootstrap.cc:492] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
W20260709 13:05:09.887753 16088 consensus_peers.cc:597] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:09.973846 17013 tablet_bootstrap.cc:492] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:09.996794 17013 tablet_bootstrap.cc:492] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:10.002847 17013 ts_tablet_manager.cc:1403] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.237s	user 0.061s	sys 0.069s
I20260709 13:05:10.013495 17013 raft_consensus.cc:359] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:10.014420 17013 raft_consensus.cc:740] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.015390 17013 consensus_queue.cc:260] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:10.018610 17013 ts_tablet_manager.cc:1434] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:05:10.019547 17013 tablet_bootstrap.cc:492] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:10.078109 17013 tablet_bootstrap.cc:492] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:10.079317 17013 tablet_bootstrap.cc:492] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:10.080144 17013 ts_tablet_manager.cc:1403] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.061s	user 0.021s	sys 0.000s
I20260709 13:05:10.084887 17013 raft_consensus.cc:359] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:10.085812 17013 raft_consensus.cc:740] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.086663 17013 consensus_queue.cc:260] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:10.089298 17013 ts_tablet_manager.cc:1434] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:10.090494 17013 tablet_bootstrap.cc:492] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:10.104127 17086 raft_consensus.cc:3060] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:10.110984 16236 consensus_peers.cc:597] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:10.123179 17013 tablet_bootstrap.cc:492] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:10.124389 17013 tablet_bootstrap.cc:492] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:10.127337 17013 ts_tablet_manager.cc:1403] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.007s
I20260709 13:05:10.130667 17013 raft_consensus.cc:359] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:10.131664 17013 raft_consensus.cc:740] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.132644 17013 consensus_queue.cc:260] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
W20260709 13:05:10.133765 16088 consensus_peers.cc:597] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:10.139935 16088 consensus_peers.cc:597] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:10.143054 17013 ts_tablet_manager.cc:1434] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:05:10.144477 17013 tablet_bootstrap.cc:492] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
W20260709 13:05:10.154711 16088 consensus_peers.cc:597] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:10.183013 17013 tablet_bootstrap.cc:492] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:10.184289 17013 tablet_bootstrap.cc:492] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:10.185016 17013 ts_tablet_manager.cc:1403] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.004s
I20260709 13:05:10.187835 17013 raft_consensus.cc:359] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:10.188624 17013 raft_consensus.cc:740] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.189679 17013 consensus_queue.cc:260] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:10.192245 17013 ts_tablet_manager.cc:1434] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:10.193126 17013 tablet_bootstrap.cc:492] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
W20260709 13:05:10.205367 16162 consensus_peers.cc:597] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:10.228351 17013 tablet_bootstrap.cc:492] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:10.231532 17013 tablet_bootstrap.cc:492] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:10.232331 17013 ts_tablet_manager.cc:1403] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.004s
I20260709 13:05:10.239393 17013 raft_consensus.cc:359] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:10.240161 17013 raft_consensus.cc:740] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.240864 17013 consensus_queue.cc:260] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:10.243227 17013 ts_tablet_manager.cc:1434] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:10.244062 17013 tablet_bootstrap.cc:492] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:10.272316 17013 tablet_bootstrap.cc:492] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:10.273554 17013 tablet_bootstrap.cc:492] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:10.274308 17013 ts_tablet_manager.cc:1403] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.006s
I20260709 13:05:10.276818 17013 raft_consensus.cc:359] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:10.277611 17013 raft_consensus.cc:740] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.278281 17013 consensus_queue.cc:260] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:10.280514 17013 ts_tablet_manager.cc:1434] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:10.281344 17013 tablet_bootstrap.cc:492] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:10.333317 17013 tablet_bootstrap.cc:492] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:10.338331 17013 tablet_bootstrap.cc:492] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:10.339020 17013 ts_tablet_manager.cc:1403] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.013s
I20260709 13:05:10.343684 17013 raft_consensus.cc:359] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:10.344745 17013 raft_consensus.cc:740] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.345671 17013 consensus_queue.cc:260] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:10.355414 17013 ts_tablet_manager.cc:1434] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:05:10.356742 17013 tablet_bootstrap.cc:492] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
W20260709 13:05:10.362951 16162 consensus_peers.cc:597] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:10.389184 17013 tablet_bootstrap.cc:492] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:10.391134 17013 tablet_bootstrap.cc:492] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:10.393735 17013 ts_tablet_manager.cc:1403] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.003s
I20260709 13:05:10.397552 17013 raft_consensus.cc:359] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:10.398510 17013 raft_consensus.cc:740] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.399294 17013 consensus_queue.cc:260] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:10.401623 17013 ts_tablet_manager.cc:1434] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:10.402606 17013 tablet_bootstrap.cc:492] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:10.436663 17013 tablet_bootstrap.cc:492] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:10.438028 17013 tablet_bootstrap.cc:492] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:10.438755 17013 ts_tablet_manager.cc:1403] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.008s
I20260709 13:05:10.441694 17013 raft_consensus.cc:359] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:10.442405 17013 raft_consensus.cc:740] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.444540 17013 consensus_queue.cc:260] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:10.447160 17013 ts_tablet_manager.cc:1434] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:10.448030 17013 tablet_bootstrap.cc:492] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:10.497875 17013 tablet_bootstrap.cc:492] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:10.501667 17013 tablet_bootstrap.cc:492] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:10.502471 17013 ts_tablet_manager.cc:1403] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.025s
I20260709 13:05:10.505914 17013 raft_consensus.cc:359] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:10.506651 17013 raft_consensus.cc:740] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.507380 17013 consensus_queue.cc:260] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:10.510036 17013 ts_tablet_manager.cc:1434] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:05:10.510867 17013 tablet_bootstrap.cc:492] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:10.521904 17086 raft_consensus.cc:3060] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:10.542538 17013 tablet_bootstrap.cc:492] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:10.543632 17013 tablet_bootstrap.cc:492] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:10.544359 17013 ts_tablet_manager.cc:1403] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
I20260709 13:05:10.547004 17013 raft_consensus.cc:359] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:10.547734 17013 raft_consensus.cc:740] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.548390 17013 consensus_queue.cc:260] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:10.551368 17013 ts_tablet_manager.cc:1434] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:10.575749 17013 tablet_bootstrap.cc:492] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:10.626957 17081 raft_consensus.cc:3060] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:10.639920 16236 consensus_peers.cc:597] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:10.703711 17175 log.cc:927] Time spent T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:05:10.762807 17013 tablet_bootstrap.cc:492] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:10.763888 17013 tablet_bootstrap.cc:492] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:10.764726 17013 ts_tablet_manager.cc:1403] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.189s	user 0.038s	sys 0.026s
I20260709 13:05:10.767529 17013 raft_consensus.cc:359] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:10.768352 17013 raft_consensus.cc:740] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.769214 17013 consensus_queue.cc:260] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:10.803022 17081 raft_consensus.cc:3060] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:10.815961 17013 ts_tablet_manager.cc:1434] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.000s
I20260709 13:05:10.841681 17013 tablet_bootstrap.cc:492] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:10.890033 17013 tablet_bootstrap.cc:492] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:10.891247 17013 tablet_bootstrap.cc:492] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:10.892220 17013 ts_tablet_manager.cc:1403] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.004s
I20260709 13:05:10.895406 17013 raft_consensus.cc:359] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:10.896306 17013 raft_consensus.cc:740] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.897671 17013 consensus_queue.cc:260] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:10.899698 17013 ts_tablet_manager.cc:1434] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:10.900673 17013 tablet_bootstrap.cc:492] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap starting.
I20260709 13:05:10.926004 17013 tablet_bootstrap.cc:492] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:10.926842 17013 tablet_bootstrap.cc:492] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf: Bootstrap complete.
I20260709 13:05:10.927466 17013 ts_tablet_manager.cc:1403] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.000s
I20260709 13:05:10.930028 17013 raft_consensus.cc:359] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:10.930768 17013 raft_consensus.cc:740] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.931475 17013 consensus_queue.cc:260] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:10.933830 17013 ts_tablet_manager.cc:1434] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
W20260709 13:05:11.984501 16162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 45311.2us
W20260709 13:05:13.805917 16236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.014s	sys 0.002s
W20260709 13:05:13.806438 16236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.015s	sys 0.002s
W20260709 13:05:13.806705 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 545121us
W20260709 13:05:13.865790 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:45195, user_credentials={real_user=slave}} blocked reactor thread for 56788us
W20260709 13:05:13.878732 16089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 64125.6us
W20260709 13:05:13.927084 16162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 53178.5us
W20260709 13:05:14.354967 16163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 90382.4us
W20260709 13:05:14.465850 17121 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8140 after lost signal to thread 7274
W20260709 13:05:14.467228 17121 debug-util.cc:398] Leaking SignalData structure 0x7b08003026a0 after lost signal to thread 15981
W20260709 13:05:14.468649 17121 debug-util.cc:398] Leaking SignalData structure 0x7b08002a99c0 after lost signal to thread 16148
W20260709 13:05:14.469941 17121 debug-util.cc:398] Leaking SignalData structure 0x7b08001502e0 after lost signal to thread 16222
W20260709 13:05:14.471522 17121 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4580 after lost signal to thread 16296
W20260709 13:05:14.472988 17121 debug-util.cc:398] Leaking SignalData structure 0x7b0800255260 after lost signal to thread 17126
W20260709 13:05:15.307449 16163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:45195, user_credentials={real_user=slave}} blocked reactor thread for 84273.5us
W20260709 13:05:16.458213 16089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.196:41631, user_credentials={real_user=slave}} blocked reactor thread for 59986.2us
W20260709 13:05:16.569490 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:45195, user_credentials={real_user=slave}} blocked reactor thread for 55800.6us
I20260709 13:05:19.194192  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:19.270510 16121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09412044d26f417da5c842c8acf1149d"
dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
mode: GRACEFUL
new_leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:49024
I20260709 13:05:19.271219 16121 raft_consensus.cc:606] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Received request to transfer leadership to TS ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:19.284138 16194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "430a0b8ad91a40389bde4a2dce852afb"
dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
mode: GRACEFUL
new_leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:05:19.284780 16194 raft_consensus.cc:606] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Received request to transfer leadership to TS ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:19.287982 16121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "496077ee29374b90a7c924539c590475"
dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
mode: GRACEFUL
new_leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:49024
I20260709 13:05:19.288545 16121 raft_consensus.cc:606] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Received request to transfer leadership to TS ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:19.292419 16121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e61baecc1a74998a356870a675301ea"
dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
mode: GRACEFUL
new_leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:49024
I20260709 13:05:19.292941 16121 raft_consensus.cc:606] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 2 LEADER]: Received request to transfer leadership to TS ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:19.295430 16121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85079923151849059accd1b7c27d4699"
dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
mode: GRACEFUL
new_leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:49024
I20260709 13:05:19.295948 16121 raft_consensus.cc:606] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Received request to transfer leadership to TS ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:19.299109 16122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "baa51a24c3524741836e9666f1b4babe"
dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
mode: GRACEFUL
new_leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:49024
I20260709 13:05:19.299647 16122 raft_consensus.cc:606] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Received request to transfer leadership to TS ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:19.300781  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:19.302484  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:19.453758 17200 raft_consensus.cc:993] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4: : Instructing follower ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:19.454382 17224 raft_consensus.cc:1081] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 2 LEADER]: Signalling peer ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:19.456019 17081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e61baecc1a74998a356870a675301ea"
dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:33074
I20260709 13:05:19.456563 17081 raft_consensus.cc:493] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.456895 17081 raft_consensus.cc:3060] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.464921 17081 raft_consensus.cc:515] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:19.467418 17081 leader_election.cc:290] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:19.468712 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61baecc1a74998a356870a675301ea" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:05:19.469148 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e61baecc1a74998a356870a675301ea" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:19.469607 16198 raft_consensus.cc:3060] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.469756 16122 raft_consensus.cc:3055] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:19.470131 16122 raft_consensus.cc:740] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:05:19.471055 16122 consensus_queue.cc:260] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:19.472229 16122 raft_consensus.cc:3060] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.477941 16198 raft_consensus.cc:2468] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 3.
I20260709 13:05:19.479353 17009 leader_election.cc:304] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:19.479506 16122 raft_consensus.cc:2468] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 3.
I20260709 13:05:19.481249 17235 raft_consensus.cc:2804] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:19.482535 17235 raft_consensus.cc:697] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 3 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:19.483839 17235 consensus_queue.cc:237] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:19.499202 15947 catalog_manager.cc:5697] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 2 to 3, leader changed from 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194) to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 3 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.510160 17189 raft_consensus.cc:993] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990: : Instructing follower ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:19.510707 17189 raft_consensus.cc:1081] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Signalling peer ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:19.513881 17084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "430a0b8ad91a40389bde4a2dce852afb"
dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:33090
I20260709 13:05:19.514281 17200 raft_consensus.cc:993] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4: : Instructing follower ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:19.514459 17084 raft_consensus.cc:493] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.514735 17200 raft_consensus.cc:1081] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Signalling peer ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:19.514894 17084 raft_consensus.cc:3060] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.516549 17088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09412044d26f417da5c842c8acf1149d"
dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:33074
I20260709 13:05:19.517129 17088 raft_consensus.cc:493] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.517439 17088 raft_consensus.cc:3060] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.527802 17224 raft_consensus.cc:993] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4: : Instructing follower ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:19.528378 17224 raft_consensus.cc:1081] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Signalling peer ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:19.530838 17085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85079923151849059accd1b7c27d4699"
dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:33074
I20260709 13:05:19.531442 17085 raft_consensus.cc:493] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.531821 17085 raft_consensus.cc:3060] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.542491 17084 raft_consensus.cc:515] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:19.554960 17088 raft_consensus.cc:515] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:19.557958 17088 leader_election.cc:290] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:19.544623 17085 raft_consensus.cc:515] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:19.559497 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09412044d26f417da5c842c8acf1149d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:19.560096 16270 raft_consensus.cc:3060] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.561810 17085 leader_election.cc:290] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:19.566196 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85079923151849059accd1b7c27d4699" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:19.566825 16121 raft_consensus.cc:3055] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:19.567101 16121 raft_consensus.cc:740] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:05:19.566251 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09412044d26f417da5c842c8acf1149d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:19.567617 16122 raft_consensus.cc:3055] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:19.567884 16121 consensus_queue.cc:260] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:19.569619 16121 raft_consensus.cc:3060] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.567942 16122 raft_consensus.cc:740] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:05:19.572940 16122 consensus_queue.cc:260] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:19.574302 16122 raft_consensus.cc:3060] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.583308 16264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85079923151849059accd1b7c27d4699" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:19.583986 16264 raft_consensus.cc:3060] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.592658 16270 raft_consensus.cc:2468] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:05:19.594686 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430a0b8ad91a40389bde4a2dce852afb" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:19.620867 16124 raft_consensus.cc:3060] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.614722 17084 leader_election.cc:290] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:19.615252 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430a0b8ad91a40389bde4a2dce852afb" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:05:19.628235 16198 raft_consensus.cc:3055] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:19.617218 16264 raft_consensus.cc:2468] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:05:19.628588 16198 raft_consensus.cc:740] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:05:19.629647 17241 raft_consensus.cc:993] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4: : Instructing follower ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:19.632149 17241 raft_consensus.cc:1081] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Signalling peer ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:19.629839 16198 consensus_queue.cc:260] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:19.583907 16121 raft_consensus.cc:2468] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:05:19.628500 17009 leader_election.cc:304] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:19.634261 17009 leader_election.cc:304] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:19.634992 17235 raft_consensus.cc:2804] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:19.635073 17236 raft_consensus.cc:2804] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:19.636591 16198 raft_consensus.cc:3060] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.643656 17084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "496077ee29374b90a7c924539c590475"
dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:33074
I20260709 13:05:19.645838 17084 raft_consensus.cc:493] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.646237 17084 raft_consensus.cc:3060] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.649477 16124 raft_consensus.cc:2468] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 3.
I20260709 13:05:19.650857 17009 leader_election.cc:304] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:19.651889 16122 raft_consensus.cc:2468] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:05:19.658308 17241 raft_consensus.cc:993] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4: : Instructing follower ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:19.662914 17236 raft_consensus.cc:697] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 2 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:19.659837 17235 raft_consensus.cc:697] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 2 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:19.664611 17084 raft_consensus.cc:515] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:19.663586 17241 raft_consensus.cc:1081] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Signalling peer ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:19.662174 16198 raft_consensus.cc:2468] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 3.
I20260709 13:05:19.665904 17236 consensus_queue.cc:237] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:19.676854 17085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "baa51a24c3524741836e9666f1b4babe"
dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:33074
I20260709 13:05:19.671559 17084 leader_election.cc:290] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:19.677768 17085 raft_consensus.cc:493] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.678328 17085 raft_consensus.cc:3060] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.687664 17085 raft_consensus.cc:515] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:19.674995 17235 consensus_queue.cc:237] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:19.691604 16192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496077ee29374b90a7c924539c590475" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:05:19.670990 17244 raft_consensus.cc:2804] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:19.692297 16192 raft_consensus.cc:3060] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.692606 17244 raft_consensus.cc:697] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 3 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:19.699887 17244 consensus_queue.cc:237] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:19.701704 17085 leader_election.cc:290] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Requested vote from peers d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:19.704957 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496077ee29374b90a7c924539c590475" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:19.705602 16122 raft_consensus.cc:3055] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:19.705873 16122 raft_consensus.cc:740] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:05:19.706758 16122 consensus_queue.cc:260] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:19.710242 16122 raft_consensus.cc:3060] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.713037 16264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa51a24c3524741836e9666f1b4babe" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:19.713656 16264 raft_consensus.cc:3060] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.716907 16192 raft_consensus.cc:2468] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:05:19.717967 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa51a24c3524741836e9666f1b4babe" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:19.718803 16124 raft_consensus.cc:3055] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:19.719128 16124 raft_consensus.cc:740] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:05:19.719944 16124 consensus_queue.cc:260] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:19.721139 16124 raft_consensus.cc:3060] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.723729 16264 raft_consensus.cc:2468] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:05:19.718796 17009 leader_election.cc:304] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:19.725528 17009 leader_election.cc:304] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:19.726475 17243 raft_consensus.cc:2804] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:19.726733 17235 raft_consensus.cc:2804] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:19.727409 17243 raft_consensus.cc:697] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [term 2 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:19.728521 17243 consensus_queue.cc:237] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:19.731237 16124 raft_consensus.cc:2468] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:05:19.740110 17235 raft_consensus.cc:697] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [term 2 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:19.741739 17235 consensus_queue.cc:237] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:19.749243 16122 raft_consensus.cc:2468] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:05:19.761713 15947 catalog_manager.cc:5697] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 1 to 2, leader changed from 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194) to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 2 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.762892 15947 catalog_manager.cc:5697] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 2 to 3, leader changed from e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195) to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 3 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.764549 15947 catalog_manager.cc:5697] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 1 to 2, leader changed from 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194) to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 2 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.765941 15947 catalog_manager.cc:5697] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 1 to 2, leader changed from 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194) to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 2 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.767339 15947 catalog_manager.cc:5697] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 1 to 2, leader changed from 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194) to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 2 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.967659 16124 raft_consensus.cc:1275] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:19.969432 17235 consensus_queue.cc:1048] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:19.996340 16192 raft_consensus.cc:1275] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:19.998095 17243 consensus_queue.cc:1048] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:20.090121 16270 raft_consensus.cc:1275] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:20.091584 17235 consensus_queue.cc:1048] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:20.093365 16270 raft_consensus.cc:1275] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:20.101518 17235 consensus_queue.cc:1048] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:20.112207 16122 raft_consensus.cc:1275] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:20.113796 17244 consensus_queue.cc:1048] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:20.139595 16124 raft_consensus.cc:1275] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:20.141069 17243 consensus_queue.cc:1048] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:20.177098 16121 raft_consensus.cc:1275] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:20.179292 17243 consensus_queue.cc:1048] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:20.185557 16266 raft_consensus.cc:1275] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:20.196933 17235 consensus_queue.cc:1048] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:05:20.214682 16115 raft_consensus.cc:1275] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:20.216306 17235 consensus_queue.cc:1048] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:20.279395 16162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 49924.5us
I20260709 13:05:20.285228 16120 raft_consensus.cc:1275] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:20.285285 16198 raft_consensus.cc:1275] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:20.287058 17243 consensus_queue.cc:1048] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:20.287878 16192 raft_consensus.cc:1275] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:05:20.278314 17265 log.cc:927] Time spent T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:05:20.336820 17244 consensus_queue.cc:1048] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:20.337066 17235 consensus_queue.cc:1048] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:20.323639  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:20.370492 17261 log.cc:927] Time spent T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4: Append to log took a long time: real 0.160s	user 0.002s	sys 0.003s
W20260709 13:05:20.372637 16163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:45195, user_credentials={real_user=slave}} blocked reactor thread for 101552us
W20260709 13:05:20.390331 16162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:44491, user_credentials={real_user=slave}} blocked reactor thread for 87848.3us
I20260709 13:05:20.591727  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:20.645435 16122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a"
dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
mode: GRACEFUL
new_leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:49024
I20260709 13:05:20.646049 16122 raft_consensus.cc:606] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 4 LEADER]: Received request to transfer leadership to TS ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:20.648783 16192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27d59706e6f746aca969af7bf2206197"
dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
mode: GRACEFUL
new_leader_uuid: "36b15691c8e648a18b69e98bee3349b4"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:05:20.649333 16192 raft_consensus.cc:606] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Received request to transfer leadership to TS 36b15691c8e648a18b69e98bee3349b4
I20260709 13:05:20.651984 16192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fc1bcba29c24ea9b5582464ad0ba47e"
dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
mode: GRACEFUL
new_leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:05:20.652428 16192 raft_consensus.cc:606] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Received request to transfer leadership to TS ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:20.654693 16192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "368367d6b6834e7b841b41cd87884744"
dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
mode: GRACEFUL
new_leader_uuid: "d2e22ad700e94d1095c014708c364bb7"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:05:20.655282 16192 raft_consensus.cc:606] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Received request to transfer leadership to TS d2e22ad700e94d1095c014708c364bb7
I20260709 13:05:20.658363 16192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4c2d4bd133442d28d078d6fc088cff4"
dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
mode: GRACEFUL
new_leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:05:20.658892 17189 raft_consensus.cc:993] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990: : Instructing follower 36b15691c8e648a18b69e98bee3349b4 to start an election
I20260709 13:05:20.658938 16192 raft_consensus.cc:606] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Received request to transfer leadership to TS ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:20.659554 17229 raft_consensus.cc:1081] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Signalling peer 36b15691c8e648a18b69e98bee3349b4 to start an election
I20260709 13:05:20.661162 16122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27d59706e6f746aca969af7bf2206197"
dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
 from {username='slave'} at 127.0.0.1:44498
I20260709 13:05:20.661582  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:20.661690 16122 raft_consensus.cc:493] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:20.662170 16122 raft_consensus.cc:3060] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:20.664059  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:20.668588 16122 raft_consensus.cc:515] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:20.670379 16122 leader_election.cc:290] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:05:20.671365 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d59706e6f746aca969af7bf2206197" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:20.671895 16266 raft_consensus.cc:3060] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:20.672012 16192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d59706e6f746aca969af7bf2206197" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:05:20.672649 16192 raft_consensus.cc:3055] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:20.672938 16192 raft_consensus.cc:740] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:05:20.673774 16192 consensus_queue.cc:260] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:20.675138 16192 raft_consensus.cc:3060] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:20.678879 16266 raft_consensus.cc:2468] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 2.
I20260709 13:05:20.681211 16089 leader_election.cc:304] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:05:20.682093 17224 raft_consensus.cc:2804] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:20.682547 17224 raft_consensus.cc:697] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [term 2 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:05:20.683458 17224 consensus_queue.cc:237] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:20.684226 16192 raft_consensus.cc:2468] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 2.
I20260709 13:05:20.695219 15945 catalog_manager.cc:5697] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 1 to 2, leader changed from e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195) to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.884508 17241 raft_consensus.cc:993] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4: : Instructing follower ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:20.885062 17200 raft_consensus.cc:1081] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 4 LEADER]: Signalling peer ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:20.887732 17085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a"
dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:33074
I20260709 13:05:20.888284 17085 raft_consensus.cc:493] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:20.888620 17085 raft_consensus.cc:3060] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:20.899559 17085 raft_consensus.cc:515] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:20.901216 17085 leader_election.cc:290] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 5 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:20.902734 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:20.903259 16115 raft_consensus.cc:3055] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:20.903496 16115 raft_consensus.cc:740] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:05:20.904241 16115 consensus_queue.cc:260] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:20.908699 16115 raft_consensus.cc:3060] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:20.913545 16192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f108a2d22648a781f7e30b9730fb4a" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:05:20.914165 16192 raft_consensus.cc:3060] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:20.919039 16115 raft_consensus.cc:2468] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 5.
I20260709 13:05:20.921196 17009 leader_election.cc:304] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:20.922574 16192 raft_consensus.cc:2468] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 5.
I20260709 13:05:20.923051 17274 raft_consensus.cc:2804] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:20.923607 17274 raft_consensus.cc:697] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 5 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:20.924477 17274 consensus_queue.cc:237] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:20.935408 15945 catalog_manager.cc:5697] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 4 to 5, leader changed from 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194) to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 5 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.077327 17275 raft_consensus.cc:993] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990: : Instructing follower ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:21.077800 17229 raft_consensus.cc:1081] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Signalling peer ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:21.079332 17085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4c2d4bd133442d28d078d6fc088cff4"
dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:33090
I20260709 13:05:21.079790 17085 raft_consensus.cc:493] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:21.080075 17085 raft_consensus.cc:3060] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.091868 17085 raft_consensus.cc:515] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:21.093926 17085 leader_election.cc:290] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:21.095723 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2d4bd133442d28d078d6fc088cff4" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:05:21.096596 16194 raft_consensus.cc:3055] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:21.096918 16194 raft_consensus.cc:740] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:05:21.097712 16194 consensus_queue.cc:260] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:21.098822 16194 raft_consensus.cc:3060] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.099397 17275 raft_consensus.cc:993] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990: : Instructing follower ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:21.099924 17275 raft_consensus.cc:1081] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Signalling peer ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:21.096588 16115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2d4bd133442d28d078d6fc088cff4" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:21.101663 16115 raft_consensus.cc:3060] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.102432 17085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fc1bcba29c24ea9b5582464ad0ba47e"
dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:33090
I20260709 13:05:21.103055 17085 raft_consensus.cc:493] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:21.103422 17085 raft_consensus.cc:3060] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.113272 17085 raft_consensus.cc:515] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:21.114332 17189 raft_consensus.cc:993] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990: : Instructing follower d2e22ad700e94d1095c014708c364bb7 to start an election
I20260709 13:05:21.114851 17189 raft_consensus.cc:1081] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Signalling peer d2e22ad700e94d1095c014708c364bb7 to start an election
I20260709 13:05:21.116336 16192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc1bcba29c24ea9b5582464ad0ba47e" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:05:21.116966 16192 raft_consensus.cc:3055] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:21.117300 16192 raft_consensus.cc:740] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:05:21.118263 16270 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "368367d6b6834e7b841b41cd87884744"
dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
 from {username='slave'} at 127.0.0.1:36644
I20260709 13:05:21.118216 16192 consensus_queue.cc:260] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:21.118916 16270 raft_consensus.cc:493] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:21.119302 16270 raft_consensus.cc:3060] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.119867 16192 raft_consensus.cc:3060] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.117206 17085 leader_election.cc:290] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:05:21.116600 16194 raft_consensus.cc:2468] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 3.
I20260709 13:05:21.127696 17009 leader_election.cc:304] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:21.128599 17274 raft_consensus.cc:2804] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:21.129616 16192 raft_consensus.cc:2468] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:05:21.130856 17274 raft_consensus.cc:697] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 3 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:21.131062 17009 leader_election.cc:304] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:21.131925 17274 consensus_queue.cc:237] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:21.135304 17235 raft_consensus.cc:2804] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:21.135882 17235 raft_consensus.cc:697] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [term 2 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:21.136061 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc1bcba29c24ea9b5582464ad0ba47e" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:21.136809 16266 raft_consensus.cc:3060] T 2fc1bcba29c24ea9b5582464ad0ba47e P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.139743 17235 consensus_queue.cc:237] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:21.145550 16270 raft_consensus.cc:515] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:21.158197 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368367d6b6834e7b841b41cd87884744" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:21.159298 16122 raft_consensus.cc:3060] T 368367d6b6834e7b841b41cd87884744 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.169165 15945 catalog_manager.cc:5697] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 2 to 3, leader changed from e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195) to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 3 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.128101 16115 raft_consensus.cc:2468] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 3.
I20260709 13:05:21.175830 16122 raft_consensus.cc:2468] T 368367d6b6834e7b841b41cd87884744 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 2.
I20260709 13:05:21.176753 16119 raft_consensus.cc:1240] T 368367d6b6834e7b841b41cd87884744 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Rejecting Update request from peer e1e05442c5b44a079dd1de9dd124c990 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:21.181104 16270 leader_election.cc:290] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:21.184621 16266 raft_consensus.cc:2468] T 2fc1bcba29c24ea9b5582464ad0ba47e P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:05:21.189597 17229 consensus_queue.cc:1059] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:21.191072 17229 raft_consensus.cc:3055] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:21.191398 17229 raft_consensus.cc:740] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:05:21.191572 15947 catalog_manager.cc:5697] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 1 to 2, leader changed from e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195) to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 2 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.192126 17229 consensus_queue.cc:260] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:21.195638 16270 raft_consensus.cc:1275] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Refusing update from remote peer 36b15691c8e648a18b69e98bee3349b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:21.195839 16198 raft_consensus.cc:1275] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Refusing update from remote peer 36b15691c8e648a18b69e98bee3349b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:21.197161 17241 consensus_queue.cc:1048] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:21.198781 16237 leader_election.cc:304] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, d2e22ad700e94d1095c014708c364bb7; no voters: 
I20260709 13:05:21.199762 17229 raft_consensus.cc:3060] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.199700 17241 consensus_queue.cc:1048] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:21.205307 16194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368367d6b6834e7b841b41cd87884744" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:05:21.200449 17252 raft_consensus.cc:2804] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:21.206215 17252 raft_consensus.cc:697] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [term 2 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:05:21.209425 17252 consensus_queue.cc:237] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:21.244141 15945 catalog_manager.cc:5697] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 1 to 2, leader changed from e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195) to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 2 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.255683 16194 raft_consensus.cc:2468] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 2.
I20260709 13:05:21.314152 16122 raft_consensus.cc:1275] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 5 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:21.315393 17274 consensus_queue.cc:1048] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:21.327776 16198 raft_consensus.cc:1275] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 5 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:21.329129 17274 consensus_queue.cc:1048] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:21.546466 16266 raft_consensus.cc:1275] T 2fc1bcba29c24ea9b5582464ad0ba47e P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:21.547567 17274 consensus_queue.cc:1048] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:21.556927 16198 raft_consensus.cc:1275] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:21.560580 17285 consensus_queue.cc:1048] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:21.665195  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:21.691054 16198 raft_consensus.cc:1275] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:21.692405 17285 consensus_queue.cc:1048] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:21.703183 16115 raft_consensus.cc:1275] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:21.704638 17274 consensus_queue.cc:1048] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:21.718371  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:21.744729 16122 raft_consensus.cc:1275] T 368367d6b6834e7b841b41cd87884744 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Refusing update from remote peer d2e22ad700e94d1095c014708c364bb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:21.747367 17252 consensus_queue.cc:1048] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:21.751739 16194 raft_consensus.cc:1275] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Refusing update from remote peer d2e22ad700e94d1095c014708c364bb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:21.753898 17252 consensus_queue.cc:1048] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:21.816550 16266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872"
dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
mode: GRACEFUL
new_leader_uuid: "36b15691c8e648a18b69e98bee3349b4"
 from {username='slave'} at 127.0.0.1:45498
I20260709 13:05:21.817107 16266 raft_consensus.cc:606] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 3 LEADER]: Received request to transfer leadership to TS 36b15691c8e648a18b69e98bee3349b4
I20260709 13:05:21.819649 16198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d"
dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
mode: GRACEFUL
new_leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:05:21.820259 16198 raft_consensus.cc:606] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 3 LEADER]: Received request to transfer leadership to TS ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:21.822566 16198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3808fd28794c4ce098037730316b2e58"
dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
mode: GRACEFUL
new_leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:05:21.823130 16198 raft_consensus.cc:606] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 3 LEADER]: Received request to transfer leadership to TS ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:21.827833 16198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "522541a48c1647ccaf475543121810d2"
dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
mode: GRACEFUL
new_leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:05:21.828470 16198 raft_consensus.cc:606] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Received request to transfer leadership to TS ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:21.837458 16122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dd3bea4269f4b61adeb12a2cabaca3d"
dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
mode: GRACEFUL
new_leader_uuid: "d2e22ad700e94d1095c014708c364bb7"
 from {username='slave'} at 127.0.0.1:49024
I20260709 13:05:21.838060 16122 raft_consensus.cc:606] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Received request to transfer leadership to TS d2e22ad700e94d1095c014708c364bb7
I20260709 13:05:21.839433  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:21.841357  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:21.934788 17241 raft_consensus.cc:993] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4: : Instructing follower d2e22ad700e94d1095c014708c364bb7 to start an election
I20260709 13:05:21.935281 17241 raft_consensus.cc:1081] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Signalling peer d2e22ad700e94d1095c014708c364bb7 to start an election
I20260709 13:05:21.936633 16266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dd3bea4269f4b61adeb12a2cabaca3d"
dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
 from {username='slave'} at 127.0.0.1:36624
I20260709 13:05:21.937093 16266 raft_consensus.cc:493] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:21.937335 16266 raft_consensus.cc:3060] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.942328 16266 raft_consensus.cc:515] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:21.943885 16266 leader_election.cc:290] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:21.944715 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd3bea4269f4b61adeb12a2cabaca3d" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:05:21.944577 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd3bea4269f4b61adeb12a2cabaca3d" candidate_uuid: "d2e22ad700e94d1095c014708c364bb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:21.945396 16198 raft_consensus.cc:3060] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.945546 16122 raft_consensus.cc:3055] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:21.945947 16122 raft_consensus.cc:740] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:05:21.946623 16122 consensus_queue.cc:260] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:21.947530 16122 raft_consensus.cc:3060] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.950484 16198 raft_consensus.cc:2468] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 2.
I20260709 13:05:21.951639 16237 leader_election.cc:304] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:05:21.952349 17302 raft_consensus.cc:2804] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:21.952358 16122 raft_consensus.cc:2468] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2e22ad700e94d1095c014708c364bb7 in term 2.
I20260709 13:05:21.952961 17302 raft_consensus.cc:697] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [term 2 LEADER]: Becoming Leader. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:05:21.953866 17302 consensus_queue.cc:237] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:21.965066 15945 catalog_manager.cc:5697] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 reported cstate change: term changed from 1 to 2, leader changed from 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194) to d2e22ad700e94d1095c014708c364bb7 (127.7.25.196). New cstate: current_term: 2 leader_uuid: "d2e22ad700e94d1095c014708c364bb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.015575 17262 raft_consensus.cc:993] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7: : Instructing follower 36b15691c8e648a18b69e98bee3349b4 to start an election
I20260709 13:05:22.016049 17262 raft_consensus.cc:1081] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 3 LEADER]: Signalling peer 36b15691c8e648a18b69e98bee3349b4 to start an election
I20260709 13:05:22.017467 16115 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872"
dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
 from {username='slave'} at 127.0.0.1:44494
I20260709 13:05:22.017899 16115 raft_consensus.cc:493] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:22.018191 16115 raft_consensus.cc:3060] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:22.024070 16115 raft_consensus.cc:515] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:22.026307 16115 leader_election.cc:290] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 4 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:05:22.027264 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:05:22.027477 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1353edd9d7d544b890b5ba9ca2c72872" candidate_uuid: "36b15691c8e648a18b69e98bee3349b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:22.027953 16198 raft_consensus.cc:3060] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:22.028066 16266 raft_consensus.cc:3055] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:22.028503 16266 raft_consensus.cc:740] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:05:22.029331 16266 consensus_queue.cc:260] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:22.031529 16266 raft_consensus.cc:3060] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:22.034926 16198 raft_consensus.cc:2468] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 4.
I20260709 13:05:22.035880 16266 raft_consensus.cc:2468] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36b15691c8e648a18b69e98bee3349b4 in term 4.
I20260709 13:05:22.035933 16089 leader_election.cc:304] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36b15691c8e648a18b69e98bee3349b4, e1e05442c5b44a079dd1de9dd124c990; no voters: 
I20260709 13:05:22.036794 17224 raft_consensus.cc:2804] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:22.037232 17224 raft_consensus.cc:697] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 4 LEADER]: Becoming Leader. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:05:22.037882 17224 consensus_queue.cc:237] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } }
I20260709 13:05:22.046777 15945 catalog_manager.cc:5697] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 reported cstate change: term changed from 3 to 4, leader changed from d2e22ad700e94d1095c014708c364bb7 (127.7.25.196) to 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194). New cstate: current_term: 4 leader_uuid: "36b15691c8e648a18b69e98bee3349b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.110664 17275 raft_consensus.cc:993] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990: : Instructing follower ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:22.111267 17312 raft_consensus.cc:1081] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 3 LEADER]: Signalling peer ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:22.112977 17081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d"
dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:33090
I20260709 13:05:22.113569 17081 raft_consensus.cc:493] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:22.113896 17081 raft_consensus.cc:3060] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:22.119820 17081 raft_consensus.cc:515] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:22.122169 17081 leader_election.cc:290] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 4 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:05:22.122283 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:05:22.122887 16198 raft_consensus.cc:3055] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:22.123210 16198 raft_consensus.cc:740] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:05:22.123883 16198 consensus_queue.cc:260] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:22.124773 16198 raft_consensus.cc:3060] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:22.125854 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ec9187fe3a4ca1acae98f045a1c35d" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:22.126482 16266 raft_consensus.cc:3060] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:22.128328 17312 raft_consensus.cc:993] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990: : Instructing follower ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:22.129284 17312 raft_consensus.cc:1081] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 3 LEADER]: Signalling peer ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:22.131189 17088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3808fd28794c4ce098037730316b2e58"
dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:33090
I20260709 13:05:22.131807 17088 raft_consensus.cc:493] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:22.132182 17088 raft_consensus.cc:3060] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:22.134989 16266 raft_consensus.cc:2468] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 4.
I20260709 13:05:22.136260 17009 leader_election.cc:304] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:22.137142 17235 raft_consensus.cc:2804] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:22.139020 17235 raft_consensus.cc:697] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 4 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:22.139950 17235 consensus_queue.cc:237] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:22.140837 17088 raft_consensus.cc:515] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:22.143087 17088 leader_election.cc:290] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 4 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:05:22.147658 16192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3808fd28794c4ce098037730316b2e58" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:05:22.148239 16192 raft_consensus.cc:3055] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:22.148516 16192 raft_consensus.cc:740] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:05:22.149267 16192 consensus_queue.cc:260] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:22.150518 16192 raft_consensus.cc:3060] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:22.153995 16198 raft_consensus.cc:2468] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 4.
I20260709 13:05:22.154824 16264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3808fd28794c4ce098037730316b2e58" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:22.155471 16264 raft_consensus.cc:3060] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:22.165144 16264 raft_consensus.cc:2468] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 4.
I20260709 13:05:22.169031 17009 leader_election.cc:304] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:22.169930 17274 raft_consensus.cc:2804] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:22.170423 17274 raft_consensus.cc:697] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 4 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:22.170769 16192 raft_consensus.cc:2468] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 4.
I20260709 13:05:22.171320 17274 consensus_queue.cc:237] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:22.180753 15945 catalog_manager.cc:5697] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 3 to 4, leader changed from e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195) to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 4 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.196902 15945 catalog_manager.cc:5697] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 3 to 4, leader changed from e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195) to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 4 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.257534 17312 raft_consensus.cc:993] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990: : Instructing follower ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:22.258076 17312 raft_consensus.cc:1081] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Signalling peer ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:22.259806 17081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "522541a48c1647ccaf475543121810d2"
dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:33090
I20260709 13:05:22.260411 17081 raft_consensus.cc:493] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:22.260778 17081 raft_consensus.cc:3060] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.267073 17081 raft_consensus.cc:515] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:22.269217 17081 leader_election.cc:290] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:05:22.271319 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522541a48c1647ccaf475543121810d2" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:05:22.274551 16198 raft_consensus.cc:3055] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:22.274976 16198 raft_consensus.cc:740] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e1e05442c5b44a079dd1de9dd124c990, State: Running, Role: LEADER
I20260709 13:05:22.275725 16198 consensus_queue.cc:260] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:22.276896 16198 raft_consensus.cc:3060] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.274504 16264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522541a48c1647ccaf475543121810d2" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:22.278144 16264 raft_consensus.cc:3060] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.284689 16198 raft_consensus.cc:2468] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 3.
I20260709 13:05:22.284973 16264 raft_consensus.cc:2468] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 3.
I20260709 13:05:22.286520 17009 leader_election.cc:304] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:22.287348 17274 raft_consensus.cc:2804] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:22.287814 17274 raft_consensus.cc:697] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 3 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:22.288676 17274 consensus_queue.cc:237] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:22.298377 15945 catalog_manager.cc:5697] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 2 to 3, leader changed from e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195) to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 3 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.381386 16198 raft_consensus.cc:1275] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Refusing update from remote peer d2e22ad700e94d1095c014708c364bb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.382805 17252 consensus_queue.cc:1048] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.394191 16115 raft_consensus.cc:1275] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Refusing update from remote peer d2e22ad700e94d1095c014708c364bb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.395648 17252 consensus_queue.cc:1048] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.483830 16264 raft_consensus.cc:1275] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Refusing update from remote peer 36b15691c8e648a18b69e98bee3349b4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:22.486756 17224 consensus_queue.cc:1048] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:22.506394 16198 raft_consensus.cc:1275] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 4 FOLLOWER]: Refusing update from remote peer 36b15691c8e648a18b69e98bee3349b4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:22.508438 17324 consensus_queue.cc:1048] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:22.621979 16270 raft_consensus.cc:1275] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:22.623884 17274 consensus_queue.cc:1048] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:05:22.707046 16163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:45195, user_credentials={real_user=slave}} blocked reactor thread for 52359.4us
I20260709 13:05:22.741024 16198 raft_consensus.cc:1275] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 4 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:22.743005 16198 raft_consensus.cc:1275] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 4 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:22.750478 16198 raft_consensus.cc:1275] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:22.752112 16270 raft_consensus.cc:1275] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:22.761309 17274 consensus_queue.cc:1048] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:22.765015 17274 consensus_queue.cc:1048] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:22.773833 17330 consensus_queue.cc:1048] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:22.782497 17333 consensus_queue.cc:1048] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:05:22.798689 16270 raft_consensus.cc:1275] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:22.804845 17333 consensus_queue.cc:1048] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:22.842531  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:22.948565  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:22.988340 16122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a26858ecdea24ad9bb9b64ee8d133dd2"
dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
mode: GRACEFUL
new_leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:49024
I20260709 13:05:22.989348 16122 raft_consensus.cc:606] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Received request to transfer leadership to TS ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:22.992774 16266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1713f6b73c3463c87e7eb5c94959eb0"
dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
mode: GRACEFUL
new_leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:45498
I20260709 13:05:22.993299 16266 raft_consensus.cc:606] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Received request to transfer leadership to TS ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:22.994645  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:22.996340  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:23.120913 17302 raft_consensus.cc:993] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7: : Instructing follower ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:23.121786 17252 raft_consensus.cc:1081] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Signalling peer ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:23.123553 17085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1713f6b73c3463c87e7eb5c94959eb0"
dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:33080
I20260709 13:05:23.124128 17085 raft_consensus.cc:493] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:23.124539 17085 raft_consensus.cc:3060] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:23.133097 17085 raft_consensus.cc:515] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:23.136603 17085 leader_election.cc:290] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Requested vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), d2e22ad700e94d1095c014708c364bb7 (127.7.25.196:41631)
I20260709 13:05:23.136781 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1713f6b73c3463c87e7eb5c94959eb0" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2e22ad700e94d1095c014708c364bb7"
I20260709 13:05:23.137538 16270 raft_consensus.cc:3055] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:23.138285 16270 raft_consensus.cc:740] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2e22ad700e94d1095c014708c364bb7, State: Running, Role: LEADER
I20260709 13:05:23.139349 16270 consensus_queue.cc:260] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:23.140447 16270 raft_consensus.cc:3060] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:23.136214 16192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1713f6b73c3463c87e7eb5c94959eb0" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:05:23.149683 16192 raft_consensus.cc:3060] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:23.150708 16270 raft_consensus.cc:2468] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:05:23.151872 17009 leader_election.cc:304] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:23.152750 17285 raft_consensus.cc:2804] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:23.153258 17285 raft_consensus.cc:697] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [term 2 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:23.154178 17285 consensus_queue.cc:237] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:23.156515 16192 raft_consensus.cc:2468] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:05:23.164106 15944 catalog_manager.cc:5697] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 1 to 2, leader changed from d2e22ad700e94d1095c014708c364bb7 (127.7.25.196) to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 2 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:23.335443 17316 raft_consensus.cc:993] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4: : Instructing follower ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:23.335950 17224 raft_consensus.cc:1081] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Signalling peer ec8b54f5a9e44f428a4d537391138dcf to start an election
I20260709 13:05:23.337738 17081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a26858ecdea24ad9bb9b64ee8d133dd2"
dest_uuid: "ec8b54f5a9e44f428a4d537391138dcf"
 from {username='slave'} at 127.0.0.1:33074
I20260709 13:05:23.338253 17081 raft_consensus.cc:493] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:23.338549 17081 raft_consensus.cc:3060] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:23.345131 17081 raft_consensus.cc:515] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:23.346727 17081 leader_election.cc:290] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Requested vote from peers 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195), e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725)
I20260709 13:05:23.347378 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a26858ecdea24ad9bb9b64ee8d133dd2" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36b15691c8e648a18b69e98bee3349b4"
I20260709 13:05:23.347668 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a26858ecdea24ad9bb9b64ee8d133dd2" candidate_uuid: "ec8b54f5a9e44f428a4d537391138dcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1e05442c5b44a079dd1de9dd124c990"
I20260709 13:05:23.348009 16122 raft_consensus.cc:3055] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:23.348238 16198 raft_consensus.cc:3060] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:23.348376 16122 raft_consensus.cc:740] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36b15691c8e648a18b69e98bee3349b4, State: Running, Role: LEADER
I20260709 13:05:23.349206 16122 consensus_queue.cc:260] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:23.350363 16122 raft_consensus.cc:3060] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:23.354002 16198 raft_consensus.cc:2468] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:05:23.355201 17009 leader_election.cc:304] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf; no voters: 
I20260709 13:05:23.355877 16122 raft_consensus.cc:2468] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec8b54f5a9e44f428a4d537391138dcf in term 2.
I20260709 13:05:23.355885 17330 raft_consensus.cc:2804] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:23.356673 17330 raft_consensus.cc:697] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [term 2 LEADER]: Becoming Leader. State: Replica: ec8b54f5a9e44f428a4d537391138dcf, State: Running, Role: LEADER
I20260709 13:05:23.357668 17330 consensus_queue.cc:237] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } }
I20260709 13:05:23.367466 15944 catalog_manager.cc:5697] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf reported cstate change: term changed from 1 to 2, leader changed from 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194) to ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193). New cstate: current_term: 2 leader_uuid: "ec8b54f5a9e44f428a4d537391138dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.627666 16198 raft_consensus.cc:1275] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:23.629035 17330 consensus_queue.cc:1048] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:23.638744 16266 raft_consensus.cc:1275] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:23.641749 17285 consensus_queue.cc:1048] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:23.784902 16194 raft_consensus.cc:1275] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:23.786075 17333 consensus_queue.cc:1048] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:23.798578 16122 raft_consensus.cc:1275] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Refusing update from remote peer ec8b54f5a9e44f428a4d537391138dcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:23.801018 17333 consensus_queue.cc:1048] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:23.997279  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:24.044767  7271 tablet_server.cc:179] TabletServer@127.7.25.193:44491 shutting down...
W20260709 13:05:24.060335 16162 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 343 similar messages]
W20260709 13:05:24.064386 16162 consensus_peers.cc:597] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.082962 16162 consensus_peers.cc:597] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.091729  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:05:24.091804 16236 consensus_peers.cc:597] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.095309 16088 consensus_peers.cc:597] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.095891  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.097043  7271 raft_consensus.cc:2243] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:05:24.097505 16088 consensus_peers.cc:597] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.097859  7271 raft_consensus.cc:2272] T a26858ecdea24ad9bb9b64ee8d133dd2 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.101605  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.102646  7271 raft_consensus.cc:2243] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.103497  7271 raft_consensus.cc:2272] T e1713f6b73c3463c87e7eb5c94959eb0 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.106149  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.106765  7271 raft_consensus.cc:2243] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.107179  7271 raft_consensus.cc:2272] T c600c8f1ec454bc0b4a3716ea85d8499 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.109629  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.110442  7271 raft_consensus.cc:2243] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.110877  7271 raft_consensus.cc:2272] T 1be59fdebe7a44cc9f945fa9793ddfda P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.114039  7271 tablet_replica.cc:333] stopping tablet replica
W20260709 13:05:24.114132 16088 consensus_peers.cc:597] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.114960  7271 raft_consensus.cc:2243] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.115489  7271 raft_consensus.cc:2272] T 5dfecacf6d204abc99b0b341ab7256b1 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:24.116901 16236 consensus_peers.cc:597] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.118446  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.119302  7271 raft_consensus.cc:2243] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.120352  7271 raft_consensus.cc:2272] T 85079923151849059accd1b7c27d4699 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.123507  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.124352  7271 raft_consensus.cc:2243] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.124811  7271 raft_consensus.cc:2272] T aaaad334dede46d888c92db5c932655e P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.127398  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.128268  7271 raft_consensus.cc:2243] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.128732  7271 raft_consensus.cc:2272] T 154f438524734d2599d72ae02e2230e6 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:24.130824 16088 consensus_peers.cc:597] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.131932  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.132998  7271 raft_consensus.cc:2243] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.133597  7271 raft_consensus.cc:2272] T 379913b2ca6a49e9bfd93ca8b06c9fee P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.137609  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.138550  7271 raft_consensus.cc:2243] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.139156  7271 raft_consensus.cc:2272] T c6c51469e614423d8a9cc50e024cf468 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.142616  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.143666  7271 raft_consensus.cc:2243] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.144320  7271 raft_consensus.cc:2272] T ffc93f8cfc444912a0c7ef667a931a5c P ec8b54f5a9e44f428a4d537391138dcf [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.148133  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.148939  7271 raft_consensus.cc:2243] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.149528  7271 raft_consensus.cc:2272] T dbeb3d9bac364b43abf555b36674a82e P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:24.150154 16088 consensus_peers.cc:597] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.152774  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.153775  7271 raft_consensus.cc:2243] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.154341  7271 raft_consensus.cc:2272] T 8eede189c87343c6a45e71d7cb23c41d P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.157640  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.158445  7271 raft_consensus.cc:2243] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.158960  7271 raft_consensus.cc:2272] T e44eefc0f2e540b99fa97ec775185660 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:24.161507 16088 consensus_peers.cc:597] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.162180  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.162999  7271 raft_consensus.cc:2243] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.163448  7271 raft_consensus.cc:2272] T adc5c10cfdd24c64a4db9e4339808499 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.166492  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.167325  7271 raft_consensus.cc:2243] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.168478  7271 raft_consensus.cc:2272] T 496077ee29374b90a7c924539c590475 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.171355  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.172140  7271 raft_consensus.cc:2243] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.172720  7271 raft_consensus.cc:2272] T eae7099a7350453682514662a4773778 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.175668  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.176518  7271 raft_consensus.cc:2243] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.177019  7271 raft_consensus.cc:2272] T 3f21b3c8be8f42be9186b827a2a086e3 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.179641  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.180547  7271 raft_consensus.cc:2243] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.181131  7271 raft_consensus.cc:2272] T 48faa67625c143aa8ce08eb068a3a8dc P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.183841  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.184702  7271 raft_consensus.cc:2243] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.185593  7271 raft_consensus.cc:2272] T 3808fd28794c4ce098037730316b2e58 P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.188369  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.189199  7271 raft_consensus.cc:2243] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.189643  7271 raft_consensus.cc:2272] T a07d00d6ed2e42308d7de0f098fa286c P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.192867  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.193684  7271 raft_consensus.cc:2243] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.194267  7271 raft_consensus.cc:2272] T 06d457e5782e42e78f4b0978f2b41dac P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.197508  7271 tablet_replica.cc:333] stopping tablet replica
W20260709 13:05:24.198158 16162 consensus_peers.cc:597] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.198314  7271 raft_consensus.cc:2243] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.198927  7271 raft_consensus.cc:2272] T f697dfb6287b4feeac50690912201da2 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:24.202031 16162 consensus_peers.cc:597] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.202101  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.203156  7271 raft_consensus.cc:2243] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.204077  7271 raft_consensus.cc:2272] T 16f108a2d22648a781f7e30b9730fb4a P ec8b54f5a9e44f428a4d537391138dcf [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:24.206176 16236 consensus_peers.cc:597] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.207127  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.208045  7271 raft_consensus.cc:2243] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.208678  7271 raft_consensus.cc:2272] T 15550bacc7b04df9bc56ec154f31b50b P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.211803  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.212523  7271 raft_consensus.cc:2243] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.213428  7271 raft_consensus.cc:2272] T 522541a48c1647ccaf475543121810d2 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.216236  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.216818  7271 raft_consensus.cc:2243] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.217303  7271 raft_consensus.cc:2272] T 105468bfb6dc48c28c16d3449c691f6b P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.219664  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.220335  7271 raft_consensus.cc:2243] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.220778  7271 raft_consensus.cc:2272] T 6f053de7054c4b3786ffa35aa5accb15 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.223013  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.223620  7271 raft_consensus.cc:2243] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.224514  7271 raft_consensus.cc:2272] T 09412044d26f417da5c842c8acf1149d P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.226836  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.227599  7271 raft_consensus.cc:2243] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.228185  7271 raft_consensus.cc:2272] T fe9bf004f8eb4f0f910840561945e386 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.231041  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.231582  7271 raft_consensus.cc:2243] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.231986  7271 raft_consensus.cc:2272] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.234566  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.235244  7271 raft_consensus.cc:2243] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.236259  7271 raft_consensus.cc:2272] T 4e61baecc1a74998a356870a675301ea P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.239274  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.239830  7271 raft_consensus.cc:2243] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.240289  7271 raft_consensus.cc:2272] T 4b5c33c4000f496f841f99af79e55532 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.242959  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.243635  7271 raft_consensus.cc:2243] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.244611  7271 raft_consensus.cc:2272] T 2fc1bcba29c24ea9b5582464ad0ba47e P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.247262  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.247778  7271 raft_consensus.cc:2243] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.248186  7271 raft_consensus.cc:2272] T 9d6c90e7e1974ef0ade824c72386b5f3 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.250275  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.250898  7271 raft_consensus.cc:2243] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.251384  7271 raft_consensus.cc:2272] T ea7b2b72b2df44e89e8b76fa65501951 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.253901  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.254462  7271 raft_consensus.cc:2243] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.254865  7271 raft_consensus.cc:2272] T 3b3ffb334ab54abb8bdb4893844c3b6b P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.257040  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.257637  7271 raft_consensus.cc:2243] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.258463  7271 raft_consensus.cc:2272] T baa51a24c3524741836e9666f1b4babe P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.261502  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.262202  7271 raft_consensus.cc:2243] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.262799  7271 raft_consensus.cc:2272] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:24.265470 16162 consensus_peers.cc:597] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.266095  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.266914  7271 raft_consensus.cc:2243] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.267935  7271 raft_consensus.cc:2272] T 430a0b8ad91a40389bde4a2dce852afb P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:24.270084 16162 consensus_peers.cc:597] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.270861  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.271703  7271 raft_consensus.cc:2243] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.272337  7271 raft_consensus.cc:2272] T eac8a97b1adc49389919710edf7c5e03 P ec8b54f5a9e44f428a4d537391138dcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.275497  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.276319  7271 raft_consensus.cc:2243] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.277364  7271 raft_consensus.cc:2272] T 15ec9187fe3a4ca1acae98f045a1c35d P ec8b54f5a9e44f428a4d537391138dcf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.279639  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.280287  7271 raft_consensus.cc:2243] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.281365  7271 raft_consensus.cc:2272] T d4c2d4bd133442d28d078d6fc088cff4 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:24.283720 16236 consensus_peers.cc:597] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.284899 16162 consensus_peers.cc:597] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.285810  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.286628  7271 raft_consensus.cc:2243] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.287111  7271 raft_consensus.cc:2272] T 406b6fe9ceac45fb8a980a2feb9cc063 P ec8b54f5a9e44f428a4d537391138dcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.289463  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:24.290073  7271 raft_consensus.cc:2243] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.290591  7271 raft_consensus.cc:2272] T bf5dc804032442d1a074ba2adaf03311 P ec8b54f5a9e44f428a4d537391138dcf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:24.293480 16236 consensus_peers.cc:597] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.307114 16162 consensus_peers.cc:597] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.314148 16236 consensus_peers.cc:597] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.316017 16162 consensus_peers.cc:597] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.331319 16088 consensus_peers.cc:597] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.344200 16162 consensus_peers.cc:597] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.368701 16162 consensus_peers.cc:597] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.383316 16236 consensus_peers.cc:597] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.383872 16236 consensus_peers.cc:597] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.399468  7271 tablet_server.cc:196] TabletServer@127.7.25.193:44491 shutdown complete.
W20260709 13:05:24.439464 16088 consensus_peers.cc:597] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.445842 16236 consensus_peers.cc:597] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.453016 16236 consensus_peers.cc:597] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.494753  7271 tablet_server.cc:179] TabletServer@127.7.25.194:0 shutting down...
W20260709 13:05:24.512099 16237 consensus_peers.cc:597] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.520232 16236 consensus_peers.cc:597] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.574803 16163 consensus_peers.cc:597] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.580363  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:24.581537  7271 tablet_replica.cc:333] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
W20260709 13:05:24.582222 16163 consensus_peers.cc:597] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.582854  7271 raft_consensus.cc:2243] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.583962  7271 raft_consensus.cc:2272] T eae7099a7350453682514662a4773778 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.586970  7271 tablet_replica.cc:333] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.587896  7271 raft_consensus.cc:2243] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:24.588495 16237 consensus_peers.cc:597] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.588784  7271 raft_consensus.cc:2272] T 85079923151849059accd1b7c27d4699 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.592393  7271 tablet_replica.cc:333] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.593591  7271 raft_consensus.cc:2243] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.594743  7271 raft_consensus.cc:2272] T ae83b44932ca4fd0a40b66c6e8061284 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.598024  7271 tablet_replica.cc:333] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.599535  7271 raft_consensus.cc:2243] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.600302  7271 raft_consensus.cc:2272] T 8dd3bea4269f4b61adeb12a2cabaca3d P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.603681  7271 tablet_replica.cc:333] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.604805  7271 raft_consensus.cc:2243] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.605358  7271 raft_consensus.cc:2272] T 3589ea61d3c14d5da5f955ac6d719881 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.608685  7271 tablet_replica.cc:333] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.609699  7271 raft_consensus.cc:2243] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.610227  7271 raft_consensus.cc:2272] T 496077ee29374b90a7c924539c590475 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.613413  7271 tablet_replica.cc:333] T c600c8f1ec454bc0b4a3716ea85d8499 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.614320  7271 raft_consensus.cc:2243] T c600c8f1ec454bc0b4a3716ea85d8499 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.614801  7271 raft_consensus.cc:2272] T c600c8f1ec454bc0b4a3716ea85d8499 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.617429  7271 tablet_replica.cc:333] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.618114  7271 raft_consensus.cc:2243] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.618611  7271 raft_consensus.cc:2272] T c6c51469e614423d8a9cc50e024cf468 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.620900  7271 tablet_replica.cc:333] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.621687  7271 raft_consensus.cc:2243] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.622184  7271 raft_consensus.cc:2272] T ffc93f8cfc444912a0c7ef667a931a5c P 36b15691c8e648a18b69e98bee3349b4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.624331  7271 tablet_replica.cc:333] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.625103  7271 raft_consensus.cc:2243] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.625689  7271 raft_consensus.cc:2272] T c98ba329bddb47c5aec148957811a4c2 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.629613  7271 tablet_replica.cc:333] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.630601  7271 raft_consensus.cc:2243] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.631238  7271 raft_consensus.cc:2272] T a26858ecdea24ad9bb9b64ee8d133dd2 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.636068  7271 tablet_replica.cc:333] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.636883  7271 raft_consensus.cc:2243] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.637514  7271 raft_consensus.cc:2272] T dbeb3d9bac364b43abf555b36674a82e P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:24.637712 16162 consensus_peers.cc:597] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 -> Peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Couldn't send request to peer ec8b54f5a9e44f428a4d537391138dcf. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.640605  7271 tablet_replica.cc:333] T 5e6e04804ef846e8b828194d87904eaa P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.641687  7271 raft_consensus.cc:2243] T 5e6e04804ef846e8b828194d87904eaa P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.642278  7271 raft_consensus.cc:2272] T 5e6e04804ef846e8b828194d87904eaa P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:24.644727 16163 consensus_peers.cc:597] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.644917  7271 tablet_replica.cc:333] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.646205  7271 raft_consensus.cc:2243] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.646950  7271 raft_consensus.cc:2272] T 48faa67625c143aa8ce08eb068a3a8dc P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.649367  7271 tablet_replica.cc:333] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.649948  7271 raft_consensus.cc:2243] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.650784  7271 raft_consensus.cc:2272] T aaaad334dede46d888c92db5c932655e P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.653467  7271 tablet_replica.cc:333] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.654320  7271 raft_consensus.cc:2243] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.654976  7271 raft_consensus.cc:2272] T 379913b2ca6a49e9bfd93ca8b06c9fee P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.657145  7271 tablet_replica.cc:333] T c32eb3a1727b42348bb90a85f5f0e419 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.657763  7271 raft_consensus.cc:2243] T c32eb3a1727b42348bb90a85f5f0e419 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.658200  7271 raft_consensus.cc:2272] T c32eb3a1727b42348bb90a85f5f0e419 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.660528  7271 tablet_replica.cc:333] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.661171  7271 raft_consensus.cc:2243] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.662074  7271 raft_consensus.cc:2272] T 7cc73085eee348a0b029b5aa5f51e288 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.665640  7271 tablet_replica.cc:333] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.667719  7271 raft_consensus.cc:2243] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.669384  7271 raft_consensus.cc:2272] T 8eede189c87343c6a45e71d7cb23c41d P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.672035  7271 tablet_replica.cc:333] T 368367d6b6834e7b841b41cd87884744 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.672672  7271 raft_consensus.cc:2243] T 368367d6b6834e7b841b41cd87884744 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.673305  7271 raft_consensus.cc:2272] T 368367d6b6834e7b841b41cd87884744 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.676057  7271 tablet_replica.cc:333] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.676766  7271 raft_consensus.cc:2243] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.677415  7271 raft_consensus.cc:2272] T 406b6fe9ceac45fb8a980a2feb9cc063 P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.680001  7271 tablet_replica.cc:333] T bf5dc804032442d1a074ba2adaf03311 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.680792  7271 raft_consensus.cc:2243] T bf5dc804032442d1a074ba2adaf03311 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.681411  7271 raft_consensus.cc:2272] T bf5dc804032442d1a074ba2adaf03311 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.684505  7271 tablet_replica.cc:333] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.685360  7271 raft_consensus.cc:2243] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.686395  7271 raft_consensus.cc:2272] T 1353edd9d7d544b890b5ba9ca2c72872 P 36b15691c8e648a18b69e98bee3349b4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.689476  7271 tablet_replica.cc:333] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.690191  7271 raft_consensus.cc:2243] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.690737  7271 raft_consensus.cc:2272] T 105468bfb6dc48c28c16d3449c691f6b P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.693964  7271 tablet_replica.cc:333] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.694792  7271 raft_consensus.cc:2243] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.695937  7271 raft_consensus.cc:2272] T 6f053de7054c4b3786ffa35aa5accb15 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.698652  7271 tablet_replica.cc:333] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.699303  7271 raft_consensus.cc:2243] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.699857  7271 raft_consensus.cc:2272] T 09412044d26f417da5c842c8acf1149d P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.702806  7271 tablet_replica.cc:333] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.703385  7271 raft_consensus.cc:2243] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.704221  7271 raft_consensus.cc:2272] T 76c283cfd76b4e9aacd796f6ead6e4b8 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.706815  7271 tablet_replica.cc:333] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.707783  7271 raft_consensus.cc:2243] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.708351  7271 raft_consensus.cc:2272] T fe849f02803548a48394a1ff9f356f98 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.711205  7271 tablet_replica.cc:333] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.711987  7271 raft_consensus.cc:2243] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.713035  7271 raft_consensus.cc:2272] T fc581e6f2f6741bc9a63c49459198306 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:24.713805 16163 consensus_peers.cc:597] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.715806  7271 tablet_replica.cc:333] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.716652  7271 raft_consensus.cc:2243] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.717243  7271 raft_consensus.cc:2272] T d4c2d4bd133442d28d078d6fc088cff4 P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:24.719478 16237 consensus_peers.cc:597] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.719939  7271 tablet_replica.cc:333] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.720775  7271 raft_consensus.cc:2243] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.721765  7271 raft_consensus.cc:2272] T d6c9099428b34e0f9bec85f2159b656e P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.724375  7271 tablet_replica.cc:333] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.725134  7271 raft_consensus.cc:2243] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.726145  7271 raft_consensus.cc:2272] T 1be59fdebe7a44cc9f945fa9793ddfda P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.729188  7271 tablet_replica.cc:333] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
W20260709 13:05:24.729867 16237 consensus_peers.cc:597] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.729907  7271 raft_consensus.cc:2243] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.731134  7271 raft_consensus.cc:2272] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.733911  7271 tablet_replica.cc:333] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.734750  7271 raft_consensus.cc:2243] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.735329  7271 raft_consensus.cc:2272] T 4e61baecc1a74998a356870a675301ea P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.738009  7271 tablet_replica.cc:333] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.738718  7271 raft_consensus.cc:2243] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.739233  7271 raft_consensus.cc:2272] T 9d6c90e7e1974ef0ade824c72386b5f3 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.742154  7271 tablet_replica.cc:333] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.742916  7271 raft_consensus.cc:2243] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.743515  7271 raft_consensus.cc:2272] T f697dfb6287b4feeac50690912201da2 P 36b15691c8e648a18b69e98bee3349b4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:24.743813 16237 consensus_peers.cc:597] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.745913  7271 tablet_replica.cc:333] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.746578  7271 raft_consensus.cc:2243] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.747051  7271 raft_consensus.cc:2272] T 16f108a2d22648a781f7e30b9730fb4a P 36b15691c8e648a18b69e98bee3349b4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.749720  7271 tablet_replica.cc:333] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.750411  7271 raft_consensus.cc:2243] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.751469  7271 raft_consensus.cc:2272] T 27d59706e6f746aca969af7bf2206197 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:24.752207 16237 consensus_peers.cc:597] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.753837  7271 tablet_replica.cc:333] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.754484  7271 raft_consensus.cc:2243] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.755025  7271 raft_consensus.cc:2272] T baa51a24c3524741836e9666f1b4babe P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.757694  7271 tablet_replica.cc:333] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.758373  7271 raft_consensus.cc:2243] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:24.759428  7271 raft_consensus.cc:2272] T ea7b2b72b2df44e89e8b76fa65501951 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.762251  7271 tablet_replica.cc:333] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.762938  7271 raft_consensus.cc:2243] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.763506  7271 raft_consensus.cc:2272] T 3b3ffb334ab54abb8bdb4893844c3b6b P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.766320  7271 tablet_replica.cc:333] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.766975  7271 raft_consensus.cc:2243] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:05:24.767264 16237 consensus_peers.cc:597] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.767897  7271 raft_consensus.cc:2272] T fe9bf004f8eb4f0f910840561945e386 P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.770255  7271 tablet_replica.cc:333] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.770911  7271 raft_consensus.cc:2243] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.771417  7271 raft_consensus.cc:2272] T 430a0b8ad91a40389bde4a2dce852afb P 36b15691c8e648a18b69e98bee3349b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:24.774056  7271 tablet_replica.cc:333] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4: stopping tablet replica
I20260709 13:05:24.774701  7271 raft_consensus.cc:2243] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:24.775285  7271 raft_consensus.cc:2272] T eac8a97b1adc49389919710edf7c5e03 P 36b15691c8e648a18b69e98bee3349b4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:24.792737 16163 consensus_peers.cc:597] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.813297 16237 consensus_peers.cc:597] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.813973 16237 consensus_peers.cc:597] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.857246 16237 consensus_peers.cc:597] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:45195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.884985 16237 consensus_peers.cc:597] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:45195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.894294 16237 consensus_peers.cc:597] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:45195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.923136 16163 consensus_peers.cc:597] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:45195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.926642  7271 tablet_server.cc:196] TabletServer@127.7.25.194:0 shutdown complete.
W20260709 13:05:24.948622 16237 consensus_peers.cc:597] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:45195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:25.008442  7271 tablet_server.cc:179] TabletServer@127.7.25.195:0 shutting down...
W20260709 13:05:25.038372 16163 consensus_peers.cc:597] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 -> Peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Couldn't send request to peer 36b15691c8e648a18b69e98bee3349b4. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:45195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:25.077709  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:25.078753  7271 tablet_replica.cc:333] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.079895  7271 raft_consensus.cc:2243] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.080549  7271 raft_consensus.cc:2272] T 430a0b8ad91a40389bde4a2dce852afb P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:25.083292 16237 consensus_peers.cc:597] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 -> Peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Couldn't send request to peer e1e05442c5b44a079dd1de9dd124c990. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:25.083688  7271 tablet_replica.cc:333] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.084468  7271 raft_consensus.cc:2243] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.084939  7271 raft_consensus.cc:2272] T ae83b44932ca4fd0a40b66c6e8061284 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.087095  7271 tablet_replica.cc:333] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.087874  7271 raft_consensus.cc:2243] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.088861  7271 raft_consensus.cc:2272] T 15550bacc7b04df9bc56ec154f31b50b P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.091640  7271 tablet_replica.cc:333] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.092418  7271 raft_consensus.cc:2243] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.093500  7271 raft_consensus.cc:2272] T 3589ea61d3c14d5da5f955ac6d719881 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.095564  7271 tablet_replica.cc:333] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.096158  7271 raft_consensus.cc:2243] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.096599  7271 raft_consensus.cc:2272] T e1713f6b73c3463c87e7eb5c94959eb0 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.098954  7271 tablet_replica.cc:333] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.099742  7271 raft_consensus.cc:2243] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.100291  7271 raft_consensus.cc:2272] T 496077ee29374b90a7c924539c590475 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:25.101450 16237 consensus_peers.cc:597] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 -> Peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Couldn't send request to peer e1e05442c5b44a079dd1de9dd124c990. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:25.103205  7271 tablet_replica.cc:333] T 5e6e04804ef846e8b828194d87904eaa P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.103969  7271 raft_consensus.cc:2243] T 5e6e04804ef846e8b828194d87904eaa P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.104542  7271 raft_consensus.cc:2272] T 5e6e04804ef846e8b828194d87904eaa P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.107090  7271 tablet_replica.cc:333] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.107751  7271 raft_consensus.cc:2243] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.108518  7271 raft_consensus.cc:2272] T dbeb3d9bac364b43abf555b36674a82e P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.110636  7271 tablet_replica.cc:333] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.111207  7271 raft_consensus.cc:2243] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.111621  7271 raft_consensus.cc:2272] T a26858ecdea24ad9bb9b64ee8d133dd2 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.113518  7271 tablet_replica.cc:333] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.114084  7271 raft_consensus.cc:2243] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.114516  7271 raft_consensus.cc:2272] T eae7099a7350453682514662a4773778 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.116518  7271 tablet_replica.cc:333] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.117146  7271 raft_consensus.cc:2243] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.117991  7271 raft_consensus.cc:2272] T 3f21b3c8be8f42be9186b827a2a086e3 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.120281  7271 tablet_replica.cc:333] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.120818  7271 raft_consensus.cc:2243] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.121369  7271 raft_consensus.cc:2272] T 522541a48c1647ccaf475543121810d2 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.123957  7271 tablet_replica.cc:333] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.124716  7271 raft_consensus.cc:2243] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.125277  7271 raft_consensus.cc:2272] T 368367d6b6834e7b841b41cd87884744 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.127825  7271 tablet_replica.cc:333] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.128415  7271 raft_consensus.cc:2243] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.129213  7271 raft_consensus.cc:2272] T bf5dc804032442d1a074ba2adaf03311 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.131381  7271 tablet_replica.cc:333] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.132090  7271 raft_consensus.cc:2243] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.132896  7271 raft_consensus.cc:2272] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.135067  7271 tablet_replica.cc:333] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.135655  7271 raft_consensus.cc:2243] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.136401  7271 raft_consensus.cc:2272] T c32eb3a1727b42348bb90a85f5f0e419 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.138329  7271 tablet_replica.cc:333] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.139048  7271 raft_consensus.cc:2243] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.139693  7271 raft_consensus.cc:2272] T 1353edd9d7d544b890b5ba9ca2c72872 P e1e05442c5b44a079dd1de9dd124c990 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.141836  7271 tablet_replica.cc:333] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.142539  7271 raft_consensus.cc:2243] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.143328  7271 raft_consensus.cc:2272] T 105468bfb6dc48c28c16d3449c691f6b P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:25.145056 16237 consensus_peers.cc:597] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 -> Peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Couldn't send request to peer e1e05442c5b44a079dd1de9dd124c990. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:25.145613  7271 tablet_replica.cc:333] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.146226  7271 raft_consensus.cc:2243] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.146780  7271 raft_consensus.cc:2272] T 76c283cfd76b4e9aacd796f6ead6e4b8 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.146966 17363 raft_consensus.cc:493] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:25.147516 17363 raft_consensus.cc:515] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:25.150019  7271 tablet_replica.cc:333] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.151003  7271 raft_consensus.cc:2243] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.151177 17363 leader_election.cc:290] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
I20260709 13:05:25.151589  7271 raft_consensus.cc:2272] T 8eede189c87343c6a45e71d7cb23c41d P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.154650  7271 tablet_replica.cc:333] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.155323  7271 raft_consensus.cc:2243] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.155886  7271 raft_consensus.cc:2272] T 7cc73085eee348a0b029b5aa5f51e288 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:25.156047 16237 leader_election.cc:336] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:25.158869  7271 tablet_replica.cc:333] T fc581e6f2f6741bc9a63c49459198306 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.159981  7271 raft_consensus.cc:2243] T fc581e6f2f6741bc9a63c49459198306 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.160566  7271 raft_consensus.cc:2272] T fc581e6f2f6741bc9a63c49459198306 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.163481  7271 tablet_replica.cc:333] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.164209  7271 raft_consensus.cc:2243] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.164803  7271 raft_consensus.cc:2272] T fe849f02803548a48394a1ff9f356f98 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.167501  7271 tablet_replica.cc:333] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.168355  7271 raft_consensus.cc:2243] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.168995  7271 raft_consensus.cc:2272] T 4e61baecc1a74998a356870a675301ea P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.171711  7271 tablet_replica.cc:333] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.172387  7271 raft_consensus.cc:2243] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.172817  7271 raft_consensus.cc:2272] T 16ba50f699994c75b3a8cc2ea2ba8cc9 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:25.173218 16236 leader_election.cc:336] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:25.173712 16236 leader_election.cc:304] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:25.174431 17363 raft_consensus.cc:2749] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:25.175228  7271 tablet_replica.cc:333] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.175957  7271 raft_consensus.cc:2243] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.176990  7271 raft_consensus.cc:2272] T 5dfecacf6d204abc99b0b341ab7256b1 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.179450  7271 tablet_replica.cc:333] T aaaad334dede46d888c92db5c932655e P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.180162  7271 raft_consensus.cc:2243] T aaaad334dede46d888c92db5c932655e P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.180665  7271 raft_consensus.cc:2272] T aaaad334dede46d888c92db5c932655e P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.183142  7271 tablet_replica.cc:333] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.183713  7271 raft_consensus.cc:2243] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.184135  7271 raft_consensus.cc:2272] T 154f438524734d2599d72ae02e2230e6 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.186239  7271 tablet_replica.cc:333] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.186761  7271 raft_consensus.cc:2243] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.187182  7271 raft_consensus.cc:2272] T d4c2d4bd133442d28d078d6fc088cff4 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.189065  7271 tablet_replica.cc:333] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.189703  7271 raft_consensus.cc:2243] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.190225  7271 raft_consensus.cc:2272] T d6c9099428b34e0f9bec85f2159b656e P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.192651  7271 tablet_replica.cc:333] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.193415  7271 raft_consensus.cc:2243] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.193979  7271 raft_consensus.cc:2272] T 16f108a2d22648a781f7e30b9730fb4a P e1e05442c5b44a079dd1de9dd124c990 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.196633  7271 tablet_replica.cc:333] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.197417  7271 raft_consensus.cc:2243] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.197991  7271 raft_consensus.cc:2272] T 27d59706e6f746aca969af7bf2206197 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.200594  7271 tablet_replica.cc:333] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.201349  7271 raft_consensus.cc:2243] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.201949  7271 raft_consensus.cc:2272] T 2fc1bcba29c24ea9b5582464ad0ba47e P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.204880  7271 tablet_replica.cc:333] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.205734  7271 raft_consensus.cc:2243] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.206817  7271 raft_consensus.cc:2272] T 4b5c33c4000f496f841f99af79e55532 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.209676  7271 tablet_replica.cc:333] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.210305  7271 raft_consensus.cc:2243] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.211155  7271 raft_consensus.cc:2272] T 9d6c90e7e1974ef0ade824c72386b5f3 P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.213354  7271 tablet_replica.cc:333] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.214155  7271 raft_consensus.cc:2243] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.215189  7271 raft_consensus.cc:2272] T e44eefc0f2e540b99fa97ec775185660 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.218037  7271 tablet_replica.cc:333] T 1be59fdebe7a44cc9f945fa9793ddfda P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.218806  7271 raft_consensus.cc:2243] T 1be59fdebe7a44cc9f945fa9793ddfda P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.219326  7271 raft_consensus.cc:2272] T 1be59fdebe7a44cc9f945fa9793ddfda P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.221894  7271 tablet_replica.cc:333] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.222604  7271 raft_consensus.cc:2243] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.223142  7271 raft_consensus.cc:2272] T 15ec9187fe3a4ca1acae98f045a1c35d P e1e05442c5b44a079dd1de9dd124c990 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.225450  7271 tablet_replica.cc:333] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.226184  7271 raft_consensus.cc:2243] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.227025  7271 raft_consensus.cc:2272] T c98ba329bddb47c5aec148957811a4c2 P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.229092  7271 tablet_replica.cc:333] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.229748  7271 raft_consensus.cc:2243] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.230484  7271 raft_consensus.cc:2272] T adc5c10cfdd24c64a4db9e4339808499 P e1e05442c5b44a079dd1de9dd124c990 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.232304  7271 tablet_replica.cc:333] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.232769  7271 raft_consensus.cc:2243] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.233210  7271 raft_consensus.cc:2272] T 8dd3bea4269f4b61adeb12a2cabaca3d P e1e05442c5b44a079dd1de9dd124c990 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.235028  7271 tablet_replica.cc:333] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.235509  7271 raft_consensus.cc:2243] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.236229  7271 raft_consensus.cc:2272] T 06d457e5782e42e78f4b0978f2b41dac P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.238178  7271 tablet_replica.cc:333] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.238615  7271 raft_consensus.cc:2243] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.238978  7271 raft_consensus.cc:2272] T 3808fd28794c4ce098037730316b2e58 P e1e05442c5b44a079dd1de9dd124c990 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.241235  7271 tablet_replica.cc:333] T a07d00d6ed2e42308d7de0f098fa286c P e1e05442c5b44a079dd1de9dd124c990: stopping tablet replica
I20260709 13:05:25.241802  7271 raft_consensus.cc:2243] T a07d00d6ed2e42308d7de0f098fa286c P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.242349  7271 raft_consensus.cc:2272] T a07d00d6ed2e42308d7de0f098fa286c P e1e05442c5b44a079dd1de9dd124c990 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:25.243580 16237 consensus_peers.cc:597] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 -> Peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Couldn't send request to peer e1e05442c5b44a079dd1de9dd124c990. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:25.317466  7271 tablet_server.cc:196] TabletServer@127.7.25.195:0 shutdown complete.
W20260709 13:05:25.322124 16237 consensus_peers.cc:597] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 -> Peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Couldn't send request to peer e1e05442c5b44a079dd1de9dd124c990. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.195:44725: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:25.336452 17363 raft_consensus.cc:493] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:25.337107 17363 raft_consensus.cc:515] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e05442c5b44a079dd1de9dd124c990" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 44725 } } peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } }
I20260709 13:05:25.344156 17363 leader_election.cc:290] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725), ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491)
W20260709 13:05:25.346274 16236 leader_election.cc:336] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
W20260709 13:05:25.352058 16237 leader_election.cc:336] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Network error: Client connection negotiation failed: client connection to 127.7.25.195:44725: connect: Connection refused (error 111)
I20260709 13:05:25.354362 16237 leader_election.cc:304] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: e1e05442c5b44a079dd1de9dd124c990, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:25.356000 17252 raft_consensus.cc:2749] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:25.363929 17367 raft_consensus.cc:493] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:25.364579 17367 raft_consensus.cc:515] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:25.367002 17367 leader_election.cc:290] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
I20260709 13:05:25.367549 17367 raft_consensus.cc:493] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:25.368093 17367 raft_consensus.cc:515] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:25.370317 17367 leader_election.cc:290] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
W20260709 13:05:25.372566 16237 leader_election.cc:336] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Network error: Client connection negotiation failed: client connection to 127.7.25.194:45195: connect: Connection refused (error 111)
W20260709 13:05:25.373216 16236 leader_election.cc:336] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:25.373669 16236 leader_election.cc:304] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:25.374444 17367 raft_consensus.cc:2749] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:25.375866 16237 leader_election.cc:336] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Network error: Client connection negotiation failed: client connection to 127.7.25.194:45195: connect: Connection refused (error 111)
W20260709 13:05:25.377542 16236 leader_election.cc:336] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
I20260709 13:05:25.377931 16236 leader_election.cc:304] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:25.378523 17367 raft_consensus.cc:2749] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:25.402911  7271 tablet_server.cc:179] TabletServer@127.7.25.196:0 shutting down...
I20260709 13:05:25.414924 17367 raft_consensus.cc:493] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ec8b54f5a9e44f428a4d537391138dcf)
I20260709 13:05:25.415663 17367 raft_consensus.cc:515] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e22ad700e94d1095c014708c364bb7" member_type: VOTER last_known_addr { host: "127.7.25.196" port: 41631 } } peers { permanent_uuid: "ec8b54f5a9e44f428a4d537391138dcf" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 44491 } } peers { permanent_uuid: "36b15691c8e648a18b69e98bee3349b4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45195 } }
I20260709 13:05:25.417922 17367 leader_election.cc:290] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491), 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195)
W20260709 13:05:25.429315 16236 leader_election.cc:336] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ec8b54f5a9e44f428a4d537391138dcf (127.7.25.193:44491): Network error: Client connection negotiation failed: client connection to 127.7.25.193:44491: connect: Connection refused (error 111)
W20260709 13:05:25.431116 16237 leader_election.cc:336] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 36b15691c8e648a18b69e98bee3349b4 (127.7.25.194:45195): Network error: Client connection negotiation failed: client connection to 127.7.25.194:45195: connect: Connection refused (error 111)
I20260709 13:05:25.431612 16237 leader_election.cc:304] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2e22ad700e94d1095c014708c364bb7; no voters: 36b15691c8e648a18b69e98bee3349b4, ec8b54f5a9e44f428a4d537391138dcf
I20260709 13:05:25.432731 17367 raft_consensus.cc:2749] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:25.436592 16237 consensus_peers.cc:597] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 -> Peer e1e05442c5b44a079dd1de9dd124c990 (127.7.25.195:44725): Couldn't send request to peer e1e05442c5b44a079dd1de9dd124c990. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.195:44725: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:25.452824  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:25.453770  7271 tablet_replica.cc:333] T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.454571  7271 raft_consensus.cc:2243] T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.455120  7271 raft_consensus.cc:2272] T ae83b44932ca4fd0a40b66c6e8061284 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.457265  7271 tablet_replica.cc:333] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.457862  7271 raft_consensus.cc:2243] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.458314  7271 raft_consensus.cc:2272] T 85079923151849059accd1b7c27d4699 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.460244  7271 tablet_replica.cc:333] T 2fc1bcba29c24ea9b5582464ad0ba47e P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.460856  7271 raft_consensus.cc:2243] T 2fc1bcba29c24ea9b5582464ad0ba47e P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.461488  7271 raft_consensus.cc:2272] T 2fc1bcba29c24ea9b5582464ad0ba47e P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.464180  7271 tablet_replica.cc:333] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.465056  7271 raft_consensus.cc:2243] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.465618  7271 raft_consensus.cc:2272] T 4b5c33c4000f496f841f99af79e55532 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.468350  7271 tablet_replica.cc:333] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.468918  7271 raft_consensus.cc:2243] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.469357  7271 raft_consensus.cc:2272] T e1713f6b73c3463c87e7eb5c94959eb0 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.471167  7271 tablet_replica.cc:333] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.471746  7271 raft_consensus.cc:2243] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.472178  7271 raft_consensus.cc:2272] T 15550bacc7b04df9bc56ec154f31b50b P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.474241  7271 tablet_replica.cc:333] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.474783  7271 raft_consensus.cc:2243] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.475244  7271 raft_consensus.cc:2272] T 3589ea61d3c14d5da5f955ac6d719881 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.477057  7271 tablet_replica.cc:333] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.477629  7271 raft_consensus.cc:2243] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.478353  7271 raft_consensus.cc:2272] T c6c51469e614423d8a9cc50e024cf468 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.480168  7271 tablet_replica.cc:333] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.480726  7271 raft_consensus.cc:2243] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.481534  7271 raft_consensus.cc:2272] T ffc93f8cfc444912a0c7ef667a931a5c P d2e22ad700e94d1095c014708c364bb7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.483750  7271 tablet_replica.cc:333] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.484454  7271 raft_consensus.cc:2243] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.485404  7271 raft_consensus.cc:2272] T c600c8f1ec454bc0b4a3716ea85d8499 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.487416  7271 tablet_replica.cc:333] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.487950  7271 raft_consensus.cc:2243] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.488379  7271 raft_consensus.cc:2272] T 3f21b3c8be8f42be9186b827a2a086e3 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.490329  7271 tablet_replica.cc:333] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.490886  7271 raft_consensus.cc:2243] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.491668  7271 raft_consensus.cc:2272] T 5e6e04804ef846e8b828194d87904eaa P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.493793  7271 tablet_replica.cc:333] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.494354  7271 raft_consensus.cc:2243] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.495091  7271 raft_consensus.cc:2272] T 48faa67625c143aa8ce08eb068a3a8dc P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.496958  7271 tablet_replica.cc:333] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.497519  7271 raft_consensus.cc:2243] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.498309  7271 raft_consensus.cc:2272] T 379913b2ca6a49e9bfd93ca8b06c9fee P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.500120  7271 tablet_replica.cc:333] T c32eb3a1727b42348bb90a85f5f0e419 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.500617  7271 raft_consensus.cc:2243] T c32eb3a1727b42348bb90a85f5f0e419 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.500962  7271 raft_consensus.cc:2272] T c32eb3a1727b42348bb90a85f5f0e419 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.502873  7271 tablet_replica.cc:333] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.503428  7271 raft_consensus.cc:2243] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.503865  7271 raft_consensus.cc:2272] T 522541a48c1647ccaf475543121810d2 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.505650  7271 tablet_replica.cc:333] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.506194  7271 raft_consensus.cc:2243] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.506603  7271 raft_consensus.cc:2272] T 6f053de7054c4b3786ffa35aa5accb15 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.508460  7271 tablet_replica.cc:333] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.508999  7271 raft_consensus.cc:2243] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.509503  7271 raft_consensus.cc:2272] T 08a6b0df9a4d4b55a27f4ffb956db8d0 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.511269  7271 tablet_replica.cc:333] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.511816  7271 raft_consensus.cc:2243] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.512220  7271 raft_consensus.cc:2272] T 09412044d26f417da5c842c8acf1149d P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.514178  7271 tablet_replica.cc:333] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.514724  7271 raft_consensus.cc:2243] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.515170  7271 raft_consensus.cc:2272] T 76c283cfd76b4e9aacd796f6ead6e4b8 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.516968  7271 tablet_replica.cc:333] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.517580  7271 raft_consensus.cc:2243] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.518070  7271 raft_consensus.cc:2272] T 5dfecacf6d204abc99b0b341ab7256b1 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.520689  7271 tablet_replica.cc:333] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.521476  7271 raft_consensus.cc:2243] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.522449  7271 raft_consensus.cc:2272] T fe849f02803548a48394a1ff9f356f98 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.524907  7271 tablet_replica.cc:333] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.525728  7271 raft_consensus.cc:2243] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.526203  7271 raft_consensus.cc:2272] T fc581e6f2f6741bc9a63c49459198306 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.528149  7271 tablet_replica.cc:333] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.528663  7271 raft_consensus.cc:2243] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.528997  7271 raft_consensus.cc:2272] T e44eefc0f2e540b99fa97ec775185660 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.530839  7271 tablet_replica.cc:333] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.531309  7271 raft_consensus.cc:2243] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.531662  7271 raft_consensus.cc:2272] T 15ec9187fe3a4ca1acae98f045a1c35d P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.533432  7271 tablet_replica.cc:333] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.534024  7271 raft_consensus.cc:2243] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.534373  7271 raft_consensus.cc:2272] T 27d59706e6f746aca969af7bf2206197 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.536127  7271 tablet_replica.cc:333] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.536592  7271 raft_consensus.cc:2243] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.537343  7271 raft_consensus.cc:2272] T 368367d6b6834e7b841b41cd87884744 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.539058  7271 tablet_replica.cc:333] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.539528  7271 raft_consensus.cc:2243] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.540167  7271 raft_consensus.cc:2272] T 406b6fe9ceac45fb8a980a2feb9cc063 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.542093  7271 tablet_replica.cc:333] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.542565  7271 raft_consensus.cc:2243] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.542945  7271 raft_consensus.cc:2272] T d6c9099428b34e0f9bec85f2159b656e P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.544700  7271 tablet_replica.cc:333] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.545253  7271 raft_consensus.cc:2243] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.545931  7271 raft_consensus.cc:2272] T eac8a97b1adc49389919710edf7c5e03 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.547683  7271 tablet_replica.cc:333] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.548134  7271 raft_consensus.cc:2243] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.548823  7271 raft_consensus.cc:2272] T 154f438524734d2599d72ae02e2230e6 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.550817  7271 tablet_replica.cc:333] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.551316  7271 raft_consensus.cc:2243] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.551719  7271 raft_consensus.cc:2272] T 1353edd9d7d544b890b5ba9ca2c72872 P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.553418  7271 tablet_replica.cc:333] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.553879  7271 raft_consensus.cc:2243] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.554311  7271 raft_consensus.cc:2272] T 7cc73085eee348a0b029b5aa5f51e288 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.556180  7271 tablet_replica.cc:333] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.556645  7271 raft_consensus.cc:2243] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.557003  7271 raft_consensus.cc:2272] T ea7b2b72b2df44e89e8b76fa65501951 P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.558851  7271 tablet_replica.cc:333] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.559312  7271 raft_consensus.cc:2243] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.559978  7271 raft_consensus.cc:2272] T 3b3ffb334ab54abb8bdb4893844c3b6b P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.561856  7271 tablet_replica.cc:333] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.562319  7271 raft_consensus.cc:2243] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.562671  7271 raft_consensus.cc:2272] T baa51a24c3524741836e9666f1b4babe P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.564445  7271 tablet_replica.cc:333] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.564926  7271 raft_consensus.cc:2243] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.565356  7271 raft_consensus.cc:2272] T fe9bf004f8eb4f0f910840561945e386 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.567070  7271 tablet_replica.cc:333] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.567567  7271 raft_consensus.cc:2243] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.568373  7271 raft_consensus.cc:2272] T 8dd3bea4269f4b61adeb12a2cabaca3d P d2e22ad700e94d1095c014708c364bb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.570122  7271 tablet_replica.cc:333] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.570771  7271 raft_consensus.cc:2243] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.571220  7271 raft_consensus.cc:2272] T 06d457e5782e42e78f4b0978f2b41dac P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.573206  7271 tablet_replica.cc:333] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.573719  7271 raft_consensus.cc:2243] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.574108  7271 raft_consensus.cc:2272] T 3808fd28794c4ce098037730316b2e58 P d2e22ad700e94d1095c014708c364bb7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.575927  7271 tablet_replica.cc:333] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.576428  7271 raft_consensus.cc:2243] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.577241  7271 raft_consensus.cc:2272] T a07d00d6ed2e42308d7de0f098fa286c P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.579236  7271 tablet_replica.cc:333] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.579721  7271 raft_consensus.cc:2243] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.580144  7271 raft_consensus.cc:2272] T c98ba329bddb47c5aec148957811a4c2 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.582094  7271 tablet_replica.cc:333] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.582610  7271 raft_consensus.cc:2243] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.583025  7271 raft_consensus.cc:2272] T adc5c10cfdd24c64a4db9e4339808499 P d2e22ad700e94d1095c014708c364bb7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.584949  7271 tablet_replica.cc:333] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7: stopping tablet replica
I20260709 13:05:25.585430  7271 raft_consensus.cc:2243] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.586169  7271 raft_consensus.cc:2272] T f697dfb6287b4feeac50690912201da2 P d2e22ad700e94d1095c014708c364bb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.654706  7271 tablet_server.cc:196] TabletServer@127.7.25.196:0 shutdown complete.
I20260709 13:05:25.718737  7271 master.cc:562] Master@127.7.25.254:39391 shutting down...
I20260709 13:05:25.744436  7271 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:25.745024  7271 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.745430  7271 tablet_replica.cc:333] T 00000000000000000000000000000000 P 05e762bf99a14b7b95889a4341734e8b: stopping tablet replica
I20260709 13:05:25.798915  7271 master.cc:584] Master@127.7.25.254:39391 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (39166 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:05:25.890237  7271 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.25.254:42097
I20260709 13:05:25.891408  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:25.897387 17368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:25.897397 17369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:25.898572 17371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:25.899439  7271 server_base.cc:1061] running on GCE node
I20260709 13:05:25.900609  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:25.900792  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:25.900911  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602325900900 us; error 0 us; skew 500 ppm
I20260709 13:05:25.901443  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:25.903779  7271 webserver.cc:533] Webserver started at http://127.7.25.254:40163/ using document root <none> and password file <none>
I20260709 13:05:25.904217  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:25.904368  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:25.904572  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:25.905711  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/master-0-root/instance:
uuid: "9fa82b94b12841f3a615c5fa4f2d5596"
format_stamp: "Formatted at 2026-07-09 13:05:25 on dist-test-slave-z1zn"
I20260709 13:05:25.910079  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:25.913538 17376 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:25.914366  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:25.914655  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/master-0-root
uuid: "9fa82b94b12841f3a615c5fa4f2d5596"
format_stamp: "Formatted at 2026-07-09 13:05:25 on dist-test-slave-z1zn"
I20260709 13:05:25.914948  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:25.944482  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:25.945804  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:25.985023  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.254:42097
I20260709 13:05:25.985261 17427 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.254:42097 every 8 connection(s)
I20260709 13:05:25.988976 17428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.001348 17428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596: Bootstrap starting.
I20260709 13:05:26.007367 17428 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.012112 17428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596: No bootstrap required, opened a new log
I20260709 13:05:26.014647 17428 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa82b94b12841f3a615c5fa4f2d5596" member_type: VOTER }
I20260709 13:05:26.015125 17428 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:26.015394 17428 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa82b94b12841f3a615c5fa4f2d5596, State: Initialized, Role: FOLLOWER
I20260709 13:05:26.016139 17428 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa82b94b12841f3a615c5fa4f2d5596" member_type: VOTER }
I20260709 13:05:26.016644 17428 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:26.016873 17428 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:26.017264 17428 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:26.022313 17428 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa82b94b12841f3a615c5fa4f2d5596" member_type: VOTER }
I20260709 13:05:26.022851 17428 leader_election.cc:304] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9fa82b94b12841f3a615c5fa4f2d5596; no voters: 
I20260709 13:05:26.024003 17428 leader_election.cc:290] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:26.024449 17431 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:26.026067 17431 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596 [term 1 LEADER]: Becoming Leader. State: Replica: 9fa82b94b12841f3a615c5fa4f2d5596, State: Running, Role: LEADER
I20260709 13:05:26.026795 17431 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa82b94b12841f3a615c5fa4f2d5596" member_type: VOTER }
I20260709 13:05:26.027537 17428 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:26.031498 17433 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fa82b94b12841f3a615c5fa4f2d5596. Latest consensus state: current_term: 1 leader_uuid: "9fa82b94b12841f3a615c5fa4f2d5596" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa82b94b12841f3a615c5fa4f2d5596" member_type: VOTER } }
I20260709 13:05:26.032366 17433 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:26.032197 17432 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9fa82b94b12841f3a615c5fa4f2d5596" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa82b94b12841f3a615c5fa4f2d5596" member_type: VOTER } }
I20260709 13:05:26.033942 17432 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:26.034647 17438 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:26.040330 17438 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:26.047528  7271 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:26.050642 17438 catalog_manager.cc:1383] Generated new cluster ID: 3785019144854914a623453b65af8324
I20260709 13:05:26.050896 17438 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:26.064829 17438 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:26.066195 17438 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:26.079330 17438 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596: Generated new TSK 0
I20260709 13:05:26.080052 17438 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:26.116430  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:26.122830 17449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:26.123672 17450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:26.125311 17452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:26.126073  7271 server_base.cc:1061] running on GCE node
I20260709 13:05:26.127089  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:26.127290  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:26.127480  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602326127460 us; error 0 us; skew 500 ppm
I20260709 13:05:26.128007  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:26.131283  7271 webserver.cc:533] Webserver started at http://127.7.25.193:44143/ using document root <none> and password file <none>
I20260709 13:05:26.131994  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:26.132261  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:26.132627  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:26.134359  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/ts-0-root/instance:
uuid: "c5b90468d1744a1b9427045ee17ce894"
format_stamp: "Formatted at 2026-07-09 13:05:26 on dist-test-slave-z1zn"
I20260709 13:05:26.140033  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:05:26.143573 17457 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:26.144361  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:05:26.144686  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/ts-0-root
uuid: "c5b90468d1744a1b9427045ee17ce894"
format_stamp: "Formatted at 2026-07-09 13:05:26 on dist-test-slave-z1zn"
I20260709 13:05:26.144963  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:26.159794  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:26.161134  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:26.162691  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:26.164999  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:26.165302  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:26.165545  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:26.165730  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:26.206300  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.193:36861
I20260709 13:05:26.206420 17519 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.193:36861 every 8 connection(s)
I20260709 13:05:26.211428  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:26.219350 17524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:26.222246 17525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:26.225183  7271 server_base.cc:1061] running on GCE node
W20260709 13:05:26.225364 17527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:26.226656  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:26.226897  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:26.227088  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602326227073 us; error 0 us; skew 500 ppm
I20260709 13:05:26.227614  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:26.230032  7271 webserver.cc:533] Webserver started at http://127.7.25.194:34007/ using document root <none> and password file <none>
I20260709 13:05:26.230716  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:26.231001  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:26.231345  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:26.232765  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/ts-1-root/instance:
uuid: "3c3f9cdf0a9446ce8df45552a499200e"
format_stamp: "Formatted at 2026-07-09 13:05:26 on dist-test-slave-z1zn"
I20260709 13:05:26.234542 17520 heartbeater.cc:344] Connected to a master server at 127.7.25.254:42097
I20260709 13:05:26.235021 17520 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:26.235954 17520 heartbeater.cc:507] Master 127.7.25.254:42097 requested a full tablet report, sending...
I20260709 13:05:26.238555 17393 ts_manager.cc:194] Registered new tserver with Master: c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861)
I20260709 13:05:26.238870  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:05:26.240413 17393 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49248
I20260709 13:05:26.242511 17532 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:26.243386  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:26.243690  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/ts-1-root
uuid: "3c3f9cdf0a9446ce8df45552a499200e"
format_stamp: "Formatted at 2026-07-09 13:05:26 on dist-test-slave-z1zn"
I20260709 13:05:26.243966  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:26.267343  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:26.268580  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:26.270090  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:26.272429  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:26.272655  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:26.272899  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:26.273070  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:26.313561  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.194:45125
I20260709 13:05:26.313697 17594 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.194:45125 every 8 connection(s)
I20260709 13:05:26.318694  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:26.326442 17598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:26.330211 17599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:26.331846 17601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:26.332674 17595 heartbeater.cc:344] Connected to a master server at 127.7.25.254:42097
I20260709 13:05:26.332856  7271 server_base.cc:1061] running on GCE node
I20260709 13:05:26.333232 17595 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:26.333981  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:26.334250  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:26.334118 17595 heartbeater.cc:507] Master 127.7.25.254:42097 requested a full tablet report, sending...
I20260709 13:05:26.334606  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602326334566 us; error 0 us; skew 500 ppm
I20260709 13:05:26.335384  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:26.336714 17393 ts_manager.cc:194] Registered new tserver with Master: 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125)
I20260709 13:05:26.338027  7271 webserver.cc:533] Webserver started at http://127.7.25.195:44503/ using document root <none> and password file <none>
I20260709 13:05:26.338436 17393 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49252
I20260709 13:05:26.338614  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:26.338973  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:26.339274  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:26.340510  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/ts-2-root/instance:
uuid: "3a88f06fc6204d8db7657213d85a020a"
format_stamp: "Formatted at 2026-07-09 13:05:26 on dist-test-slave-z1zn"
I20260709 13:05:26.345338  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:05:26.349056 17606 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:26.350040  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:05:26.350363  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/ts-2-root
uuid: "3a88f06fc6204d8db7657213d85a020a"
format_stamp: "Formatted at 2026-07-09 13:05:26 on dist-test-slave-z1zn"
I20260709 13:05:26.350621  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:26.360551  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:26.361824  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:26.363308  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:26.365605  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:26.365829  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:26.366096  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:26.366248  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:26.407931  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.195:43905
I20260709 13:05:26.408068 17668 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.195:43905 every 8 connection(s)
I20260709 13:05:26.422972 17669 heartbeater.cc:344] Connected to a master server at 127.7.25.254:42097
I20260709 13:05:26.423408 17669 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:26.424068 17669 heartbeater.cc:507] Master 127.7.25.254:42097 requested a full tablet report, sending...
I20260709 13:05:26.426087 17393 ts_manager.cc:194] Registered new tserver with Master: 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:26.426707  7271 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01541373s
I20260709 13:05:26.427488 17393 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49268
I20260709 13:05:26.453406 17393 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49278:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:26.456439 17393 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:26.530596 17484 tablet_service.cc:1511] Processing CreateTablet for tablet b1162ebdc359462e918f6aa54bf485eb (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:26.531543 17483 tablet_service.cc:1511] Processing CreateTablet for tablet d4d897bb6b06464c988dee1dc7fcd7e3 (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:26.532198 17484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1162ebdc359462e918f6aa54bf485eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.532915 17483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4d897bb6b06464c988dee1dc7fcd7e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.533584 17634 tablet_service.cc:1511] Processing CreateTablet for tablet f3c15862f65e48e4a4d1f2bb361fa5ab (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:26.535081 17634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3c15862f65e48e4a4d1f2bb361fa5ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.535535 17485 tablet_service.cc:1511] Processing CreateTablet for tablet f3c15862f65e48e4a4d1f2bb361fa5ab (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:26.536870 17485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3c15862f65e48e4a4d1f2bb361fa5ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.538250 17633 tablet_service.cc:1511] Processing CreateTablet for tablet b1162ebdc359462e918f6aa54bf485eb (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:26.539574 17633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1162ebdc359462e918f6aa54bf485eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.543727 17560 tablet_service.cc:1511] Processing CreateTablet for tablet f3c15862f65e48e4a4d1f2bb361fa5ab (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:26.545070 17560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3c15862f65e48e4a4d1f2bb361fa5ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.546311 17559 tablet_service.cc:1511] Processing CreateTablet for tablet b1162ebdc359462e918f6aa54bf485eb (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:26.550536 17559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1162ebdc359462e918f6aa54bf485eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.558564 17558 tablet_service.cc:1511] Processing CreateTablet for tablet d4d897bb6b06464c988dee1dc7fcd7e3 (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:26.560120 17558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4d897bb6b06464c988dee1dc7fcd7e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.561774 17632 tablet_service.cc:1511] Processing CreateTablet for tablet d4d897bb6b06464c988dee1dc7fcd7e3 (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:26.563820 17632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4d897bb6b06464c988dee1dc7fcd7e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.572811 17482 tablet_service.cc:1511] Processing CreateTablet for tablet d6e78ccea70b40fc97e68e533dcc0265 (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:26.574393 17482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6e78ccea70b40fc97e68e533dcc0265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.576740 17631 tablet_service.cc:1511] Processing CreateTablet for tablet d6e78ccea70b40fc97e68e533dcc0265 (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:26.578342 17557 tablet_service.cc:1511] Processing CreateTablet for tablet d6e78ccea70b40fc97e68e533dcc0265 (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:26.579792 17557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6e78ccea70b40fc97e68e533dcc0265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.578392 17631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6e78ccea70b40fc97e68e533dcc0265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.586117 17481 tablet_service.cc:1511] Processing CreateTablet for tablet 04b29f7376784d9a9effcc3d1f370edf (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:26.587545 17481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04b29f7376784d9a9effcc3d1f370edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.590270 17556 tablet_service.cc:1511] Processing CreateTablet for tablet 04b29f7376784d9a9effcc3d1f370edf (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:26.590963 17630 tablet_service.cc:1511] Processing CreateTablet for tablet 04b29f7376784d9a9effcc3d1f370edf (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:26.592339 17630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04b29f7376784d9a9effcc3d1f370edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.597442 17556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04b29f7376784d9a9effcc3d1f370edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.630172 17485 tablet_service.cc:1511] Processing CreateTablet for tablet a4ea05cdff60471d8544f2da34ae4243 (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:26.631709 17485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4ea05cdff60471d8544f2da34ae4243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.645042 17555 tablet_service.cc:1511] Processing CreateTablet for tablet a4ea05cdff60471d8544f2da34ae4243 (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:26.647009 17555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4ea05cdff60471d8544f2da34ae4243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.658106 17684 tablet_bootstrap.cc:492] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894: Bootstrap starting.
I20260709 13:05:26.668789 17683 tablet_bootstrap.cc:492] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a: Bootstrap starting.
I20260709 13:05:26.676097 17633 tablet_service.cc:1511] Processing CreateTablet for tablet a4ea05cdff60471d8544f2da34ae4243 (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:26.677605 17633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4ea05cdff60471d8544f2da34ae4243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.678793 17559 tablet_service.cc:1511] Processing CreateTablet for tablet e01d0c0226174b62940910e6842d3d6f (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:26.679456 17481 tablet_service.cc:1511] Processing CreateTablet for tablet e01d0c0226174b62940910e6842d3d6f (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:26.680356 17559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e01d0c0226174b62940910e6842d3d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.684661 17631 tablet_service.cc:1511] Processing CreateTablet for tablet e01d0c0226174b62940910e6842d3d6f (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:26.685812 17685 tablet_bootstrap.cc:492] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e: Bootstrap starting.
I20260709 13:05:26.686102 17631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e01d0c0226174b62940910e6842d3d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.697131 17482 tablet_service.cc:1511] Processing CreateTablet for tablet 6a96d46137374b208ccaa960ce9530ae (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:26.686522 17481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e01d0c0226174b62940910e6842d3d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.691040 17684 tablet_bootstrap.cc:654] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.690994 17484 tablet_service.cc:1511] Processing CreateTablet for tablet b87e0199ea6c47ea87b84ef639cae449 (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:26.702519 17685 tablet_bootstrap.cc:654] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.703117 17484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b87e0199ea6c47ea87b84ef639cae449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.694679 17630 tablet_service.cc:1511] Processing CreateTablet for tablet b87e0199ea6c47ea87b84ef639cae449 (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:26.704644 17630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b87e0199ea6c47ea87b84ef639cae449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.711817 17683 tablet_bootstrap.cc:654] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.712594 17482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a96d46137374b208ccaa960ce9530ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.720518 17560 tablet_service.cc:1511] Processing CreateTablet for tablet 6a96d46137374b208ccaa960ce9530ae (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:26.721952 17560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a96d46137374b208ccaa960ce9530ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.726657 17633 tablet_service.cc:1511] Processing CreateTablet for tablet 6a96d46137374b208ccaa960ce9530ae (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:26.728070 17633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a96d46137374b208ccaa960ce9530ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.736961 17485 tablet_service.cc:1511] Processing CreateTablet for tablet 419a4a24d7264a019316d46cc4f0d807 (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:26.738920 17485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419a4a24d7264a019316d46cc4f0d807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.741293 17632 tablet_service.cc:1511] Processing CreateTablet for tablet 419a4a24d7264a019316d46cc4f0d807 (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:26.742688 17632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419a4a24d7264a019316d46cc4f0d807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.743083 17559 tablet_service.cc:1511] Processing CreateTablet for tablet 419a4a24d7264a019316d46cc4f0d807 (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:26.745016 17559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419a4a24d7264a019316d46cc4f0d807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.693382 17558 tablet_service.cc:1511] Processing CreateTablet for tablet b87e0199ea6c47ea87b84ef639cae449 (DEFAULT_TABLE table=test-workload [id=5d05a66eea0d490598d0b3273f16b47b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:26.764288 17685 tablet_bootstrap.cc:492] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e: No bootstrap required, opened a new log
I20260709 13:05:26.764844 17685 ts_tablet_manager.cc:1403] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e: Time spent bootstrapping tablet: real 0.087s	user 0.025s	sys 0.031s
I20260709 13:05:26.771762 17685 raft_consensus.cc:359] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.772573 17685 raft_consensus.cc:385] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:26.772884 17685 raft_consensus.cc:740] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Initialized, Role: FOLLOWER
I20260709 13:05:26.773747 17685 consensus_queue.cc:260] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.780328 17558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b87e0199ea6c47ea87b84ef639cae449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:26.788303 17684 tablet_bootstrap.cc:492] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894: No bootstrap required, opened a new log
I20260709 13:05:26.788992 17684 ts_tablet_manager.cc:1403] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894: Time spent bootstrapping tablet: real 0.131s	user 0.009s	sys 0.003s
I20260709 13:05:26.792389 17684 raft_consensus.cc:359] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.793224 17684 raft_consensus.cc:385] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:26.793789 17684 raft_consensus.cc:740] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Initialized, Role: FOLLOWER
I20260709 13:05:26.795848 17595 heartbeater.cc:499] Master 127.7.25.254:42097 was elected leader, sending a full tablet report...
I20260709 13:05:26.795830 17684 consensus_queue.cc:260] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.798246 17685 ts_tablet_manager.cc:1434] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.020s
I20260709 13:05:26.798892 17683 tablet_bootstrap.cc:492] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a: No bootstrap required, opened a new log
I20260709 13:05:26.799432 17683 ts_tablet_manager.cc:1403] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a: Time spent bootstrapping tablet: real 0.131s	user 0.022s	sys 0.019s
I20260709 13:05:26.799530 17685 tablet_bootstrap.cc:492] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e: Bootstrap starting.
I20260709 13:05:26.802529 17683 raft_consensus.cc:359] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.803380 17683 raft_consensus.cc:385] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:26.806702 17685 tablet_bootstrap.cc:654] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.803702 17683 raft_consensus.cc:740] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Initialized, Role: FOLLOWER
W20260709 13:05:26.818274 17596 tablet.cc:2406] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:26.822646 17520 heartbeater.cc:499] Master 127.7.25.254:42097 was elected leader, sending a full tablet report...
I20260709 13:05:26.816222 17683 consensus_queue.cc:260] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.826413 17684 ts_tablet_manager.cc:1434] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894: Time spent starting tablet: real 0.037s	user 0.011s	sys 0.007s
I20260709 13:05:26.827780 17684 tablet_bootstrap.cc:492] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894: Bootstrap starting.
I20260709 13:05:26.828941 17685 tablet_bootstrap.cc:492] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e: No bootstrap required, opened a new log
I20260709 13:05:26.829682 17685 ts_tablet_manager.cc:1403] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.006s
I20260709 13:05:26.834782 17685 raft_consensus.cc:359] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.835345 17684 tablet_bootstrap.cc:654] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.837499 17685 raft_consensus.cc:385] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:26.837956 17685 raft_consensus.cc:740] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Initialized, Role: FOLLOWER
I20260709 13:05:26.838925 17685 consensus_queue.cc:260] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.841436 17685 ts_tablet_manager.cc:1434] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.008s
I20260709 13:05:26.842136 17669 heartbeater.cc:499] Master 127.7.25.254:42097 was elected leader, sending a full tablet report...
I20260709 13:05:26.842651 17685 tablet_bootstrap.cc:492] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e: Bootstrap starting.
I20260709 13:05:26.843019 17683 ts_tablet_manager.cc:1434] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.011s
I20260709 13:05:26.844169 17683 tablet_bootstrap.cc:492] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a: Bootstrap starting.
I20260709 13:05:26.852128 17683 tablet_bootstrap.cc:654] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.852339 17685 tablet_bootstrap.cc:654] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.854565 17684 tablet_bootstrap.cc:492] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894: No bootstrap required, opened a new log
I20260709 13:05:26.855218 17684 ts_tablet_manager.cc:1403] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.008s
I20260709 13:05:26.860064 17684 raft_consensus.cc:359] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } }
I20260709 13:05:26.861203 17684 raft_consensus.cc:385] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:26.861658 17684 raft_consensus.cc:740] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Initialized, Role: FOLLOWER
I20260709 13:05:26.862335 17683 tablet_bootstrap.cc:492] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a: No bootstrap required, opened a new log
I20260709 13:05:26.862887 17683 ts_tablet_manager.cc:1403] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.001s
I20260709 13:05:26.862919 17684 consensus_queue.cc:260] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } }
I20260709 13:05:26.865892 17683 raft_consensus.cc:359] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } }
I20260709 13:05:26.866341 17684 ts_tablet_manager.cc:1434] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.001s
I20260709 13:05:26.866715 17683 raft_consensus.cc:385] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:26.867120 17683 raft_consensus.cc:740] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Initialized, Role: FOLLOWER
I20260709 13:05:26.867930 17684 tablet_bootstrap.cc:492] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894: Bootstrap starting.
I20260709 13:05:26.868054 17683 consensus_queue.cc:260] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } }
I20260709 13:05:26.870733 17683 ts_tablet_manager.cc:1434] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:26.871812 17683 tablet_bootstrap.cc:492] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a: Bootstrap starting.
I20260709 13:05:26.877722 17689 raft_consensus.cc:493] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.878851 17689 raft_consensus.cc:515] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.883107 17683 tablet_bootstrap.cc:654] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.890437 17689 leader_election.cc:290] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:26.894531 17684 tablet_bootstrap.cc:654] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.896872 17683 tablet_bootstrap.cc:492] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a: No bootstrap required, opened a new log
I20260709 13:05:26.897527 17683 ts_tablet_manager.cc:1403] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.007s
I20260709 13:05:26.897835 17685 tablet_bootstrap.cc:492] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e: No bootstrap required, opened a new log
I20260709 13:05:26.898574 17685 ts_tablet_manager.cc:1403] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e: Time spent bootstrapping tablet: real 0.056s	user 0.028s	sys 0.021s
I20260709 13:05:26.900671 17683 raft_consensus.cc:359] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.901497 17683 raft_consensus.cc:385] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:26.901787 17683 raft_consensus.cc:740] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Initialized, Role: FOLLOWER
I20260709 13:05:26.902700 17683 consensus_queue.cc:260] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.904521 17685 raft_consensus.cc:359] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.905187 17683 ts_tablet_manager.cc:1434] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:26.905577 17685 raft_consensus.cc:385] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:26.905972 17685 raft_consensus.cc:740] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Initialized, Role: FOLLOWER
I20260709 13:05:26.906517 17683 tablet_bootstrap.cc:492] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a: Bootstrap starting.
I20260709 13:05:26.913602 17683 tablet_bootstrap.cc:654] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.916910 17495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1162ebdc359462e918f6aa54bf485eb" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b90468d1744a1b9427045ee17ce894" is_pre_election: true
I20260709 13:05:26.916576 17685 consensus_queue.cc:260] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.917676 17689 raft_consensus.cc:493] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.918193 17689 raft_consensus.cc:515] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
W20260709 13:05:26.918891 17534 leader_election.cc:343] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:26.922945 17684 tablet_bootstrap.cc:492] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894: No bootstrap required, opened a new log
I20260709 13:05:26.923570 17684 ts_tablet_manager.cc:1403] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.000s
I20260709 13:05:26.925365 17689 leader_election.cc:290] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:26.925690 17495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ea05cdff60471d8544f2da34ae4243" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b90468d1744a1b9427045ee17ce894" is_pre_election: true
W20260709 13:05:26.929947 17534 leader_election.cc:343] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:26.928944 17684 raft_consensus.cc:359] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.931007 17684 raft_consensus.cc:385] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:26.931370 17684 raft_consensus.cc:740] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Initialized, Role: FOLLOWER
I20260709 13:05:26.933632 17684 consensus_queue.cc:260] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.934944 17683 tablet_bootstrap.cc:492] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a: No bootstrap required, opened a new log
I20260709 13:05:26.935592 17683 ts_tablet_manager.cc:1403] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.016s
I20260709 13:05:26.935499 17644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1162ebdc359462e918f6aa54bf485eb" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a" is_pre_election: true
I20260709 13:05:26.936425 17644 raft_consensus.cc:2468] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 0.
I20260709 13:05:26.937846 17643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ea05cdff60471d8544f2da34ae4243" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a" is_pre_election: true
I20260709 13:05:26.938795 17683 raft_consensus.cc:359] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.939363 17684 ts_tablet_manager.cc:1434] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:05:26.939605 17683 raft_consensus.cc:385] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:26.939786 17533 leader_election.cc:304] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, 3c3f9cdf0a9446ce8df45552a499200e; no voters: c5b90468d1744a1b9427045ee17ce894
I20260709 13:05:26.940004 17683 raft_consensus.cc:740] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Initialized, Role: FOLLOWER
I20260709 13:05:26.940618 17684 tablet_bootstrap.cc:492] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894: Bootstrap starting.
W20260709 13:05:26.941238 17533 leader_election.cc:343] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:26.941184 17683 consensus_queue.cc:260] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.941792 17533 leader_election.cc:304] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c3f9cdf0a9446ce8df45552a499200e; no voters: 3a88f06fc6204d8db7657213d85a020a, c5b90468d1744a1b9427045ee17ce894
I20260709 13:05:26.943259 17689 raft_consensus.cc:2804] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:26.943662 17689 raft_consensus.cc:493] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.943768 17683 ts_tablet_manager.cc:1434] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:26.944088 17689 raft_consensus.cc:3060] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:26.952512 17683 tablet_bootstrap.cc:492] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a: Bootstrap starting.
I20260709 13:05:26.953832 17701 raft_consensus.cc:2749] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:26.958847 17684 tablet_bootstrap.cc:654] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.961474 17685 ts_tablet_manager.cc:1434] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.010s
I20260709 13:05:26.962849 17685 tablet_bootstrap.cc:492] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e: Bootstrap starting.
I20260709 13:05:26.959210 17701 raft_consensus.cc:493] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.964483 17689 raft_consensus.cc:515] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.965481 17701 raft_consensus.cc:515] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.968016 17495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1162ebdc359462e918f6aa54bf485eb" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:26.969250 17701 leader_election.cc:290] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:26.969170 17643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b29f7376784d9a9effcc3d1f370edf" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a" is_pre_election: true
I20260709 13:05:26.969995 17643 raft_consensus.cc:2468] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 0.
W20260709 13:05:26.970469 17534 leader_election.cc:343] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:26.970001 17685 tablet_bootstrap.cc:654] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.971267 17533 leader_election.cc:304] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, 3c3f9cdf0a9446ce8df45552a499200e; no voters: 
I20260709 13:05:26.971478 17683 tablet_bootstrap.cc:654] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:26.971446 17495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b29f7376784d9a9effcc3d1f370edf" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b90468d1744a1b9427045ee17ce894" is_pre_election: true
I20260709 13:05:26.972218 17701 raft_consensus.cc:2804] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:26.972625 17701 raft_consensus.cc:493] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.972990 17701 raft_consensus.cc:3060] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:26.973403 17534 leader_election.cc:343] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:26.976531 17643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1162ebdc359462e918f6aa54bf485eb" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
I20260709 13:05:26.977509 17643 raft_consensus.cc:3060] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:26.980572 17683 tablet_bootstrap.cc:492] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a: No bootstrap required, opened a new log
I20260709 13:05:26.981226 17683 ts_tablet_manager.cc:1403] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.004s
I20260709 13:05:26.985193 17689 leader_election.cc:290] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:26.985028 17683 raft_consensus.cc:359] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.985882 17683 raft_consensus.cc:385] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:26.986222 17683 raft_consensus.cc:740] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Initialized, Role: FOLLOWER
I20260709 13:05:26.986860 17643 raft_consensus.cc:2468] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 1.
I20260709 13:05:26.987838 17683 consensus_queue.cc:260] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.988708 17533 leader_election.cc:304] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, 3c3f9cdf0a9446ce8df45552a499200e; no voters: c5b90468d1744a1b9427045ee17ce894
I20260709 13:05:26.990110 17689 raft_consensus.cc:2804] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:26.991358 17685 tablet_bootstrap.cc:492] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e: No bootstrap required, opened a new log
I20260709 13:05:26.991393 17689 raft_consensus.cc:697] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [term 1 LEADER]: Becoming Leader. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Running, Role: LEADER
I20260709 13:05:26.992029 17685 ts_tablet_manager.cc:1403] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.012s
I20260709 13:05:26.992695 17689 consensus_queue.cc:237] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.993541 17684 tablet_bootstrap.cc:492] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894: No bootstrap required, opened a new log
I20260709 13:05:26.994073 17684 ts_tablet_manager.cc:1403] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.005s
I20260709 13:05:26.995587 17685 raft_consensus.cc:359] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } }
I20260709 13:05:26.988587 17701 raft_consensus.cc:515] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.997990 17683 ts_tablet_manager.cc:1434] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:05:26.997608 17684 raft_consensus.cc:359] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:26.998538 17684 raft_consensus.cc:385] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:26.998905 17684 raft_consensus.cc:740] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Initialized, Role: FOLLOWER
I20260709 13:05:26.999168 17683 tablet_bootstrap.cc:492] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a: Bootstrap starting.
I20260709 13:05:26.999861 17701 leader_election.cc:290] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:27.000063 17643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b29f7376784d9a9effcc3d1f370edf" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
I20260709 13:05:27.000545 17685 raft_consensus.cc:385] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.000944 17685 raft_consensus.cc:740] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.001286 17495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b29f7376784d9a9effcc3d1f370edf" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:27.002019 17685 consensus_queue.cc:260] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } }
I20260709 13:05:27.005017 17685 ts_tablet_manager.cc:1434] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:05:27.006194 17683 tablet_bootstrap.cc:654] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.006346 17685 tablet_bootstrap.cc:492] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e: Bootstrap starting.
W20260709 13:05:27.008771 17534 leader_election.cc:343] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:27.001353 17643 raft_consensus.cc:3060] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.010492 17393 catalog_manager.cc:5697] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194). New cstate: current_term: 1 leader_uuid: "3c3f9cdf0a9446ce8df45552a499200e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:27.014216 17685 tablet_bootstrap.cc:654] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.001479 17684 consensus_queue.cc:260] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.022502 17643 raft_consensus.cc:2468] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 1.
I20260709 13:05:27.025539 17685 tablet_bootstrap.cc:492] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e: No bootstrap required, opened a new log
I20260709 13:05:27.026537 17685 ts_tablet_manager.cc:1403] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 13:05:27.026317 17533 leader_election.cc:304] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, 3c3f9cdf0a9446ce8df45552a499200e; no voters: c5b90468d1744a1b9427045ee17ce894
I20260709 13:05:27.027714 17684 ts_tablet_manager.cc:1434] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:05:27.028837 17684 tablet_bootstrap.cc:492] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894: Bootstrap starting.
I20260709 13:05:27.029816 17685 raft_consensus.cc:359] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.030611 17685 raft_consensus.cc:385] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.031004 17685 raft_consensus.cc:740] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.031769 17685 consensus_queue.cc:260] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.032820 17701 raft_consensus.cc:2804] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:27.033372 17701 raft_consensus.cc:697] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [term 1 LEADER]: Becoming Leader. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Running, Role: LEADER
I20260709 13:05:27.034242 17701 consensus_queue.cc:237] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.036603 17684 tablet_bootstrap.cc:654] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:27.043753 17441 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:27.046331 17685 ts_tablet_manager.cc:1434] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:05:27.047531 17685 tablet_bootstrap.cc:492] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e: Bootstrap starting.
I20260709 13:05:27.048566 17683 tablet_bootstrap.cc:492] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a: No bootstrap required, opened a new log
I20260709 13:05:27.049310 17683 ts_tablet_manager.cc:1403] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a: Time spent bootstrapping tablet: real 0.050s	user 0.026s	sys 0.023s
I20260709 13:05:27.053268 17683 raft_consensus.cc:359] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.054111 17683 raft_consensus.cc:385] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.054481 17683 raft_consensus.cc:740] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.055572 17683 consensus_queue.cc:260] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.057912 17683 ts_tablet_manager.cc:1434] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:05:27.058990 17683 tablet_bootstrap.cc:492] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a: Bootstrap starting.
I20260709 13:05:27.065294 17683 tablet_bootstrap.cc:654] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.078610 17685 tablet_bootstrap.cc:654] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.079962 17684 tablet_bootstrap.cc:492] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894: No bootstrap required, opened a new log
I20260709 13:05:27.080554 17684 ts_tablet_manager.cc:1403] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.034s
I20260709 13:05:27.083946 17684 raft_consensus.cc:359] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.084949 17684 raft_consensus.cc:385] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.085253 17685 tablet_bootstrap.cc:492] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e: No bootstrap required, opened a new log
I20260709 13:05:27.085023 17683 tablet_bootstrap.cc:492] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a: No bootstrap required, opened a new log
I20260709 13:05:27.085538 17684 raft_consensus.cc:740] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.085953 17685 ts_tablet_manager.cc:1403] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.000s
I20260709 13:05:27.085953 17683 ts_tablet_manager.cc:1403] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.006s
I20260709 13:05:27.086925 17684 consensus_queue.cc:260] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.089375 17685 raft_consensus.cc:359] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.089568 17683 raft_consensus.cc:359] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.090171 17685 raft_consensus.cc:385] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.090358 17684 ts_tablet_manager.cc:1434] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:05:27.090466 17683 raft_consensus.cc:385] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.091169 17683 raft_consensus.cc:740] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.091650 17684 tablet_bootstrap.cc:492] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894: Bootstrap starting.
I20260709 13:05:27.090505 17685 raft_consensus.cc:740] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.092092 17683 consensus_queue.cc:260] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.092733 17685 consensus_queue.cc:260] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.094529 17683 ts_tablet_manager.cc:1434] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:27.095579 17683 tablet_bootstrap.cc:492] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a: Bootstrap starting.
I20260709 13:05:27.095655 17685 ts_tablet_manager.cc:1434] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:27.096879 17685 tablet_bootstrap.cc:492] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e: Bootstrap starting.
I20260709 13:05:27.098874 17684 tablet_bootstrap.cc:654] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.102417 17683 tablet_bootstrap.cc:654] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.104552 17685 tablet_bootstrap.cc:654] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.126521 17393 catalog_manager.cc:5697] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194). New cstate: current_term: 1 leader_uuid: "3c3f9cdf0a9446ce8df45552a499200e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:27.148516 17683 tablet_bootstrap.cc:492] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a: No bootstrap required, opened a new log
I20260709 13:05:27.148684 17685 tablet_bootstrap.cc:492] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e: No bootstrap required, opened a new log
I20260709 13:05:27.149127 17683 ts_tablet_manager.cc:1403] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a: Time spent bootstrapping tablet: real 0.054s	user 0.024s	sys 0.019s
I20260709 13:05:27.149315 17685 ts_tablet_manager.cc:1403] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e: Time spent bootstrapping tablet: real 0.053s	user 0.021s	sys 0.028s
I20260709 13:05:27.149437 17684 tablet_bootstrap.cc:492] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894: No bootstrap required, opened a new log
I20260709 13:05:27.150100 17684 ts_tablet_manager.cc:1403] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894: Time spent bootstrapping tablet: real 0.059s	user 0.032s	sys 0.022s
I20260709 13:05:27.151383 17683 raft_consensus.cc:359] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.151978 17683 raft_consensus.cc:385] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.152227 17683 raft_consensus.cc:740] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.152580 17685 raft_consensus.cc:359] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.152988 17683 consensus_queue.cc:260] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.153403 17685 raft_consensus.cc:385] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.152905 17684 raft_consensus.cc:359] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.153887 17685 raft_consensus.cc:740] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.153998 17684 raft_consensus.cc:385] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.154420 17684 raft_consensus.cc:740] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.154821 17685 consensus_queue.cc:260] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.155206 17683 ts_tablet_manager.cc:1434] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:27.155287 17684 consensus_queue.cc:260] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.156405 17683 tablet_bootstrap.cc:492] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a: Bootstrap starting.
I20260709 13:05:27.157364 17685 ts_tablet_manager.cc:1434] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:05:27.158461 17685 tablet_bootstrap.cc:492] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e: Bootstrap starting.
I20260709 13:05:27.163264 17683 tablet_bootstrap.cc:654] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.165423 17685 tablet_bootstrap.cc:654] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.169023 17684 ts_tablet_manager.cc:1434] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:05:27.173700 17692 raft_consensus.cc:493] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.174266 17692 raft_consensus.cc:515] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.177937 17692 leader_election.cc:290] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125)
I20260709 13:05:27.178064 17684 tablet_bootstrap.cc:492] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894: Bootstrap starting.
I20260709 13:05:27.198606 17690 raft_consensus.cc:493] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.199218 17690 raft_consensus.cc:515] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.204671 17683 tablet_bootstrap.cc:492] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a: No bootstrap required, opened a new log
I20260709 13:05:27.204941 17692 raft_consensus.cc:493] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.205103 17685 tablet_bootstrap.cc:492] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e: No bootstrap required, opened a new log
I20260709 13:05:27.205154 17690 leader_election.cc:290] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:27.205323 17683 ts_tablet_manager.cc:1403] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.027s
I20260709 13:05:27.206028 17685 ts_tablet_manager.cc:1403] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e: Time spent bootstrapping tablet: real 0.048s	user 0.025s	sys 0.021s
I20260709 13:05:27.205704 17692 raft_consensus.cc:515] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.206691 17690 raft_consensus.cc:493] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.207178 17690 raft_consensus.cc:515] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.208763 17692 leader_election.cc:290] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125)
I20260709 13:05:27.209015 17685 raft_consensus.cc:359] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.208762 17683 raft_consensus.cc:359] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.209908 17685 raft_consensus.cc:385] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.210081 17683 raft_consensus.cc:385] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.210336 17685 raft_consensus.cc:740] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.210427 17683 raft_consensus.cc:740] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.211406 17690 leader_election.cc:290] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:27.211284 17685 consensus_queue.cc:260] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.211422 17683 consensus_queue.cc:260] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.214242 17683 ts_tablet_manager.cc:1434] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:05:27.215294 17683 tablet_bootstrap.cc:492] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a: Bootstrap starting.
I20260709 13:05:27.216502 17685 ts_tablet_manager.cc:1434] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:05:27.217666 17685 tablet_bootstrap.cc:492] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e: Bootstrap starting.
I20260709 13:05:27.221382 17683 tablet_bootstrap.cc:654] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.223675 17685 tablet_bootstrap.cc:654] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.234090 17683 tablet_bootstrap.cc:492] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a: No bootstrap required, opened a new log
I20260709 13:05:27.234661 17683 ts_tablet_manager.cc:1403] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.011s
I20260709 13:05:27.235025 17684 tablet_bootstrap.cc:654] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.236514 17685 tablet_bootstrap.cc:492] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e: No bootstrap required, opened a new log
I20260709 13:05:27.237164 17685 ts_tablet_manager.cc:1403] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e: Time spent bootstrapping tablet: real 0.020s	user 0.002s	sys 0.016s
I20260709 13:05:27.237816 17683 raft_consensus.cc:359] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.238615 17683 raft_consensus.cc:385] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.238912 17683 raft_consensus.cc:740] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.239778 17683 consensus_queue.cc:260] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.242376 17683 ts_tablet_manager.cc:1434] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:27.242039 17685 raft_consensus.cc:359] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.243119 17685 raft_consensus.cc:385] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.243484 17685 raft_consensus.cc:740] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.244300 17685 consensus_queue.cc:260] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.246803 17495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d897bb6b06464c988dee1dc7fcd7e3" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b90468d1744a1b9427045ee17ce894" is_pre_election: true
I20260709 13:05:27.247494 17495 raft_consensus.cc:2468] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 0.
I20260709 13:05:27.247879 17685 ts_tablet_manager.cc:1434] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:05:27.248844 17685 tablet_bootstrap.cc:492] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e: Bootstrap starting.
I20260709 13:05:27.248673 17494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e78ccea70b40fc97e68e533dcc0265" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b90468d1744a1b9427045ee17ce894" is_pre_election: true
I20260709 13:05:27.249441 17494 raft_consensus.cc:2468] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 0.
I20260709 13:05:27.251070 17608 leader_election.cc:304] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:27.252007 17608 leader_election.cc:304] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:27.253242 17692 raft_consensus.cc:2804] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:27.253619 17692 raft_consensus.cc:493] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.253949 17692 raft_consensus.cc:3060] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.255388 17685 tablet_bootstrap.cc:654] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.258785 17570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d897bb6b06464c988dee1dc7fcd7e3" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e" is_pre_election: true
I20260709 13:05:27.259495 17570 raft_consensus.cc:2468] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 0.
I20260709 13:05:27.260753 17569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e78ccea70b40fc97e68e533dcc0265" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e" is_pre_election: true
I20260709 13:05:27.261475 17569 raft_consensus.cc:2468] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 0.
I20260709 13:05:27.268326 17692 raft_consensus.cc:515] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.271672 17643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b29f7376784d9a9effcc3d1f370edf" candidate_uuid: "c5b90468d1744a1b9427045ee17ce894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a" is_pre_election: true
I20260709 13:05:27.272531 17643 raft_consensus.cc:2393] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5b90468d1744a1b9427045ee17ce894 in current term 1: Already voted for candidate 3c3f9cdf0a9446ce8df45552a499200e in this term.
I20260709 13:05:27.273063 17684 tablet_bootstrap.cc:492] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894: No bootstrap required, opened a new log
I20260709 13:05:27.273757 17684 ts_tablet_manager.cc:1403] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894: Time spent bootstrapping tablet: real 0.097s	user 0.014s	sys 0.000s
I20260709 13:05:27.274771 17643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d897bb6b06464c988dee1dc7fcd7e3" candidate_uuid: "c5b90468d1744a1b9427045ee17ce894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a" is_pre_election: true
I20260709 13:05:27.275622 17643 raft_consensus.cc:2393] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5b90468d1744a1b9427045ee17ce894 in current term 1: Already voted for candidate 3a88f06fc6204d8db7657213d85a020a in this term.
I20260709 13:05:27.277024 17684 raft_consensus.cc:359] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.277393 17692 leader_election.cc:290] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 1 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125)
I20260709 13:05:27.277850 17684 raft_consensus.cc:385] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.277966 17569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d897bb6b06464c988dee1dc7fcd7e3" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
I20260709 13:05:27.279776 17684 raft_consensus.cc:740] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.279927 17569 raft_consensus.cc:3060] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.280720 17684 consensus_queue.cc:260] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.282574 17685 tablet_bootstrap.cc:492] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e: No bootstrap required, opened a new log
I20260709 13:05:27.283206 17685 ts_tablet_manager.cc:1403] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.016s
I20260709 13:05:27.283286 17684 ts_tablet_manager.cc:1434] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:27.284422 17684 tablet_bootstrap.cc:492] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894: Bootstrap starting.
I20260709 13:05:27.275074 17729 raft_consensus.cc:2804] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:27.278605 17494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d897bb6b06464c988dee1dc7fcd7e3" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:27.285447 17729 raft_consensus.cc:493] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.286201 17494 raft_consensus.cc:3060] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.286439 17729 raft_consensus.cc:3060] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.286446 17685 raft_consensus.cc:359] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.288928 17685 raft_consensus.cc:385] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.289230 17690 raft_consensus.cc:493] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.289341 17685 raft_consensus.cc:740] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.289855 17690 raft_consensus.cc:515] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.290323 17685 consensus_queue.cc:260] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.292143 17690 leader_election.cc:290] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:27.292694 17685 ts_tablet_manager.cc:1434] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:05:27.294099 17684 tablet_bootstrap.cc:654] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.295128 17494 raft_consensus.cc:2468] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 1.
I20260709 13:05:27.296758 17608 leader_election.cc:304] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:27.297395 17569 raft_consensus.cc:2468] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 1.
I20260709 13:05:27.297606 17692 raft_consensus.cc:2804] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:27.303531 17729 raft_consensus.cc:515] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.306160 17729 leader_election.cc:290] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 1 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125)
I20260709 13:05:27.306068 17643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ea05cdff60471d8544f2da34ae4243" candidate_uuid: "c5b90468d1744a1b9427045ee17ce894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a" is_pre_election: true
I20260709 13:05:27.306802 17494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e78ccea70b40fc97e68e533dcc0265" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:27.306986 17643 raft_consensus.cc:2468] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5b90468d1744a1b9427045ee17ce894 in term 0.
I20260709 13:05:27.307422 17494 raft_consensus.cc:3060] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.309227 17570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b29f7376784d9a9effcc3d1f370edf" candidate_uuid: "c5b90468d1744a1b9427045ee17ce894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e" is_pre_election: true
I20260709 13:05:27.309341 17569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e78ccea70b40fc97e68e533dcc0265" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
I20260709 13:05:27.310032 17569 raft_consensus.cc:3060] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.310710 17568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d897bb6b06464c988dee1dc7fcd7e3" candidate_uuid: "c5b90468d1744a1b9427045ee17ce894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e" is_pre_election: true
I20260709 13:05:27.311108 17458 leader_election.cc:304] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:27.311558 17568 raft_consensus.cc:2393] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5b90468d1744a1b9427045ee17ce894 in current term 1: Already voted for candidate 3a88f06fc6204d8db7657213d85a020a in this term.
I20260709 13:05:27.312175 17690 raft_consensus.cc:2804] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:27.312590 17690 raft_consensus.cc:493] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.312716 17458 leader_election.cc:304] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5b90468d1744a1b9427045ee17ce894; no voters: 3a88f06fc6204d8db7657213d85a020a, 3c3f9cdf0a9446ce8df45552a499200e
I20260709 13:05:27.313026 17690 raft_consensus.cc:3060] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.316284 17570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ea05cdff60471d8544f2da34ae4243" candidate_uuid: "c5b90468d1744a1b9427045ee17ce894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e" is_pre_election: true
I20260709 13:05:27.317152 17570 raft_consensus.cc:2468] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5b90468d1744a1b9427045ee17ce894 in term 0.
I20260709 13:05:27.323720 17690 raft_consensus.cc:515] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.331176 17692 raft_consensus.cc:697] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 1 LEADER]: Becoming Leader. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Running, Role: LEADER
I20260709 13:05:27.332580 17692 consensus_queue.cc:237] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.334869 17690 leader_election.cc:290] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [CANDIDATE]: Term 1 election: Requested vote from peers 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:27.335850 17690 raft_consensus.cc:3060] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.336221 17732 raft_consensus.cc:493] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.336937 17732 raft_consensus.cc:515] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } }
I20260709 13:05:27.340978 17495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c15862f65e48e4a4d1f2bb361fa5ab" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b90468d1744a1b9427045ee17ce894" is_pre_election: true
I20260709 13:05:27.341473 17569 raft_consensus.cc:2468] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 1.
I20260709 13:05:27.342022 17495 raft_consensus.cc:2468] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 0.
I20260709 13:05:27.343549 17607 leader_election.cc:304] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, 3c3f9cdf0a9446ce8df45552a499200e; no voters: 
I20260709 13:05:27.343806 17608 leader_election.cc:304] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:27.345219 17729 raft_consensus.cc:2804] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:27.345839 17735 raft_consensus.cc:2804] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:27.346671 17729 raft_consensus.cc:697] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [term 1 LEADER]: Becoming Leader. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Running, Role: LEADER
I20260709 13:05:27.348253 17729 consensus_queue.cc:237] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.350642 17690 raft_consensus.cc:2749] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:27.352871 17569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ea05cdff60471d8544f2da34ae4243" candidate_uuid: "c5b90468d1744a1b9427045ee17ce894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
I20260709 13:05:27.353618 17569 raft_consensus.cc:3060] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.354379 17494 raft_consensus.cc:2468] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 1.
I20260709 13:05:27.355424 17684 tablet_bootstrap.cc:492] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894: No bootstrap required, opened a new log
I20260709 13:05:27.355899 17684 ts_tablet_manager.cc:1403] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894: Time spent bootstrapping tablet: real 0.072s	user 0.028s	sys 0.016s
I20260709 13:05:27.357286 17732 leader_election.cc:290] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125)
I20260709 13:05:27.358045 17570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c15862f65e48e4a4d1f2bb361fa5ab" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e" is_pre_election: true
I20260709 13:05:27.358361 17735 raft_consensus.cc:493] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.358760 17735 raft_consensus.cc:3060] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.358807 17570 raft_consensus.cc:2468] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 0.
I20260709 13:05:27.358767 17684 raft_consensus.cc:359] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.362820 17684 raft_consensus.cc:385] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.362975 17569 raft_consensus.cc:2468] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b90468d1744a1b9427045ee17ce894 in term 1.
I20260709 13:05:27.364593 17643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ea05cdff60471d8544f2da34ae4243" candidate_uuid: "c5b90468d1744a1b9427045ee17ce894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
I20260709 13:05:27.365257 17643 raft_consensus.cc:3060] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.364264 17458 leader_election.cc:304] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5b90468d1744a1b9427045ee17ce894; no voters: 3a88f06fc6204d8db7657213d85a020a, 3c3f9cdf0a9446ce8df45552a499200e
I20260709 13:05:27.366597 17393 catalog_manager.cc:5697] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a88f06fc6204d8db7657213d85a020a (127.7.25.195). New cstate: current_term: 1 leader_uuid: "3a88f06fc6204d8db7657213d85a020a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:27.368024 17690 raft_consensus.cc:2749] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:27.363154 17684 raft_consensus.cc:740] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.369386 17735 raft_consensus.cc:515] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } }
I20260709 13:05:27.369449 17684 consensus_queue.cc:260] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.367589 17458 leader_election.cc:304] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3f9cdf0a9446ce8df45552a499200e, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:27.373124 17735 leader_election.cc:290] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 1 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125)
I20260709 13:05:27.373279 17494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c15862f65e48e4a4d1f2bb361fa5ab" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:27.373308 17690 raft_consensus.cc:2804] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:27.374253 17690 raft_consensus.cc:697] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 1 LEADER]: Becoming Leader. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Running, Role: LEADER
I20260709 13:05:27.374826 17569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c15862f65e48e4a4d1f2bb361fa5ab" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
I20260709 13:05:27.375033 17690 consensus_queue.cc:237] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.375664 17569 raft_consensus.cc:3060] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.376422 17494 raft_consensus.cc:3060] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.372459 17643 raft_consensus.cc:2468] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b90468d1744a1b9427045ee17ce894 in term 1.
I20260709 13:05:27.372493 17684 ts_tablet_manager.cc:1434] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:05:27.379261 17684 tablet_bootstrap.cc:492] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894: Bootstrap starting.
I20260709 13:05:27.384773 17684 tablet_bootstrap.cc:654] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.385202 17494 raft_consensus.cc:2468] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 1.
I20260709 13:05:27.386507 17608 leader_election.cc:304] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:27.387385 17735 raft_consensus.cc:2804] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:27.387434 17390 catalog_manager.cc:5697] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a88f06fc6204d8db7657213d85a020a (127.7.25.195). New cstate: current_term: 1 leader_uuid: "3a88f06fc6204d8db7657213d85a020a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:27.389982 17735 raft_consensus.cc:697] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 1 LEADER]: Becoming Leader. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Running, Role: LEADER
I20260709 13:05:27.391201 17735 consensus_queue.cc:237] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } }
I20260709 13:05:27.409873 17701 raft_consensus.cc:493] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.410772 17701 raft_consensus.cc:515] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.415807 17494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a96d46137374b208ccaa960ce9530ae" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b90468d1744a1b9427045ee17ce894" is_pre_election: true
I20260709 13:05:27.416066 17701 leader_election.cc:290] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:27.417346 17643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a96d46137374b208ccaa960ce9530ae" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a" is_pre_election: true
I20260709 13:05:27.418102 17643 raft_consensus.cc:2468] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 0.
I20260709 13:05:27.419523 17533 leader_election.cc:304] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, 3c3f9cdf0a9446ce8df45552a499200e; no voters: 
I20260709 13:05:27.420439 17701 raft_consensus.cc:2804] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:27.420842 17701 raft_consensus.cc:493] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:27.422111 17534 leader_election.cc:343] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:27.421239 17701 raft_consensus.cc:3060] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.428640 17569 raft_consensus.cc:2468] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 1.
I20260709 13:05:27.432090 17390 catalog_manager.cc:5697] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a88f06fc6204d8db7657213d85a020a (127.7.25.195). New cstate: current_term: 1 leader_uuid: "3a88f06fc6204d8db7657213d85a020a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:27.444360 17689 consensus_queue.cc:1048] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:27.452430 17684 tablet_bootstrap.cc:492] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894: No bootstrap required, opened a new log
I20260709 13:05:27.453064 17684 ts_tablet_manager.cc:1403] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894: Time spent bootstrapping tablet: real 0.074s	user 0.027s	sys 0.041s
I20260709 13:05:27.452168 17701 raft_consensus.cc:515] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.456043 17701 leader_election.cc:290] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:27.456697 17494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a96d46137374b208ccaa960ce9530ae" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:27.457538 17644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a96d46137374b208ccaa960ce9530ae" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
W20260709 13:05:27.458300 17534 leader_election.cc:343] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:27.458495 17644 raft_consensus.cc:3060] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.460063 17390 catalog_manager.cc:5697] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5b90468d1744a1b9427045ee17ce894 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "c5b90468d1744a1b9427045ee17ce894" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:27.461596 17684 raft_consensus.cc:359] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.462280 17684 raft_consensus.cc:385] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.462529 17684 raft_consensus.cc:740] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.463227 17684 consensus_queue.cc:260] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.468966 17684 ts_tablet_manager.cc:1434] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:05:27.470003 17684 tablet_bootstrap.cc:492] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894: Bootstrap starting.
I20260709 13:05:27.470522 17644 raft_consensus.cc:2468] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 1.
I20260709 13:05:27.472465 17533 leader_election.cc:304] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, 3c3f9cdf0a9446ce8df45552a499200e; no voters: c5b90468d1744a1b9427045ee17ce894
I20260709 13:05:27.474113 17701 raft_consensus.cc:2804] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:27.474686 17701 raft_consensus.cc:697] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 1 LEADER]: Becoming Leader. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Running, Role: LEADER
I20260709 13:05:27.475605 17701 consensus_queue.cc:237] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.478540 17690 raft_consensus.cc:493] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.478976 17684 tablet_bootstrap.cc:654] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.479103 17690 raft_consensus.cc:515] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.481287 17690 leader_election.cc:290] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:27.484129 17569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1162ebdc359462e918f6aa54bf485eb" candidate_uuid: "c5b90468d1744a1b9427045ee17ce894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e" is_pre_election: true
I20260709 13:05:27.484567 17644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1162ebdc359462e918f6aa54bf485eb" candidate_uuid: "c5b90468d1744a1b9427045ee17ce894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a" is_pre_election: true
I20260709 13:05:27.486691 17458 leader_election.cc:304] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5b90468d1744a1b9427045ee17ce894; no voters: 3a88f06fc6204d8db7657213d85a020a, 3c3f9cdf0a9446ce8df45552a499200e
I20260709 13:05:27.489238 17690 raft_consensus.cc:2749] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:27.493700 17494 raft_consensus.cc:3060] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.496584 17684 tablet_bootstrap.cc:492] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894: No bootstrap required, opened a new log
I20260709 13:05:27.497188 17684 ts_tablet_manager.cc:1403] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.010s
I20260709 13:05:27.498529 17393 catalog_manager.cc:5697] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194). New cstate: current_term: 1 leader_uuid: "3c3f9cdf0a9446ce8df45552a499200e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:27.499840 17684 raft_consensus.cc:359] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.500532 17684 raft_consensus.cc:385] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.500797 17684 raft_consensus.cc:740] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.501504 17684 consensus_queue.cc:260] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.505059 17684 ts_tablet_manager.cc:1434] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:27.506781 17690 raft_consensus.cc:493] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.507331 17690 raft_consensus.cc:515] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.509925 17690 leader_election.cc:290] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:27.510284 17569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419a4a24d7264a019316d46cc4f0d807" candidate_uuid: "c5b90468d1744a1b9427045ee17ce894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e" is_pre_election: true
I20260709 13:05:27.510977 17569 raft_consensus.cc:2468] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5b90468d1744a1b9427045ee17ce894 in term 0.
I20260709 13:05:27.511471 17644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419a4a24d7264a019316d46cc4f0d807" candidate_uuid: "c5b90468d1744a1b9427045ee17ce894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a" is_pre_election: true
I20260709 13:05:27.512135 17644 raft_consensus.cc:2468] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5b90468d1744a1b9427045ee17ce894 in term 0.
I20260709 13:05:27.512243 17458 leader_election.cc:304] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3f9cdf0a9446ce8df45552a499200e, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:27.513619 17690 raft_consensus.cc:2804] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:27.514009 17690 raft_consensus.cc:493] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.514345 17690 raft_consensus.cc:3060] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.515784 17702 consensus_queue.cc:1048] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:27.520442 17735 raft_consensus.cc:493] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.521303 17735 raft_consensus.cc:515] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.521867 17690 raft_consensus.cc:515] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.524055 17690 leader_election.cc:290] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [CANDIDATE]: Term 1 election: Requested vote from peers 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:27.525779 17569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419a4a24d7264a019316d46cc4f0d807" candidate_uuid: "c5b90468d1744a1b9427045ee17ce894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
I20260709 13:05:27.526439 17569 raft_consensus.cc:3060] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.526962 17570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01d0c0226174b62940910e6842d3d6f" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e" is_pre_election: true
I20260709 13:05:27.527869 17570 raft_consensus.cc:2468] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 0.
I20260709 13:05:27.529707 17607 leader_election.cc:304] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, 3c3f9cdf0a9446ce8df45552a499200e; no voters: 
I20260709 13:05:27.530851 17692 raft_consensus.cc:2804] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:27.529781 17690 raft_consensus.cc:493] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.531376 17692 raft_consensus.cc:493] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.526896 17735 leader_election.cc:290] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125)
I20260709 13:05:27.531797 17692 raft_consensus.cc:3060] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.531522 17690 raft_consensus.cc:515] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.532688 17494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01d0c0226174b62940910e6842d3d6f" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b90468d1744a1b9427045ee17ce894" is_pre_election: true
I20260709 13:05:27.534440 17570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87e0199ea6c47ea87b84ef639cae449" candidate_uuid: "c5b90468d1744a1b9427045ee17ce894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e" is_pre_election: true
I20260709 13:05:27.534626 17690 leader_election.cc:290] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:27.535110 17570 raft_consensus.cc:2468] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5b90468d1744a1b9427045ee17ce894 in term 0.
I20260709 13:05:27.535311 17644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87e0199ea6c47ea87b84ef639cae449" candidate_uuid: "c5b90468d1744a1b9427045ee17ce894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a" is_pre_election: true
I20260709 13:05:27.535995 17644 raft_consensus.cc:2468] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5b90468d1744a1b9427045ee17ce894 in term 0.
I20260709 13:05:27.536388 17458 leader_election.cc:304] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3f9cdf0a9446ce8df45552a499200e, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:27.536296 17569 raft_consensus.cc:2468] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b90468d1744a1b9427045ee17ce894 in term 1.
I20260709 13:05:27.534178 17494 raft_consensus.cc:2468] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 0.
I20260709 13:05:27.533454 17643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419a4a24d7264a019316d46cc4f0d807" candidate_uuid: "c5b90468d1744a1b9427045ee17ce894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
I20260709 13:05:27.537729 17690 raft_consensus.cc:2804] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:27.537911 17458 leader_election.cc:304] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3f9cdf0a9446ce8df45552a499200e, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:27.538177 17690 raft_consensus.cc:493] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.538014 17643 raft_consensus.cc:3060] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.538911 17734 raft_consensus.cc:2804] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:27.540305 17692 raft_consensus.cc:515] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.538940 17690 raft_consensus.cc:3060] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.541863 17702 consensus_queue.cc:1048] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:27.546641 17643 raft_consensus.cc:2468] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b90468d1744a1b9427045ee17ce894 in term 1.
I20260709 13:05:27.548362 17734 raft_consensus.cc:697] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 1 LEADER]: Becoming Leader. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Running, Role: LEADER
I20260709 13:05:27.553004 17734 consensus_queue.cc:237] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.556090 17494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01d0c0226174b62940910e6842d3d6f" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:27.556775 17494 raft_consensus.cc:3060] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.557422 17692 leader_election.cc:290] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 1 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125)
I20260709 13:05:27.558964 17569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01d0c0226174b62940910e6842d3d6f" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
I20260709 13:05:27.559572 17569 raft_consensus.cc:3060] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.559592 17690 raft_consensus.cc:515] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.563853 17690 leader_election.cc:290] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [CANDIDATE]: Term 1 election: Requested vote from peers 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:27.564910 17643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87e0199ea6c47ea87b84ef639cae449" candidate_uuid: "c5b90468d1744a1b9427045ee17ce894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
I20260709 13:05:27.571306 17643 raft_consensus.cc:3060] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.565706 17570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87e0199ea6c47ea87b84ef639cae449" candidate_uuid: "c5b90468d1744a1b9427045ee17ce894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
I20260709 13:05:27.577795 17570 raft_consensus.cc:3060] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.582643 17643 raft_consensus.cc:2468] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b90468d1744a1b9427045ee17ce894 in term 1.
I20260709 13:05:27.564778 17494 raft_consensus.cc:2468] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 1.
I20260709 13:05:27.566885 17569 raft_consensus.cc:2468] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 1.
I20260709 13:05:27.584741 17608 leader_election.cc:304] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:27.584618 17458 leader_election.cc:304] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:27.570570 17702 consensus_queue.cc:1048] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:05:27.586953 17734 raft_consensus.cc:2804] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:27.587752 17734 raft_consensus.cc:697] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 1 LEADER]: Becoming Leader. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Running, Role: LEADER
I20260709 13:05:27.588644 17734 consensus_queue.cc:237] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.595088 17570 raft_consensus.cc:2468] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b90468d1744a1b9427045ee17ce894 in term 1.
I20260709 13:05:27.595778 17393 catalog_manager.cc:5697] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5b90468d1744a1b9427045ee17ce894 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "c5b90468d1744a1b9427045ee17ce894" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:27.600603 17692 raft_consensus.cc:2804] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:27.602743 17692 raft_consensus.cc:697] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [term 1 LEADER]: Becoming Leader. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Running, Role: LEADER
I20260709 13:05:27.603618 17692 consensus_queue.cc:237] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:27.614408 17393 catalog_manager.cc:5697] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a88f06fc6204d8db7657213d85a020a (127.7.25.195). New cstate: current_term: 1 leader_uuid: "3a88f06fc6204d8db7657213d85a020a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:27.617729 17391 catalog_manager.cc:5697] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5b90468d1744a1b9427045ee17ce894 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "c5b90468d1744a1b9427045ee17ce894" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:27.640506  7271 ts_manager.cc:295] Set tserver state for c5b90468d1744a1b9427045ee17ce894 to MAINTENANCE_MODE
I20260709 13:05:27.641361  7271 tablet_server.cc:179] TabletServer@127.7.25.193:0 shutting down...
I20260709 13:05:27.659790  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:27.660753  7271 tablet_replica.cc:333] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894: stopping tablet replica
I20260709 13:05:27.661463  7271 raft_consensus.cc:2243] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.661898  7271 raft_consensus.cc:2272] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.663966  7271 tablet_replica.cc:333] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894: stopping tablet replica
I20260709 13:05:27.664580  7271 raft_consensus.cc:2243] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.665269  7271 pending_rounds.cc:70] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894: Trying to abort 1 pending ops.
I20260709 13:05:27.665426  7271 pending_rounds.cc:77] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635132970102784 op_type: NO_OP noop_request { }
I20260709 13:05:27.665757  7271 raft_consensus.cc:2889] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:05:27.666030  7271 raft_consensus.cc:2272] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.668095  7271 tablet_replica.cc:333] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894: stopping tablet replica
I20260709 13:05:27.668669  7271 raft_consensus.cc:2243] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.669135  7271 raft_consensus.cc:2272] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.671607  7271 tablet_replica.cc:333] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894: stopping tablet replica
I20260709 13:05:27.672178  7271 raft_consensus.cc:2243] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.672767  7271 pending_rounds.cc:70] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894: Trying to abort 1 pending ops.
I20260709 13:05:27.672968  7271 pending_rounds.cc:77] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635133709840384 op_type: NO_OP noop_request { }
I20260709 13:05:27.673301  7271 raft_consensus.cc:2889] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:05:27.673593  7271 raft_consensus.cc:2272] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.675860  7271 tablet_replica.cc:333] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894: stopping tablet replica
I20260709 13:05:27.676571  7271 raft_consensus.cc:2243] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.677067  7271 raft_consensus.cc:2272] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.679848  7271 tablet_replica.cc:333] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894: stopping tablet replica
I20260709 13:05:27.680436  7271 raft_consensus.cc:2243] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.680785  7271 raft_consensus.cc:2272] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.682529  7271 tablet_replica.cc:333] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894: stopping tablet replica
I20260709 13:05:27.683005  7271 raft_consensus.cc:2243] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.683341  7271 raft_consensus.cc:2272] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.684900  7271 tablet_replica.cc:333] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894: stopping tablet replica
I20260709 13:05:27.685402  7271 raft_consensus.cc:2243] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.685712  7271 raft_consensus.cc:2272] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.687477  7271 tablet_replica.cc:333] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894: stopping tablet replica
I20260709 13:05:27.687929  7271 raft_consensus.cc:2243] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.688446  7271 pending_rounds.cc:70] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894: Trying to abort 1 pending ops.
I20260709 13:05:27.688596  7271 pending_rounds.cc:77] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635133815709696 op_type: NO_OP noop_request { }
I20260709 13:05:27.688810  7271 raft_consensus.cc:2889] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:05:27.689010  7271 raft_consensus.cc:2272] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.691790  7271 tablet_replica.cc:333] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894: stopping tablet replica
I20260709 13:05:27.692303  7271 raft_consensus.cc:2243] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.692679  7271 raft_consensus.cc:2272] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.722813  7271 tablet_server.cc:196] TabletServer@127.7.25.193:0 shutdown complete.
I20260709 13:05:27.745013 17692 consensus_queue.cc:1048] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:27.762028 17608 consensus_peers.cc:597] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.778328 17692 consensus_queue.cc:1048] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:27.791230 17608 consensus_peers.cc:597] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:27.880476 17534 consensus_peers.cc:597] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.881361 17732 consensus_queue.cc:1048] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:27.894235 17608 consensus_peers.cc:597] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:27.927901 17534 consensus_peers.cc:597] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.992823 17702 consensus_queue.cc:1048] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:27.994575 17735 consensus_queue.cc:1048] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:28.006357 17608 consensus_peers.cc:597] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:28.045055 17441 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:05:28.191291 17534 consensus_peers.cc:597] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:28.946132 17735 raft_consensus.cc:493] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.946611 17735 raft_consensus.cc:515] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:28.948268 17735 leader_election.cc:290] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125)
I20260709 13:05:28.949388 17570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ea05cdff60471d8544f2da34ae4243" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e" is_pre_election: true
I20260709 13:05:28.950006 17570 raft_consensus.cc:2468] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 1.
I20260709 13:05:28.951197 17607 leader_election.cc:304] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, 3c3f9cdf0a9446ce8df45552a499200e; no voters: 
I20260709 13:05:28.952025 17735 raft_consensus.cc:2804] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:28.952159 17608 leader_election.cc:336] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111)
I20260709 13:05:28.952482 17735 raft_consensus.cc:493] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.952915 17735 raft_consensus.cc:3060] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:28.958278 17735 raft_consensus.cc:515] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:28.960263 17735 leader_election.cc:290] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 2 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125)
I20260709 13:05:28.961433 17570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ea05cdff60471d8544f2da34ae4243" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
I20260709 13:05:28.962141 17570 raft_consensus.cc:3060] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:28.964190 17608 leader_election.cc:336] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111)
I20260709 13:05:28.968125 17570 raft_consensus.cc:2468] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 2.
I20260709 13:05:28.969439 17607 leader_election.cc:304] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, 3c3f9cdf0a9446ce8df45552a499200e; no voters: c5b90468d1744a1b9427045ee17ce894
I20260709 13:05:28.970395 17735 raft_consensus.cc:2804] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:28.971345 17735 raft_consensus.cc:697] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 2 LEADER]: Becoming Leader. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Running, Role: LEADER
I20260709 13:05:28.972306 17735 consensus_queue.cc:237] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:28.979173 17393 catalog_manager.cc:5697] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a reported cstate change: term changed from 1 to 2, leader changed from c5b90468d1744a1b9427045ee17ce894 (127.7.25.193) to 3a88f06fc6204d8db7657213d85a020a (127.7.25.195). New cstate: current_term: 2 leader_uuid: "3a88f06fc6204d8db7657213d85a020a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:29.046232 17441 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:05:29.174598 17608 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111) [suppressed 148 similar messages]
I20260709 13:05:29.228523 17702 raft_consensus.cc:493] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.229108 17702 raft_consensus.cc:515] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:29.231137 17702 leader_election.cc:290] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:29.232364 17644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87e0199ea6c47ea87b84ef639cae449" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a" is_pre_election: true
I20260709 13:05:29.233067 17644 raft_consensus.cc:2468] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 1.
I20260709 13:05:29.234237 17533 leader_election.cc:304] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, 3c3f9cdf0a9446ce8df45552a499200e; no voters: 
I20260709 13:05:29.234951 17702 raft_consensus.cc:2804] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:29.235174 17534 leader_election.cc:336] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111)
I20260709 13:05:29.235416 17702 raft_consensus.cc:493] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.235821 17702 raft_consensus.cc:3060] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:29.241379 17702 raft_consensus.cc:515] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:29.243387 17702 leader_election.cc:290] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 2 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:29.244604 17644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87e0199ea6c47ea87b84ef639cae449" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
I20260709 13:05:29.245332 17644 raft_consensus.cc:3060] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:29.247375 17534 leader_election.cc:336] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111)
I20260709 13:05:29.252192 17644 raft_consensus.cc:2468] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 2.
I20260709 13:05:29.253448 17533 leader_election.cc:304] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, 3c3f9cdf0a9446ce8df45552a499200e; no voters: c5b90468d1744a1b9427045ee17ce894
I20260709 13:05:29.254277 17702 raft_consensus.cc:2804] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:29.255414 17702 raft_consensus.cc:697] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Becoming Leader. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Running, Role: LEADER
I20260709 13:05:29.256147 17702 consensus_queue.cc:237] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:29.263809 17393 catalog_manager.cc:5697] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e reported cstate change: term changed from 1 to 2, leader changed from c5b90468d1744a1b9427045ee17ce894 (127.7.25.193) to 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194). New cstate: current_term: 2 leader_uuid: "3c3f9cdf0a9446ce8df45552a499200e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.492759 17702 raft_consensus.cc:493] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.493332 17702 raft_consensus.cc:515] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:29.494982 17702 leader_election.cc:290] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:29.496089 17644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419a4a24d7264a019316d46cc4f0d807" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a" is_pre_election: true
I20260709 13:05:29.496807 17644 raft_consensus.cc:2468] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 1.
I20260709 13:05:29.497747 17533 leader_election.cc:304] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, 3c3f9cdf0a9446ce8df45552a499200e; no voters: 
I20260709 13:05:29.498517 17702 raft_consensus.cc:2804] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:29.498903 17702 raft_consensus.cc:493] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:29.498718 17534 leader_election.cc:336] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111)
I20260709 13:05:29.499291 17702 raft_consensus.cc:3060] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:29.504197 17702 raft_consensus.cc:515] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:29.505813 17702 leader_election.cc:290] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 2 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:29.506850 17644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419a4a24d7264a019316d46cc4f0d807" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
I20260709 13:05:29.507378 17644 raft_consensus.cc:3060] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:29.509729 17534 leader_election.cc:336] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111)
I20260709 13:05:29.512610 17644 raft_consensus.cc:2468] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 2.
I20260709 13:05:29.513554 17533 leader_election.cc:304] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, 3c3f9cdf0a9446ce8df45552a499200e; no voters: c5b90468d1744a1b9427045ee17ce894
I20260709 13:05:29.514213 17702 raft_consensus.cc:2804] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:29.514654 17702 raft_consensus.cc:697] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Becoming Leader. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Running, Role: LEADER
I20260709 13:05:29.515268 17702 consensus_queue.cc:237] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:29.522370 17393 catalog_manager.cc:5697] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e reported cstate change: term changed from 1 to 2, leader changed from c5b90468d1744a1b9427045ee17ce894 (127.7.25.193) to 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194). New cstate: current_term: 2 leader_uuid: "3c3f9cdf0a9446ce8df45552a499200e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:29.554744 17608 consensus_peers.cc:597] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:29.569186 17570 raft_consensus.cc:1275] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Refusing update from remote peer 3a88f06fc6204d8db7657213d85a020a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:05:29.570555 17735 consensus_queue.cc:1048] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:29.637778 17644 raft_consensus.cc:1275] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Refusing update from remote peer 3c3f9cdf0a9446ce8df45552a499200e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:05:29.638993 17702 consensus_queue.cc:1048] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:29.652691 17534 consensus_peers.cc:597] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:29.897960 17534 consensus_peers.cc:597] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:29.988794 17644 raft_consensus.cc:1275] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Refusing update from remote peer 3c3f9cdf0a9446ce8df45552a499200e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:05:29.990135 17702 consensus_queue.cc:1048] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:29.996789 17608 consensus_peers.cc:597] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:30.047222 17441 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:05:30.357362 17608 consensus_peers.cc:597] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:30.450431 17534 consensus_peers.cc:597] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:30.478612 17608 consensus_peers.cc:597] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:30.587311 17534 consensus_peers.cc:597] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:30.683909 17608 consensus_peers.cc:597] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:30.760411 17534 consensus_peers.cc:597] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:31.048210 17441 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:05:31.984391 17608 consensus_peers.cc:597] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:32.045637 17534 consensus_peers.cc:597] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:32.049220 17441 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:05:32.383630 17534 consensus_peers.cc:597] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:32.768158  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:32.769069 17608 consensus_peers.cc:597] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:32.804453 17785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:32.813541  7271 server_base.cc:1061] running on GCE node
W20260709 13:05:32.815692 17784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:32.821537 17787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:32.823572  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:32.823983  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:32.824252  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602332824224 us; error 0 us; skew 500 ppm
I20260709 13:05:32.825196  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:32.830871  7271 webserver.cc:533] Webserver started at http://127.7.25.193:44143/ using document root <none> and password file <none>
I20260709 13:05:32.831650  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:32.832017  7271 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 13:05:32.835852 17608 consensus_peers.cc:597] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:32.848440  7271 fs_manager.cc:714] Time spent opening directory manager: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:05:32.857450 17793 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:32.858537  7271 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:05:32.858912  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/ts-0-root
uuid: "c5b90468d1744a1b9427045ee17ce894"
format_stamp: "Formatted at 2026-07-09 13:05:26 on dist-test-slave-z1zn"
I20260709 13:05:32.859836  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602011513864-7271-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:32.884193  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:32.886413  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:32.893673  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:32.899660 17800 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:05:32.900911 17534 consensus_peers.cc:597] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:32.953465  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:05:32.953899  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.056s	user 0.002s	sys 0.001s
I20260709 13:05:32.954308  7271 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:05:32.961669 17800 tablet_bootstrap.cc:492] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894: Bootstrap starting.
I20260709 13:05:32.974201 17800 tablet_bootstrap.cc:492] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:32.974937 17800 tablet_bootstrap.cc:492] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894: Bootstrap complete.
I20260709 13:05:32.975550 17800 ts_tablet_manager.cc:1403] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.001s
I20260709 13:05:32.978122 17800 raft_consensus.cc:359] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:32.978968 17800 raft_consensus.cc:385] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.979234 17800 raft_consensus.cc:740] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.979858 17800 consensus_queue.cc:260] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:32.982525 17800 ts_tablet_manager.cc:1434] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:05:32.983206 17800 tablet_bootstrap.cc:492] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894: Bootstrap starting.
I20260709 13:05:32.997727 17800 tablet_bootstrap.cc:492] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:32.998922 17800 tablet_bootstrap.cc:492] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894: Bootstrap complete.
I20260709 13:05:32.999488 17800 ts_tablet_manager.cc:1403] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.005s
I20260709 13:05:32.999495  7271 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:05:32.999961  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.046s	user 0.046s	sys 0.000s
I20260709 13:05:33.002121 17800 raft_consensus.cc:359] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.002799 17800 raft_consensus.cc:740] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.003640 17800 consensus_queue.cc:260] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.005416 17800 ts_tablet_manager.cc:1434] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:05:33.006131 17800 tablet_bootstrap.cc:492] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894: Bootstrap starting.
I20260709 13:05:33.021996 17800 tablet_bootstrap.cc:492] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:33.023830 17800 tablet_bootstrap.cc:492] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894: Bootstrap complete.
I20260709 13:05:33.024660 17800 ts_tablet_manager.cc:1403] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.005s
W20260709 13:05:33.026155 17534 consensus_peers.cc:597] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:33.027571 17800 raft_consensus.cc:359] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.028184 17800 raft_consensus.cc:740] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.028935 17800 consensus_queue.cc:260] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.031303 17800 ts_tablet_manager.cc:1434] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:33.032259 17800 tablet_bootstrap.cc:492] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894: Bootstrap starting.
W20260709 13:05:33.042964 17608 consensus_peers.cc:597] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:33.047688 17800 tablet_bootstrap.cc:492] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:05:33.048828 17800 tablet_bootstrap.cc:492] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894: Bootstrap complete.
I20260709 13:05:33.049592 17800 ts_tablet_manager.cc:1403] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
W20260709 13:05:33.050742 17441 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:33.051836 17800 raft_consensus.cc:359] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.052706 17800 raft_consensus.cc:740] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.053431 17800 consensus_queue.cc:260] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.054971 17800 ts_tablet_manager.cc:1434] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:05:33.055647 17800 tablet_bootstrap.cc:492] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894: Bootstrap starting.
I20260709 13:05:33.066694 17800 tablet_bootstrap.cc:492] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:33.067396 17800 tablet_bootstrap.cc:492] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894: Bootstrap complete.
I20260709 13:05:33.067936 17800 ts_tablet_manager.cc:1403] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:05:33.070348 17800 raft_consensus.cc:359] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.071106 17800 raft_consensus.cc:740] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.072018 17800 consensus_queue.cc:260] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.074082 17800 ts_tablet_manager.cc:1434] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:05:33.074941 17800 tablet_bootstrap.cc:492] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894: Bootstrap starting.
I20260709 13:05:33.080276  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.193:36861
I20260709 13:05:33.080399 17862 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.193:36861 every 8 connection(s)
I20260709 13:05:33.085587  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:33.092190 17800 tablet_bootstrap.cc:492] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:33.093612 17800 tablet_bootstrap.cc:492] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894: Bootstrap complete.
I20260709 13:05:33.094636 17800 ts_tablet_manager.cc:1403] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.007s
I20260709 13:05:33.098920 17800 raft_consensus.cc:359] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.099589 17800 raft_consensus.cc:740] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.100375 17800 consensus_queue.cc:260] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.103778 17800 ts_tablet_manager.cc:1434] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:33.104954 17800 tablet_bootstrap.cc:492] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894: Bootstrap starting.
I20260709 13:05:33.123459 17800 tablet_bootstrap.cc:492] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:33.124488 17800 tablet_bootstrap.cc:492] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894: Bootstrap complete.
I20260709 13:05:33.124243 17570 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a96d46137374b208ccaa960ce9530ae"
dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
mode: GRACEFUL
new_leader_uuid: "3a88f06fc6204d8db7657213d85a020a"
 from {username='slave'} at 127.0.0.1:42412
I20260709 13:05:33.125248 17570 raft_consensus.cc:606] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 1 LEADER]: Received request to transfer leadership to TS 3a88f06fc6204d8db7657213d85a020a
I20260709 13:05:33.125399 17800 ts_tablet_manager.cc:1403] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:05:33.126202 17863 heartbeater.cc:344] Connected to a master server at 127.7.25.254:42097
I20260709 13:05:33.126670 17863 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:33.127650 17863 heartbeater.cc:507] Master 127.7.25.254:42097 requested a full tablet report, sending...
I20260709 13:05:33.128389 17570 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b87e0199ea6c47ea87b84ef639cae449"
dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
mode: GRACEFUL
new_leader_uuid: "3a88f06fc6204d8db7657213d85a020a"
 from {username='slave'} at 127.0.0.1:42412
I20260709 13:05:33.128379 17800 raft_consensus.cc:359] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } }
I20260709 13:05:33.129248 17570 raft_consensus.cc:606] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Received request to transfer leadership to TS 3a88f06fc6204d8db7657213d85a020a
I20260709 13:05:33.129278 17800 raft_consensus.cc:740] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.130402 17800 consensus_queue.cc:260] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } }
I20260709 13:05:33.132509 17800 ts_tablet_manager.cc:1434] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:33.133375 17800 tablet_bootstrap.cc:492] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894: Bootstrap starting.
I20260709 13:05:33.140698 17391 ts_manager.cc:194] Re-registered known tserver with Master: c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861)
I20260709 13:05:33.147401 17644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e01d0c0226174b62940910e6842d3d6f"
dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
mode: GRACEFUL
new_leader_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
 from {username='slave'} at 127.0.0.1:35704
I20260709 13:05:33.148043 17644 raft_consensus.cc:606] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [term 1 LEADER]: Received request to transfer leadership to TS 3c3f9cdf0a9446ce8df45552a499200e
I20260709 13:05:33.149503  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:05:33.150012  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:33.150856  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:33.153115 17800 tablet_bootstrap.cc:492] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:05:33.154160 17800 tablet_bootstrap.cc:492] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894: Bootstrap complete.
I20260709 13:05:33.154807 17800 ts_tablet_manager.cc:1403] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:05:33.157480 17800 raft_consensus.cc:359] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.158310 17800 raft_consensus.cc:740] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.159097 17800 consensus_queue.cc:260] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.160547 17391 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41128
I20260709 13:05:33.161010 17800 ts_tablet_manager.cc:1434] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:33.162040 17800 tablet_bootstrap.cc:492] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894: Bootstrap starting.
I20260709 13:05:33.164604 17863 heartbeater.cc:499] Master 127.7.25.254:42097 was elected leader, sending a full tablet report...
I20260709 13:05:33.169220 17837 raft_consensus.cc:3060] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:33.175428 17800 tablet_bootstrap.cc:492] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:05:33.176437 17800 tablet_bootstrap.cc:492] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894: Bootstrap complete.
I20260709 13:05:33.177057 17800 ts_tablet_manager.cc:1403] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:05:33.178923 17837 pending_rounds.cc:85] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894: Aborting all ops after (but not including) 0
I20260709 13:05:33.179327 17837 pending_rounds.cc:107] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:05:33.179077 17800 raft_consensus.cc:359] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.179769 17837 raft_consensus.cc:2889] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:33.180430 17800 raft_consensus.cc:740] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.181265 17800 consensus_queue.cc:260] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.183259 17800 ts_tablet_manager.cc:1434] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:05:33.184101 17800 tablet_bootstrap.cc:492] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894: Bootstrap starting.
I20260709 13:05:33.185853 17702 raft_consensus.cc:993] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e: : Instructing follower 3a88f06fc6204d8db7657213d85a020a to start an election
I20260709 13:05:33.186596 17876 raft_consensus.cc:1081] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 1 LEADER]: Signalling peer 3a88f06fc6204d8db7657213d85a020a to start an election
I20260709 13:05:33.188781 17644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a96d46137374b208ccaa960ce9530ae"
dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
 from {username='slave'} at 127.0.0.1:34452
I20260709 13:05:33.189438 17644 raft_consensus.cc:493] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:33.189860 17644 raft_consensus.cc:3060] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:33.202229 17644 raft_consensus.cc:515] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.206705 17835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a96d46137374b208ccaa960ce9530ae" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:33.207728 17835 raft_consensus.cc:3060] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [term 0 FOLLOWER]: Advancing to term 2
I20260709 13:05:33.220525 17835 raft_consensus.cc:2468] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 2.
I20260709 13:05:33.222103 17608 leader_election.cc:304] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:33.223402 17792 raft_consensus.cc:2804] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:33.223672 17570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a96d46137374b208ccaa960ce9530ae" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
I20260709 13:05:33.223933 17792 raft_consensus.cc:697] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [term 2 LEADER]: Becoming Leader. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Running, Role: LEADER
I20260709 13:05:33.224388 17570 raft_consensus.cc:3055] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:33.224776 17570 raft_consensus.cc:740] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Running, Role: LEADER
I20260709 13:05:33.225097 17802 raft_consensus.cc:493] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.225155 17792 consensus_queue.cc:237] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.225883 17802 raft_consensus.cc:515] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.225853 17570 consensus_queue.cc:260] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.227501 17570 raft_consensus.cc:3060] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:33.233407 17644 leader_election.cc:290] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 2 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125)
I20260709 13:05:33.236828 17570 raft_consensus.cc:2468] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 2.
I20260709 13:05:33.244509 17802 leader_election.cc:290] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:33.246971 17570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a96d46137374b208ccaa960ce9530ae" candidate_uuid: "c5b90468d1744a1b9427045ee17ce894" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e" is_pre_election: true
I20260709 13:05:33.247933 17570 raft_consensus.cc:2410] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5b90468d1744a1b9427045ee17ce894 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:05:33.249019 17391 catalog_manager.cc:5697] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a reported cstate change: term changed from 1 to 2, leader changed from 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194) to 3a88f06fc6204d8db7657213d85a020a (127.7.25.195). New cstate: current_term: 2 leader_uuid: "3a88f06fc6204d8db7657213d85a020a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:33.252667 17800 tablet_bootstrap.cc:492] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:33.253801 17800 tablet_bootstrap.cc:492] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894: Bootstrap complete.
I20260709 13:05:33.254606 17800 ts_tablet_manager.cc:1403] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894: Time spent bootstrapping tablet: real 0.071s	user 0.033s	sys 0.014s
I20260709 13:05:33.257252 17800 raft_consensus.cc:359] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.258057 17800 raft_consensus.cc:740] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b90468d1744a1b9427045ee17ce894, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.258733 17800 consensus_queue.cc:260] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.261574 17800 ts_tablet_manager.cc:1434] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:33.265148 17644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a96d46137374b208ccaa960ce9530ae" candidate_uuid: "c5b90468d1744a1b9427045ee17ce894" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a88f06fc6204d8db7657213d85a020a" is_pre_election: true
I20260709 13:05:33.268013 17794 leader_election.cc:304] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5b90468d1744a1b9427045ee17ce894; no voters: 3a88f06fc6204d8db7657213d85a020a, 3c3f9cdf0a9446ce8df45552a499200e
I20260709 13:05:33.270529 17881 raft_consensus.cc:2749] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:33.485316 17702 raft_consensus.cc:993] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e: : Instructing follower 3a88f06fc6204d8db7657213d85a020a to start an election
I20260709 13:05:33.485787 17876 raft_consensus.cc:1081] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Signalling peer 3a88f06fc6204d8db7657213d85a020a to start an election
I20260709 13:05:33.487562 17644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b87e0199ea6c47ea87b84ef639cae449"
dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
 from {username='slave'} at 127.0.0.1:34452
I20260709 13:05:33.488135 17644 raft_consensus.cc:493] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:33.488467 17644 raft_consensus.cc:3060] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.488484 17836 raft_consensus.cc:3060] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:33.494275 17644 raft_consensus.cc:515] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.495654 17836 pending_rounds.cc:85] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894: Aborting all ops after (but not including) 0
I20260709 13:05:33.496093 17836 pending_rounds.cc:107] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:05:33.496392 17836 raft_consensus.cc:2889] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:33.498173 17835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87e0199ea6c47ea87b84ef639cae449" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:33.498658 17644 leader_election.cc:290] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 3 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125)
I20260709 13:05:33.498842 17835 raft_consensus.cc:3060] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.498476 17570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87e0199ea6c47ea87b84ef639cae449" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
I20260709 13:05:33.499675 17570 raft_consensus.cc:3055] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:33.500002 17570 raft_consensus.cc:740] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Running, Role: LEADER
I20260709 13:05:33.500952 17570 consensus_queue.cc:260] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.502269 17570 raft_consensus.cc:3060] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.505764 17835 raft_consensus.cc:2468] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 3.
I20260709 13:05:33.507001 17608 leader_election.cc:304] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:33.507750 17792 raft_consensus.cc:2804] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:33.508234 17792 raft_consensus.cc:697] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [term 3 LEADER]: Becoming Leader. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Running, Role: LEADER
I20260709 13:05:33.509282 17792 consensus_queue.cc:237] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.510958 17570 raft_consensus.cc:2468] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 3.
I20260709 13:05:33.519068 17391 catalog_manager.cc:5697] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a reported cstate change: term changed from 2 to 3, leader changed from 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194) to 3a88f06fc6204d8db7657213d85a020a (127.7.25.195). New cstate: current_term: 3 leader_uuid: "3a88f06fc6204d8db7657213d85a020a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:33.564494 17781 raft_consensus.cc:993] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a: : Instructing follower 3c3f9cdf0a9446ce8df45552a499200e to start an election
I20260709 13:05:33.564983 17792 raft_consensus.cc:1081] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [term 1 LEADER]: Signalling peer 3c3f9cdf0a9446ce8df45552a499200e to start an election
I20260709 13:05:33.566774 17570 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e01d0c0226174b62940910e6842d3d6f"
dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
 from {username='slave'} at 127.0.0.1:34650
I20260709 13:05:33.567323 17570 raft_consensus.cc:493] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:33.567648 17570 raft_consensus.cc:3060] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:33.573820 17570 raft_consensus.cc:515] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.575711 17570 leader_election.cc:290] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 2 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:33.576599 17835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01d0c0226174b62940910e6842d3d6f" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:33.576803 17644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01d0c0226174b62940910e6842d3d6f" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
I20260709 13:05:33.577385 17835 raft_consensus.cc:3060] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:33.577471 17644 raft_consensus.cc:3055] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:33.577982 17644 raft_consensus.cc:740] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Running, Role: LEADER
I20260709 13:05:33.578938 17644 consensus_queue.cc:260] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.580286 17644 raft_consensus.cc:3060] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:33.583755 17835 raft_consensus.cc:2468] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 2.
I20260709 13:05:33.584995 17534 leader_election.cc:304] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3f9cdf0a9446ce8df45552a499200e, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:33.585512 17644 raft_consensus.cc:2468] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 2.
I20260709 13:05:33.585942 17702 raft_consensus.cc:2804] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:33.586526 17702 raft_consensus.cc:697] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Becoming Leader. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Running, Role: LEADER
I20260709 13:05:33.587597 17702 consensus_queue.cc:237] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:33.596315 17391 catalog_manager.cc:5697] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e reported cstate change: term changed from 1 to 2, leader changed from 3a88f06fc6204d8db7657213d85a020a (127.7.25.195) to 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194). New cstate: current_term: 2 leader_uuid: "3c3f9cdf0a9446ce8df45552a499200e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:33.645196 17835 raft_consensus.cc:1275] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Refusing update from remote peer 3a88f06fc6204d8db7657213d85a020a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:33.646643 17792 consensus_queue.cc:1048] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:33.659376 17570 raft_consensus.cc:1275] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Refusing update from remote peer 3a88f06fc6204d8db7657213d85a020a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:33.661437 17781 consensus_queue.cc:1048] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:33.804540 17424 debug-util.cc:398] Leaking SignalData structure 0x7b080038f4c0 after lost signal to thread 7274
W20260709 13:05:34.052220 17441 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:34.085793 17835 raft_consensus.cc:1275] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Refusing update from remote peer 3a88f06fc6204d8db7657213d85a020a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:34.087502 17897 consensus_queue.cc:1048] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:34.088166 17897 consensus_queue.cc:1243] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Peer c5b90468d1744a1b9427045ee17ce894 log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:05:34.090394 17835 pending_rounds.cc:85] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894: Aborting all ops after (but not including) 0
I20260709 13:05:34.090770 17835 pending_rounds.cc:107] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:05:34.091149 17835 raft_consensus.cc:2889] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:34.093135 17570 raft_consensus.cc:1275] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Refusing update from remote peer 3a88f06fc6204d8db7657213d85a020a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:34.095391 17897 consensus_queue.cc:1048] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:34.161485  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:34.169034 17569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "419a4a24d7264a019316d46cc4f0d807"
dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
mode: GRACEFUL
new_leader_uuid: "3a88f06fc6204d8db7657213d85a020a"
 from {username='slave'} at 127.0.0.1:42412
I20260709 13:05:34.169664 17569 raft_consensus.cc:606] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Received request to transfer leadership to TS 3a88f06fc6204d8db7657213d85a020a
I20260709 13:05:34.172495 17644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4ea05cdff60471d8544f2da34ae4243"
dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
mode: GRACEFUL
new_leader_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
 from {username='slave'} at 127.0.0.1:35704
I20260709 13:05:34.173017 17644 raft_consensus.cc:606] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 2 LEADER]: Received request to transfer leadership to TS 3c3f9cdf0a9446ce8df45552a499200e
I20260709 13:05:34.175859 17644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3c15862f65e48e4a4d1f2bb361fa5ab"
dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
mode: GRACEFUL
new_leader_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
 from {username='slave'} at 127.0.0.1:35704
I20260709 13:05:34.176443 17644 raft_consensus.cc:606] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 1 LEADER]: Received request to transfer leadership to TS 3c3f9cdf0a9446ce8df45552a499200e
I20260709 13:05:34.177671  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:05:34.178158  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:34.178287 17644 raft_consensus.cc:1275] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Refusing update from remote peer 3c3f9cdf0a9446ce8df45552a499200e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:34.178900  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:34.179982 17896 consensus_queue.cc:1048] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:34.192042 17835 raft_consensus.cc:1275] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Refusing update from remote peer 3c3f9cdf0a9446ce8df45552a499200e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:34.193495 17876 consensus_queue.cc:1048] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:34.294962 17792 raft_consensus.cc:993] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a: : Instructing follower 3c3f9cdf0a9446ce8df45552a499200e to start an election
I20260709 13:05:34.295499 17897 raft_consensus.cc:1081] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 2 LEADER]: Signalling peer 3c3f9cdf0a9446ce8df45552a499200e to start an election
I20260709 13:05:34.297042 17569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4ea05cdff60471d8544f2da34ae4243"
dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
 from {username='slave'} at 127.0.0.1:34650
I20260709 13:05:34.297694 17569 raft_consensus.cc:493] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.298079 17569 raft_consensus.cc:3060] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.307083 17569 raft_consensus.cc:515] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:34.309768 17569 leader_election.cc:290] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 3 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:34.310122 17835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ea05cdff60471d8544f2da34ae4243" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:34.310321 17644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ea05cdff60471d8544f2da34ae4243" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
I20260709 13:05:34.310809 17835 raft_consensus.cc:3060] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.310853 17644 raft_consensus.cc:3055] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:34.311308 17644 raft_consensus.cc:740] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Running, Role: LEADER
I20260709 13:05:34.312213 17644 consensus_queue.cc:260] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:34.313514 17644 raft_consensus.cc:3060] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.318332 17835 raft_consensus.cc:2468] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 3.
I20260709 13:05:34.319617 17534 leader_election.cc:304] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3f9cdf0a9446ce8df45552a499200e, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:34.320462 17876 raft_consensus.cc:2804] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:34.320729 17644 raft_consensus.cc:2468] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 3.
I20260709 13:05:34.320989 17876 raft_consensus.cc:697] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 3 LEADER]: Becoming Leader. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Running, Role: LEADER
I20260709 13:05:34.322378 17876 consensus_queue.cc:237] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:34.331179 17390 catalog_manager.cc:5697] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e reported cstate change: term changed from 2 to 3, leader changed from 3a88f06fc6204d8db7657213d85a020a (127.7.25.195) to 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194). New cstate: current_term: 3 leader_uuid: "3c3f9cdf0a9446ce8df45552a499200e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.605669 17896 raft_consensus.cc:993] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e: : Instructing follower 3a88f06fc6204d8db7657213d85a020a to start an election
I20260709 13:05:34.606321 17876 raft_consensus.cc:1081] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Signalling peer 3a88f06fc6204d8db7657213d85a020a to start an election
I20260709 13:05:34.608188 17644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "419a4a24d7264a019316d46cc4f0d807"
dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
 from {username='slave'} at 127.0.0.1:34452
I20260709 13:05:34.608664 17644 raft_consensus.cc:493] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.608942 17644 raft_consensus.cc:3060] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.613511 17644 raft_consensus.cc:515] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:34.615437 17644 leader_election.cc:290] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 3 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125)
I20260709 13:05:34.616888 17569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419a4a24d7264a019316d46cc4f0d807" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
I20260709 13:05:34.617111 17835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419a4a24d7264a019316d46cc4f0d807" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:34.617529 17569 raft_consensus.cc:3055] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:34.617820 17835 raft_consensus.cc:3060] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.617918 17569 raft_consensus.cc:740] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Running, Role: LEADER
I20260709 13:05:34.619060 17569 consensus_queue.cc:260] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:34.620088 17569 raft_consensus.cc:3060] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.625138 17569 raft_consensus.cc:2468] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 3.
I20260709 13:05:34.625931 17835 raft_consensus.cc:2468] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 3.
I20260709 13:05:34.626370 17607 leader_election.cc:304] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, 3c3f9cdf0a9446ce8df45552a499200e; no voters: 
I20260709 13:05:34.627316 17897 raft_consensus.cc:2804] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:34.627731 17897 raft_consensus.cc:697] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 3 LEADER]: Becoming Leader. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Running, Role: LEADER
I20260709 13:05:34.628595 17897 consensus_queue.cc:237] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:34.636997 17390 catalog_manager.cc:5697] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a reported cstate change: term changed from 2 to 3, leader changed from 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194) to 3a88f06fc6204d8db7657213d85a020a (127.7.25.195). New cstate: current_term: 3 leader_uuid: "3a88f06fc6204d8db7657213d85a020a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.708037 17897 raft_consensus.cc:993] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a: : Instructing follower 3c3f9cdf0a9446ce8df45552a499200e to start an election
I20260709 13:05:34.708532 17792 raft_consensus.cc:1081] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 1 LEADER]: Signalling peer 3c3f9cdf0a9446ce8df45552a499200e to start an election
I20260709 13:05:34.710234 17569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3c15862f65e48e4a4d1f2bb361fa5ab"
dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
 from {username='slave'} at 127.0.0.1:34650
I20260709 13:05:34.710716 17569 raft_consensus.cc:493] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.711020 17569 raft_consensus.cc:3060] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.716197 17569 raft_consensus.cc:515] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } }
I20260709 13:05:34.718510 17569 leader_election.cc:290] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 2 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:34.718909 17835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c15862f65e48e4a4d1f2bb361fa5ab" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:34.719074 17644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c15862f65e48e4a4d1f2bb361fa5ab" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
I20260709 13:05:34.719676 17644 raft_consensus.cc:3055] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:34.720013 17644 raft_consensus.cc:740] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Running, Role: LEADER
I20260709 13:05:34.720193 17835 raft_consensus.cc:3060] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.720988 17644 consensus_queue.cc:260] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } }
I20260709 13:05:34.722419 17644 raft_consensus.cc:3060] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.725571 17835 raft_consensus.cc:2468] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 2.
I20260709 13:05:34.726722 17534 leader_election.cc:304] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3f9cdf0a9446ce8df45552a499200e, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:34.727530 17896 raft_consensus.cc:2804] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:34.728039 17896 raft_consensus.cc:697] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Becoming Leader. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Running, Role: LEADER
I20260709 13:05:34.728924 17896 consensus_queue.cc:237] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } }
I20260709 13:05:34.731439 17644 raft_consensus.cc:2468] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 2.
I20260709 13:05:34.737998 17390 catalog_manager.cc:5697] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e reported cstate change: term changed from 1 to 2, leader changed from 3a88f06fc6204d8db7657213d85a020a (127.7.25.195) to 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194). New cstate: current_term: 2 leader_uuid: "3c3f9cdf0a9446ce8df45552a499200e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.778890 17644 raft_consensus.cc:1275] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 3 FOLLOWER]: Refusing update from remote peer 3c3f9cdf0a9446ce8df45552a499200e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:34.780403 17896 consensus_queue.cc:1048] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:34.797216 17835 raft_consensus.cc:1275] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Refusing update from remote peer 3c3f9cdf0a9446ce8df45552a499200e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:34.798691 17876 consensus_queue.cc:1048] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.017066 17569 raft_consensus.cc:1275] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Refusing update from remote peer 3a88f06fc6204d8db7657213d85a020a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:35.018793 17792 consensus_queue.cc:1048] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.029587 17835 raft_consensus.cc:1275] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Refusing update from remote peer 3a88f06fc6204d8db7657213d85a020a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:35.031196 17792 consensus_queue.cc:1048] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:35.053303 17441 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:35.170111 17644 raft_consensus.cc:1275] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Refusing update from remote peer 3c3f9cdf0a9446ce8df45552a499200e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:35.171732 17876 consensus_queue.cc:1048] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.185128 17835 raft_consensus.cc:1275] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Refusing update from remote peer 3c3f9cdf0a9446ce8df45552a499200e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:35.187012 17876 consensus_queue.cc:1048] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.201184  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:35.211334 17569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04b29f7376784d9a9effcc3d1f370edf"
dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
mode: GRACEFUL
new_leader_uuid: "3a88f06fc6204d8db7657213d85a020a"
 from {username='slave'} at 127.0.0.1:42412
I20260709 13:05:35.211951 17569 raft_consensus.cc:606] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [term 1 LEADER]: Received request to transfer leadership to TS 3a88f06fc6204d8db7657213d85a020a
I20260709 13:05:35.214989 17569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4ea05cdff60471d8544f2da34ae4243"
dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
mode: GRACEFUL
new_leader_uuid: "3a88f06fc6204d8db7657213d85a020a"
 from {username='slave'} at 127.0.0.1:42412
I20260709 13:05:35.215615 17569 raft_consensus.cc:606] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 3 LEADER]: Received request to transfer leadership to TS 3a88f06fc6204d8db7657213d85a020a
I20260709 13:05:35.218293 17644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6e78ccea70b40fc97e68e533dcc0265"
dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
mode: GRACEFUL
new_leader_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
 from {username='slave'} at 127.0.0.1:35704
I20260709 13:05:35.218768 17644 raft_consensus.cc:606] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [term 1 LEADER]: Received request to transfer leadership to TS 3c3f9cdf0a9446ce8df45552a499200e
I20260709 13:05:35.219913  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:05:35.220423  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:35.221012  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:35.260274 17876 raft_consensus.cc:993] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e: : Instructing follower 3a88f06fc6204d8db7657213d85a020a to start an election
I20260709 13:05:35.260959 17876 raft_consensus.cc:1081] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [term 1 LEADER]: Signalling peer 3a88f06fc6204d8db7657213d85a020a to start an election
I20260709 13:05:35.262427 17644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04b29f7376784d9a9effcc3d1f370edf"
dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
 from {username='slave'} at 127.0.0.1:34452
I20260709 13:05:35.262923 17644 raft_consensus.cc:493] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:35.263190 17644 raft_consensus.cc:3060] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:35.267652 17644 raft_consensus.cc:515] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:35.269176 17644 leader_election.cc:290] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 2 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125)
I20260709 13:05:35.270352 17835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b29f7376784d9a9effcc3d1f370edf" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:35.270366 17569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b29f7376784d9a9effcc3d1f370edf" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
I20260709 13:05:35.270931 17835 raft_consensus.cc:3060] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:35.271185 17569 raft_consensus.cc:3055] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:35.271593 17569 raft_consensus.cc:740] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Running, Role: LEADER
I20260709 13:05:35.272619 17569 consensus_queue.cc:260] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:35.274046 17569 raft_consensus.cc:3060] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:35.276254 17835 raft_consensus.cc:2468] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 2.
I20260709 13:05:35.277344 17608 leader_election.cc:304] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:35.278074 17897 raft_consensus.cc:2804] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:35.278501 17897 raft_consensus.cc:697] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a [term 2 LEADER]: Becoming Leader. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Running, Role: LEADER
I20260709 13:05:35.279450 17897 consensus_queue.cc:237] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:35.282136 17569 raft_consensus.cc:2468] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 2.
I20260709 13:05:35.287561 17393 catalog_manager.cc:5697] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a reported cstate change: term changed from 1 to 2, leader changed from 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194) to 3a88f06fc6204d8db7657213d85a020a (127.7.25.195). New cstate: current_term: 2 leader_uuid: "3a88f06fc6204d8db7657213d85a020a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:35.329844 17914 raft_consensus.cc:993] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a: : Instructing follower 3c3f9cdf0a9446ce8df45552a499200e to start an election
I20260709 13:05:35.330348 17897 raft_consensus.cc:1081] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [term 1 LEADER]: Signalling peer 3c3f9cdf0a9446ce8df45552a499200e to start an election
I20260709 13:05:35.332037 17569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6e78ccea70b40fc97e68e533dcc0265"
dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
 from {username='slave'} at 127.0.0.1:34650
I20260709 13:05:35.332670 17569 raft_consensus.cc:493] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:35.333069 17569 raft_consensus.cc:3060] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:35.341282 17569 raft_consensus.cc:515] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:35.344141 17569 leader_election.cc:290] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 2 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:35.344452 17835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e78ccea70b40fc97e68e533dcc0265" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:35.344697 17644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e78ccea70b40fc97e68e533dcc0265" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
I20260709 13:05:35.345221 17644 raft_consensus.cc:3055] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:35.345315 17835 raft_consensus.cc:3060] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:35.345563 17644 raft_consensus.cc:740] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Running, Role: LEADER
I20260709 13:05:35.346505 17644 consensus_queue.cc:260] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:35.347800 17644 raft_consensus.cc:3060] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:35.352654 17835 raft_consensus.cc:2468] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 2.
I20260709 13:05:35.353919 17534 leader_election.cc:304] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3f9cdf0a9446ce8df45552a499200e, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:35.354425 17644 raft_consensus.cc:2468] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 2.
I20260709 13:05:35.354806 17876 raft_consensus.cc:2804] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:35.355413 17876 raft_consensus.cc:697] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Becoming Leader. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Running, Role: LEADER
I20260709 13:05:35.356393 17876 consensus_queue.cc:237] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:35.360282 17896 raft_consensus.cc:993] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e: : Instructing follower 3a88f06fc6204d8db7657213d85a020a to start an election
I20260709 13:05:35.360773 17876 raft_consensus.cc:1081] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 3 LEADER]: Signalling peer 3a88f06fc6204d8db7657213d85a020a to start an election
I20260709 13:05:35.362426 17644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4ea05cdff60471d8544f2da34ae4243"
dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
 from {username='slave'} at 127.0.0.1:34452
I20260709 13:05:35.363051 17644 raft_consensus.cc:493] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:35.363411 17644 raft_consensus.cc:3060] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:35.364848 17393 catalog_manager.cc:5697] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e reported cstate change: term changed from 1 to 2, leader changed from 3a88f06fc6204d8db7657213d85a020a (127.7.25.195) to 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194). New cstate: current_term: 2 leader_uuid: "3c3f9cdf0a9446ce8df45552a499200e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:35.370944 17644 raft_consensus.cc:515] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:35.373821 17644 leader_election.cc:290] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 4 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125)
I20260709 13:05:35.375051 17569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ea05cdff60471d8544f2da34ae4243" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
I20260709 13:05:35.374964 17835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ea05cdff60471d8544f2da34ae4243" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:35.375927 17835 raft_consensus.cc:3060] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:35.377043 17569 raft_consensus.cc:3055] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:35.377486 17569 raft_consensus.cc:740] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Running, Role: LEADER
I20260709 13:05:35.378578 17569 consensus_queue.cc:260] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:35.379884 17569 raft_consensus.cc:3060] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:35.383481 17835 raft_consensus.cc:2468] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 4.
I20260709 13:05:35.384759 17608 leader_election.cc:304] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:35.385603 17897 raft_consensus.cc:2804] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:35.386140 17897 raft_consensus.cc:697] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 4 LEADER]: Becoming Leader. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Running, Role: LEADER
I20260709 13:05:35.386953 17569 raft_consensus.cc:2468] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 4.
I20260709 13:05:35.387020 17897 consensus_queue.cc:237] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:35.394541 17393 catalog_manager.cc:5697] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a reported cstate change: term changed from 3 to 4, leader changed from 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194) to 3a88f06fc6204d8db7657213d85a020a (127.7.25.195). New cstate: current_term: 4 leader_uuid: "3a88f06fc6204d8db7657213d85a020a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:35.757318 17835 raft_consensus.cc:1275] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Refusing update from remote peer 3c3f9cdf0a9446ce8df45552a499200e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:35.758718 17876 consensus_queue.cc:1048] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.771006 17644 raft_consensus.cc:1275] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Refusing update from remote peer 3c3f9cdf0a9446ce8df45552a499200e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:35.772976 17702 consensus_queue.cc:1048] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:35.800216 17835 raft_consensus.cc:1275] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 4 FOLLOWER]: Refusing update from remote peer 3a88f06fc6204d8db7657213d85a020a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:35.801807 17914 consensus_queue.cc:1048] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.805198 17569 raft_consensus.cc:1275] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 4 FOLLOWER]: Refusing update from remote peer 3a88f06fc6204d8db7657213d85a020a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:35.807060 17914 consensus_queue.cc:1048] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.838799 17569 raft_consensus.cc:1275] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Refusing update from remote peer 3a88f06fc6204d8db7657213d85a020a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:35.844444 17897 consensus_queue.cc:1048] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:35.855754 17835 raft_consensus.cc:1275] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Refusing update from remote peer 3a88f06fc6204d8db7657213d85a020a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:35.858659 17930 consensus_queue.cc:1048] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:36.054461 17441 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:36.231403  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:36.243692 17644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "419a4a24d7264a019316d46cc4f0d807"
dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
mode: GRACEFUL
new_leader_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
 from {username='slave'} at 127.0.0.1:35704
I20260709 13:05:36.244244 17644 raft_consensus.cc:606] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 3 LEADER]: Received request to transfer leadership to TS 3c3f9cdf0a9446ce8df45552a499200e
I20260709 13:05:36.247150 17644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4d897bb6b06464c988dee1dc7fcd7e3"
dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
mode: GRACEFUL
new_leader_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
 from {username='slave'} at 127.0.0.1:35704
I20260709 13:05:36.247738 17644 raft_consensus.cc:606] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 1 LEADER]: Received request to transfer leadership to TS 3c3f9cdf0a9446ce8df45552a499200e
I20260709 13:05:36.250349 17569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3c15862f65e48e4a4d1f2bb361fa5ab"
dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
mode: GRACEFUL
new_leader_uuid: "3a88f06fc6204d8db7657213d85a020a"
 from {username='slave'} at 127.0.0.1:42412
I20260709 13:05:36.250964 17569 raft_consensus.cc:606] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Received request to transfer leadership to TS 3a88f06fc6204d8db7657213d85a020a
I20260709 13:05:36.252420  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:05:36.252952  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:36.253554  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:36.632737 17930 raft_consensus.cc:993] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a: : Instructing follower 3c3f9cdf0a9446ce8df45552a499200e to start an election
I20260709 13:05:36.633445 17914 raft_consensus.cc:1081] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 1 LEADER]: Signalling peer 3c3f9cdf0a9446ce8df45552a499200e to start an election
I20260709 13:05:36.635133 17569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4d897bb6b06464c988dee1dc7fcd7e3"
dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
 from {username='slave'} at 127.0.0.1:34650
I20260709 13:05:36.635613 17569 raft_consensus.cc:493] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:36.635912 17569 raft_consensus.cc:3060] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:36.641093 17569 raft_consensus.cc:515] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:36.642784 17569 leader_election.cc:290] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 2 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:36.643599 17835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d897bb6b06464c988dee1dc7fcd7e3" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:36.644194 17643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d897bb6b06464c988dee1dc7fcd7e3" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
I20260709 13:05:36.644245 17835 raft_consensus.cc:3060] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:36.644867 17643 raft_consensus.cc:3055] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:36.645241 17643 raft_consensus.cc:740] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Running, Role: LEADER
I20260709 13:05:36.646209 17643 consensus_queue.cc:260] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:36.647550 17643 raft_consensus.cc:3060] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:36.651782 17835 raft_consensus.cc:2468] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 2.
I20260709 13:05:36.653508 17534 leader_election.cc:304] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3f9cdf0a9446ce8df45552a499200e, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:36.654258 17896 raft_consensus.cc:2804] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:36.654749 17896 raft_consensus.cc:697] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Becoming Leader. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Running, Role: LEADER
I20260709 13:05:36.655655 17896 consensus_queue.cc:237] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:36.656756 17643 raft_consensus.cc:2468] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 2.
I20260709 13:05:36.664019 17393 catalog_manager.cc:5697] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e reported cstate change: term changed from 1 to 2, leader changed from 3a88f06fc6204d8db7657213d85a020a (127.7.25.195) to 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194). New cstate: current_term: 2 leader_uuid: "3c3f9cdf0a9446ce8df45552a499200e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:36.686414 17702 raft_consensus.cc:993] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e: : Instructing follower 3a88f06fc6204d8db7657213d85a020a to start an election
I20260709 13:05:36.686966 17702 raft_consensus.cc:1081] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Signalling peer 3a88f06fc6204d8db7657213d85a020a to start an election
I20260709 13:05:36.688446 17643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3c15862f65e48e4a4d1f2bb361fa5ab"
dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
 from {username='slave'} at 127.0.0.1:34452
I20260709 13:05:36.688943 17643 raft_consensus.cc:493] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:36.689307 17643 raft_consensus.cc:3060] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.694463 17643 raft_consensus.cc:515] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } }
I20260709 13:05:36.696173 17643 leader_election.cc:290] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 3 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125)
I20260709 13:05:36.697340 17835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c15862f65e48e4a4d1f2bb361fa5ab" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:36.697454 17569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c15862f65e48e4a4d1f2bb361fa5ab" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
I20260709 13:05:36.698158 17835 raft_consensus.cc:3060] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.698235 17569 raft_consensus.cc:3055] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:36.698606 17569 raft_consensus.cc:740] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Running, Role: LEADER
I20260709 13:05:36.699338 17569 consensus_queue.cc:260] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } }
I20260709 13:05:36.700524 17569 raft_consensus.cc:3060] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.704676 17835 raft_consensus.cc:2468] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 3.
I20260709 13:05:36.705886 17608 leader_election.cc:304] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:36.706677 17914 raft_consensus.cc:2804] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:36.706882 17569 raft_consensus.cc:2468] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 3.
I20260709 13:05:36.707218 17914 raft_consensus.cc:697] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 3 LEADER]: Becoming Leader. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Running, Role: LEADER
I20260709 13:05:36.708148 17914 consensus_queue.cc:237] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } }
I20260709 13:05:36.717262 17393 catalog_manager.cc:5697] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a reported cstate change: term changed from 2 to 3, leader changed from 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194) to 3a88f06fc6204d8db7657213d85a020a (127.7.25.195). New cstate: current_term: 3 leader_uuid: "3a88f06fc6204d8db7657213d85a020a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:36.724401 17897 raft_consensus.cc:993] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a: : Instructing follower 3c3f9cdf0a9446ce8df45552a499200e to start an election
I20260709 13:05:36.724942 17897 raft_consensus.cc:1081] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 3 LEADER]: Signalling peer 3c3f9cdf0a9446ce8df45552a499200e to start an election
I20260709 13:05:36.727038 17569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "419a4a24d7264a019316d46cc4f0d807"
dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
 from {username='slave'} at 127.0.0.1:34650
I20260709 13:05:36.727746 17569 raft_consensus.cc:493] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:36.728122 17569 raft_consensus.cc:3060] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:36.733240 17569 raft_consensus.cc:515] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:36.735239 17569 leader_election.cc:290] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 4 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:36.735706 17835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419a4a24d7264a019316d46cc4f0d807" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:36.735802 17643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419a4a24d7264a019316d46cc4f0d807" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
I20260709 13:05:36.736379 17835 raft_consensus.cc:3060] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:36.737033 17643 raft_consensus.cc:3055] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:36.737411 17643 raft_consensus.cc:740] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Running, Role: LEADER
I20260709 13:05:36.738210 17643 consensus_queue.cc:260] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:36.739423 17643 raft_consensus.cc:3060] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:36.743723 17835 raft_consensus.cc:2468] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 4.
I20260709 13:05:36.744961 17534 leader_election.cc:304] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3f9cdf0a9446ce8df45552a499200e, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:36.745972 17702 raft_consensus.cc:2804] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:36.746470 17702 raft_consensus.cc:697] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 4 LEADER]: Becoming Leader. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Running, Role: LEADER
I20260709 13:05:36.746649 17643 raft_consensus.cc:2468] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 4.
I20260709 13:05:36.747354 17702 consensus_queue.cc:237] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:36.756368 17393 catalog_manager.cc:5697] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e reported cstate change: term changed from 3 to 4, leader changed from 3a88f06fc6204d8db7657213d85a020a (127.7.25.195) to 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194). New cstate: current_term: 4 leader_uuid: "3c3f9cdf0a9446ce8df45552a499200e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:37.055505 17441 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:37.070935 17835 raft_consensus.cc:1275] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Refusing update from remote peer 3c3f9cdf0a9446ce8df45552a499200e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:37.072307 17702 consensus_queue.cc:1048] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:37.082340 17643 raft_consensus.cc:1275] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Refusing update from remote peer 3c3f9cdf0a9446ce8df45552a499200e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:37.084161 17896 consensus_queue.cc:1048] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:37.212294 17835 raft_consensus.cc:1275] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 4 FOLLOWER]: Refusing update from remote peer 3c3f9cdf0a9446ce8df45552a499200e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:37.213833 17896 consensus_queue.cc:1048] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:37.213996 17569 raft_consensus.cc:1275] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Refusing update from remote peer 3a88f06fc6204d8db7657213d85a020a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:37.215404 17914 consensus_queue.cc:1048] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:37.224335 17643 raft_consensus.cc:1275] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 4 FOLLOWER]: Refusing update from remote peer 3c3f9cdf0a9446ce8df45552a499200e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:37.226995 17876 consensus_queue.cc:1048] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:37.230106 17835 raft_consensus.cc:1275] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Refusing update from remote peer 3a88f06fc6204d8db7657213d85a020a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:37.234014 17952 consensus_queue.cc:1048] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:37.259961  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:37.267781 17643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a96d46137374b208ccaa960ce9530ae"
dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
mode: GRACEFUL
new_leader_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
 from {username='slave'} at 127.0.0.1:35704
I20260709 13:05:37.268340 17643 raft_consensus.cc:606] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [term 2 LEADER]: Received request to transfer leadership to TS 3c3f9cdf0a9446ce8df45552a499200e
I20260709 13:05:37.270798 17569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1162ebdc359462e918f6aa54bf485eb"
dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
mode: GRACEFUL
new_leader_uuid: "3a88f06fc6204d8db7657213d85a020a"
 from {username='slave'} at 127.0.0.1:42412
I20260709 13:05:37.271309 17569 raft_consensus.cc:606] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [term 1 LEADER]: Received request to transfer leadership to TS 3a88f06fc6204d8db7657213d85a020a
I20260709 13:05:37.273571 17569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4d897bb6b06464c988dee1dc7fcd7e3"
dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
mode: GRACEFUL
new_leader_uuid: "3a88f06fc6204d8db7657213d85a020a"
 from {username='slave'} at 127.0.0.1:42412
I20260709 13:05:37.274026 17569 raft_consensus.cc:606] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Received request to transfer leadership to TS 3a88f06fc6204d8db7657213d85a020a
I20260709 13:05:37.274966  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:05:37.275470  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:37.276019  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:37.502189 17896 raft_consensus.cc:993] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e: : Instructing follower 3a88f06fc6204d8db7657213d85a020a to start an election
I20260709 13:05:37.502903 17876 raft_consensus.cc:1081] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [term 1 LEADER]: Signalling peer 3a88f06fc6204d8db7657213d85a020a to start an election
I20260709 13:05:37.504544 17643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1162ebdc359462e918f6aa54bf485eb"
dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
 from {username='slave'} at 127.0.0.1:34452
I20260709 13:05:37.505038 17643 raft_consensus.cc:493] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.505438 17643 raft_consensus.cc:3060] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.512368 17643 raft_consensus.cc:515] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:37.514350 17643 leader_election.cc:290] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 2 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125)
I20260709 13:05:37.514979 17835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1162ebdc359462e918f6aa54bf485eb" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:37.515378 17569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1162ebdc359462e918f6aa54bf485eb" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
I20260709 13:05:37.515645 17835 raft_consensus.cc:3060] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.515936 17569 raft_consensus.cc:3055] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:37.516261 17569 raft_consensus.cc:740] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Running, Role: LEADER
I20260709 13:05:37.516937 17569 consensus_queue.cc:260] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:37.517925 17569 raft_consensus.cc:3060] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.520463 17835 raft_consensus.cc:2468] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 2.
I20260709 13:05:37.521481 17608 leader_election.cc:304] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:37.522195 17951 raft_consensus.cc:2804] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:37.522570 17569 raft_consensus.cc:2468] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 2.
I20260709 13:05:37.522604 17951 raft_consensus.cc:697] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a [term 2 LEADER]: Becoming Leader. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Running, Role: LEADER
I20260709 13:05:37.523641 17951 consensus_queue.cc:237] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:37.530484 17393 catalog_manager.cc:5697] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a reported cstate change: term changed from 1 to 2, leader changed from 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194) to 3a88f06fc6204d8db7657213d85a020a (127.7.25.195). New cstate: current_term: 2 leader_uuid: "3a88f06fc6204d8db7657213d85a020a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.671154 17702 raft_consensus.cc:993] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e: : Instructing follower 3a88f06fc6204d8db7657213d85a020a to start an election
I20260709 13:05:37.671655 17896 raft_consensus.cc:1081] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Signalling peer 3a88f06fc6204d8db7657213d85a020a to start an election
I20260709 13:05:37.673207 17644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4d897bb6b06464c988dee1dc7fcd7e3"
dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
 from {username='slave'} at 127.0.0.1:34452
I20260709 13:05:37.673668 17644 raft_consensus.cc:493] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.673945 17644 raft_consensus.cc:3060] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.678476 17644 raft_consensus.cc:515] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:37.679932 17644 leader_election.cc:290] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 3 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125)
I20260709 13:05:37.680872 17835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d897bb6b06464c988dee1dc7fcd7e3" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:37.681008 17569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d897bb6b06464c988dee1dc7fcd7e3" candidate_uuid: "3a88f06fc6204d8db7657213d85a020a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
I20260709 13:05:37.681449 17835 raft_consensus.cc:3060] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.681638 17569 raft_consensus.cc:3055] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:37.682044 17569 raft_consensus.cc:740] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Running, Role: LEADER
I20260709 13:05:37.682621 17569 consensus_queue.cc:260] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:37.683460 17569 raft_consensus.cc:3060] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.686169 17835 raft_consensus.cc:2468] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 3.
I20260709 13:05:37.687310 17608 leader_election.cc:304] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a88f06fc6204d8db7657213d85a020a, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:37.688027 17951 raft_consensus.cc:2804] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:37.688395 17569 raft_consensus.cc:2468] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a88f06fc6204d8db7657213d85a020a in term 3.
I20260709 13:05:37.688525 17951 raft_consensus.cc:697] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 3 LEADER]: Becoming Leader. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Running, Role: LEADER
I20260709 13:05:37.689523 17951 consensus_queue.cc:237] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:37.695392 17393 catalog_manager.cc:5697] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a reported cstate change: term changed from 2 to 3, leader changed from 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194) to 3a88f06fc6204d8db7657213d85a020a (127.7.25.195). New cstate: current_term: 3 leader_uuid: "3a88f06fc6204d8db7657213d85a020a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.738672 17914 raft_consensus.cc:993] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a: : Instructing follower 3c3f9cdf0a9446ce8df45552a499200e to start an election
I20260709 13:05:37.739243 17951 raft_consensus.cc:1081] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [term 2 LEADER]: Signalling peer 3c3f9cdf0a9446ce8df45552a499200e to start an election
I20260709 13:05:37.740738 17569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a96d46137374b208ccaa960ce9530ae"
dest_uuid: "3c3f9cdf0a9446ce8df45552a499200e"
 from {username='slave'} at 127.0.0.1:34650
I20260709 13:05:37.741331 17569 raft_consensus.cc:493] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.741575 17569 raft_consensus.cc:3060] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.746440 17569 raft_consensus.cc:515] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:37.747840 17569 leader_election.cc:290] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 3 election: Requested vote from peers c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861), 3a88f06fc6204d8db7657213d85a020a (127.7.25.195:43905)
I20260709 13:05:37.748781 17835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a96d46137374b208ccaa960ce9530ae" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5b90468d1744a1b9427045ee17ce894"
I20260709 13:05:37.748835 17644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a96d46137374b208ccaa960ce9530ae" candidate_uuid: "3c3f9cdf0a9446ce8df45552a499200e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3a88f06fc6204d8db7657213d85a020a"
I20260709 13:05:37.749521 17835 raft_consensus.cc:3060] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.749603 17644 raft_consensus.cc:3055] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:37.750000 17644 raft_consensus.cc:740] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3a88f06fc6204d8db7657213d85a020a, State: Running, Role: LEADER
I20260709 13:05:37.750644 17644 consensus_queue.cc:260] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:37.751530 17644 raft_consensus.cc:3060] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.754439 17835 raft_consensus.cc:2468] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 3.
I20260709 13:05:37.755621 17534 leader_election.cc:304] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3f9cdf0a9446ce8df45552a499200e, c5b90468d1744a1b9427045ee17ce894; no voters: 
I20260709 13:05:37.756335 17896 raft_consensus.cc:2804] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:37.756544 17644 raft_consensus.cc:2468] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f9cdf0a9446ce8df45552a499200e in term 3.
I20260709 13:05:37.756865 17896 raft_consensus.cc:697] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 3 LEADER]: Becoming Leader. State: Replica: 3c3f9cdf0a9446ce8df45552a499200e, State: Running, Role: LEADER
I20260709 13:05:37.757910 17896 consensus_queue.cc:237] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } }
I20260709 13:05:37.765429 17393 catalog_manager.cc:5697] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e reported cstate change: term changed from 2 to 3, leader changed from 3a88f06fc6204d8db7657213d85a020a (127.7.25.195) to 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194). New cstate: current_term: 3 leader_uuid: "3c3f9cdf0a9446ce8df45552a499200e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.926209 17569 raft_consensus.cc:1275] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Refusing update from remote peer 3a88f06fc6204d8db7657213d85a020a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:37.927450 17951 consensus_queue.cc:1048] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:37.939054 17835 raft_consensus.cc:1275] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Refusing update from remote peer 3a88f06fc6204d8db7657213d85a020a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:37.940313 17961 consensus_queue.cc:1048] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:38.056519 17441 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:38.127046 17835 raft_consensus.cc:1275] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Refusing update from remote peer 3a88f06fc6204d8db7657213d85a020a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:38.128692 17961 consensus_queue.cc:1048] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:38.140228 17569 raft_consensus.cc:1275] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Refusing update from remote peer 3a88f06fc6204d8db7657213d85a020a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:38.141774 17969 consensus_queue.cc:1048] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3f9cdf0a9446ce8df45552a499200e" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 45125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:38.282003  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:38.288710 17644 raft_consensus.cc:1275] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [term 3 FOLLOWER]: Refusing update from remote peer 3c3f9cdf0a9446ce8df45552a499200e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:38.290197 17896 consensus_queue.cc:1048] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a88f06fc6204d8db7657213d85a020a" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:38.301091 17835 raft_consensus.cc:1275] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Refusing update from remote peer 3c3f9cdf0a9446ce8df45552a499200e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:38.302659 17896 consensus_queue.cc:1048] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b90468d1744a1b9427045ee17ce894" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:38.317436  7271 tablet_server.cc:179] TabletServer@127.7.25.193:36861 shutting down...
I20260709 13:05:38.339720  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:38.340454  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:38.341408  7271 raft_consensus.cc:2243] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.342046  7271 raft_consensus.cc:2272] T a4ea05cdff60471d8544f2da34ae4243 P c5b90468d1744a1b9427045ee17ce894 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.344120  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:38.344660  7271 raft_consensus.cc:2243] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.345029  7271 raft_consensus.cc:2272] T e01d0c0226174b62940910e6842d3d6f P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.347186  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:38.347707  7271 raft_consensus.cc:2243] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.348075  7271 raft_consensus.cc:2272] T d4d897bb6b06464c988dee1dc7fcd7e3 P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.350410  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:38.350941  7271 raft_consensus.cc:2243] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.351296  7271 raft_consensus.cc:2272] T 6a96d46137374b208ccaa960ce9530ae P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.354058  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:38.354626  7271 raft_consensus.cc:2243] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.355067  7271 raft_consensus.cc:2272] T b87e0199ea6c47ea87b84ef639cae449 P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.356927  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:38.357532  7271 raft_consensus.cc:2243] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.357975  7271 raft_consensus.cc:2272] T 419a4a24d7264a019316d46cc4f0d807 P c5b90468d1744a1b9427045ee17ce894 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.359771  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:38.360283  7271 raft_consensus.cc:2243] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.360710  7271 raft_consensus.cc:2272] T f3c15862f65e48e4a4d1f2bb361fa5ab P c5b90468d1744a1b9427045ee17ce894 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.362636  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:38.363162  7271 raft_consensus.cc:2243] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.363564  7271 raft_consensus.cc:2272] T 04b29f7376784d9a9effcc3d1f370edf P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.365464  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:38.365952  7271 raft_consensus.cc:2243] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.366348  7271 raft_consensus.cc:2272] T b1162ebdc359462e918f6aa54bf485eb P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.368832  7271 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:38.369410  7271 raft_consensus.cc:2243] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.370105  7271 raft_consensus.cc:2272] T d6e78ccea70b40fc97e68e533dcc0265 P c5b90468d1744a1b9427045ee17ce894 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:38.382428 17534 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 80 similar messages]
W20260709 13:05:38.386368 17534 consensus_peers.cc:597] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.401789  7271 tablet_server.cc:196] TabletServer@127.7.25.193:36861 shutdown complete.
I20260709 13:05:38.421501  7271 tablet_server.cc:179] TabletServer@127.7.25.194:0 shutting down...
W20260709 13:05:38.445992 17608 consensus_peers.cc:597] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.445979  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:38.446982  7271 tablet_replica.cc:333] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e: stopping tablet replica
I20260709 13:05:38.447640  7271 raft_consensus.cc:2243] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.448107  7271 raft_consensus.cc:2272] T b87e0199ea6c47ea87b84ef639cae449 P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.450326  7271 tablet_replica.cc:333] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e: stopping tablet replica
I20260709 13:05:38.450937  7271 raft_consensus.cc:2243] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.451740  7271 raft_consensus.cc:2272] T 6a96d46137374b208ccaa960ce9530ae P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.455142  7271 tablet_replica.cc:333] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e: stopping tablet replica
I20260709 13:05:38.455785  7271 raft_consensus.cc:2243] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.456239  7271 raft_consensus.cc:2272] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.459564  7271 tablet_replica.cc:333] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e: stopping tablet replica
I20260709 13:05:38.460161  7271 raft_consensus.cc:2243] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.460966  7271 raft_consensus.cc:2272] T e01d0c0226174b62940910e6842d3d6f P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.463333  7271 tablet_replica.cc:333] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e: stopping tablet replica
I20260709 13:05:38.463877  7271 raft_consensus.cc:2243] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.464296  7271 raft_consensus.cc:2272] T a4ea05cdff60471d8544f2da34ae4243 P 3c3f9cdf0a9446ce8df45552a499200e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.466987  7271 tablet_replica.cc:333] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e: stopping tablet replica
I20260709 13:05:38.467711  7271 raft_consensus.cc:2243] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.469158  7271 raft_consensus.cc:2272] T d6e78ccea70b40fc97e68e533dcc0265 P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:38.471279 17608 consensus_peers.cc:597] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.472067  7271 tablet_replica.cc:333] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e: stopping tablet replica
I20260709 13:05:38.472780  7271 raft_consensus.cc:2243] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.473222  7271 raft_consensus.cc:2272] T b1162ebdc359462e918f6aa54bf485eb P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.475819  7271 tablet_replica.cc:333] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e: stopping tablet replica
I20260709 13:05:38.476308  7271 raft_consensus.cc:2243] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.476980  7271 raft_consensus.cc:2272] T 419a4a24d7264a019316d46cc4f0d807 P 3c3f9cdf0a9446ce8df45552a499200e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.478976  7271 tablet_replica.cc:333] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e: stopping tablet replica
I20260709 13:05:38.479399  7271 raft_consensus.cc:2243] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.479753  7271 raft_consensus.cc:2272] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3c3f9cdf0a9446ce8df45552a499200e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.481691  7271 tablet_replica.cc:333] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e: stopping tablet replica
I20260709 13:05:38.482103  7271 raft_consensus.cc:2243] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.482470  7271 raft_consensus.cc:2272] T 04b29f7376784d9a9effcc3d1f370edf P 3c3f9cdf0a9446ce8df45552a499200e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.516582  7271 tablet_server.cc:196] TabletServer@127.7.25.194:0 shutdown complete.
W20260709 13:05:38.536605 17608 consensus_peers.cc:597] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:38.541240 17607 consensus_peers.cc:597] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a -> Peer 3c3f9cdf0a9446ce8df45552a499200e (127.7.25.194:45125): Couldn't send request to peer 3c3f9cdf0a9446ce8df45552a499200e. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:45125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.543655  7271 tablet_server.cc:179] TabletServer@127.7.25.195:0 shutting down...
W20260709 13:05:38.550534 17608 consensus_peers.cc:597] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:38.567790 17608 consensus_peers.cc:597] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a -> Peer c5b90468d1744a1b9427045ee17ce894 (127.7.25.193:36861): Couldn't send request to peer c5b90468d1744a1b9427045ee17ce894. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:36861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.571553  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:38.572340  7271 tablet_replica.cc:333] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a: stopping tablet replica
I20260709 13:05:38.573011  7271 raft_consensus.cc:2243] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.573544  7271 raft_consensus.cc:2272] T e01d0c0226174b62940910e6842d3d6f P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.575752  7271 tablet_replica.cc:333] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a: stopping tablet replica
I20260709 13:05:38.576390  7271 raft_consensus.cc:2243] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.577229  7271 raft_consensus.cc:2272] T a4ea05cdff60471d8544f2da34ae4243 P 3a88f06fc6204d8db7657213d85a020a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.579416  7271 tablet_replica.cc:333] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a: stopping tablet replica
I20260709 13:05:38.579974  7271 raft_consensus.cc:2243] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.580509  7271 raft_consensus.cc:2272] T d6e78ccea70b40fc97e68e533dcc0265 P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.582599  7271 tablet_replica.cc:333] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a: stopping tablet replica
I20260709 13:05:38.583196  7271 raft_consensus.cc:2243] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.583619  7271 raft_consensus.cc:2272] T 6a96d46137374b208ccaa960ce9530ae P 3a88f06fc6204d8db7657213d85a020a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.586561  7271 tablet_replica.cc:333] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a: stopping tablet replica
I20260709 13:05:38.587162  7271 raft_consensus.cc:2243] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.587955  7271 raft_consensus.cc:2272] T b87e0199ea6c47ea87b84ef639cae449 P 3a88f06fc6204d8db7657213d85a020a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.590140  7271 tablet_replica.cc:333] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a: stopping tablet replica
I20260709 13:05:38.590679  7271 raft_consensus.cc:2243] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.591483  7271 raft_consensus.cc:2272] T d4d897bb6b06464c988dee1dc7fcd7e3 P 3a88f06fc6204d8db7657213d85a020a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.594162  7271 tablet_replica.cc:333] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a: stopping tablet replica
I20260709 13:05:38.594722  7271 raft_consensus.cc:2243] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.595160  7271 raft_consensus.cc:2272] T 419a4a24d7264a019316d46cc4f0d807 P 3a88f06fc6204d8db7657213d85a020a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.597205  7271 tablet_replica.cc:333] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a: stopping tablet replica
I20260709 13:05:38.597748  7271 raft_consensus.cc:2243] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.598515  7271 raft_consensus.cc:2272] T 04b29f7376784d9a9effcc3d1f370edf P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.600455  7271 tablet_replica.cc:333] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a: stopping tablet replica
I20260709 13:05:38.600997  7271 raft_consensus.cc:2243] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.601804  7271 raft_consensus.cc:2272] T f3c15862f65e48e4a4d1f2bb361fa5ab P 3a88f06fc6204d8db7657213d85a020a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.603829  7271 tablet_replica.cc:333] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a: stopping tablet replica
I20260709 13:05:38.604321  7271 raft_consensus.cc:2243] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.605180  7271 raft_consensus.cc:2272] T b1162ebdc359462e918f6aa54bf485eb P 3a88f06fc6204d8db7657213d85a020a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.636070  7271 tablet_server.cc:196] TabletServer@127.7.25.195:0 shutdown complete.
I20260709 13:05:38.662002  7271 master.cc:562] Master@127.7.25.254:42097 shutting down...
I20260709 13:05:38.684906  7271 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.685545  7271 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.685949  7271 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9fa82b94b12841f3a615c5fa4f2d5596: stopping tablet replica
I20260709 13:05:38.722141  7271 master.cc:584] Master@127.7.25.254:42097 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12877 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:05:38.767621  7271 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.25.254:36953
I20260709 13:05:38.768802  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:38.773871 17979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:38.774238 17980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:38.775667 17982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:38.776628  7271 server_base.cc:1061] running on GCE node
I20260709 13:05:38.777664  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:38.777837  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:38.778035  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602338778004 us; error 0 us; skew 500 ppm
I20260709 13:05:38.778597  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:38.780885  7271 webserver.cc:533] Webserver started at http://127.7.25.254:36439/ using document root <none> and password file <none>
I20260709 13:05:38.781495  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:38.781685  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:38.781980  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:38.783088  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602011513864-7271-0/minicluster-data/master-0-root/instance:
uuid: "f19be14aed254934b97b326eaf3ca60e"
format_stamp: "Formatted at 2026-07-09 13:05:38 on dist-test-slave-z1zn"
I20260709 13:05:38.787571  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:05:38.790927 17987 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:38.791682  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:05:38.791970  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602011513864-7271-0/minicluster-data/master-0-root
uuid: "f19be14aed254934b97b326eaf3ca60e"
format_stamp: "Formatted at 2026-07-09 13:05:38 on dist-test-slave-z1zn"
I20260709 13:05:38.792258  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602011513864-7271-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602011513864-7271-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602011513864-7271-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:38.819744  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:38.820978  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:38.859606  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.254:36953
I20260709 13:05:38.859740 18038 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.254:36953 every 8 connection(s)
I20260709 13:05:38.863461 18039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:38.874478 18039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e: Bootstrap starting.
I20260709 13:05:38.879287 18039 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.883544 18039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e: No bootstrap required, opened a new log
I20260709 13:05:38.885862 18039 raft_consensus.cc:359] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f19be14aed254934b97b326eaf3ca60e" member_type: VOTER }
I20260709 13:05:38.886240 18039 raft_consensus.cc:385] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.886509 18039 raft_consensus.cc:740] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f19be14aed254934b97b326eaf3ca60e, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.887020 18039 consensus_queue.cc:260] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f19be14aed254934b97b326eaf3ca60e" member_type: VOTER }
I20260709 13:05:38.887419 18039 raft_consensus.cc:399] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:38.887607 18039 raft_consensus.cc:493] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:38.887831 18039 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.892580 18039 raft_consensus.cc:515] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f19be14aed254934b97b326eaf3ca60e" member_type: VOTER }
I20260709 13:05:38.893155 18039 leader_election.cc:304] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f19be14aed254934b97b326eaf3ca60e; no voters: 
I20260709 13:05:38.894471 18039 leader_election.cc:290] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:38.894824 18042 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:38.896266 18042 raft_consensus.cc:697] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e [term 1 LEADER]: Becoming Leader. State: Replica: f19be14aed254934b97b326eaf3ca60e, State: Running, Role: LEADER
I20260709 13:05:38.896924 18042 consensus_queue.cc:237] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f19be14aed254934b97b326eaf3ca60e" member_type: VOTER }
I20260709 13:05:38.897697 18039 sys_catalog.cc:565] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:38.901345 18043 sys_catalog.cc:455] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f19be14aed254934b97b326eaf3ca60e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f19be14aed254934b97b326eaf3ca60e" member_type: VOTER } }
I20260709 13:05:38.901464 18044 sys_catalog.cc:455] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e [sys.catalog]: SysCatalogTable state changed. Reason: New leader f19be14aed254934b97b326eaf3ca60e. Latest consensus state: current_term: 1 leader_uuid: "f19be14aed254934b97b326eaf3ca60e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f19be14aed254934b97b326eaf3ca60e" member_type: VOTER } }
I20260709 13:05:38.902372 18044 sys_catalog.cc:458] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:38.904368 18043 sys_catalog.cc:458] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:38.905932 18049 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:38.912515 18049 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:38.913552  7271 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:38.921599 18049 catalog_manager.cc:1383] Generated new cluster ID: 7aa7b838ff1c480aa35e261bb9ca3b8a
I20260709 13:05:38.921942 18049 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:38.941967 18049 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:38.943233 18049 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:38.958880 18049 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e: Generated new TSK 0
I20260709 13:05:38.959587 18049 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:38.980943  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:38.987515 18060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:38.988826 18061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:38.990427  7271 server_base.cc:1061] running on GCE node
W20260709 13:05:38.990978 18063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:38.992079  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:38.992321  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:38.992492  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602338992469 us; error 0 us; skew 500 ppm
I20260709 13:05:38.993026  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:38.995455  7271 webserver.cc:533] Webserver started at http://127.7.25.193:35617/ using document root <none> and password file <none>
I20260709 13:05:38.995956  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:38.996163  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:38.996423  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:38.997602  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602011513864-7271-0/minicluster-data/ts-0-root/instance:
uuid: "90778a284eb94de982518efadd354606"
format_stamp: "Formatted at 2026-07-09 13:05:38 on dist-test-slave-z1zn"
I20260709 13:05:39.002087  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:39.005561 18068 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.006477  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:39.006765  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602011513864-7271-0/minicluster-data/ts-0-root
uuid: "90778a284eb94de982518efadd354606"
format_stamp: "Formatted at 2026-07-09 13:05:38 on dist-test-slave-z1zn"
I20260709 13:05:39.007005  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602011513864-7271-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602011513864-7271-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602011513864-7271-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.019853  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.021003  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.022477  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:39.024767  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:39.024946  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.025301  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:39.025460  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.066442  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.193:36891
I20260709 13:05:39.066560 18130 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.193:36891 every 8 connection(s)
I20260709 13:05:39.071431  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.078796 18135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.079653 18136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.082803 18138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.084074  7271 server_base.cc:1061] running on GCE node
I20260709 13:05:39.085150  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.085376  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.085574  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602339085555 us; error 0 us; skew 500 ppm
I20260709 13:05:39.086304 18131 heartbeater.cc:344] Connected to a master server at 127.7.25.254:36953
I20260709 13:05:39.086331  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.086820 18131 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:39.087630 18131 heartbeater.cc:507] Master 127.7.25.254:36953 requested a full tablet report, sending...
I20260709 13:05:39.089582  7271 webserver.cc:533] Webserver started at http://127.7.25.194:34127/ using document root <none> and password file <none>
I20260709 13:05:39.089967 18004 ts_manager.cc:194] Registered new tserver with Master: 90778a284eb94de982518efadd354606 (127.7.25.193:36891)
I20260709 13:05:39.090299  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.090605  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.090934  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.092381  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602011513864-7271-0/minicluster-data/ts-1-root/instance:
uuid: "417b39057e5f44d1b328b6e2c9f66bf4"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-z1zn"
I20260709 13:05:39.092483 18004 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41202
I20260709 13:05:39.097312  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.003s
I20260709 13:05:39.100945 18143 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.101806  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:39.102104  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602011513864-7271-0/minicluster-data/ts-1-root
uuid: "417b39057e5f44d1b328b6e2c9f66bf4"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-z1zn"
I20260709 13:05:39.102415  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602011513864-7271-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602011513864-7271-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602011513864-7271-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.131373  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.132673  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.134176  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:39.136385  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:39.136611  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.136850  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:39.137020  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.177417  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.194:35799
I20260709 13:05:39.177528 18205 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.194:35799 every 8 connection(s)
I20260709 13:05:39.182472  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.189460 18209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.191062 18210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.194643 18212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.194844 18206 heartbeater.cc:344] Connected to a master server at 127.7.25.254:36953
I20260709 13:05:39.195071  7271 server_base.cc:1061] running on GCE node
I20260709 13:05:39.195400 18206 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:39.196084  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.196365  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.196352 18206 heartbeater.cc:507] Master 127.7.25.254:36953 requested a full tablet report, sending...
I20260709 13:05:39.196834  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602339196812 us; error 0 us; skew 500 ppm
I20260709 13:05:39.197616  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.199029 18004 ts_manager.cc:194] Registered new tserver with Master: 417b39057e5f44d1b328b6e2c9f66bf4 (127.7.25.194:35799)
I20260709 13:05:39.200651  7271 webserver.cc:533] Webserver started at http://127.7.25.195:33893/ using document root <none> and password file <none>
I20260709 13:05:39.201129 18004 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41216
I20260709 13:05:39.201357  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.201682  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.201997  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.203439  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602011513864-7271-0/minicluster-data/ts-2-root/instance:
uuid: "0f0461c64d0947ff9e35ec87077276e5"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-z1zn"
I20260709 13:05:39.208281  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:05:39.212093 18217 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.212994  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:39.213409  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602011513864-7271-0/minicluster-data/ts-2-root
uuid: "0f0461c64d0947ff9e35ec87077276e5"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-z1zn"
I20260709 13:05:39.213685  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602011513864-7271-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602011513864-7271-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602011513864-7271-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.235869  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.237066  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.238584  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:39.240813  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:39.241041  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.241361  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:39.241540  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.281677  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.195:40579
I20260709 13:05:39.281801 18279 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.195:40579 every 8 connection(s)
I20260709 13:05:39.295924 18280 heartbeater.cc:344] Connected to a master server at 127.7.25.254:36953
I20260709 13:05:39.296397 18280 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:39.297178 18280 heartbeater.cc:507] Master 127.7.25.254:36953 requested a full tablet report, sending...
I20260709 13:05:39.299135 18004 ts_manager.cc:194] Registered new tserver with Master: 0f0461c64d0947ff9e35ec87077276e5 (127.7.25.195:40579)
I20260709 13:05:39.299614  7271 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014761233s
I20260709 13:05:39.300916 18004 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41222
I20260709 13:05:39.326686 18004 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41232:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:39.328791 18004 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:39.400318 18095 tablet_service.cc:1511] Processing CreateTablet for tablet 5167988b17c244739fb4d2de9a2c44ec (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=02758488a34448ab9ee87fd70c5b0259]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:39.400307 18096 tablet_service.cc:1511] Processing CreateTablet for tablet 43582a74cda94c32af6da1b7be4930cf (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=02758488a34448ab9ee87fd70c5b0259]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:39.401969 18095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5167988b17c244739fb4d2de9a2c44ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.402588 18096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43582a74cda94c32af6da1b7be4930cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.416869 18245 tablet_service.cc:1511] Processing CreateTablet for tablet 43582a74cda94c32af6da1b7be4930cf (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=02758488a34448ab9ee87fd70c5b0259]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:39.418375 18245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43582a74cda94c32af6da1b7be4930cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.419433 18244 tablet_service.cc:1511] Processing CreateTablet for tablet 5167988b17c244739fb4d2de9a2c44ec (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=02758488a34448ab9ee87fd70c5b0259]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:39.419952 18171 tablet_service.cc:1511] Processing CreateTablet for tablet 43582a74cda94c32af6da1b7be4930cf (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=02758488a34448ab9ee87fd70c5b0259]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:39.420806 18244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5167988b17c244739fb4d2de9a2c44ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.421810 18171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43582a74cda94c32af6da1b7be4930cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.426489 18170 tablet_service.cc:1511] Processing CreateTablet for tablet 5167988b17c244739fb4d2de9a2c44ec (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=02758488a34448ab9ee87fd70c5b0259]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:39.428318 18170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5167988b17c244739fb4d2de9a2c44ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.453959 18296 tablet_bootstrap.cc:492] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5: Bootstrap starting.
I20260709 13:05:39.456594 18297 tablet_bootstrap.cc:492] T 5167988b17c244739fb4d2de9a2c44ec P 417b39057e5f44d1b328b6e2c9f66bf4: Bootstrap starting.
I20260709 13:05:39.459604 18295 tablet_bootstrap.cc:492] T 5167988b17c244739fb4d2de9a2c44ec P 90778a284eb94de982518efadd354606: Bootstrap starting.
I20260709 13:05:39.461922 18296 tablet_bootstrap.cc:654] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.464764 18297 tablet_bootstrap.cc:654] T 5167988b17c244739fb4d2de9a2c44ec P 417b39057e5f44d1b328b6e2c9f66bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.467381 18295 tablet_bootstrap.cc:654] T 5167988b17c244739fb4d2de9a2c44ec P 90778a284eb94de982518efadd354606: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.468281 18296 tablet_bootstrap.cc:492] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5: No bootstrap required, opened a new log
I20260709 13:05:39.468752 18296 ts_tablet_manager.cc:1403] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.005s
I20260709 13:05:39.470384 18297 tablet_bootstrap.cc:492] T 5167988b17c244739fb4d2de9a2c44ec P 417b39057e5f44d1b328b6e2c9f66bf4: No bootstrap required, opened a new log
I20260709 13:05:39.470922 18297 ts_tablet_manager.cc:1403] T 5167988b17c244739fb4d2de9a2c44ec P 417b39057e5f44d1b328b6e2c9f66bf4: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:05:39.472399 18295 tablet_bootstrap.cc:492] T 5167988b17c244739fb4d2de9a2c44ec P 90778a284eb94de982518efadd354606: No bootstrap required, opened a new log
I20260709 13:05:39.472076 18296 raft_consensus.cc:359] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.472883 18295 ts_tablet_manager.cc:1403] T 5167988b17c244739fb4d2de9a2c44ec P 90778a284eb94de982518efadd354606: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:05:39.472936 18296 raft_consensus.cc:385] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.473393 18296 raft_consensus.cc:740] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0461c64d0947ff9e35ec87077276e5, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.473905 18297 raft_consensus.cc:359] T 5167988b17c244739fb4d2de9a2c44ec P 417b39057e5f44d1b328b6e2c9f66bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.474218 18296 consensus_queue.cc:260] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.474679 18297 raft_consensus.cc:385] T 5167988b17c244739fb4d2de9a2c44ec P 417b39057e5f44d1b328b6e2c9f66bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.475107 18297 raft_consensus.cc:740] T 5167988b17c244739fb4d2de9a2c44ec P 417b39057e5f44d1b328b6e2c9f66bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 417b39057e5f44d1b328b6e2c9f66bf4, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.475667 18295 raft_consensus.cc:359] T 5167988b17c244739fb4d2de9a2c44ec P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.476663 18295 raft_consensus.cc:385] T 5167988b17c244739fb4d2de9a2c44ec P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.476197 18297 consensus_queue.cc:260] T 5167988b17c244739fb4d2de9a2c44ec P 417b39057e5f44d1b328b6e2c9f66bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.477068 18295 raft_consensus.cc:740] T 5167988b17c244739fb4d2de9a2c44ec P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90778a284eb94de982518efadd354606, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.478286 18295 consensus_queue.cc:260] T 5167988b17c244739fb4d2de9a2c44ec P 90778a284eb94de982518efadd354606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.481015 18280 heartbeater.cc:499] Master 127.7.25.254:36953 was elected leader, sending a full tablet report...
I20260709 13:05:39.483767 18297 ts_tablet_manager.cc:1434] T 5167988b17c244739fb4d2de9a2c44ec P 417b39057e5f44d1b328b6e2c9f66bf4: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 13:05:39.485466 18206 heartbeater.cc:499] Master 127.7.25.254:36953 was elected leader, sending a full tablet report...
I20260709 13:05:39.486187 18296 ts_tablet_manager.cc:1434] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5: Time spent starting tablet: real 0.017s	user 0.017s	sys 0.001s
I20260709 13:05:39.487253 18296 tablet_bootstrap.cc:492] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5: Bootstrap starting.
I20260709 13:05:39.488065 18131 heartbeater.cc:499] Master 127.7.25.254:36953 was elected leader, sending a full tablet report...
I20260709 13:05:39.488970 18295 ts_tablet_manager.cc:1434] T 5167988b17c244739fb4d2de9a2c44ec P 90778a284eb94de982518efadd354606: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.004s
I20260709 13:05:39.490091 18295 tablet_bootstrap.cc:492] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606: Bootstrap starting.
I20260709 13:05:39.494266 18296 tablet_bootstrap.cc:654] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.495883 18295 tablet_bootstrap.cc:654] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.496876 18297 tablet_bootstrap.cc:492] T 43582a74cda94c32af6da1b7be4930cf P 417b39057e5f44d1b328b6e2c9f66bf4: Bootstrap starting.
I20260709 13:05:39.483790 18302 raft_consensus.cc:493] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.504099 18302 raft_consensus.cc:515] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.517446 18302 leader_election.cc:290] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90778a284eb94de982518efadd354606 (127.7.25.193:36891), 417b39057e5f44d1b328b6e2c9f66bf4 (127.7.25.194:35799)
I20260709 13:05:39.521716 18297 tablet_bootstrap.cc:654] T 43582a74cda94c32af6da1b7be4930cf P 417b39057e5f44d1b328b6e2c9f66bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.525947 18296 tablet_bootstrap.cc:492] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5: No bootstrap required, opened a new log
I20260709 13:05:39.526531 18296 ts_tablet_manager.cc:1403] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.014s
I20260709 13:05:39.527200 18295 tablet_bootstrap.cc:492] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606: No bootstrap required, opened a new log
I20260709 13:05:39.527717 18295 ts_tablet_manager.cc:1403] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606: Time spent bootstrapping tablet: real 0.038s	user 0.022s	sys 0.005s
I20260709 13:05:39.529748 18296 raft_consensus.cc:359] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } }
I20260709 13:05:39.530562 18296 raft_consensus.cc:385] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.530884 18296 raft_consensus.cc:740] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0461c64d0947ff9e35ec87077276e5, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.530831 18295 raft_consensus.cc:359] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } }
I20260709 13:05:39.534552 18295 raft_consensus.cc:385] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.531565 18106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5167988b17c244739fb4d2de9a2c44ec" candidate_uuid: "0f0461c64d0947ff9e35ec87077276e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90778a284eb94de982518efadd354606" is_pre_election: true
I20260709 13:05:39.531941 18296 consensus_queue.cc:260] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } }
I20260709 13:05:39.535215 18295 raft_consensus.cc:740] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90778a284eb94de982518efadd354606, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.536744 18106 raft_consensus.cc:2468] T 5167988b17c244739fb4d2de9a2c44ec P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0461c64d0947ff9e35ec87077276e5 in term 0.
I20260709 13:05:39.537479 18181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5167988b17c244739fb4d2de9a2c44ec" candidate_uuid: "0f0461c64d0947ff9e35ec87077276e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" is_pre_election: true
I20260709 13:05:39.537312 18295 consensus_queue.cc:260] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } }
I20260709 13:05:39.538184 18221 leader_election.cc:304] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0461c64d0947ff9e35ec87077276e5, 90778a284eb94de982518efadd354606; no voters: 
I20260709 13:05:39.539680 18295 ts_tablet_manager.cc:1434] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.007s
I20260709 13:05:39.540472 18302 raft_consensus.cc:2804] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:39.540907 18296 ts_tablet_manager.cc:1434] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 13:05:39.538226 18181 raft_consensus.cc:2468] T 5167988b17c244739fb4d2de9a2c44ec P 417b39057e5f44d1b328b6e2c9f66bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0461c64d0947ff9e35ec87077276e5 in term 0.
I20260709 13:05:39.540884 18302 raft_consensus.cc:493] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.542286 18302 raft_consensus.cc:3060] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.548250 18302 raft_consensus.cc:515] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.549649 18297 tablet_bootstrap.cc:492] T 43582a74cda94c32af6da1b7be4930cf P 417b39057e5f44d1b328b6e2c9f66bf4: No bootstrap required, opened a new log
I20260709 13:05:39.550999 18302 leader_election.cc:290] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [CANDIDATE]: Term 1 election: Requested vote from peers 90778a284eb94de982518efadd354606 (127.7.25.193:36891), 417b39057e5f44d1b328b6e2c9f66bf4 (127.7.25.194:35799)
I20260709 13:05:39.551041 18106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5167988b17c244739fb4d2de9a2c44ec" candidate_uuid: "0f0461c64d0947ff9e35ec87077276e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90778a284eb94de982518efadd354606"
I20260709 13:05:39.551836 18106 raft_consensus.cc:3060] T 5167988b17c244739fb4d2de9a2c44ec P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.550274 18297 ts_tablet_manager.cc:1403] T 43582a74cda94c32af6da1b7be4930cf P 417b39057e5f44d1b328b6e2c9f66bf4: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.002s
I20260709 13:05:39.552107 18181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5167988b17c244739fb4d2de9a2c44ec" candidate_uuid: "0f0461c64d0947ff9e35ec87077276e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "417b39057e5f44d1b328b6e2c9f66bf4"
I20260709 13:05:39.552744 18181 raft_consensus.cc:3060] T 5167988b17c244739fb4d2de9a2c44ec P 417b39057e5f44d1b328b6e2c9f66bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.555531 18297 raft_consensus.cc:359] T 43582a74cda94c32af6da1b7be4930cf P 417b39057e5f44d1b328b6e2c9f66bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } }
I20260709 13:05:39.556411 18297 raft_consensus.cc:385] T 43582a74cda94c32af6da1b7be4930cf P 417b39057e5f44d1b328b6e2c9f66bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.556743 18297 raft_consensus.cc:740] T 43582a74cda94c32af6da1b7be4930cf P 417b39057e5f44d1b328b6e2c9f66bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 417b39057e5f44d1b328b6e2c9f66bf4, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.557586 18297 consensus_queue.cc:260] T 43582a74cda94c32af6da1b7be4930cf P 417b39057e5f44d1b328b6e2c9f66bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } }
I20260709 13:05:39.559310 18106 raft_consensus.cc:2468] T 5167988b17c244739fb4d2de9a2c44ec P 90778a284eb94de982518efadd354606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0461c64d0947ff9e35ec87077276e5 in term 1.
I20260709 13:05:39.559818 18297 ts_tablet_manager.cc:1434] T 43582a74cda94c32af6da1b7be4930cf P 417b39057e5f44d1b328b6e2c9f66bf4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:39.560357 18221 leader_election.cc:304] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0461c64d0947ff9e35ec87077276e5, 90778a284eb94de982518efadd354606; no voters: 
I20260709 13:05:39.561286 18302 raft_consensus.cc:2804] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:39.561694 18302 raft_consensus.cc:697] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0461c64d0947ff9e35ec87077276e5, State: Running, Role: LEADER
I20260709 13:05:39.562470 18302 consensus_queue.cc:237] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.562806 18181 raft_consensus.cc:2468] T 5167988b17c244739fb4d2de9a2c44ec P 417b39057e5f44d1b328b6e2c9f66bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0461c64d0947ff9e35ec87077276e5 in term 1.
I20260709 13:05:39.570291 18003 catalog_manager.cc:5697] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0461c64d0947ff9e35ec87077276e5 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "0f0461c64d0947ff9e35ec87077276e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:39.576846 18302 raft_consensus.cc:493] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.577581 18302 raft_consensus.cc:515] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } }
I20260709 13:05:39.579510 18302 leader_election.cc:290] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90778a284eb94de982518efadd354606 (127.7.25.193:36891), 417b39057e5f44d1b328b6e2c9f66bf4 (127.7.25.194:35799)
I20260709 13:05:39.580174 18106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43582a74cda94c32af6da1b7be4930cf" candidate_uuid: "0f0461c64d0947ff9e35ec87077276e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90778a284eb94de982518efadd354606" is_pre_election: true
I20260709 13:05:39.580506 18181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43582a74cda94c32af6da1b7be4930cf" candidate_uuid: "0f0461c64d0947ff9e35ec87077276e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" is_pre_election: true
I20260709 13:05:39.580912 18106 raft_consensus.cc:2468] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0461c64d0947ff9e35ec87077276e5 in term 0.
I20260709 13:05:39.581190 18181 raft_consensus.cc:2468] T 43582a74cda94c32af6da1b7be4930cf P 417b39057e5f44d1b328b6e2c9f66bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0461c64d0947ff9e35ec87077276e5 in term 0.
I20260709 13:05:39.582031 18221 leader_election.cc:304] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0461c64d0947ff9e35ec87077276e5, 90778a284eb94de982518efadd354606; no voters: 
I20260709 13:05:39.582732 18302 raft_consensus.cc:2804] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:39.583123 18302 raft_consensus.cc:493] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.583398 18302 raft_consensus.cc:3060] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.589453 18302 raft_consensus.cc:515] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } }
I20260709 13:05:39.591148 18302 leader_election.cc:290] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [CANDIDATE]: Term 1 election: Requested vote from peers 90778a284eb94de982518efadd354606 (127.7.25.193:36891), 417b39057e5f44d1b328b6e2c9f66bf4 (127.7.25.194:35799)
I20260709 13:05:39.591941 18106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43582a74cda94c32af6da1b7be4930cf" candidate_uuid: "0f0461c64d0947ff9e35ec87077276e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90778a284eb94de982518efadd354606"
I20260709 13:05:39.592160 18181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43582a74cda94c32af6da1b7be4930cf" candidate_uuid: "0f0461c64d0947ff9e35ec87077276e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "417b39057e5f44d1b328b6e2c9f66bf4"
I20260709 13:05:39.592617 18106 raft_consensus.cc:3060] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.592698 18181 raft_consensus.cc:3060] T 43582a74cda94c32af6da1b7be4930cf P 417b39057e5f44d1b328b6e2c9f66bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.599737 18181 raft_consensus.cc:2468] T 43582a74cda94c32af6da1b7be4930cf P 417b39057e5f44d1b328b6e2c9f66bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0461c64d0947ff9e35ec87077276e5 in term 1.
I20260709 13:05:39.599737 18106 raft_consensus.cc:2468] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0461c64d0947ff9e35ec87077276e5 in term 1.
I20260709 13:05:39.601092 18218 leader_election.cc:304] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0461c64d0947ff9e35ec87077276e5, 417b39057e5f44d1b328b6e2c9f66bf4; no voters: 
I20260709 13:05:39.601917 18302 raft_consensus.cc:2804] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:39.602427 18302 raft_consensus.cc:697] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0461c64d0947ff9e35ec87077276e5, State: Running, Role: LEADER
I20260709 13:05:39.603060 18302 consensus_queue.cc:237] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } }
I20260709 13:05:39.611291 18003 catalog_manager.cc:5697] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0461c64d0947ff9e35ec87077276e5 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "0f0461c64d0947ff9e35ec87077276e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:39.682166 18003 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41244:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:39.684197 18003 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:39.709197 18095 tablet_service.cc:1511] Processing CreateTablet for tablet e3f5bf6c14574ffe889316261df03661 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=49b7e1833a4f45d28bd4d6586550f004]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:39.710472 18095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3f5bf6c14574ffe889316261df03661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.711247 18170 tablet_service.cc:1511] Processing CreateTablet for tablet e3f5bf6c14574ffe889316261df03661 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=49b7e1833a4f45d28bd4d6586550f004]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:39.712586 18170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3f5bf6c14574ffe889316261df03661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.712594 18245 tablet_service.cc:1511] Processing CreateTablet for tablet e3f5bf6c14574ffe889316261df03661 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=49b7e1833a4f45d28bd4d6586550f004]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:39.713995 18245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3f5bf6c14574ffe889316261df03661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.716152 18171 tablet_service.cc:1511] Processing CreateTablet for tablet 41a4952308b145e0ae57ca89b0486a4f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=49b7e1833a4f45d28bd4d6586550f004]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:39.717487 18171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a4952308b145e0ae57ca89b0486a4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.727013 18096 tablet_service.cc:1511] Processing CreateTablet for tablet 41a4952308b145e0ae57ca89b0486a4f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=49b7e1833a4f45d28bd4d6586550f004]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:39.728387 18096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a4952308b145e0ae57ca89b0486a4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.729117 18297 tablet_bootstrap.cc:492] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4: Bootstrap starting.
I20260709 13:05:39.729995 18295 tablet_bootstrap.cc:492] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606: Bootstrap starting.
I20260709 13:05:39.736588 18244 tablet_service.cc:1511] Processing CreateTablet for tablet 41a4952308b145e0ae57ca89b0486a4f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=49b7e1833a4f45d28bd4d6586550f004]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:39.737098 18297 tablet_bootstrap.cc:654] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.738060 18244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a4952308b145e0ae57ca89b0486a4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.743234 18295 tablet_bootstrap.cc:654] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.744637 18296 tablet_bootstrap.cc:492] T e3f5bf6c14574ffe889316261df03661 P 0f0461c64d0947ff9e35ec87077276e5: Bootstrap starting.
I20260709 13:05:39.751175 18296 tablet_bootstrap.cc:654] T e3f5bf6c14574ffe889316261df03661 P 0f0461c64d0947ff9e35ec87077276e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.756029 18295 tablet_bootstrap.cc:492] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606: No bootstrap required, opened a new log
I20260709 13:05:39.756809 18295 ts_tablet_manager.cc:1403] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606: Time spent bootstrapping tablet: real 0.027s	user 0.003s	sys 0.015s
I20260709 13:05:39.759182 18297 tablet_bootstrap.cc:492] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4: No bootstrap required, opened a new log
I20260709 13:05:39.759774 18297 ts_tablet_manager.cc:1403] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.007s
I20260709 13:05:39.759974 18295 raft_consensus.cc:359] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.761231 18295 raft_consensus.cc:385] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.761561 18295 raft_consensus.cc:740] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90778a284eb94de982518efadd354606, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.762471 18295 consensus_queue.cc:260] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.763327 18296 tablet_bootstrap.cc:492] T e3f5bf6c14574ffe889316261df03661 P 0f0461c64d0947ff9e35ec87077276e5: No bootstrap required, opened a new log
I20260709 13:05:39.763207 18297 raft_consensus.cc:359] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.763960 18296 ts_tablet_manager.cc:1403] T e3f5bf6c14574ffe889316261df03661 P 0f0461c64d0947ff9e35ec87077276e5: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.002s
I20260709 13:05:39.764082 18297 raft_consensus.cc:385] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.764520 18297 raft_consensus.cc:740] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 417b39057e5f44d1b328b6e2c9f66bf4, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.765509 18297 consensus_queue.cc:260] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.766935 18295 ts_tablet_manager.cc:1434] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:05:39.767539 18296 raft_consensus.cc:359] T e3f5bf6c14574ffe889316261df03661 P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.768028 18295 tablet_bootstrap.cc:492] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606: Bootstrap starting.
I20260709 13:05:39.768326 18296 raft_consensus.cc:385] T e3f5bf6c14574ffe889316261df03661 P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.768658 18296 raft_consensus.cc:740] T e3f5bf6c14574ffe889316261df03661 P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0461c64d0947ff9e35ec87077276e5, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.769424 18296 consensus_queue.cc:260] T e3f5bf6c14574ffe889316261df03661 P 0f0461c64d0947ff9e35ec87077276e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.770088 18297 ts_tablet_manager.cc:1434] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:05:39.770704 18304 raft_consensus.cc:493] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.771195 18304 raft_consensus.cc:515] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.772110 18296 ts_tablet_manager.cc:1434] T e3f5bf6c14574ffe889316261df03661 P 0f0461c64d0947ff9e35ec87077276e5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 13:05:39.773239 18296 tablet_bootstrap.cc:492] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5: Bootstrap starting.
I20260709 13:05:39.773777 18304 leader_election.cc:290] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 417b39057e5f44d1b328b6e2c9f66bf4 (127.7.25.194:35799), 0f0461c64d0947ff9e35ec87077276e5 (127.7.25.195:40579)
I20260709 13:05:39.773993 18297 tablet_bootstrap.cc:492] T 41a4952308b145e0ae57ca89b0486a4f P 417b39057e5f44d1b328b6e2c9f66bf4: Bootstrap starting.
I20260709 13:05:39.779845 18296 tablet_bootstrap.cc:654] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.788079 18297 tablet_bootstrap.cc:654] T 41a4952308b145e0ae57ca89b0486a4f P 417b39057e5f44d1b328b6e2c9f66bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.794340 18296 tablet_bootstrap.cc:492] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5: No bootstrap required, opened a new log
I20260709 13:05:39.795079 18296 ts_tablet_manager.cc:1403] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 13:05:39.798591 18296 raft_consensus.cc:359] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.799378 18296 raft_consensus.cc:385] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.799705 18296 raft_consensus.cc:740] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0461c64d0947ff9e35ec87077276e5, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.800102 18295 tablet_bootstrap.cc:654] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.794342 18297 tablet_bootstrap.cc:492] T 41a4952308b145e0ae57ca89b0486a4f P 417b39057e5f44d1b328b6e2c9f66bf4: No bootstrap required, opened a new log
I20260709 13:05:39.801129 18297 ts_tablet_manager.cc:1403] T 41a4952308b145e0ae57ca89b0486a4f P 417b39057e5f44d1b328b6e2c9f66bf4: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.006s
I20260709 13:05:39.804097 18296 consensus_queue.cc:260] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.806841 18296 ts_tablet_manager.cc:1434] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:05:39.807813 18297 raft_consensus.cc:359] T 41a4952308b145e0ae57ca89b0486a4f P 417b39057e5f44d1b328b6e2c9f66bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.808672 18297 raft_consensus.cc:385] T 41a4952308b145e0ae57ca89b0486a4f P 417b39057e5f44d1b328b6e2c9f66bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.808974 18297 raft_consensus.cc:740] T 41a4952308b145e0ae57ca89b0486a4f P 417b39057e5f44d1b328b6e2c9f66bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 417b39057e5f44d1b328b6e2c9f66bf4, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.809851 18297 consensus_queue.cc:260] T 41a4952308b145e0ae57ca89b0486a4f P 417b39057e5f44d1b328b6e2c9f66bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.814596 18297 ts_tablet_manager.cc:1434] T 41a4952308b145e0ae57ca89b0486a4f P 417b39057e5f44d1b328b6e2c9f66bf4: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.004s
I20260709 13:05:39.818790 18181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f5bf6c14574ffe889316261df03661" candidate_uuid: "90778a284eb94de982518efadd354606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" is_pre_election: true
I20260709 13:05:39.819519 18181 raft_consensus.cc:2468] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90778a284eb94de982518efadd354606 in term 0.
I20260709 13:05:39.820863 18069 leader_election.cc:304] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 417b39057e5f44d1b328b6e2c9f66bf4, 90778a284eb94de982518efadd354606; no voters: 
I20260709 13:05:39.821609 18295 tablet_bootstrap.cc:492] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606: No bootstrap required, opened a new log
I20260709 13:05:39.821863 18304 raft_consensus.cc:2804] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:39.822214 18295 ts_tablet_manager.cc:1403] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.008s
I20260709 13:05:39.822243 18304 raft_consensus.cc:493] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.823350 18304 raft_consensus.cc:3060] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.820641 18255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f5bf6c14574ffe889316261df03661" candidate_uuid: "90778a284eb94de982518efadd354606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0461c64d0947ff9e35ec87077276e5" is_pre_election: true
I20260709 13:05:39.824311 18255 raft_consensus.cc:2468] T e3f5bf6c14574ffe889316261df03661 P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90778a284eb94de982518efadd354606 in term 0.
I20260709 13:05:39.825717 18295 raft_consensus.cc:359] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.826548 18295 raft_consensus.cc:385] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.826849 18295 raft_consensus.cc:740] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90778a284eb94de982518efadd354606, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.827646 18295 consensus_queue.cc:260] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.830744 18295 ts_tablet_manager.cc:1434] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:05:39.832149 18304 raft_consensus.cc:515] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.834774 18181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f5bf6c14574ffe889316261df03661" candidate_uuid: "90778a284eb94de982518efadd354606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "417b39057e5f44d1b328b6e2c9f66bf4"
I20260709 13:05:39.835062 18255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f5bf6c14574ffe889316261df03661" candidate_uuid: "90778a284eb94de982518efadd354606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0461c64d0947ff9e35ec87077276e5"
I20260709 13:05:39.835287 18304 leader_election.cc:290] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [CANDIDATE]: Term 1 election: Requested vote from peers 417b39057e5f44d1b328b6e2c9f66bf4 (127.7.25.194:35799), 0f0461c64d0947ff9e35ec87077276e5 (127.7.25.195:40579)
I20260709 13:05:39.835399 18181 raft_consensus.cc:3060] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.835752 18255 raft_consensus.cc:3060] T e3f5bf6c14574ffe889316261df03661 P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.842396 18181 raft_consensus.cc:2468] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90778a284eb94de982518efadd354606 in term 1.
I20260709 13:05:39.842496 18255 raft_consensus.cc:2468] T e3f5bf6c14574ffe889316261df03661 P 0f0461c64d0947ff9e35ec87077276e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90778a284eb94de982518efadd354606 in term 1.
I20260709 13:05:39.843430 18069 leader_election.cc:304] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 417b39057e5f44d1b328b6e2c9f66bf4, 90778a284eb94de982518efadd354606; no voters: 
I20260709 13:05:39.844127 18304 raft_consensus.cc:2804] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:39.844619 18304 raft_consensus.cc:697] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [term 1 LEADER]: Becoming Leader. State: Replica: 90778a284eb94de982518efadd354606, State: Running, Role: LEADER
I20260709 13:05:39.845323 18304 consensus_queue.cc:237] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.852735 18003 catalog_manager.cc:5697] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90778a284eb94de982518efadd354606 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "90778a284eb94de982518efadd354606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:39.909617 18052 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:39.928508 18302 raft_consensus.cc:493] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.929163 18302 raft_consensus.cc:515] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.930930 18302 leader_election.cc:290] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90778a284eb94de982518efadd354606 (127.7.25.193:36891), 417b39057e5f44d1b328b6e2c9f66bf4 (127.7.25.194:35799)
I20260709 13:05:39.932029 18181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a4952308b145e0ae57ca89b0486a4f" candidate_uuid: "0f0461c64d0947ff9e35ec87077276e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" is_pre_election: true
I20260709 13:05:39.931849 18106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a4952308b145e0ae57ca89b0486a4f" candidate_uuid: "0f0461c64d0947ff9e35ec87077276e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90778a284eb94de982518efadd354606" is_pre_election: true
I20260709 13:05:39.932754 18106 raft_consensus.cc:2468] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0461c64d0947ff9e35ec87077276e5 in term 0.
I20260709 13:05:39.932752 18181 raft_consensus.cc:2468] T 41a4952308b145e0ae57ca89b0486a4f P 417b39057e5f44d1b328b6e2c9f66bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0461c64d0947ff9e35ec87077276e5 in term 0.
I20260709 13:05:39.934098 18221 leader_election.cc:304] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0461c64d0947ff9e35ec87077276e5, 90778a284eb94de982518efadd354606; no voters: 
I20260709 13:05:39.934789 18302 raft_consensus.cc:2804] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:39.935146 18302 raft_consensus.cc:493] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.935379 18302 raft_consensus.cc:3060] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.940253 18302 raft_consensus.cc:515] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.942073 18302 leader_election.cc:290] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [CANDIDATE]: Term 1 election: Requested vote from peers 90778a284eb94de982518efadd354606 (127.7.25.193:36891), 417b39057e5f44d1b328b6e2c9f66bf4 (127.7.25.194:35799)
I20260709 13:05:39.942845 18106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a4952308b145e0ae57ca89b0486a4f" candidate_uuid: "0f0461c64d0947ff9e35ec87077276e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90778a284eb94de982518efadd354606"
I20260709 13:05:39.943169 18181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a4952308b145e0ae57ca89b0486a4f" candidate_uuid: "0f0461c64d0947ff9e35ec87077276e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "417b39057e5f44d1b328b6e2c9f66bf4"
I20260709 13:05:39.943588 18106 raft_consensus.cc:3060] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.943782 18181 raft_consensus.cc:3060] T 41a4952308b145e0ae57ca89b0486a4f P 417b39057e5f44d1b328b6e2c9f66bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.950874 18181 raft_consensus.cc:2468] T 41a4952308b145e0ae57ca89b0486a4f P 417b39057e5f44d1b328b6e2c9f66bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0461c64d0947ff9e35ec87077276e5 in term 1.
I20260709 13:05:39.950874 18106 raft_consensus.cc:2468] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0461c64d0947ff9e35ec87077276e5 in term 1.
I20260709 13:05:39.952392 18218 leader_election.cc:304] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0461c64d0947ff9e35ec87077276e5, 417b39057e5f44d1b328b6e2c9f66bf4; no voters: 
I20260709 13:05:39.953095 18302 raft_consensus.cc:2804] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:39.953596 18302 raft_consensus.cc:697] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0461c64d0947ff9e35ec87077276e5, State: Running, Role: LEADER
I20260709 13:05:39.954438 18302 consensus_queue.cc:237] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:39.962195 18003 catalog_manager.cc:5697] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0461c64d0947ff9e35ec87077276e5 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "0f0461c64d0947ff9e35ec87077276e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:39.976432 18302 consensus_queue.cc:1048] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:39.988675 18329 consensus_queue.cc:1048] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:40.016957 18255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43582a74cda94c32af6da1b7be4930cf"
dest_uuid: "0f0461c64d0947ff9e35ec87077276e5"
mode: GRACEFUL
new_leader_uuid: "90778a284eb94de982518efadd354606"
 from {username='slave'} at 127.0.0.1:34442
I20260709 13:05:40.017580 18255 raft_consensus.cc:606] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [term 1 LEADER]: Received request to transfer leadership to TS 90778a284eb94de982518efadd354606
I20260709 13:05:40.029052 18255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41a4952308b145e0ae57ca89b0486a4f"
dest_uuid: "0f0461c64d0947ff9e35ec87077276e5"
mode: GRACEFUL
new_leader_uuid: "90778a284eb94de982518efadd354606"
 from {username='slave'} at 127.0.0.1:34442
I20260709 13:05:40.029640 18255 raft_consensus.cc:606] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [term 1 LEADER]: Received request to transfer leadership to TS 90778a284eb94de982518efadd354606
I20260709 13:05:40.097193 18329 consensus_queue.cc:1048] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.104254 18301 raft_consensus.cc:993] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5: : Instructing follower 90778a284eb94de982518efadd354606 to start an election
I20260709 13:05:40.104764 18301 raft_consensus.cc:1081] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [term 1 LEADER]: Signalling peer 90778a284eb94de982518efadd354606 to start an election
I20260709 13:05:40.107980 18105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43582a74cda94c32af6da1b7be4930cf"
dest_uuid: "90778a284eb94de982518efadd354606"
 from {username='slave'} at 127.0.0.1:35498
I20260709 13:05:40.109153 18329 consensus_queue.cc:1048] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:40.110319 18105 raft_consensus.cc:493] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:40.110824 18105 raft_consensus.cc:3060] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.120669 18105 raft_consensus.cc:515] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } }
I20260709 13:05:40.128124 18255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43582a74cda94c32af6da1b7be4930cf" candidate_uuid: "90778a284eb94de982518efadd354606" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f0461c64d0947ff9e35ec87077276e5"
I20260709 13:05:40.128665 18255 raft_consensus.cc:3055] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:40.128997 18255 raft_consensus.cc:740] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f0461c64d0947ff9e35ec87077276e5, State: Running, Role: LEADER
I20260709 13:05:40.129844 18255 consensus_queue.cc:260] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } }
I20260709 13:05:40.131018 18255 raft_consensus.cc:3060] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.131587 18105 leader_election.cc:290] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606 [CANDIDATE]: Term 2 election: Requested vote from peers 0f0461c64d0947ff9e35ec87077276e5 (127.7.25.195:40579), 417b39057e5f44d1b328b6e2c9f66bf4 (127.7.25.194:35799)
I20260709 13:05:40.138458 18255 raft_consensus.cc:2468] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90778a284eb94de982518efadd354606 in term 2.
I20260709 13:05:40.139659 18181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43582a74cda94c32af6da1b7be4930cf" candidate_uuid: "90778a284eb94de982518efadd354606" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "417b39057e5f44d1b328b6e2c9f66bf4"
I20260709 13:05:40.139784 18071 leader_election.cc:304] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0461c64d0947ff9e35ec87077276e5, 90778a284eb94de982518efadd354606; no voters: 
I20260709 13:05:40.140358 18181 raft_consensus.cc:3060] T 43582a74cda94c32af6da1b7be4930cf P 417b39057e5f44d1b328b6e2c9f66bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.140980 18304 raft_consensus.cc:2804] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:40.141474 18304 raft_consensus.cc:697] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606 [term 2 LEADER]: Becoming Leader. State: Replica: 90778a284eb94de982518efadd354606, State: Running, Role: LEADER
I20260709 13:05:40.142271 18304 consensus_queue.cc:237] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } }
I20260709 13:05:40.146450 18181 raft_consensus.cc:2468] T 43582a74cda94c32af6da1b7be4930cf P 417b39057e5f44d1b328b6e2c9f66bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90778a284eb94de982518efadd354606 in term 2.
I20260709 13:05:40.148872 18000 catalog_manager.cc:5697] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606 reported cstate change: term changed from 1 to 2, leader changed from 0f0461c64d0947ff9e35ec87077276e5 (127.7.25.195) to 90778a284eb94de982518efadd354606 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "90778a284eb94de982518efadd354606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.292016 18304 consensus_queue.cc:1048] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.304800 18304 consensus_queue.cc:1048] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.471423 18329 consensus_queue.cc:1048] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.484402 18301 consensus_queue.cc:1048] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:40.498144 18329 raft_consensus.cc:993] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5: : Instructing follower 90778a284eb94de982518efadd354606 to start an election
I20260709 13:05:40.498694 18301 raft_consensus.cc:1081] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [term 1 LEADER]: Signalling peer 90778a284eb94de982518efadd354606 to start an election
I20260709 13:05:40.500509 18105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41a4952308b145e0ae57ca89b0486a4f"
dest_uuid: "90778a284eb94de982518efadd354606"
 from {username='slave'} at 127.0.0.1:35498
I20260709 13:05:40.502113 18105 raft_consensus.cc:493] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:40.502506 18105 raft_consensus.cc:3060] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.508934 18105 raft_consensus.cc:515] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:40.510857 18105 leader_election.cc:290] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606 [CANDIDATE]: Term 2 election: Requested vote from peers 417b39057e5f44d1b328b6e2c9f66bf4 (127.7.25.194:35799), 0f0461c64d0947ff9e35ec87077276e5 (127.7.25.195:40579)
I20260709 13:05:40.511866 18180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a4952308b145e0ae57ca89b0486a4f" candidate_uuid: "90778a284eb94de982518efadd354606" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "417b39057e5f44d1b328b6e2c9f66bf4"
I20260709 13:05:40.512068 18255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a4952308b145e0ae57ca89b0486a4f" candidate_uuid: "90778a284eb94de982518efadd354606" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f0461c64d0947ff9e35ec87077276e5"
I20260709 13:05:40.512538 18180 raft_consensus.cc:3060] T 41a4952308b145e0ae57ca89b0486a4f P 417b39057e5f44d1b328b6e2c9f66bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.512764 18255 raft_consensus.cc:3055] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:40.513227 18255 raft_consensus.cc:740] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f0461c64d0947ff9e35ec87077276e5, State: Running, Role: LEADER
I20260709 13:05:40.514187 18255 consensus_queue.cc:260] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:40.515688 18255 raft_consensus.cc:3060] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.519272 18180 raft_consensus.cc:2468] T 41a4952308b145e0ae57ca89b0486a4f P 417b39057e5f44d1b328b6e2c9f66bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90778a284eb94de982518efadd354606 in term 2.
I20260709 13:05:40.520330 18069 leader_election.cc:304] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 417b39057e5f44d1b328b6e2c9f66bf4, 90778a284eb94de982518efadd354606; no voters: 
I20260709 13:05:40.521049 18304 raft_consensus.cc:2804] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:40.521608 18304 raft_consensus.cc:697] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606 [term 2 LEADER]: Becoming Leader. State: Replica: 90778a284eb94de982518efadd354606, State: Running, Role: LEADER
I20260709 13:05:40.522493 18304 consensus_queue.cc:237] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:40.523033 18255 raft_consensus.cc:2468] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90778a284eb94de982518efadd354606 in term 2.
I20260709 13:05:40.529645 18004 catalog_manager.cc:5697] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606 reported cstate change: term changed from 1 to 2, leader changed from 0f0461c64d0947ff9e35ec87077276e5 (127.7.25.195) to 90778a284eb94de982518efadd354606 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "90778a284eb94de982518efadd354606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.544782 18180 raft_consensus.cc:1275] T 43582a74cda94c32af6da1b7be4930cf P 417b39057e5f44d1b328b6e2c9f66bf4 [term 2 FOLLOWER]: Refusing update from remote peer 90778a284eb94de982518efadd354606: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:40.546181 18304 consensus_queue.cc:1048] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:40.555470 18255 raft_consensus.cc:1275] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [term 2 FOLLOWER]: Refusing update from remote peer 90778a284eb94de982518efadd354606: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:40.557574 18337 consensus_queue.cc:1048] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:40.782462  7271 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:05:40.784024  7271 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:05:40.784353  7271 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:05:40.796401 18105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3f5bf6c14574ffe889316261df03661"
dest_uuid: "90778a284eb94de982518efadd354606"
mode: GRACEFUL
new_leader_uuid: "417b39057e5f44d1b328b6e2c9f66bf4"
 from {username='slave'} at 127.0.0.1:35510
I20260709 13:05:40.796903 18105 raft_consensus.cc:606] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [term 1 LEADER]: Received request to transfer leadership to TS 417b39057e5f44d1b328b6e2c9f66bf4
I20260709 13:05:40.798056  7271 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:05:40.886803 18337 raft_consensus.cc:993] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606: : Instructing follower 417b39057e5f44d1b328b6e2c9f66bf4 to start an election
I20260709 13:05:40.887358 18324 raft_consensus.cc:1081] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [term 1 LEADER]: Signalling peer 417b39057e5f44d1b328b6e2c9f66bf4 to start an election
I20260709 13:05:40.889101 18180 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3f5bf6c14574ffe889316261df03661"
dest_uuid: "417b39057e5f44d1b328b6e2c9f66bf4"
 from {username='slave'} at 127.0.0.1:36678
I20260709 13:05:40.889704 18180 raft_consensus.cc:493] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:40.890085 18180 raft_consensus.cc:3060] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.897372 18180 raft_consensus.cc:515] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:40.899523 18180 leader_election.cc:290] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4 [CANDIDATE]: Term 2 election: Requested vote from peers 90778a284eb94de982518efadd354606 (127.7.25.193:36891), 0f0461c64d0947ff9e35ec87077276e5 (127.7.25.195:40579)
I20260709 13:05:40.910781 18105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f5bf6c14574ffe889316261df03661" candidate_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90778a284eb94de982518efadd354606"
I20260709 13:05:40.911522 18105 raft_consensus.cc:3055] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:40.911626 18255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f5bf6c14574ffe889316261df03661" candidate_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f0461c64d0947ff9e35ec87077276e5"
I20260709 13:05:40.911945 18105 raft_consensus.cc:740] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90778a284eb94de982518efadd354606, State: Running, Role: LEADER
I20260709 13:05:40.912388 18255 raft_consensus.cc:3060] T e3f5bf6c14574ffe889316261df03661 P 0f0461c64d0947ff9e35ec87077276e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.912866 18105 consensus_queue.cc:260] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:40.914325 18105 raft_consensus.cc:3060] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.918154 18255 raft_consensus.cc:2468] T e3f5bf6c14574ffe889316261df03661 P 0f0461c64d0947ff9e35ec87077276e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 417b39057e5f44d1b328b6e2c9f66bf4 in term 2.
I20260709 13:05:40.919588 18146 leader_election.cc:304] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0461c64d0947ff9e35ec87077276e5, 417b39057e5f44d1b328b6e2c9f66bf4; no voters: 
I20260709 13:05:40.920473 18303 raft_consensus.cc:2804] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:40.921708 18303 raft_consensus.cc:697] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 417b39057e5f44d1b328b6e2c9f66bf4, State: Running, Role: LEADER
I20260709 13:05:40.921972 18105 raft_consensus.cc:2468] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 417b39057e5f44d1b328b6e2c9f66bf4 in term 2.
I20260709 13:05:40.922521 18303 consensus_queue.cc:237] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } }
I20260709 13:05:40.928428 18004 catalog_manager.cc:5697] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4 reported cstate change: term changed from 1 to 2, leader changed from 90778a284eb94de982518efadd354606 (127.7.25.193) to 417b39057e5f44d1b328b6e2c9f66bf4 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90778a284eb94de982518efadd354606" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "417b39057e5f44d1b328b6e2c9f66bf4" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0461c64d0947ff9e35ec87077276e5" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 40579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.015559  7271 tablet_server.cc:179] TabletServer@127.7.25.193:0 shutting down...
I20260709 13:05:41.035938  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:41.036592  7271 tablet_replica.cc:333] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606: stopping tablet replica
I20260709 13:05:41.037252  7271 raft_consensus.cc:2243] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:41.037690  7271 raft_consensus.cc:2272] T e3f5bf6c14574ffe889316261df03661 P 90778a284eb94de982518efadd354606 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:41.039791  7271 tablet_replica.cc:333] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606: stopping tablet replica
I20260709 13:05:41.040261  7271 raft_consensus.cc:2243] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:41.040822  7271 pending_rounds.cc:70] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606: Trying to abort 1 pending ops.
I20260709 13:05:41.040971  7271 pending_rounds.cc:77] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305635186791514112 op_type: NO_OP noop_request { }
I20260709 13:05:41.041291  7271 raft_consensus.cc:2889] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:05:41.041510  7271 raft_consensus.cc:2272] T 41a4952308b145e0ae57ca89b0486a4f P 90778a284eb94de982518efadd354606 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:41.043658  7271 tablet_replica.cc:333] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606: stopping tablet replica
I20260709 13:05:41.044144  7271 raft_consensus.cc:2243] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:41.044898  7271 raft_consensus.cc:2272] T 43582a74cda94c32af6da1b7be4930cf P 90778a284eb94de982518efadd354606 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:41.047353  7271 tablet_replica.cc:333] T 5167988b17c244739fb4d2de9a2c44ec P 90778a284eb94de982518efadd354606: stopping tablet replica
I20260709 13:05:41.047991  7271 raft_consensus.cc:2243] T 5167988b17c244739fb4d2de9a2c44ec P 90778a284eb94de982518efadd354606 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:41.048473  7271 raft_consensus.cc:2272] T 5167988b17c244739fb4d2de9a2c44ec P 90778a284eb94de982518efadd354606 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:41.051148 18221 consensus_peers.cc:597] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 -> Peer 90778a284eb94de982518efadd354606 (127.7.25.193:36891): Couldn't send request to peer 90778a284eb94de982518efadd354606. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:41.071802  7271 tablet_server.cc:196] TabletServer@127.7.25.193:0 shutdown complete.
I20260709 13:05:41.084905  7271 tablet_server.cc:179] TabletServer@127.7.25.194:0 shutting down...
I20260709 13:05:41.103314  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:41.104000  7271 tablet_replica.cc:333] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4: stopping tablet replica
I20260709 13:05:41.104628  7271 raft_consensus.cc:2243] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:41.105376  7271 pending_rounds.cc:70] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4: Trying to abort 1 pending ops.
I20260709 13:05:41.105584  7271 pending_rounds.cc:77] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305635188426772480 op_type: NO_OP noop_request { }
I20260709 13:05:41.105875  7271 raft_consensus.cc:2889] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:05:41.106156  7271 raft_consensus.cc:2272] T e3f5bf6c14574ffe889316261df03661 P 417b39057e5f44d1b328b6e2c9f66bf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:41.108424  7271 tablet_replica.cc:333] T 41a4952308b145e0ae57ca89b0486a4f P 417b39057e5f44d1b328b6e2c9f66bf4: stopping tablet replica
I20260709 13:05:41.108945  7271 raft_consensus.cc:2243] T 41a4952308b145e0ae57ca89b0486a4f P 417b39057e5f44d1b328b6e2c9f66bf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:41.109418  7271 raft_consensus.cc:2272] T 41a4952308b145e0ae57ca89b0486a4f P 417b39057e5f44d1b328b6e2c9f66bf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:41.111609  7271 tablet_replica.cc:333] T 43582a74cda94c32af6da1b7be4930cf P 417b39057e5f44d1b328b6e2c9f66bf4: stopping tablet replica
I20260709 13:05:41.112123  7271 raft_consensus.cc:2243] T 43582a74cda94c32af6da1b7be4930cf P 417b39057e5f44d1b328b6e2c9f66bf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:41.112553  7271 raft_consensus.cc:2272] T 43582a74cda94c32af6da1b7be4930cf P 417b39057e5f44d1b328b6e2c9f66bf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:41.114774  7271 tablet_replica.cc:333] T 5167988b17c244739fb4d2de9a2c44ec P 417b39057e5f44d1b328b6e2c9f66bf4: stopping tablet replica
I20260709 13:05:41.115312  7271 raft_consensus.cc:2243] T 5167988b17c244739fb4d2de9a2c44ec P 417b39057e5f44d1b328b6e2c9f66bf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:41.115772  7271 raft_consensus.cc:2272] T 5167988b17c244739fb4d2de9a2c44ec P 417b39057e5f44d1b328b6e2c9f66bf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:41.138372  7271 tablet_server.cc:196] TabletServer@127.7.25.194:0 shutdown complete.
I20260709 13:05:41.150449  7271 tablet_server.cc:179] TabletServer@127.7.25.195:0 shutting down...
I20260709 13:05:41.167659  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:41.168314  7271 tablet_replica.cc:333] T e3f5bf6c14574ffe889316261df03661 P 0f0461c64d0947ff9e35ec87077276e5: stopping tablet replica
I20260709 13:05:41.168866  7271 raft_consensus.cc:2243] T e3f5bf6c14574ffe889316261df03661 P 0f0461c64d0947ff9e35ec87077276e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:41.169346  7271 raft_consensus.cc:2272] T e3f5bf6c14574ffe889316261df03661 P 0f0461c64d0947ff9e35ec87077276e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:41.171566  7271 tablet_replica.cc:333] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5: stopping tablet replica
I20260709 13:05:41.172082  7271 raft_consensus.cc:2243] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:41.172508  7271 raft_consensus.cc:2272] T 41a4952308b145e0ae57ca89b0486a4f P 0f0461c64d0947ff9e35ec87077276e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:41.174690  7271 tablet_replica.cc:333] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5: stopping tablet replica
I20260709 13:05:41.175256  7271 raft_consensus.cc:2243] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:41.175725  7271 raft_consensus.cc:2272] T 43582a74cda94c32af6da1b7be4930cf P 0f0461c64d0947ff9e35ec87077276e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:41.178076  7271 tablet_replica.cc:333] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5: stopping tablet replica
I20260709 13:05:41.178574  7271 raft_consensus.cc:2243] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:41.179365  7271 raft_consensus.cc:2272] T 5167988b17c244739fb4d2de9a2c44ec P 0f0461c64d0947ff9e35ec87077276e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:41.202139  7271 tablet_server.cc:196] TabletServer@127.7.25.195:0 shutdown complete.
I20260709 13:05:41.215051  7271 master.cc:562] Master@127.7.25.254:36953 shutting down...
I20260709 13:05:41.230110  7271 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:41.230680  7271 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:41.231012  7271 tablet_replica.cc:333] T 00000000000000000000000000000000 P f19be14aed254934b97b326eaf3ca60e: stopping tablet replica
I20260709 13:05:41.242756  7271 master.cc:584] Master@127.7.25.254:36953 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2503 ms)
[----------] 6 tests from LeaderRebalancerTest (329588 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:05:41.271598  7271 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.25.254:33809
I20260709 13:05:41.272814  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:41.277803 18348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:41.278223 18349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:41.279537 18351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:41.280516  7271 server_base.cc:1061] running on GCE node
I20260709 13:05:41.281642  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:41.281858  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:41.282061  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602341282028 us; error 0 us; skew 500 ppm
I20260709 13:05:41.282646  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:41.285442  7271 webserver.cc:533] Webserver started at http://127.7.25.254:40377/ using document root <none> and password file <none>
I20260709 13:05:41.285984  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:41.286149  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:41.286523  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:41.287647  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602011513864-7271-0/minicluster-data/master-0-root/instance:
uuid: "8388925bb71444ce8b5891438b8a9e4d"
format_stamp: "Formatted at 2026-07-09 13:05:41 on dist-test-slave-z1zn"
I20260709 13:05:41.292338  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:05:41.295773 18356 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:41.296728  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:05:41.296998  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602011513864-7271-0/minicluster-data/master-0-root
uuid: "8388925bb71444ce8b5891438b8a9e4d"
format_stamp: "Formatted at 2026-07-09 13:05:41 on dist-test-slave-z1zn"
I20260709 13:05:41.297317  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602011513864-7271-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602011513864-7271-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602011513864-7271-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:41.332209  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:41.333310  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:41.370040  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.254:33809
I20260709 13:05:41.370141 18407 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.254:33809 every 8 connection(s)
I20260709 13:05:41.374060 18408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.385005 18408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d: Bootstrap starting.
I20260709 13:05:41.389609 18408 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.393833 18408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d: No bootstrap required, opened a new log
I20260709 13:05:41.396014 18408 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8388925bb71444ce8b5891438b8a9e4d" member_type: VOTER }
I20260709 13:05:41.396412 18408 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.396667 18408 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8388925bb71444ce8b5891438b8a9e4d, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.397399 18408 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8388925bb71444ce8b5891438b8a9e4d" member_type: VOTER }
I20260709 13:05:41.397890 18408 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:41.398119 18408 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:41.398394 18408 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.403347 18408 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8388925bb71444ce8b5891438b8a9e4d" member_type: VOTER }
I20260709 13:05:41.403918 18408 leader_election.cc:304] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8388925bb71444ce8b5891438b8a9e4d; no voters: 
I20260709 13:05:41.405126 18408 leader_election.cc:290] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:41.405565 18411 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.406931 18411 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d [term 1 LEADER]: Becoming Leader. State: Replica: 8388925bb71444ce8b5891438b8a9e4d, State: Running, Role: LEADER
I20260709 13:05:41.407640 18411 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8388925bb71444ce8b5891438b8a9e4d" member_type: VOTER }
I20260709 13:05:41.408164 18408 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:41.410552 18412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8388925bb71444ce8b5891438b8a9e4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8388925bb71444ce8b5891438b8a9e4d" member_type: VOTER } }
I20260709 13:05:41.410588 18413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8388925bb71444ce8b5891438b8a9e4d. Latest consensus state: current_term: 1 leader_uuid: "8388925bb71444ce8b5891438b8a9e4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8388925bb71444ce8b5891438b8a9e4d" member_type: VOTER } }
I20260709 13:05:41.411365 18412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:41.411391 18413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:41.416467 18416 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:41.424306 18416 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:41.425465  7271 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:41.434118 18416 catalog_manager.cc:1383] Generated new cluster ID: 21c23296524146b2a4cbeb8601ae14a6
I20260709 13:05:41.434449 18416 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:41.449368 18416 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:41.450742 18416 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:41.469199 18416 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d: Generated new TSK 0
I20260709 13:05:41.469841 18416 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:41.492448  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:41.499063 18429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:41.500229 18430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:41.502941  7271 server_base.cc:1061] running on GCE node
W20260709 13:05:41.502888 18432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:41.504315  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:41.504515  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:41.504640  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602341504629 us; error 0 us; skew 500 ppm
I20260709 13:05:41.505223  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:41.507561  7271 webserver.cc:533] Webserver started at http://127.7.25.193:41415/ using document root <none> and password file <none>
I20260709 13:05:41.507992  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:41.508157  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:41.508388  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:41.509541  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602011513864-7271-0/minicluster-data/ts-0-root/instance:
uuid: "a81e9f90f26a4379b54fd57a6976af76"
format_stamp: "Formatted at 2026-07-09 13:05:41 on dist-test-slave-z1zn"
I20260709 13:05:41.514127  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:05:41.517546 18437 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:41.518458  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:41.518772  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602011513864-7271-0/minicluster-data/ts-0-root
uuid: "a81e9f90f26a4379b54fd57a6976af76"
format_stamp: "Formatted at 2026-07-09 13:05:41 on dist-test-slave-z1zn"
I20260709 13:05:41.519049  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602011513864-7271-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602011513864-7271-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602011513864-7271-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:41.549638  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:41.550784  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:41.552220  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:41.554626  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:41.554860  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:41.555121  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:41.555310  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:41.595294  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.193:35283
I20260709 13:05:41.595402 18499 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.193:35283 every 8 connection(s)
I20260709 13:05:41.600474  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:41.607067 18504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:41.609378 18505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:41.610970 18507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:41.611534  7271 server_base.cc:1061] running on GCE node
I20260709 13:05:41.613111 18500 heartbeater.cc:344] Connected to a master server at 127.7.25.254:33809
I20260709 13:05:41.613390  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:05:41.613521 18500 heartbeater.cc:461] Registering TS with master...
W20260709 13:05:41.613709  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:41.613970  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602341613950 us; error 0 us; skew 500 ppm
I20260709 13:05:41.614440 18500 heartbeater.cc:507] Master 127.7.25.254:33809 requested a full tablet report, sending...
I20260709 13:05:41.614600  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:41.616668 18373 ts_manager.cc:194] Registered new tserver with Master: a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283)
I20260709 13:05:41.617362  7271 webserver.cc:533] Webserver started at http://127.7.25.194:35939/ using document root <none> and password file <none>
I20260709 13:05:41.617960  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:41.618171  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:41.618450  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:41.618918 18373 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46130
I20260709 13:05:41.619663  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602011513864-7271-0/minicluster-data/ts-1-root/instance:
uuid: "ae5be77f387e48639ec76424d120a703"
format_stamp: "Formatted at 2026-07-09 13:05:41 on dist-test-slave-z1zn"
I20260709 13:05:41.624675  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 13:05:41.628139 18512 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:41.628901  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:41.629247  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602011513864-7271-0/minicluster-data/ts-1-root
uuid: "ae5be77f387e48639ec76424d120a703"
format_stamp: "Formatted at 2026-07-09 13:05:41 on dist-test-slave-z1zn"
I20260709 13:05:41.629530  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602011513864-7271-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602011513864-7271-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602011513864-7271-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:41.651415  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:41.652544  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:41.654105  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:41.656422  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:41.656598  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:41.656903  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:41.657065  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:41.695196  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.194:40685
I20260709 13:05:41.695317 18574 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.194:40685 every 8 connection(s)
I20260709 13:05:41.700313  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:41.707717 18579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:41.708689 18578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:41.711133 18575 heartbeater.cc:344] Connected to a master server at 127.7.25.254:33809
I20260709 13:05:41.711674 18575 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:41.711848  7271 server_base.cc:1061] running on GCE node
W20260709 13:05:41.711931 18581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:41.712734 18575 heartbeater.cc:507] Master 127.7.25.254:33809 requested a full tablet report, sending...
I20260709 13:05:41.713158  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:41.713429  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:41.713616  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602341713582 us; error 0 us; skew 500 ppm
I20260709 13:05:41.714218  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:41.714975 18373 ts_manager.cc:194] Registered new tserver with Master: ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:41.717206  7271 webserver.cc:533] Webserver started at http://127.7.25.195:44009/ using document root <none> and password file <none>
I20260709 13:05:41.717242 18373 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46138
I20260709 13:05:41.718129  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:41.718410  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:41.718725  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:41.720225  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602011513864-7271-0/minicluster-data/ts-2-root/instance:
uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
format_stamp: "Formatted at 2026-07-09 13:05:41 on dist-test-slave-z1zn"
I20260709 13:05:41.724709  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:05:41.728384 18586 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:41.729300  7271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:41.729614  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602011513864-7271-0/minicluster-data/ts-2-root
uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
format_stamp: "Formatted at 2026-07-09 13:05:41 on dist-test-slave-z1zn"
I20260709 13:05:41.729911  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602011513864-7271-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602011513864-7271-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602011513864-7271-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:41.747273  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:41.748401  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:41.749884  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:41.752138  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:41.752377  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:41.752619  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:41.752794  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:41.791759  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.195:39169
I20260709 13:05:41.791853 18648 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.195:39169 every 8 connection(s)
I20260709 13:05:41.805430 18649 heartbeater.cc:344] Connected to a master server at 127.7.25.254:33809
I20260709 13:05:41.805797 18649 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:41.806535 18649 heartbeater.cc:507] Master 127.7.25.254:33809 requested a full tablet report, sending...
I20260709 13:05:41.808419 18373 ts_manager.cc:194] Registered new tserver with Master: 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:41.808724  7271 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013528046s
I20260709 13:05:41.810019 18373 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46152
I20260709 13:05:41.835145 18373 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46156:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:41.837888 18373 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:41.908841 18614 tablet_service.cc:1511] Processing CreateTablet for tablet ad19ad4e2d824251af244da83f5e615a (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:41.910388 18614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad19ad4e2d824251af244da83f5e615a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.915251 18613 tablet_service.cc:1511] Processing CreateTablet for tablet 051026925e764ccd9b7e0b6fe38e10e7 (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:41.916692 18613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 051026925e764ccd9b7e0b6fe38e10e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.922700 18612 tablet_service.cc:1511] Processing CreateTablet for tablet b03ee79e498042c8b75d3fbcebb1effd (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:41.924250 18612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03ee79e498042c8b75d3fbcebb1effd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.924430 18462 tablet_service.cc:1511] Processing CreateTablet for tablet 536acabdfb254492867815cfbb3c77aa (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:41.925931 18462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 536acabdfb254492867815cfbb3c77aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.926239 18461 tablet_service.cc:1511] Processing CreateTablet for tablet 764ec65bcdd54a2a966c4a8666bdc49f (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:41.927578 18461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 764ec65bcdd54a2a966c4a8666bdc49f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.928440 18536 tablet_service.cc:1511] Processing CreateTablet for tablet 764ec65bcdd54a2a966c4a8666bdc49f (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:41.929880 18536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 764ec65bcdd54a2a966c4a8666bdc49f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.929550 18539 tablet_service.cc:1511] Processing CreateTablet for tablet 051026925e764ccd9b7e0b6fe38e10e7 (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:41.930167 18463 tablet_service.cc:1511] Processing CreateTablet for tablet b03ee79e498042c8b75d3fbcebb1effd (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:41.930985 18539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 051026925e764ccd9b7e0b6fe38e10e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.931572 18463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03ee79e498042c8b75d3fbcebb1effd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.932752 18538 tablet_service.cc:1511] Processing CreateTablet for tablet b03ee79e498042c8b75d3fbcebb1effd (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:41.934191 18464 tablet_service.cc:1511] Processing CreateTablet for tablet 051026925e764ccd9b7e0b6fe38e10e7 (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:41.935611 18464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 051026925e764ccd9b7e0b6fe38e10e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.928435 18540 tablet_service.cc:1511] Processing CreateTablet for tablet ad19ad4e2d824251af244da83f5e615a (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:41.935299 18537 tablet_service.cc:1511] Processing CreateTablet for tablet 536acabdfb254492867815cfbb3c77aa (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:41.934163 18538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03ee79e498042c8b75d3fbcebb1effd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.938161 18465 tablet_service.cc:1511] Processing CreateTablet for tablet ad19ad4e2d824251af244da83f5e615a (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:41.939472 18465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad19ad4e2d824251af244da83f5e615a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.939983 18540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad19ad4e2d824251af244da83f5e615a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.941979 18537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 536acabdfb254492867815cfbb3c77aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.943821 18611 tablet_service.cc:1511] Processing CreateTablet for tablet 536acabdfb254492867815cfbb3c77aa (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:41.945349 18611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 536acabdfb254492867815cfbb3c77aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.951284 18610 tablet_service.cc:1511] Processing CreateTablet for tablet 764ec65bcdd54a2a966c4a8666bdc49f (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:41.952771 18610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 764ec65bcdd54a2a966c4a8666bdc49f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.952884 18460 tablet_service.cc:1511] Processing CreateTablet for tablet 213f4e3e7d184b60ab88d2f134fccf46 (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:41.954319 18535 tablet_service.cc:1511] Processing CreateTablet for tablet 213f4e3e7d184b60ab88d2f134fccf46 (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:41.955791 18535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213f4e3e7d184b60ab88d2f134fccf46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.954376 18460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213f4e3e7d184b60ab88d2f134fccf46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.999349 18609 tablet_service.cc:1511] Processing CreateTablet for tablet 213f4e3e7d184b60ab88d2f134fccf46 (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:42.000792 18609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213f4e3e7d184b60ab88d2f134fccf46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.000710 18459 tablet_service.cc:1511] Processing CreateTablet for tablet 2f0f524f92b745e7a4ec40dfa0267295 (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:42.002696 18459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f0f524f92b745e7a4ec40dfa0267295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.006238 18534 tablet_service.cc:1511] Processing CreateTablet for tablet 2f0f524f92b745e7a4ec40dfa0267295 (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:42.007736 18534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f0f524f92b745e7a4ec40dfa0267295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.019177 18666 tablet_bootstrap.cc:492] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Bootstrap starting.
I20260709 13:05:42.023164 18460 tablet_service.cc:1511] Processing CreateTablet for tablet 109a4a99e5ac4b248028219843cf6ab8 (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:42.024607 18460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 109a4a99e5ac4b248028219843cf6ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.028643 18535 tablet_service.cc:1511] Processing CreateTablet for tablet 109a4a99e5ac4b248028219843cf6ab8 (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:42.030119 18535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 109a4a99e5ac4b248028219843cf6ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.029793 18610 tablet_service.cc:1511] Processing CreateTablet for tablet 109a4a99e5ac4b248028219843cf6ab8 (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:42.037446 18610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 109a4a99e5ac4b248028219843cf6ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.037271 18464 tablet_service.cc:1511] Processing CreateTablet for tablet 7fbfcd9d2442462d8b4feb44a3649b27 (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:42.038794 18464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fbfcd9d2442462d8b4feb44a3649b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.039377 18533 tablet_service.cc:1511] Processing CreateTablet for tablet 7fbfcd9d2442462d8b4feb44a3649b27 (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:42.040724 18533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fbfcd9d2442462d8b4feb44a3649b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.054661 18613 tablet_service.cc:1511] Processing CreateTablet for tablet 2f0f524f92b745e7a4ec40dfa0267295 (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:42.058964 18614 tablet_service.cc:1511] Processing CreateTablet for tablet 7fbfcd9d2442462d8b4feb44a3649b27 (DEFAULT_TABLE table=test-workload [id=b7566a1d0ee14939b905120cd129ac27]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:42.059953 18664 tablet_bootstrap.cc:492] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703: Bootstrap starting.
I20260709 13:05:42.060817 18613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f0f524f92b745e7a4ec40dfa0267295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.066959 18665 tablet_bootstrap.cc:492] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76: Bootstrap starting.
I20260709 13:05:42.067796 18666 tablet_bootstrap.cc:654] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.074079 18664 tablet_bootstrap.cc:654] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.080207 18614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fbfcd9d2442462d8b4feb44a3649b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.085500 18665 tablet_bootstrap.cc:654] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.105489 18664 tablet_bootstrap.cc:492] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703: No bootstrap required, opened a new log
I20260709 13:05:42.106062 18664 ts_tablet_manager.cc:1403] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.005s
I20260709 13:05:42.106375 18666 tablet_bootstrap.cc:492] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f: No bootstrap required, opened a new log
I20260709 13:05:42.106897 18666 ts_tablet_manager.cc:1403] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent bootstrapping tablet: real 0.088s	user 0.009s	sys 0.020s
I20260709 13:05:42.108862 18664 raft_consensus.cc:359] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.109987 18664 raft_consensus.cc:385] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.109807 18666 raft_consensus.cc:359] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.110977 18666 raft_consensus.cc:385] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.111361 18666 raft_consensus.cc:740] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.110410 18664 raft_consensus.cc:740] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.114698 18666 consensus_queue.cc:260] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.118139 18664 consensus_queue.cc:260] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.122251 18665 tablet_bootstrap.cc:492] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76: No bootstrap required, opened a new log
I20260709 13:05:42.125312 18575 heartbeater.cc:499] Master 127.7.25.254:33809 was elected leader, sending a full tablet report...
I20260709 13:05:42.126068 18664 ts_tablet_manager.cc:1434] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 13:05:42.127164 18664 tablet_bootstrap.cc:492] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703: Bootstrap starting.
I20260709 13:05:42.133065 18666 ts_tablet_manager.cc:1434] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent starting tablet: real 0.026s	user 0.012s	sys 0.008s
I20260709 13:05:42.131520 18665 ts_tablet_manager.cc:1403] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.019s
I20260709 13:05:42.138345 18649 heartbeater.cc:499] Master 127.7.25.254:33809 was elected leader, sending a full tablet report...
I20260709 13:05:42.141636 18664 tablet_bootstrap.cc:654] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.143467 18666 tablet_bootstrap.cc:492] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f: Bootstrap starting.
I20260709 13:05:42.149290 18665 raft_consensus.cc:359] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } } peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } }
I20260709 13:05:42.150198 18665 raft_consensus.cc:385] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.150524 18665 raft_consensus.cc:740] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.151410 18665 consensus_queue.cc:260] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } } peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } }
I20260709 13:05:42.154412 18664 tablet_bootstrap.cc:492] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703: No bootstrap required, opened a new log
I20260709 13:05:42.154465 18666 tablet_bootstrap.cc:654] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.155287 18664 ts_tablet_manager.cc:1403] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.010s
I20260709 13:05:42.159375 18664 raft_consensus.cc:359] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.160634 18664 raft_consensus.cc:385] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.161160 18664 raft_consensus.cc:740] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.162503 18664 consensus_queue.cc:260] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.165309 18665 ts_tablet_manager.cc:1434] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.010s
I20260709 13:05:42.166659 18665 tablet_bootstrap.cc:492] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76: Bootstrap starting.
I20260709 13:05:42.170238 18664 ts_tablet_manager.cc:1434] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:05:42.171722 18664 tablet_bootstrap.cc:492] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703: Bootstrap starting.
I20260709 13:05:42.165241 18500 heartbeater.cc:499] Master 127.7.25.254:33809 was elected leader, sending a full tablet report...
I20260709 13:05:42.172853 18665 tablet_bootstrap.cc:654] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.179947 18664 tablet_bootstrap.cc:654] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.192467 18666 tablet_bootstrap.cc:492] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f: No bootstrap required, opened a new log
I20260709 13:05:42.193070 18666 ts_tablet_manager.cc:1403] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent bootstrapping tablet: real 0.050s	user 0.026s	sys 0.016s
I20260709 13:05:42.196061 18666 raft_consensus.cc:359] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.196918 18666 raft_consensus.cc:385] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.197294 18666 raft_consensus.cc:740] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.198138 18666 consensus_queue.cc:260] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.202670 18666 ts_tablet_manager.cc:1434] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:42.202881 18665 tablet_bootstrap.cc:492] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76: No bootstrap required, opened a new log
I20260709 13:05:42.203714 18665 ts_tablet_manager.cc:1403] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.015s
I20260709 13:05:42.203904 18666 tablet_bootstrap.cc:492] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f: Bootstrap starting.
I20260709 13:05:42.207645 18665 raft_consensus.cc:359] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.210076 18665 raft_consensus.cc:385] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.210640 18665 raft_consensus.cc:740] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.211751 18665 consensus_queue.cc:260] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.214061 18666 tablet_bootstrap.cc:654] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.215046 18665 ts_tablet_manager.cc:1434] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:05:42.216717 18665 tablet_bootstrap.cc:492] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76: Bootstrap starting.
I20260709 13:05:42.225919 18665 tablet_bootstrap.cc:654] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.232615 18666 tablet_bootstrap.cc:492] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f: No bootstrap required, opened a new log
I20260709 13:05:42.233150 18666 ts_tablet_manager.cc:1403] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.012s
I20260709 13:05:42.233651 18664 tablet_bootstrap.cc:492] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703: No bootstrap required, opened a new log
I20260709 13:05:42.234195 18664 ts_tablet_manager.cc:1403] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703: Time spent bootstrapping tablet: real 0.063s	user 0.033s	sys 0.023s
I20260709 13:05:42.235745 18665 tablet_bootstrap.cc:492] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76: No bootstrap required, opened a new log
I20260709 13:05:42.235703 18666 raft_consensus.cc:359] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } } peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } }
I20260709 13:05:42.236433 18665 ts_tablet_manager.cc:1403] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 13:05:42.236454 18666 raft_consensus.cc:385] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.237008 18666 raft_consensus.cc:740] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.237197 18664 raft_consensus.cc:359] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.238004 18664 raft_consensus.cc:385] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.237777 18666 consensus_queue.cc:260] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } } peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } }
I20260709 13:05:42.238322 18664 raft_consensus.cc:740] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.239363 18664 consensus_queue.cc:260] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.239580 18665 raft_consensus.cc:359] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.239955 18666 ts_tablet_manager.cc:1434] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:05:42.240357 18665 raft_consensus.cc:385] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.240739 18665 raft_consensus.cc:740] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.241302 18666 tablet_bootstrap.cc:492] T 536acabdfb254492867815cfbb3c77aa P 2cfdcc4bf28d40b59a436fc9d1a7995f: Bootstrap starting.
I20260709 13:05:42.241636 18665 consensus_queue.cc:260] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.243963 18665 ts_tablet_manager.cc:1434] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:42.244982 18665 tablet_bootstrap.cc:492] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76: Bootstrap starting.
I20260709 13:05:42.247001 18664 ts_tablet_manager.cc:1434] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:05:42.248190 18664 tablet_bootstrap.cc:492] T 051026925e764ccd9b7e0b6fe38e10e7 P ae5be77f387e48639ec76424d120a703: Bootstrap starting.
I20260709 13:05:42.248232 18666 tablet_bootstrap.cc:654] T 536acabdfb254492867815cfbb3c77aa P 2cfdcc4bf28d40b59a436fc9d1a7995f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.251116 18665 tablet_bootstrap.cc:654] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.255486 18664 tablet_bootstrap.cc:654] T 051026925e764ccd9b7e0b6fe38e10e7 P ae5be77f387e48639ec76424d120a703: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.260694 18666 tablet_bootstrap.cc:492] T 536acabdfb254492867815cfbb3c77aa P 2cfdcc4bf28d40b59a436fc9d1a7995f: No bootstrap required, opened a new log
I20260709 13:05:42.261315 18666 ts_tablet_manager.cc:1403] T 536acabdfb254492867815cfbb3c77aa P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.006s
I20260709 13:05:42.263320 18665 tablet_bootstrap.cc:492] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76: No bootstrap required, opened a new log
I20260709 13:05:42.264149 18665 ts_tablet_manager.cc:1403] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:05:42.264307 18666 raft_consensus.cc:359] T 536acabdfb254492867815cfbb3c77aa P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.265304 18666 raft_consensus.cc:385] T 536acabdfb254492867815cfbb3c77aa P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.265650 18666 raft_consensus.cc:740] T 536acabdfb254492867815cfbb3c77aa P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.266659 18666 consensus_queue.cc:260] T 536acabdfb254492867815cfbb3c77aa P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.267635 18665 raft_consensus.cc:359] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.268354 18664 tablet_bootstrap.cc:492] T 051026925e764ccd9b7e0b6fe38e10e7 P ae5be77f387e48639ec76424d120a703: No bootstrap required, opened a new log
I20260709 13:05:42.268416 18665 raft_consensus.cc:385] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.268914 18665 raft_consensus.cc:740] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.269026 18664 ts_tablet_manager.cc:1403] T 051026925e764ccd9b7e0b6fe38e10e7 P ae5be77f387e48639ec76424d120a703: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 13:05:42.269307 18666 ts_tablet_manager.cc:1434] T 536acabdfb254492867815cfbb3c77aa P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:05:42.269891 18665 consensus_queue.cc:260] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.270426 18666 tablet_bootstrap.cc:492] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Bootstrap starting.
I20260709 13:05:42.272209 18665 ts_tablet_manager.cc:1434] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:05:42.272455 18664 raft_consensus.cc:359] T 051026925e764ccd9b7e0b6fe38e10e7 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.273308 18665 tablet_bootstrap.cc:492] T 764ec65bcdd54a2a966c4a8666bdc49f P a81e9f90f26a4379b54fd57a6976af76: Bootstrap starting.
I20260709 13:05:42.273363 18664 raft_consensus.cc:385] T 051026925e764ccd9b7e0b6fe38e10e7 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.273891 18664 raft_consensus.cc:740] T 051026925e764ccd9b7e0b6fe38e10e7 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.274833 18664 consensus_queue.cc:260] T 051026925e764ccd9b7e0b6fe38e10e7 P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.277494 18666 tablet_bootstrap.cc:654] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.280215 18665 tablet_bootstrap.cc:654] T 764ec65bcdd54a2a966c4a8666bdc49f P a81e9f90f26a4379b54fd57a6976af76: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.284538 18664 ts_tablet_manager.cc:1434] T 051026925e764ccd9b7e0b6fe38e10e7 P ae5be77f387e48639ec76424d120a703: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:05:42.289683 18664 tablet_bootstrap.cc:492] T b03ee79e498042c8b75d3fbcebb1effd P ae5be77f387e48639ec76424d120a703: Bootstrap starting.
I20260709 13:05:42.292471 18665 tablet_bootstrap.cc:492] T 764ec65bcdd54a2a966c4a8666bdc49f P a81e9f90f26a4379b54fd57a6976af76: No bootstrap required, opened a new log
I20260709 13:05:42.293171 18665 ts_tablet_manager.cc:1403] T 764ec65bcdd54a2a966c4a8666bdc49f P a81e9f90f26a4379b54fd57a6976af76: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.000s
I20260709 13:05:42.296402 18665 raft_consensus.cc:359] T 764ec65bcdd54a2a966c4a8666bdc49f P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.297338 18665 raft_consensus.cc:385] T 764ec65bcdd54a2a966c4a8666bdc49f P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.297439 18664 tablet_bootstrap.cc:654] T b03ee79e498042c8b75d3fbcebb1effd P ae5be77f387e48639ec76424d120a703: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.297746 18665 raft_consensus.cc:740] T 764ec65bcdd54a2a966c4a8666bdc49f P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.298722 18665 consensus_queue.cc:260] T 764ec65bcdd54a2a966c4a8666bdc49f P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.301280 18666 tablet_bootstrap.cc:492] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f: No bootstrap required, opened a new log
I20260709 13:05:42.301313 18665 ts_tablet_manager.cc:1434] T 764ec65bcdd54a2a966c4a8666bdc49f P a81e9f90f26a4379b54fd57a6976af76: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:05:42.302042 18666 ts_tablet_manager.cc:1403] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.017s
I20260709 13:05:42.303639 18665 tablet_bootstrap.cc:492] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76: Bootstrap starting.
I20260709 13:05:42.304950 18664 tablet_bootstrap.cc:492] T b03ee79e498042c8b75d3fbcebb1effd P ae5be77f387e48639ec76424d120a703: No bootstrap required, opened a new log
I20260709 13:05:42.305552 18664 ts_tablet_manager.cc:1403] T b03ee79e498042c8b75d3fbcebb1effd P ae5be77f387e48639ec76424d120a703: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.005s
I20260709 13:05:42.305331 18666 raft_consensus.cc:359] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.306213 18666 raft_consensus.cc:385] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.306483 18666 raft_consensus.cc:740] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.307178 18666 consensus_queue.cc:260] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.308624 18664 raft_consensus.cc:359] T b03ee79e498042c8b75d3fbcebb1effd P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.309386 18666 ts_tablet_manager.cc:1434] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:05:42.309444 18664 raft_consensus.cc:385] T b03ee79e498042c8b75d3fbcebb1effd P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.310105 18664 raft_consensus.cc:740] T b03ee79e498042c8b75d3fbcebb1effd P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.310750 18666 tablet_bootstrap.cc:492] T b03ee79e498042c8b75d3fbcebb1effd P 2cfdcc4bf28d40b59a436fc9d1a7995f: Bootstrap starting.
I20260709 13:05:42.310995 18664 consensus_queue.cc:260] T b03ee79e498042c8b75d3fbcebb1effd P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.315429 18673 raft_consensus.cc:493] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.314951 18665 tablet_bootstrap.cc:654] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.315932 18673 raft_consensus.cc:515] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.321543 18666 tablet_bootstrap.cc:654] T b03ee79e498042c8b75d3fbcebb1effd P 2cfdcc4bf28d40b59a436fc9d1a7995f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.326443 18673 leader_election.cc:290] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:42.315912 18664 ts_tablet_manager.cc:1434] T b03ee79e498042c8b75d3fbcebb1effd P ae5be77f387e48639ec76424d120a703: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:42.334836 18664 tablet_bootstrap.cc:492] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703: Bootstrap starting.
I20260709 13:05:42.340250 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213f4e3e7d184b60ab88d2f134fccf46" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703" is_pre_election: true
I20260709 13:05:42.341058 18550 raft_consensus.cc:2468] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 0.
I20260709 13:05:42.342610 18440 leader_election.cc:304] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:42.343310 18664 tablet_bootstrap.cc:654] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.343542 18673 raft_consensus.cc:2804] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:42.344156 18673 raft_consensus.cc:493] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.344488 18673 raft_consensus.cc:3060] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.347376 18665 tablet_bootstrap.cc:492] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76: No bootstrap required, opened a new log
I20260709 13:05:42.348067 18665 ts_tablet_manager.cc:1403] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76: Time spent bootstrapping tablet: real 0.045s	user 0.025s	sys 0.013s
I20260709 13:05:42.349639 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213f4e3e7d184b60ab88d2f134fccf46" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
I20260709 13:05:42.350221 18690 raft_consensus.cc:493] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.350401 18624 raft_consensus.cc:2468] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 0.
I20260709 13:05:42.351444 18665 raft_consensus.cc:359] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.352169 18665 raft_consensus.cc:385] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.352300 18671 raft_consensus.cc:493] T b03ee79e498042c8b75d3fbcebb1effd P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.352519 18665 raft_consensus.cc:740] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.352852 18671 raft_consensus.cc:515] T b03ee79e498042c8b75d3fbcebb1effd P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.352945 18690 raft_consensus.cc:515] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.353291 18673 raft_consensus.cc:515] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.353466 18665 consensus_queue.cc:260] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.355386 18690 leader_election.cc:290] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:42.356832 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051026925e764ccd9b7e0b6fe38e10e7" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703" is_pre_election: true
I20260709 13:05:42.357550 18550 raft_consensus.cc:2468] T 051026925e764ccd9b7e0b6fe38e10e7 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 0.
I20260709 13:05:42.359473 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051026925e764ccd9b7e0b6fe38e10e7" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
I20260709 13:05:42.360391 18624 raft_consensus.cc:2468] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 0.
I20260709 13:05:42.362048 18441 leader_election.cc:304] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76; no voters: 
I20260709 13:05:42.363651 18671 leader_election.cc:290] T b03ee79e498042c8b75d3fbcebb1effd P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:42.364670 18690 raft_consensus.cc:2804] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:42.365456 18690 raft_consensus.cc:493] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.365867 18690 raft_consensus.cc:3060] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.367802 18664 tablet_bootstrap.cc:492] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703: No bootstrap required, opened a new log
I20260709 13:05:42.368403 18664 ts_tablet_manager.cc:1403] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.005s
I20260709 13:05:42.371129 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213f4e3e7d184b60ab88d2f134fccf46" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:42.371567 18664 raft_consensus.cc:359] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.372043 18550 raft_consensus.cc:3060] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.372416 18664 raft_consensus.cc:385] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.372840 18664 raft_consensus.cc:740] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.373703 18664 consensus_queue.cc:260] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.376003 18664 ts_tablet_manager.cc:1434] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:42.379851 18673 leader_election.cc:290] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Requested vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:42.380482 18673 raft_consensus.cc:493] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.377015 18664 tablet_bootstrap.cc:492] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703: Bootstrap starting.
I20260709 13:05:42.384490 18673 raft_consensus.cc:515] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.388226 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213f4e3e7d184b60ab88d2f134fccf46" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:42.389889 18671 raft_consensus.cc:493] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.390292 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee79e498042c8b75d3fbcebb1effd" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703" is_pre_election: true
I20260709 13:05:42.390465 18671 raft_consensus.cc:515] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.391338 18664 tablet_bootstrap.cc:654] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.391443 18549 raft_consensus.cc:2468] T b03ee79e498042c8b75d3fbcebb1effd P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 0.
I20260709 13:05:42.388933 18624 raft_consensus.cc:3060] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.393774 18440 leader_election.cc:304] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:42.392900 18671 leader_election.cc:290] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:42.397683 18666 tablet_bootstrap.cc:492] T b03ee79e498042c8b75d3fbcebb1effd P 2cfdcc4bf28d40b59a436fc9d1a7995f: No bootstrap required, opened a new log
I20260709 13:05:42.398509 18666 ts_tablet_manager.cc:1403] T b03ee79e498042c8b75d3fbcebb1effd P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.001s
I20260709 13:05:42.402838 18666 raft_consensus.cc:359] T b03ee79e498042c8b75d3fbcebb1effd P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.403918 18666 raft_consensus.cc:385] T b03ee79e498042c8b75d3fbcebb1effd P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.404393 18666 raft_consensus.cc:740] T b03ee79e498042c8b75d3fbcebb1effd P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.407564 18673 leader_election.cc:290] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:42.407950 18623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee79e498042c8b75d3fbcebb1effd" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
I20260709 13:05:42.408478 18673 raft_consensus.cc:2804] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:42.383688 18550 raft_consensus.cc:2468] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 1.
I20260709 13:05:42.410604 18440 leader_election.cc:304] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:42.408985 18673 raft_consensus.cc:493] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.412047 18673 raft_consensus.cc:3060] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.417728 18666 consensus_queue.cc:260] T b03ee79e498042c8b75d3fbcebb1effd P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
W20260709 13:05:42.419070 18421 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:42.419974 18623 raft_consensus.cc:2468] T b03ee79e498042c8b75d3fbcebb1effd P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 0.
I20260709 13:05:42.421559 18666 ts_tablet_manager.cc:1434] T b03ee79e498042c8b75d3fbcebb1effd P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:05:42.422685 18666 tablet_bootstrap.cc:492] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Bootstrap starting.
I20260709 13:05:42.426019 18670 raft_consensus.cc:493] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.426592 18670 raft_consensus.cc:515] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } } peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } }
I20260709 13:05:42.429034 18666 tablet_bootstrap.cc:654] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.436077 18673 raft_consensus.cc:515] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.438685 18670 leader_election.cc:290] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:42.440822 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee79e498042c8b75d3fbcebb1effd" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:42.441530 18550 raft_consensus.cc:3060] T b03ee79e498042c8b75d3fbcebb1effd P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.450801 18550 raft_consensus.cc:2468] T b03ee79e498042c8b75d3fbcebb1effd P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 1.
I20260709 13:05:42.451902 18673 leader_election.cc:290] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Requested vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:42.453261 18440 leader_election.cc:304] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:42.453831 18673 raft_consensus.cc:2804] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:42.456100 18691 raft_consensus.cc:2804] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:42.444161 18624 raft_consensus.cc:2468] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 1.
I20260709 13:05:42.457847 18665 ts_tablet_manager.cc:1434] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76: Time spent starting tablet: real 0.109s	user 0.012s	sys 0.047s
I20260709 13:05:42.461522 18665 tablet_bootstrap.cc:492] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76: Bootstrap starting.
I20260709 13:05:42.470412 18691 raft_consensus.cc:697] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Becoming Leader. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Running, Role: LEADER
I20260709 13:05:42.479490 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee79e498042c8b75d3fbcebb1effd" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
I20260709 13:05:42.480545 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee79e498042c8b75d3fbcebb1effd" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:42.481007 18624 raft_consensus.cc:3060] T b03ee79e498042c8b75d3fbcebb1effd P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.481252 18474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0f524f92b745e7a4ec40dfa0267295" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
I20260709 13:05:42.476655 18673 raft_consensus.cc:697] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Becoming Leader. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Running, Role: LEADER
I20260709 13:05:42.489393 18673 consensus_queue.cc:237] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
W20260709 13:05:42.485790 18513 leader_election.cc:343] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:42.482142 18665 tablet_bootstrap.cc:654] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.493049 18671 raft_consensus.cc:493] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.493559 18671 raft_consensus.cc:515] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.495745 18671 leader_election.cc:290] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:42.496801 18691 consensus_queue.cc:237] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.488425 18664 tablet_bootstrap.cc:492] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703: No bootstrap required, opened a new log
I20260709 13:05:42.497676 18623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee79e498042c8b75d3fbcebb1effd" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
I20260709 13:05:42.474954 18690 raft_consensus.cc:515] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.485801 18666 tablet_bootstrap.cc:492] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f: No bootstrap required, opened a new log
I20260709 13:05:42.497237 18474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536acabdfb254492867815cfbb3c77aa" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
I20260709 13:05:42.499050 18474 raft_consensus.cc:2468] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 0.
I20260709 13:05:42.499392 18622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0f524f92b745e7a4ec40dfa0267295" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
I20260709 13:05:42.488093 18624 raft_consensus.cc:2468] T b03ee79e498042c8b75d3fbcebb1effd P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 1.
I20260709 13:05:42.500530 18664 ts_tablet_manager.cc:1403] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703: Time spent bootstrapping tablet: real 0.124s	user 0.033s	sys 0.016s
I20260709 13:05:42.500767 18513 leader_election.cc:304] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:42.500952 18666 ts_tablet_manager.cc:1403] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent bootstrapping tablet: real 0.078s	user 0.008s	sys 0.008s
I20260709 13:05:42.501227 18621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536acabdfb254492867815cfbb3c77aa" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
I20260709 13:05:42.504035 18621 raft_consensus.cc:2468] T 536acabdfb254492867815cfbb3c77aa P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 0.
I20260709 13:05:42.502475 18516 leader_election.cc:304] T b03ee79e498042c8b75d3fbcebb1effd P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae5be77f387e48639ec76424d120a703; no voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76
I20260709 13:05:42.505157 18671 raft_consensus.cc:2749] T b03ee79e498042c8b75d3fbcebb1effd P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:42.506641 18671 raft_consensus.cc:2804] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:42.506827 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad19ad4e2d824251af244da83f5e615a" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703" is_pre_election: true
I20260709 13:05:42.507191 18671 raft_consensus.cc:493] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.507323 18474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad19ad4e2d824251af244da83f5e615a" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
I20260709 13:05:42.507714 18671 raft_consensus.cc:3060] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.507982 18474 raft_consensus.cc:2468] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 0.
W20260709 13:05:42.508215 18516 leader_election.cc:343] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:42.508670 18516 leader_election.cc:304] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae5be77f387e48639ec76424d120a703; no voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76
I20260709 13:05:42.509558 18587 leader_election.cc:304] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76; no voters: 
I20260709 13:05:42.509888 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051026925e764ccd9b7e0b6fe38e10e7" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:42.504135 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051026925e764ccd9b7e0b6fe38e10e7" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:42.510733 18550 raft_consensus.cc:3060] T 051026925e764ccd9b7e0b6fe38e10e7 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.510782 18670 raft_consensus.cc:2804] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:42.510835 18624 raft_consensus.cc:3060] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.511510 18670 raft_consensus.cc:493] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.511893 18670 raft_consensus.cc:3060] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.522670 18670 raft_consensus.cc:515] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } } peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } }
I20260709 13:05:42.524601 18704 raft_consensus.cc:2749] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:42.502306 18690 leader_election.cc:290] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Requested vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:42.526298 18474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad19ad4e2d824251af244da83f5e615a" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:42.531893 18474 raft_consensus.cc:3060] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.535574 18665 tablet_bootstrap.cc:492] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76: No bootstrap required, opened a new log
I20260709 13:05:42.527232 18670 leader_election.cc:290] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:42.533676 18624 raft_consensus.cc:2468] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 1.
I20260709 13:05:42.536337 18665 ts_tablet_manager.cc:1403] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76: Time spent bootstrapping tablet: real 0.075s	user 0.016s	sys 0.001s
W20260709 13:05:42.526486 18589 leader_election.cc:343] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:42.537071 18441 leader_election.cc:304] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76; no voters: 
I20260709 13:05:42.538746 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad19ad4e2d824251af244da83f5e615a" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:42.539371 18665 raft_consensus.cc:359] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.540199 18665 raft_consensus.cc:385] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.540042 18474 raft_consensus.cc:2468] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 1.
W20260709 13:05:42.540331 18589 leader_election.cc:343] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:42.540675 18665 raft_consensus.cc:740] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.541592 18690 raft_consensus.cc:2804] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:42.541591 18587 leader_election.cc:304] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76; no voters: ae5be77f387e48639ec76424d120a703
I20260709 13:05:42.541914 18665 consensus_queue.cc:260] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.542436 18690 raft_consensus.cc:697] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Becoming Leader. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Running, Role: LEADER
I20260709 13:05:42.543125 18670 raft_consensus.cc:2804] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:42.543301 18690 consensus_queue.cc:237] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.547420 18671 raft_consensus.cc:515] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.548394 18665 ts_tablet_manager.cc:1434] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:05:42.548216 18373 catalog_manager.cc:5697] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 reported cstate change: term changed from 0 to 1, leader changed from <none> to a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "a81e9f90f26a4379b54fd57a6976af76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.549485 18665 tablet_bootstrap.cc:492] T 7fbfcd9d2442462d8b4feb44a3649b27 P a81e9f90f26a4379b54fd57a6976af76: Bootstrap starting.
I20260709 13:05:42.550331 18373 catalog_manager.cc:5697] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 reported cstate change: term changed from 0 to 1, leader changed from <none> to a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "a81e9f90f26a4379b54fd57a6976af76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.524968 18666 raft_consensus.cc:359] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.556089 18666 raft_consensus.cc:385] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.556540 18666 raft_consensus.cc:740] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.557809 18665 tablet_bootstrap.cc:654] T 7fbfcd9d2442462d8b4feb44a3649b27 P a81e9f90f26a4379b54fd57a6976af76: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.557629 18666 consensus_queue.cc:260] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.560135 18704 raft_consensus.cc:493] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.560755 18704 raft_consensus.cc:515] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.563473 18665 tablet_bootstrap.cc:492] T 7fbfcd9d2442462d8b4feb44a3649b27 P a81e9f90f26a4379b54fd57a6976af76: No bootstrap required, opened a new log
I20260709 13:05:42.563983 18665 ts_tablet_manager.cc:1403] T 7fbfcd9d2442462d8b4feb44a3649b27 P a81e9f90f26a4379b54fd57a6976af76: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.005s
I20260709 13:05:42.566483 18665 raft_consensus.cc:359] T 7fbfcd9d2442462d8b4feb44a3649b27 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.567332 18665 raft_consensus.cc:385] T 7fbfcd9d2442462d8b4feb44a3649b27 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.567430 18550 raft_consensus.cc:2468] T 051026925e764ccd9b7e0b6fe38e10e7 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 1.
I20260709 13:05:42.567700 18665 raft_consensus.cc:740] T 7fbfcd9d2442462d8b4feb44a3649b27 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.568563 18690 raft_consensus.cc:493] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.568516 18665 consensus_queue.cc:260] T 7fbfcd9d2442462d8b4feb44a3649b27 P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.569137 18690 raft_consensus.cc:515] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.571352 18690 leader_election.cc:290] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:42.572518 18665 ts_tablet_manager.cc:1434] T 7fbfcd9d2442462d8b4feb44a3649b27 P a81e9f90f26a4379b54fd57a6976af76: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:42.566444 18664 raft_consensus.cc:359] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.573884 18665 tablet_bootstrap.cc:492] T 109a4a99e5ac4b248028219843cf6ab8 P a81e9f90f26a4379b54fd57a6976af76: Bootstrap starting.
I20260709 13:05:42.572984 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0f524f92b745e7a4ec40dfa0267295" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703" is_pre_election: true
I20260709 13:05:42.574581 18549 raft_consensus.cc:2468] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 0.
I20260709 13:05:42.574642 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0f524f92b745e7a4ec40dfa0267295" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
W20260709 13:05:42.577335 18441 leader_election.cc:343] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:42.577526 18621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ec65bcdd54a2a966c4a8666bdc49f" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
I20260709 13:05:42.578061 18440 leader_election.cc:304] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 2cfdcc4bf28d40b59a436fc9d1a7995f
I20260709 13:05:42.578434 18704 leader_election.cc:290] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:42.573657 18709 raft_consensus.cc:493] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.573506 18664 raft_consensus.cc:385] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.580530 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ec65bcdd54a2a966c4a8666bdc49f" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
I20260709 13:05:42.581250 18475 raft_consensus.cc:2468] T 764ec65bcdd54a2a966c4a8666bdc49f P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 0.
I20260709 13:05:42.580711 18709 raft_consensus.cc:515] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.579946 18474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536acabdfb254492867815cfbb3c77aa" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:42.575059 18666 ts_tablet_manager.cc:1434] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.000s
I20260709 13:05:42.580715 18664 raft_consensus.cc:740] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.584865 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ec65bcdd54a2a966c4a8666bdc49f" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703" is_pre_election: true
I20260709 13:05:42.582753 18513 leader_election.cc:304] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:42.585726 18550 raft_consensus.cc:2468] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 0.
I20260709 13:05:42.583659 18709 leader_election.cc:290] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:42.585767 18664 consensus_queue.cc:260] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.583823 18621 raft_consensus.cc:2468] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 0.
I20260709 13:05:42.587132 18589 leader_election.cc:304] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:42.588027 18704 raft_consensus.cc:2804] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:42.584350 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ec65bcdd54a2a966c4a8666bdc49f" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
I20260709 13:05:42.589339 18475 raft_consensus.cc:2468] T 764ec65bcdd54a2a966c4a8666bdc49f P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 0.
I20260709 13:05:42.581785 18665 tablet_bootstrap.cc:654] T 109a4a99e5ac4b248028219843cf6ab8 P a81e9f90f26a4379b54fd57a6976af76: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.582266 18690 raft_consensus.cc:2804] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:42.585073 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536acabdfb254492867815cfbb3c77aa" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:42.592631 18690 raft_consensus.cc:493] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.593008 18624 raft_consensus.cc:3060] T 536acabdfb254492867815cfbb3c77aa P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.593065 18690 raft_consensus.cc:3060] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.594146 18704 raft_consensus.cc:493] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.594588 18704 raft_consensus.cc:3060] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.591262 18709 raft_consensus.cc:2804] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:42.596381 18709 raft_consensus.cc:493] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.596728 18709 raft_consensus.cc:3060] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.585911 18666 tablet_bootstrap.cc:492] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Bootstrap starting.
I20260709 13:05:42.584669 18671 leader_election.cc:290] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:42.591276 18670 raft_consensus.cc:697] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Becoming Leader. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Running, Role: LEADER
I20260709 13:05:42.671437 18670 consensus_queue.cc:237] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } } peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } }
I20260709 13:05:42.583184 18474 raft_consensus.cc:3060] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.686836 18664 ts_tablet_manager.cc:1434] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703: Time spent starting tablet: real 0.157s	user 0.013s	sys 0.013s
I20260709 13:05:42.697715 18664 tablet_bootstrap.cc:492] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703: Bootstrap starting.
W20260709 13:05:42.715780 18587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.193:35283, user_credentials={real_user=slave}} blocked reactor thread for 74353.8us
I20260709 13:05:42.725539 18709 raft_consensus.cc:515] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.727408 18664 tablet_bootstrap.cc:654] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.726810 18665 tablet_bootstrap.cc:492] T 109a4a99e5ac4b248028219843cf6ab8 P a81e9f90f26a4379b54fd57a6976af76: No bootstrap required, opened a new log
I20260709 13:05:42.729835 18665 ts_tablet_manager.cc:1403] T 109a4a99e5ac4b248028219843cf6ab8 P a81e9f90f26a4379b54fd57a6976af76: Time spent bootstrapping tablet: real 0.156s	user 0.037s	sys 0.008s
I20260709 13:05:42.726522 18690 raft_consensus.cc:515] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.734745 18690 leader_election.cc:290] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Requested vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:42.736565 18621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0f524f92b745e7a4ec40dfa0267295" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:42.736265 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0f524f92b745e7a4ec40dfa0267295" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:42.737632 18550 raft_consensus.cc:3060] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:42.738348 18441 leader_election.cc:343] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:42.733156 18709 leader_election.cc:290] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:42.745772 18705 raft_consensus.cc:493] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.746820 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ec65bcdd54a2a966c4a8666bdc49f" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:42.746750 18705 raft_consensus.cc:515] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.749501 18705 leader_election.cc:290] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:42.752513 18548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109a4a99e5ac4b248028219843cf6ab8" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703" is_pre_election: true
I20260709 13:05:42.762800 18664 tablet_bootstrap.cc:492] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703: No bootstrap required, opened a new log
I20260709 13:05:42.757956 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ec65bcdd54a2a966c4a8666bdc49f" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:42.763375 18664 ts_tablet_manager.cc:1403] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703: Time spent bootstrapping tablet: real 0.074s	user 0.005s	sys 0.014s
I20260709 13:05:42.763883 18475 raft_consensus.cc:3060] T 764ec65bcdd54a2a966c4a8666bdc49f P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.765192 18550 raft_consensus.cc:2468] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 1.
I20260709 13:05:42.764004 18373 catalog_manager.cc:5697] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195). New cstate: current_term: 1 leader_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.760468 18704 raft_consensus.cc:515] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.766710 18440 leader_election.cc:304] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 2cfdcc4bf28d40b59a436fc9d1a7995f
I20260709 13:05:42.768323 18549 raft_consensus.cc:2393] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in current term 1: Already voted for candidate ae5be77f387e48639ec76424d120a703 in this term.
I20260709 13:05:42.761169 18372 catalog_manager.cc:5697] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 reported cstate change: term changed from 0 to 1, leader changed from <none> to a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "a81e9f90f26a4379b54fd57a6976af76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.762248 18665 raft_consensus.cc:359] T 109a4a99e5ac4b248028219843cf6ab8 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.759016 18473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109a4a99e5ac4b248028219843cf6ab8" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
I20260709 13:05:42.754331 18666 tablet_bootstrap.cc:654] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.767026 18664 raft_consensus.cc:359] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } } peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } }
I20260709 13:05:42.768879 18690 raft_consensus.cc:2804] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:42.770617 18664 raft_consensus.cc:385] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.770911 18690 raft_consensus.cc:697] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Becoming Leader. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Running, Role: LEADER
I20260709 13:05:42.770984 18664 raft_consensus.cc:740] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.772351 18472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ec65bcdd54a2a966c4a8666bdc49f" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:42.772150 18690 consensus_queue.cc:237] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.772753 18664 consensus_queue.cc:260] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } } peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } }
I20260709 13:05:42.770073 18665 raft_consensus.cc:385] T 109a4a99e5ac4b248028219843cf6ab8 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.774123 18665 raft_consensus.cc:740] T 109a4a99e5ac4b248028219843cf6ab8 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Initialized, Role: FOLLOWER
W20260709 13:05:42.772837 18589 leader_election.cc:343] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:42.775913 18664 ts_tablet_manager.cc:1434] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:05:42.775741 18665 consensus_queue.cc:260] T 109a4a99e5ac4b248028219843cf6ab8 P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.776659 18473 raft_consensus.cc:2468] T 109a4a99e5ac4b248028219843cf6ab8 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 0.
I20260709 13:05:42.776751 18621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ec65bcdd54a2a966c4a8666bdc49f" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:42.777617 18664 tablet_bootstrap.cc:492] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703: Bootstrap starting.
I20260709 13:05:42.777716 18621 raft_consensus.cc:2393] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ae5be77f387e48639ec76424d120a703 in current term 1: Already voted for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in this term.
I20260709 13:05:42.778954 18587 leader_election.cc:304] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76; no voters: ae5be77f387e48639ec76424d120a703
I20260709 13:05:42.779204 18516 leader_election.cc:304] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae5be77f387e48639ec76424d120a703; no voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76
I20260709 13:05:42.780172 18671 raft_consensus.cc:2749] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:42.780263 18705 raft_consensus.cc:2804] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:42.780697 18705 raft_consensus.cc:493] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.781064 18705 raft_consensus.cc:3060] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.777652 18624 raft_consensus.cc:2468] T 536acabdfb254492867815cfbb3c77aa P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 1.
I20260709 13:05:42.782887 18516 leader_election.cc:304] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:42.783898 18671 raft_consensus.cc:2804] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:42.784437 18671 raft_consensus.cc:697] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [term 1 LEADER]: Becoming Leader. State: Replica: ae5be77f387e48639ec76424d120a703, State: Running, Role: LEADER
I20260709 13:05:42.785208 18664 tablet_bootstrap.cc:654] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.785429 18474 raft_consensus.cc:2468] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 1.
I20260709 13:05:42.785650 18671 consensus_queue.cc:237] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.789058 18665 ts_tablet_manager.cc:1434] T 109a4a99e5ac4b248028219843cf6ab8 P a81e9f90f26a4379b54fd57a6976af76: Time spent starting tablet: real 0.059s	user 0.002s	sys 0.005s
I20260709 13:05:42.771413 18704 leader_election.cc:290] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:42.800911 18705 raft_consensus.cc:515] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.811031 18705 leader_election.cc:290] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:42.812023 18474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109a4a99e5ac4b248028219843cf6ab8" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:42.813344 18474 raft_consensus.cc:3060] T 109a4a99e5ac4b248028219843cf6ab8 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.814461 18664 tablet_bootstrap.cc:492] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703: No bootstrap required, opened a new log
I20260709 13:05:42.815224 18664 ts_tablet_manager.cc:1403] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.015s
I20260709 13:05:42.839160 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109a4a99e5ac4b248028219843cf6ab8" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703"
W20260709 13:05:42.840940 18589 leader_election.cc:343] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:42.841120 18475 raft_consensus.cc:2468] T 764ec65bcdd54a2a966c4a8666bdc49f P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 1.
I20260709 13:05:42.842705 18587 leader_election.cc:304] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76; no voters: ae5be77f387e48639ec76424d120a703
I20260709 13:05:42.843987 18705 raft_consensus.cc:2804] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:42.844513 18705 raft_consensus.cc:697] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Becoming Leader. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Running, Role: LEADER
I20260709 13:05:42.845258 18474 raft_consensus.cc:2468] T 109a4a99e5ac4b248028219843cf6ab8 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 1.
I20260709 13:05:42.845700 18705 consensus_queue.cc:237] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.846707 18664 raft_consensus.cc:359] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.847278 18664 raft_consensus.cc:385] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.847505 18664 raft_consensus.cc:740] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.848155 18664 consensus_queue.cc:260] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.850286 18664 ts_tablet_manager.cc:1434] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.019s
I20260709 13:05:42.849910 18587 leader_election.cc:304] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76; no voters: ae5be77f387e48639ec76424d120a703
I20260709 13:05:42.851055 18709 raft_consensus.cc:2804] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:42.851508 18709 raft_consensus.cc:697] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Becoming Leader. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Running, Role: LEADER
I20260709 13:05:42.852424 18709 consensus_queue.cc:237] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.853060 18666 tablet_bootstrap.cc:492] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f: No bootstrap required, opened a new log
I20260709 13:05:42.853788 18666 ts_tablet_manager.cc:1403] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent bootstrapping tablet: real 0.268s	user 0.026s	sys 0.021s
I20260709 13:05:42.857110 18666 raft_consensus.cc:359] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.857879 18666 raft_consensus.cc:385] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.858155 18666 raft_consensus.cc:740] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.859373 18666 consensus_queue.cc:260] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.862385 18666 ts_tablet_manager.cc:1434] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:42.864153 18666 tablet_bootstrap.cc:492] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Bootstrap starting.
I20260709 13:05:42.867216 18373 catalog_manager.cc:5697] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae5be77f387e48639ec76424d120a703 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "ae5be77f387e48639ec76424d120a703" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.870846 18666 tablet_bootstrap.cc:654] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.876206 18666 tablet_bootstrap.cc:492] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f: No bootstrap required, opened a new log
I20260709 13:05:42.876667 18666 ts_tablet_manager.cc:1403] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:05:42.878441 18372 catalog_manager.cc:5697] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195). New cstate: current_term: 1 leader_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:42.879537 18666 raft_consensus.cc:359] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.880115 18666 raft_consensus.cc:385] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.880426 18666 raft_consensus.cc:740] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.879990 18372 catalog_manager.cc:5697] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195). New cstate: current_term: 1 leader_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:42.881067 18666 consensus_queue.cc:260] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.882979 18666 ts_tablet_manager.cc:1434] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:05:42.889457 18371 catalog_manager.cc:5697] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 reported cstate change: term changed from 0 to 1, leader changed from <none> to a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "a81e9f90f26a4379b54fd57a6976af76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.894100 18690 consensus_queue.cc:1048] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:42.909823 18690 consensus_queue.cc:1048] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:42.963877 18704 raft_consensus.cc:493] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.964406 18704 raft_consensus.cc:515] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:42.966229 18704 leader_election.cc:290] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:42.967285 18474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109a4a99e5ac4b248028219843cf6ab8" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
I20260709 13:05:42.967490 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109a4a99e5ac4b248028219843cf6ab8" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
I20260709 13:05:42.968068 18474 raft_consensus.cc:2393] T 109a4a99e5ac4b248028219843cf6ab8 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae5be77f387e48639ec76424d120a703 in current term 1: Already voted for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in this term.
I20260709 13:05:42.969337 18513 leader_election.cc:304] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae5be77f387e48639ec76424d120a703; no voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76
I20260709 13:05:42.970120 18704 raft_consensus.cc:3060] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.975503 18704 raft_consensus.cc:2749] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:42.982612 18690 consensus_queue.cc:1048] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:42.983383 18673 consensus_queue.cc:1048] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:42.991606 18673 consensus_queue.cc:1048] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:43.001070 18691 consensus_queue.cc:1048] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:43.025775 18704 raft_consensus.cc:493] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.026593 18704 raft_consensus.cc:515] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.028848 18704 leader_election.cc:290] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:43.029843 18474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fbfcd9d2442462d8b4feb44a3649b27" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
I20260709 13:05:43.030596 18474 raft_consensus.cc:2468] T 7fbfcd9d2442462d8b4feb44a3649b27 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 0.
I20260709 13:05:43.031643 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fbfcd9d2442462d8b4feb44a3649b27" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
I20260709 13:05:43.032385 18624 raft_consensus.cc:2468] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 0.
I20260709 13:05:43.032507 18513 leader_election.cc:304] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:43.033388 18704 raft_consensus.cc:2804] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:43.033746 18704 raft_consensus.cc:493] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.034101 18704 raft_consensus.cc:3060] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:43.041329 18704 raft_consensus.cc:515] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.043030 18704 leader_election.cc:290] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:43.043763 18474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fbfcd9d2442462d8b4feb44a3649b27" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:43.044075 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fbfcd9d2442462d8b4feb44a3649b27" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:43.044317 18474 raft_consensus.cc:3060] T 7fbfcd9d2442462d8b4feb44a3649b27 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:43.044659 18624 raft_consensus.cc:3060] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:43.049753 18474 raft_consensus.cc:2468] T 7fbfcd9d2442462d8b4feb44a3649b27 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 1.
I20260709 13:05:43.049995 18624 raft_consensus.cc:2468] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 1.
I20260709 13:05:43.051051 18513 leader_election.cc:304] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:43.051772 18704 raft_consensus.cc:2804] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:43.052193 18704 raft_consensus.cc:697] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [term 1 LEADER]: Becoming Leader. State: Replica: ae5be77f387e48639ec76424d120a703, State: Running, Role: LEADER
I20260709 13:05:43.052906 18704 consensus_queue.cc:237] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.060767 18370 catalog_manager.cc:5697] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae5be77f387e48639ec76424d120a703 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "ae5be77f387e48639ec76424d120a703" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:43.070055 18709 raft_consensus.cc:493] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.070582 18709 raft_consensus.cc:515] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.072306 18709 leader_election.cc:290] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:43.073009 18474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0f524f92b745e7a4ec40dfa0267295" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
I20260709 13:05:43.073349 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0f524f92b745e7a4ec40dfa0267295" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703" is_pre_election: true
I20260709 13:05:43.074100 18549 raft_consensus.cc:2393] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in current term 1: Already voted for candidate a81e9f90f26a4379b54fd57a6976af76 in this term.
I20260709 13:05:43.074959 18589 leader_election.cc:304] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f; no voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703
I20260709 13:05:43.075687 18709 raft_consensus.cc:3060] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:43.081385 18709 raft_consensus.cc:2749] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:43.108839 18624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad19ad4e2d824251af244da83f5e615a"
dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
mode: GRACEFUL
new_leader_uuid: "a81e9f90f26a4379b54fd57a6976af76"
 from {username='slave'} at 127.0.0.1:58590
I20260709 13:05:43.109601 18624 raft_consensus.cc:606] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Received request to transfer leadership to TS a81e9f90f26a4379b54fd57a6976af76
I20260709 13:05:43.117367 18704 raft_consensus.cc:493] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.117990 18704 raft_consensus.cc:515] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } } peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } }
I20260709 13:05:43.120210 18704 leader_election.cc:290] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169), a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283)
I20260709 13:05:43.121177 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad19ad4e2d824251af244da83f5e615a" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
I20260709 13:05:43.121591 18474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad19ad4e2d824251af244da83f5e615a" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
I20260709 13:05:43.122522 18474 raft_consensus.cc:2393] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae5be77f387e48639ec76424d120a703 in current term 1: Already voted for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in this term.
I20260709 13:05:43.123790 18513 leader_election.cc:304] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae5be77f387e48639ec76424d120a703; no voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76
I20260709 13:05:43.124475 18704 raft_consensus.cc:3060] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:43.129922 18704 raft_consensus.cc:2749] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:43.131445 18549 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "536acabdfb254492867815cfbb3c77aa"
dest_uuid: "ae5be77f387e48639ec76424d120a703"
mode: GRACEFUL
new_leader_uuid: "a81e9f90f26a4379b54fd57a6976af76"
 from {username='slave'} at 127.0.0.1:35438
I20260709 13:05:43.132130 18549 raft_consensus.cc:606] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [term 1 LEADER]: Received request to transfer leadership to TS a81e9f90f26a4379b54fd57a6976af76
I20260709 13:05:43.137342 18624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "764ec65bcdd54a2a966c4a8666bdc49f"
dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
mode: GRACEFUL
new_leader_uuid: "ae5be77f387e48639ec76424d120a703"
 from {username='slave'} at 127.0.0.1:58590
I20260709 13:05:43.137882 18624 raft_consensus.cc:606] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Received request to transfer leadership to TS ae5be77f387e48639ec76424d120a703
I20260709 13:05:43.151767 18474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "213f4e3e7d184b60ab88d2f134fccf46"
dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
mode: GRACEFUL
new_leader_uuid: "ae5be77f387e48639ec76424d120a703"
 from {username='slave'} at 127.0.0.1:59858
I20260709 13:05:43.152401 18474 raft_consensus.cc:606] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Received request to transfer leadership to TS ae5be77f387e48639ec76424d120a703
I20260709 13:05:43.158461 18474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f0f524f92b745e7a4ec40dfa0267295"
dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
mode: GRACEFUL
new_leader_uuid: "ae5be77f387e48639ec76424d120a703"
 from {username='slave'} at 127.0.0.1:59858
I20260709 13:05:43.158941 18474 raft_consensus.cc:606] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Received request to transfer leadership to TS ae5be77f387e48639ec76424d120a703
I20260709 13:05:43.162577 18709 consensus_queue.cc:1048] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:43.164740 18624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "109a4a99e5ac4b248028219843cf6ab8"
dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
mode: GRACEFUL
new_leader_uuid: "ae5be77f387e48639ec76424d120a703"
 from {username='slave'} at 127.0.0.1:58590
I20260709 13:05:43.165261 18624 raft_consensus.cc:606] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Received request to transfer leadership to TS ae5be77f387e48639ec76424d120a703
I20260709 13:05:43.171423 18549 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fbfcd9d2442462d8b4feb44a3649b27"
dest_uuid: "ae5be77f387e48639ec76424d120a703"
mode: GRACEFUL
new_leader_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
 from {username='slave'} at 127.0.0.1:35438
I20260709 13:05:43.172132 18549 raft_consensus.cc:606] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [term 1 LEADER]: Received request to transfer leadership to TS 2cfdcc4bf28d40b59a436fc9d1a7995f
I20260709 13:05:43.176097 18709 consensus_queue.cc:1048] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:43.185497 18670 raft_consensus.cc:993] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f: : Instructing follower a81e9f90f26a4379b54fd57a6976af76 to start an election
I20260709 13:05:43.185983 18709 raft_consensus.cc:1081] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Signalling peer a81e9f90f26a4379b54fd57a6976af76 to start an election
I20260709 13:05:43.187606 18474 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad19ad4e2d824251af244da83f5e615a"
dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
 from {username='slave'} at 127.0.0.1:59842
I20260709 13:05:43.188246 18474 raft_consensus.cc:493] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:43.188627 18474 raft_consensus.cc:3060] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.193645 18474 raft_consensus.cc:515] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } } peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } }
I20260709 13:05:43.195557 18474 leader_election.cc:290] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 2 election: Requested vote from peers 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:43.196437 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad19ad4e2d824251af244da83f5e615a" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:43.196674 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad19ad4e2d824251af244da83f5e615a" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:43.197422 18624 raft_consensus.cc:3055] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:43.197415 18550 raft_consensus.cc:3060] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.198010 18624 raft_consensus.cc:740] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Running, Role: LEADER
I20260709 13:05:43.198972 18624 consensus_queue.cc:260] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } } peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } }
I20260709 13:05:43.200322 18624 raft_consensus.cc:3060] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.205566 18550 raft_consensus.cc:2468] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 2.
I20260709 13:05:43.206939 18440 leader_election.cc:304] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:43.207685 18690 raft_consensus.cc:2804] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:43.207643 18624 raft_consensus.cc:2468] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 2.
I20260709 13:05:43.208436 18690 raft_consensus.cc:697] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 [term 2 LEADER]: Becoming Leader. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Running, Role: LEADER
I20260709 13:05:43.209517 18690 consensus_queue.cc:237] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } } peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } }
I20260709 13:05:43.215826 18371 catalog_manager.cc:5697] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 reported cstate change: term changed from 1 to 2, leader changed from 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195) to a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "a81e9f90f26a4379b54fd57a6976af76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:43.247514 18690 consensus_queue.cc:1048] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:43.260604 18704 consensus_queue.cc:1048] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:43.263568 18690 consensus_queue.cc:1048] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:43.265059 18670 consensus_queue.cc:1048] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:43.275498 18698 raft_consensus.cc:993] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76: : Instructing follower ae5be77f387e48639ec76424d120a703 to start an election
I20260709 13:05:43.275990 18698 raft_consensus.cc:1081] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Signalling peer ae5be77f387e48639ec76424d120a703 to start an election
I20260709 13:05:43.279386 18550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f0f524f92b745e7a4ec40dfa0267295"
dest_uuid: "ae5be77f387e48639ec76424d120a703"
 from {username='slave'} at 127.0.0.1:35408
I20260709 13:05:43.279971 18550 raft_consensus.cc:493] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:43.280361 18550 raft_consensus.cc:3060] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.283488 18704 consensus_queue.cc:1048] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:43.288091 18550 raft_consensus.cc:515] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.293836 18550 leader_election.cc:290] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 2 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:43.294673 18473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0f524f92b745e7a4ec40dfa0267295" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:43.295466 18473 raft_consensus.cc:3055] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:43.295513 18621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0f524f92b745e7a4ec40dfa0267295" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:43.295918 18473 raft_consensus.cc:740] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Running, Role: LEADER
I20260709 13:05:43.296298 18621 raft_consensus.cc:3060] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.296916 18473 consensus_queue.cc:260] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.298421 18473 raft_consensus.cc:3060] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.307042 18705 consensus_queue.cc:1048] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:43.311411 18621 raft_consensus.cc:2468] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 2.
I20260709 13:05:43.311931 18712 raft_consensus.cc:993] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703: : Instructing follower a81e9f90f26a4379b54fd57a6976af76 to start an election
I20260709 13:05:43.312461 18712 raft_consensus.cc:1081] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [term 1 LEADER]: Signalling peer a81e9f90f26a4379b54fd57a6976af76 to start an election
I20260709 13:05:43.313730 18516 leader_election.cc:304] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:43.318409 18671 raft_consensus.cc:2804] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:43.318922 18671 raft_consensus.cc:697] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Becoming Leader. State: Replica: ae5be77f387e48639ec76424d120a703, State: Running, Role: LEADER
I20260709 13:05:43.319491 18475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "536acabdfb254492867815cfbb3c77aa"
dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
 from {username='slave'} at 127.0.0.1:59826
I20260709 13:05:43.319892 18671 consensus_queue.cc:237] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.320188 18475 raft_consensus.cc:493] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:43.321135 18475 raft_consensus.cc:3060] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.324682 18709 raft_consensus.cc:993] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f: : Instructing follower ae5be77f387e48639ec76424d120a703 to start an election
I20260709 13:05:43.325259 18709 raft_consensus.cc:1081] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Signalling peer ae5be77f387e48639ec76424d120a703 to start an election
I20260709 13:05:43.327142 18549 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "764ec65bcdd54a2a966c4a8666bdc49f"
dest_uuid: "ae5be77f387e48639ec76424d120a703"
 from {username='slave'} at 127.0.0.1:35424
I20260709 13:05:43.327716 18549 raft_consensus.cc:493] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:43.328091 18549 raft_consensus.cc:3060] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.328656 18473 raft_consensus.cc:2468] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 2.
I20260709 13:05:43.330770 18705 consensus_queue.cc:1048] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:43.332469 18475 raft_consensus.cc:515] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.335196 18475 leader_election.cc:290] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 2 election: Requested vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:43.335791 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536acabdfb254492867815cfbb3c77aa" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:43.336174 18621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "536acabdfb254492867815cfbb3c77aa" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:43.336161 18549 raft_consensus.cc:515] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.336918 18550 raft_consensus.cc:3055] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:43.337026 18621 raft_consensus.cc:3060] T 536acabdfb254492867815cfbb3c77aa P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.337441 18550 raft_consensus.cc:740] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Running, Role: LEADER
I20260709 13:05:43.338863 18549 leader_election.cc:290] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 2 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:43.339277 18550 consensus_queue.cc:260] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.339828 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ec65bcdd54a2a966c4a8666bdc49f" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:43.340396 18475 raft_consensus.cc:3060] T 764ec65bcdd54a2a966c4a8666bdc49f P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.340766 18550 raft_consensus.cc:3060] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.341413 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ec65bcdd54a2a966c4a8666bdc49f" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:43.342020 18624 raft_consensus.cc:3055] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:43.342314 18624 raft_consensus.cc:740] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Running, Role: LEADER
I20260709 13:05:43.343122 18624 consensus_queue.cc:260] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.344169 18624 raft_consensus.cc:3060] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.344772 18621 raft_consensus.cc:2468] T 536acabdfb254492867815cfbb3c77aa P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 2.
I20260709 13:05:43.345997 18441 leader_election.cc:304] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76; no voters: 
I20260709 13:05:43.346906 18698 raft_consensus.cc:2804] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:43.347371 18698 raft_consensus.cc:697] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76 [term 2 LEADER]: Becoming Leader. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Running, Role: LEADER
I20260709 13:05:43.348409 18550 raft_consensus.cc:2468] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 2.
I20260709 13:05:43.348428 18698 consensus_queue.cc:237] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.351040 18475 raft_consensus.cc:2468] T 764ec65bcdd54a2a966c4a8666bdc49f P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 2.
I20260709 13:05:43.352546 18513 leader_election.cc:304] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:43.353493 18671 raft_consensus.cc:2804] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:43.353945 18671 raft_consensus.cc:697] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Becoming Leader. State: Replica: ae5be77f387e48639ec76424d120a703, State: Running, Role: LEADER
I20260709 13:05:43.354849 18671 consensus_queue.cc:237] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.355264 18624 raft_consensus.cc:2468] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 2.
I20260709 13:05:43.356181 18370 catalog_manager.cc:5697] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 reported cstate change: term changed from 1 to 2, leader changed from a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193) to ae5be77f387e48639ec76424d120a703 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "ae5be77f387e48639ec76424d120a703" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:43.360210 18690 raft_consensus.cc:993] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76: : Instructing follower ae5be77f387e48639ec76424d120a703 to start an election
I20260709 13:05:43.360766 18690 raft_consensus.cc:1081] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Signalling peer ae5be77f387e48639ec76424d120a703 to start an election
I20260709 13:05:43.362579 18709 consensus_queue.cc:1048] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:43.365608 18550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "213f4e3e7d184b60ab88d2f134fccf46"
dest_uuid: "ae5be77f387e48639ec76424d120a703"
 from {username='slave'} at 127.0.0.1:35408
I20260709 13:05:43.366242 18550 raft_consensus.cc:493] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:43.366681 18550 raft_consensus.cc:3060] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.367766 18372 catalog_manager.cc:5697] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76 reported cstate change: term changed from 1 to 2, leader changed from ae5be77f387e48639ec76424d120a703 (127.7.25.194) to a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "a81e9f90f26a4379b54fd57a6976af76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:43.374476 18550 raft_consensus.cc:515] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.377529 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213f4e3e7d184b60ab88d2f134fccf46" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:43.377724 18550 leader_election.cc:290] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 2 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:43.378193 18475 raft_consensus.cc:3055] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:43.378584 18475 raft_consensus.cc:740] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Running, Role: LEADER
I20260709 13:05:43.379518 18475 consensus_queue.cc:260] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.379813 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213f4e3e7d184b60ab88d2f134fccf46" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:43.380504 18624 raft_consensus.cc:3060] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.380951 18475 raft_consensus.cc:3060] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.381162 18371 catalog_manager.cc:5697] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 reported cstate change: term changed from 1 to 2, leader changed from 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195) to ae5be77f387e48639ec76424d120a703 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "ae5be77f387e48639ec76424d120a703" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:43.382731 18670 raft_consensus.cc:993] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f: : Instructing follower ae5be77f387e48639ec76424d120a703 to start an election
I20260709 13:05:43.383526 18670 raft_consensus.cc:1081] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Signalling peer ae5be77f387e48639ec76424d120a703 to start an election
I20260709 13:05:43.387424 18550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "109a4a99e5ac4b248028219843cf6ab8"
dest_uuid: "ae5be77f387e48639ec76424d120a703"
 from {username='slave'} at 127.0.0.1:35424
I20260709 13:05:43.387995 18550 raft_consensus.cc:493] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:43.388370 18550 raft_consensus.cc:3060] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.388684 18475 raft_consensus.cc:2468] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 2.
I20260709 13:05:43.389945 18513 leader_election.cc:304] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:43.390813 18671 raft_consensus.cc:2804] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:43.391119 18624 raft_consensus.cc:2468] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 2.
I20260709 13:05:43.391312 18671 raft_consensus.cc:697] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Becoming Leader. State: Replica: ae5be77f387e48639ec76424d120a703, State: Running, Role: LEADER
I20260709 13:05:43.392273 18671 consensus_queue.cc:237] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.395370 18550 raft_consensus.cc:515] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.398049 18550 leader_election.cc:290] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 2 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:43.398509 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109a4a99e5ac4b248028219843cf6ab8" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:43.398732 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109a4a99e5ac4b248028219843cf6ab8" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:43.399401 18475 raft_consensus.cc:3060] T 109a4a99e5ac4b248028219843cf6ab8 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.399516 18624 raft_consensus.cc:3055] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:43.400027 18624 raft_consensus.cc:740] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Running, Role: LEADER
I20260709 13:05:43.400760 18624 consensus_queue.cc:260] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.402092 18624 raft_consensus.cc:3060] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.406780 18475 raft_consensus.cc:2468] T 109a4a99e5ac4b248028219843cf6ab8 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 2.
I20260709 13:05:43.402745 18372 catalog_manager.cc:5697] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 reported cstate change: term changed from 1 to 2, leader changed from a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193) to ae5be77f387e48639ec76424d120a703 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "ae5be77f387e48639ec76424d120a703" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:43.407930 18513 leader_election.cc:304] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:43.408269 18624 raft_consensus.cc:2468] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 2.
I20260709 13:05:43.408720 18671 raft_consensus.cc:2804] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:43.409292 18671 raft_consensus.cc:697] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Becoming Leader. State: Replica: ae5be77f387e48639ec76424d120a703, State: Running, Role: LEADER
I20260709 13:05:43.410049 18671 consensus_queue.cc:237] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.419929 18372 catalog_manager.cc:5697] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 reported cstate change: term changed from 1 to 2, leader changed from 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195) to ae5be77f387e48639ec76424d120a703 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "ae5be77f387e48639ec76424d120a703" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:43.615651 18671 consensus_queue.cc:1048] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:43.633309 18704 consensus_queue.cc:1048] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:43.637334 18621 raft_consensus.cc:1275] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Refusing update from remote peer a81e9f90f26a4379b54fd57a6976af76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:43.638870 18698 consensus_queue.cc:1048] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.641682 18712 raft_consensus.cc:993] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703: : Instructing follower 2cfdcc4bf28d40b59a436fc9d1a7995f to start an election
I20260709 13:05:43.642185 18704 raft_consensus.cc:1081] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [term 1 LEADER]: Signalling peer 2cfdcc4bf28d40b59a436fc9d1a7995f to start an election
I20260709 13:05:43.643890 18624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7fbfcd9d2442462d8b4feb44a3649b27"
dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
 from {username='slave'} at 127.0.0.1:58588
I20260709 13:05:43.644469 18624 raft_consensus.cc:493] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:43.645642 18624 raft_consensus.cc:3060] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.647017 18550 raft_consensus.cc:1275] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Refusing update from remote peer a81e9f90f26a4379b54fd57a6976af76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:43.648818 18691 consensus_queue.cc:1048] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.658913 18624 raft_consensus.cc:515] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.661476 18624 leader_election.cc:290] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 2 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:43.661976 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fbfcd9d2442462d8b4feb44a3649b27" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:43.662621 18475 raft_consensus.cc:3060] T 7fbfcd9d2442462d8b4feb44a3649b27 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.662926 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fbfcd9d2442462d8b4feb44a3649b27" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:43.663440 18550 raft_consensus.cc:3055] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:43.663635 18550 raft_consensus.cc:740] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Running, Role: LEADER
I20260709 13:05:43.664294 18550 consensus_queue.cc:260] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.665302 18550 raft_consensus.cc:3060] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.669350 18475 raft_consensus.cc:2468] T 7fbfcd9d2442462d8b4feb44a3649b27 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 2.
I20260709 13:05:43.670645 18587 leader_election.cc:304] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76; no voters: 
I20260709 13:05:43.671475 18709 raft_consensus.cc:2804] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:43.671720 18550 raft_consensus.cc:2468] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 2.
I20260709 13:05:43.671972 18709 raft_consensus.cc:697] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 LEADER]: Becoming Leader. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Running, Role: LEADER
I20260709 13:05:43.672894 18709 consensus_queue.cc:237] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:43.679425 18371 catalog_manager.cc:5697] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f reported cstate change: term changed from 1 to 2, leader changed from ae5be77f387e48639ec76424d120a703 (127.7.25.194) to 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195). New cstate: current_term: 2 leader_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:43.733165 18624 raft_consensus.cc:1275] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Refusing update from remote peer ae5be77f387e48639ec76424d120a703: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:43.734536 18704 consensus_queue.cc:1048] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.737795 18550 raft_consensus.cc:1275] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Refusing update from remote peer a81e9f90f26a4379b54fd57a6976af76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:43.739202 18691 consensus_queue.cc:1048] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.745607 18475 raft_consensus.cc:1275] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Refusing update from remote peer ae5be77f387e48639ec76424d120a703: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:43.747107 18671 consensus_queue.cc:1048] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.752472 18624 raft_consensus.cc:1275] T 536acabdfb254492867815cfbb3c77aa P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Refusing update from remote peer a81e9f90f26a4379b54fd57a6976af76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:43.755079 18698 consensus_queue.cc:1048] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.802332 18624 raft_consensus.cc:1275] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Refusing update from remote peer ae5be77f387e48639ec76424d120a703: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:43.803687 18671 consensus_queue.cc:1048] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.811817 18475 raft_consensus.cc:1275] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Refusing update from remote peer ae5be77f387e48639ec76424d120a703: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:43.813454 18704 consensus_queue.cc:1048] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.856441 18624 raft_consensus.cc:1275] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Refusing update from remote peer ae5be77f387e48639ec76424d120a703: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:43.858260 18704 consensus_queue.cc:1048] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.868999 18475 raft_consensus.cc:1275] T 764ec65bcdd54a2a966c4a8666bdc49f P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Refusing update from remote peer ae5be77f387e48639ec76424d120a703: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:43.870566 18671 consensus_queue.cc:1048] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.893584 18624 raft_consensus.cc:1275] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Refusing update from remote peer ae5be77f387e48639ec76424d120a703: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:43.894898 18671 consensus_queue.cc:1048] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.902559 18475 raft_consensus.cc:1275] T 109a4a99e5ac4b248028219843cf6ab8 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Refusing update from remote peer ae5be77f387e48639ec76424d120a703: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:43.904331 18671 consensus_queue.cc:1048] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:44.138106 18550 raft_consensus.cc:1275] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Refusing update from remote peer 2cfdcc4bf28d40b59a436fc9d1a7995f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:44.139569 18670 consensus_queue.cc:1048] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:44.147704 18475 raft_consensus.cc:1275] T 7fbfcd9d2442462d8b4feb44a3649b27 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Refusing update from remote peer 2cfdcc4bf28d40b59a436fc9d1a7995f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:44.149266 18670 consensus_queue.cc:1048] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:46.204059 18372 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46160:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:46.206558 18372 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:46.261989 18460 tablet_service.cc:1511] Processing CreateTablet for tablet 039abee1d8234488af162854ead95ba8 (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:46.263725 18460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 039abee1d8234488af162854ead95ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.263747 18535 tablet_service.cc:1511] Processing CreateTablet for tablet 039abee1d8234488af162854ead95ba8 (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:46.264976 18535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 039abee1d8234488af162854ead95ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.264869 18613 tablet_service.cc:1511] Processing CreateTablet for tablet 039abee1d8234488af162854ead95ba8 (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:46.266453 18613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 039abee1d8234488af162854ead95ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.269120 18540 tablet_service.cc:1511] Processing CreateTablet for tablet e7a63d86bb544b899e15f04ea3515a5b (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:46.270659 18540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a63d86bb544b899e15f04ea3515a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.271206 18462 tablet_service.cc:1511] Processing CreateTablet for tablet e7a63d86bb544b899e15f04ea3515a5b (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:46.272605 18462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a63d86bb544b899e15f04ea3515a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.274364 18614 tablet_service.cc:1511] Processing CreateTablet for tablet e7a63d86bb544b899e15f04ea3515a5b (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:46.275825 18614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a63d86bb544b899e15f04ea3515a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.275461 18533 tablet_service.cc:1511] Processing CreateTablet for tablet 9c6c421ea62442a694dd0a2b1cb57453 (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:46.276805 18533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c6c421ea62442a694dd0a2b1cb57453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.278342 18464 tablet_service.cc:1511] Processing CreateTablet for tablet 9c6c421ea62442a694dd0a2b1cb57453 (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:46.278640 18459 tablet_service.cc:1511] Processing CreateTablet for tablet 0cf9ea9968ef472481200296f720403c (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:46.279734 18464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c6c421ea62442a694dd0a2b1cb57453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.280994 18534 tablet_service.cc:1511] Processing CreateTablet for tablet 0cf9ea9968ef472481200296f720403c (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:46.282445 18534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cf9ea9968ef472481200296f720403c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.282326 18610 tablet_service.cc:1511] Processing CreateTablet for tablet 9c6c421ea62442a694dd0a2b1cb57453 (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:46.284672 18612 tablet_service.cc:1511] Processing CreateTablet for tablet 0cf9ea9968ef472481200296f720403c (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:46.285547 18459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cf9ea9968ef472481200296f720403c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.286979 18465 tablet_service.cc:1511] Processing CreateTablet for tablet 0cddeef7b03b4de2820561f1c176c996 (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:46.287364 18538 tablet_service.cc:1511] Processing CreateTablet for tablet 0cddeef7b03b4de2820561f1c176c996 (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:46.288655 18538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cddeef7b03b4de2820561f1c176c996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.289287 18609 tablet_service.cc:1511] Processing CreateTablet for tablet 0cddeef7b03b4de2820561f1c176c996 (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:46.291461 18461 tablet_service.cc:1511] Processing CreateTablet for tablet caa517a1211e4a4d8f2643968b4ccaf0 (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:46.293118 18537 tablet_service.cc:1511] Processing CreateTablet for tablet caa517a1211e4a4d8f2643968b4ccaf0 (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:46.294528 18537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caa517a1211e4a4d8f2643968b4ccaf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.294274 18611 tablet_service.cc:1511] Processing CreateTablet for tablet caa517a1211e4a4d8f2643968b4ccaf0 (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:46.296532 18463 tablet_service.cc:1511] Processing CreateTablet for tablet bbeaec4d719c41bfb7d127b9f2a94cec (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:46.298254 18610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c6c421ea62442a694dd0a2b1cb57453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.301437 18609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cddeef7b03b4de2820561f1c176c996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.302959 18611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caa517a1211e4a4d8f2643968b4ccaf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.303035 18539 tablet_service.cc:1511] Processing CreateTablet for tablet bbeaec4d719c41bfb7d127b9f2a94cec (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:46.304427 18539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbeaec4d719c41bfb7d127b9f2a94cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.305263 18608 tablet_service.cc:1511] Processing CreateTablet for tablet bbeaec4d719c41bfb7d127b9f2a94cec (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:46.306682 18612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cf9ea9968ef472481200296f720403c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.309367 18458 tablet_service.cc:1511] Processing CreateTablet for tablet 815b50d8b4ea4c6bb7ef7d28994ca164 (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:46.310817 18608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbeaec4d719c41bfb7d127b9f2a94cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.311836 18536 tablet_service.cc:1511] Processing CreateTablet for tablet 815b50d8b4ea4c6bb7ef7d28994ca164 (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:46.313477 18458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 815b50d8b4ea4c6bb7ef7d28994ca164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.314160 18465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cddeef7b03b4de2820561f1c176c996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.314793 18536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 815b50d8b4ea4c6bb7ef7d28994ca164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.315860 18463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbeaec4d719c41bfb7d127b9f2a94cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.317401 18461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caa517a1211e4a4d8f2643968b4ccaf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.333535 18607 tablet_service.cc:1511] Processing CreateTablet for tablet 815b50d8b4ea4c6bb7ef7d28994ca164 (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:46.335085 18607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 815b50d8b4ea4c6bb7ef7d28994ca164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.336932 18457 tablet_service.cc:1511] Processing CreateTablet for tablet f73bbcaaf32949ab8f64850999edd9c0 (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:46.338433 18457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f73bbcaaf32949ab8f64850999edd9c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.342397 18606 tablet_service.cc:1511] Processing CreateTablet for tablet f73bbcaaf32949ab8f64850999edd9c0 (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:46.340502 18532 tablet_service.cc:1511] Processing CreateTablet for tablet f73bbcaaf32949ab8f64850999edd9c0 (DEFAULT_TABLE table=soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:46.344295 18606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f73bbcaaf32949ab8f64850999edd9c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.344745 18532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f73bbcaaf32949ab8f64850999edd9c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.352025 18768 tablet_bootstrap.cc:492] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703: Bootstrap starting.
I20260709 13:05:46.360572 18768 tablet_bootstrap.cc:654] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.475149 18768 tablet_bootstrap.cc:492] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703: No bootstrap required, opened a new log
I20260709 13:05:46.475674 18768 ts_tablet_manager.cc:1403] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703: Time spent bootstrapping tablet: real 0.124s	user 0.015s	sys 0.024s
W20260709 13:05:46.478479 18421 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:46.478691 18768 raft_consensus.cc:359] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.479637 18768 raft_consensus.cc:385] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.479991 18768 raft_consensus.cc:740] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.480897 18768 consensus_queue.cc:260] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.481637 18770 tablet_bootstrap.cc:492] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Bootstrap starting.
I20260709 13:05:46.493969 18768 ts_tablet_manager.cc:1434] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:05:46.503033 18770 tablet_bootstrap.cc:654] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.503037 18768 tablet_bootstrap.cc:492] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703: Bootstrap starting.
I20260709 13:05:46.526495 18768 tablet_bootstrap.cc:654] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.529794 18772 tablet_bootstrap.cc:492] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76: Bootstrap starting.
I20260709 13:05:46.533592 18768 tablet_bootstrap.cc:492] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703: No bootstrap required, opened a new log
I20260709 13:05:46.534183 18768 ts_tablet_manager.cc:1403] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.005s
I20260709 13:05:46.534868 18770 tablet_bootstrap.cc:492] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f: No bootstrap required, opened a new log
I20260709 13:05:46.535265 18770 ts_tablet_manager.cc:1403] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.000s
I20260709 13:05:46.537560 18770 raft_consensus.cc:359] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.537456 18768 raft_consensus.cc:359] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.538232 18770 raft_consensus.cc:385] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.538331 18772 tablet_bootstrap.cc:654] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.538342 18768 raft_consensus.cc:385] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.538590 18770 raft_consensus.cc:740] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.538985 18768 raft_consensus.cc:740] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.539602 18770 consensus_queue.cc:260] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.539866 18768 consensus_queue.cc:260] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.541803 18770 ts_tablet_manager.cc:1434] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:05:46.542392 18768 ts_tablet_manager.cc:1434] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:46.542918 18770 tablet_bootstrap.cc:492] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Bootstrap starting.
I20260709 13:05:46.543440 18768 tablet_bootstrap.cc:492] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703: Bootstrap starting.
I20260709 13:05:46.549440 18770 tablet_bootstrap.cc:654] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.555269 18768 tablet_bootstrap.cc:654] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.564790 18772 tablet_bootstrap.cc:492] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76: No bootstrap required, opened a new log
I20260709 13:05:46.565407 18770 tablet_bootstrap.cc:492] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f: No bootstrap required, opened a new log
I20260709 13:05:46.565503 18772 ts_tablet_manager.cc:1403] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.002s
I20260709 13:05:46.565969 18770 ts_tablet_manager.cc:1403] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.012s
I20260709 13:05:46.567808 18768 tablet_bootstrap.cc:492] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703: No bootstrap required, opened a new log
I20260709 13:05:46.568327 18768 ts_tablet_manager.cc:1403] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.004s
I20260709 13:05:46.568152 18772 raft_consensus.cc:359] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.568866 18772 raft_consensus.cc:385] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.569160 18772 raft_consensus.cc:740] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.569180 18770 raft_consensus.cc:359] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.570078 18770 raft_consensus.cc:385] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.569924 18772 consensus_queue.cc:260] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.570430 18770 raft_consensus.cc:740] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.571252 18770 consensus_queue.cc:260] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.572031 18772 ts_tablet_manager.cc:1434] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:05:46.573378 18772 tablet_bootstrap.cc:492] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76: Bootstrap starting.
I20260709 13:05:46.573608 18770 ts_tablet_manager.cc:1434] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:46.574046 18768 raft_consensus.cc:359] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.574810 18770 tablet_bootstrap.cc:492] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Bootstrap starting.
I20260709 13:05:46.574875 18768 raft_consensus.cc:385] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.575455 18768 raft_consensus.cc:740] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.576218 18768 consensus_queue.cc:260] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.578931 18768 ts_tablet_manager.cc:1434] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.006s
I20260709 13:05:46.579989 18768 tablet_bootstrap.cc:492] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703: Bootstrap starting.
I20260709 13:05:46.582814 18770 tablet_bootstrap.cc:654] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.586468 18756 raft_consensus.cc:493] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.587014 18756 raft_consensus.cc:515] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.588462 18768 tablet_bootstrap.cc:654] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.590292 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf9ea9968ef472481200296f720403c" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
W20260709 13:05:46.591881 18513 leader_election.cc:343] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:46.592763 18756 leader_election.cc:290] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:46.594419 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf9ea9968ef472481200296f720403c" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
W20260709 13:05:46.596235 18516 leader_election.cc:343] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:46.596848 18516 leader_election.cc:304] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae5be77f387e48639ec76424d120a703; no voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76
I20260709 13:05:46.598024 18756 raft_consensus.cc:2749] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:46.598924 18770 tablet_bootstrap.cc:492] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f: No bootstrap required, opened a new log
I20260709 13:05:46.599128 18768 tablet_bootstrap.cc:492] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703: No bootstrap required, opened a new log
I20260709 13:05:46.599556 18770 ts_tablet_manager.cc:1403] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.011s
I20260709 13:05:46.599727 18768 ts_tablet_manager.cc:1403] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.001s
I20260709 13:05:46.602849 18770 raft_consensus.cc:359] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.603171 18768 raft_consensus.cc:359] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.603713 18770 raft_consensus.cc:385] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.603957 18768 raft_consensus.cc:385] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.604118 18770 raft_consensus.cc:740] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.604336 18768 raft_consensus.cc:740] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.605268 18768 consensus_queue.cc:260] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.605162 18770 consensus_queue.cc:260] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.607417 18770 ts_tablet_manager.cc:1434] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:46.606024 18772 tablet_bootstrap.cc:654] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.609182 18768 ts_tablet_manager.cc:1434] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 13:05:46.611867 18768 tablet_bootstrap.cc:492] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703: Bootstrap starting.
I20260709 13:05:46.610140 18770 tablet_bootstrap.cc:492] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f: Bootstrap starting.
I20260709 13:05:46.619833 18768 tablet_bootstrap.cc:654] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.625537 18770 tablet_bootstrap.cc:654] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.625711 18772 tablet_bootstrap.cc:492] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76: No bootstrap required, opened a new log
I20260709 13:05:46.626330 18772 ts_tablet_manager.cc:1403] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.013s
I20260709 13:05:46.627404 18768 tablet_bootstrap.cc:492] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703: No bootstrap required, opened a new log
I20260709 13:05:46.628005 18768 ts_tablet_manager.cc:1403] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:05:46.629578 18772 raft_consensus.cc:359] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.630389 18772 raft_consensus.cc:385] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.630715 18772 raft_consensus.cc:740] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.631609 18772 consensus_queue.cc:260] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.634137 18772 ts_tablet_manager.cc:1434] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:46.635097 18772 tablet_bootstrap.cc:492] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76: Bootstrap starting.
I20260709 13:05:46.631489 18768 raft_consensus.cc:359] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.636938 18768 raft_consensus.cc:385] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.637332 18768 raft_consensus.cc:740] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.638197 18768 consensus_queue.cc:260] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.639242 18770 tablet_bootstrap.cc:492] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f: No bootstrap required, opened a new log
I20260709 13:05:46.639829 18770 ts_tablet_manager.cc:1403] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.009s
I20260709 13:05:46.640820 18768 ts_tablet_manager.cc:1434] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.003s
I20260709 13:05:46.641791 18772 tablet_bootstrap.cc:654] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.641984 18768 tablet_bootstrap.cc:492] T f73bbcaaf32949ab8f64850999edd9c0 P ae5be77f387e48639ec76424d120a703: Bootstrap starting.
I20260709 13:05:46.643190 18770 raft_consensus.cc:359] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.644032 18770 raft_consensus.cc:385] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.644356 18770 raft_consensus.cc:740] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.645242 18770 consensus_queue.cc:260] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.648142 18770 ts_tablet_manager.cc:1434] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:05:46.649303 18770 tablet_bootstrap.cc:492] T caa517a1211e4a4d8f2643968b4ccaf0 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Bootstrap starting.
I20260709 13:05:46.650417 18768 tablet_bootstrap.cc:654] T f73bbcaaf32949ab8f64850999edd9c0 P ae5be77f387e48639ec76424d120a703: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.656554 18756 raft_consensus.cc:493] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.657253 18756 raft_consensus.cc:515] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.659471 18756 leader_election.cc:290] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:46.659621 18770 tablet_bootstrap.cc:654] T caa517a1211e4a4d8f2643968b4ccaf0 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.661345 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a63d86bb544b899e15f04ea3515a5b" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
I20260709 13:05:46.664494 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a63d86bb544b899e15f04ea3515a5b" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
W20260709 13:05:46.665844 18513 leader_election.cc:343] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:46.667492 18624 raft_consensus.cc:2468] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 0.
I20260709 13:05:46.669389 18516 leader_election.cc:304] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, ae5be77f387e48639ec76424d120a703; no voters: a81e9f90f26a4379b54fd57a6976af76
I20260709 13:05:46.672161 18767 raft_consensus.cc:2804] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:46.672645 18767 raft_consensus.cc:493] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.673044 18767 raft_consensus.cc:3060] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:46.716688 18771 raft_consensus.cc:493] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.717552 18771 raft_consensus.cc:515] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.723773 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cddeef7b03b4de2820561f1c176c996" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703" is_pre_election: true
I20260709 13:05:46.724643 18550 raft_consensus.cc:2468] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 0.
I20260709 13:05:46.726136 18771 leader_election.cc:290] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:46.727676 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cddeef7b03b4de2820561f1c176c996" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
I20260709 13:05:46.727419 18440 leader_election.cc:304] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 
W20260709 13:05:46.739591 18441 leader_election.cc:343] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:46.740743 18755 raft_consensus.cc:2804] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:46.741371 18755 raft_consensus.cc:493] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.741775 18755 raft_consensus.cc:3060] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:46.755867 18767 raft_consensus.cc:515] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.772610 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a63d86bb544b899e15f04ea3515a5b" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
W20260709 13:05:46.775309 18513 leader_election.cc:343] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:46.758670 18755 raft_consensus.cc:515] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.779855 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a63d86bb544b899e15f04ea3515a5b" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:46.780665 18624 raft_consensus.cc:3060] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:46.789224 18767 leader_election.cc:290] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:46.797309 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cddeef7b03b4de2820561f1c176c996" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:46.798380 18756 raft_consensus.cc:493] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.801489 18550 raft_consensus.cc:3060] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:46.801604 18756 raft_consensus.cc:515] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.804898 18756 leader_election.cc:290] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:46.800408 18624 raft_consensus.cc:2468] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 1.
I20260709 13:05:46.807024 18516 leader_election.cc:304] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, ae5be77f387e48639ec76424d120a703; no voters: a81e9f90f26a4379b54fd57a6976af76
I20260709 13:05:46.808290 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039abee1d8234488af162854ead95ba8" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
W20260709 13:05:46.810110 18513 leader_election.cc:343] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:46.810901 18756 raft_consensus.cc:2804] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:46.812637 18709 raft_consensus.cc:493] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.813443 18709 raft_consensus.cc:515] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.817230 18756 raft_consensus.cc:697] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 1 LEADER]: Becoming Leader. State: Replica: ae5be77f387e48639ec76424d120a703, State: Running, Role: LEADER
I20260709 13:05:46.817525 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815b50d8b4ea4c6bb7ef7d28994ca164" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
I20260709 13:05:46.820910 18709 leader_election.cc:290] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:46.820806 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815b50d8b4ea4c6bb7ef7d28994ca164" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703" is_pre_election: true
I20260709 13:05:46.820822 18475 raft_consensus.cc:2468] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 0.
I20260709 13:05:46.821736 18621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cddeef7b03b4de2820561f1c176c996" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
W20260709 13:05:46.823045 18589 leader_election.cc:343] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:46.818651 18756 consensus_queue.cc:237] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
W20260709 13:05:46.824255 18441 leader_election.cc:343] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:46.825456 18587 leader_election.cc:304] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76; no voters: ae5be77f387e48639ec76424d120a703
I20260709 13:05:46.827348 18709 raft_consensus.cc:2804] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:46.827925 18709 raft_consensus.cc:493] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.828461 18709 raft_consensus.cc:3060] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:46.836688 18786 raft_consensus.cc:493] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.837637 18786 raft_consensus.cc:515] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.841471 18786 leader_election.cc:290] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:46.844027 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeaec4d719c41bfb7d127b9f2a94cec" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
W20260709 13:05:46.846272 18513 leader_election.cc:343] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:46.849237 18755 leader_election.cc:290] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Requested vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:46.854521 18772 tablet_bootstrap.cc:492] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76: No bootstrap required, opened a new log
I20260709 13:05:46.854521 18768 tablet_bootstrap.cc:492] T f73bbcaaf32949ab8f64850999edd9c0 P ae5be77f387e48639ec76424d120a703: No bootstrap required, opened a new log
I20260709 13:05:46.855154 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039abee1d8234488af162854ead95ba8" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
I20260709 13:05:46.855901 18768 ts_tablet_manager.cc:1403] T f73bbcaaf32949ab8f64850999edd9c0 P ae5be77f387e48639ec76424d120a703: Time spent bootstrapping tablet: real 0.214s	user 0.051s	sys 0.096s
I20260709 13:05:46.856159 18550 raft_consensus.cc:2468] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 1.
I20260709 13:05:46.856578 18770 tablet_bootstrap.cc:492] T caa517a1211e4a4d8f2643968b4ccaf0 P 2cfdcc4bf28d40b59a436fc9d1a7995f: No bootstrap required, opened a new log
I20260709 13:05:46.857290 18770 ts_tablet_manager.cc:1403] T caa517a1211e4a4d8f2643968b4ccaf0 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent bootstrapping tablet: real 0.208s	user 0.102s	sys 0.096s
I20260709 13:05:46.855211 18772 ts_tablet_manager.cc:1403] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76: Time spent bootstrapping tablet: real 0.220s	user 0.086s	sys 0.098s
I20260709 13:05:46.860476 18770 raft_consensus.cc:359] T caa517a1211e4a4d8f2643968b4ccaf0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.861141 18772 raft_consensus.cc:359] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.861274 18770 raft_consensus.cc:385] T caa517a1211e4a4d8f2643968b4ccaf0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.861974 18772 raft_consensus.cc:385] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.861276 18440 leader_election.cc:304] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 2cfdcc4bf28d40b59a436fc9d1a7995f
I20260709 13:05:46.862056 18770 raft_consensus.cc:740] T caa517a1211e4a4d8f2643968b4ccaf0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.862495 18772 raft_consensus.cc:740] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.863070 18770 consensus_queue.cc:260] T caa517a1211e4a4d8f2643968b4ccaf0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.863330 18772 consensus_queue.cc:260] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.863838 18771 raft_consensus.cc:2804] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:46.866227 18768 raft_consensus.cc:359] T f73bbcaaf32949ab8f64850999edd9c0 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.867034 18768 raft_consensus.cc:385] T f73bbcaaf32949ab8f64850999edd9c0 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.867441 18768 raft_consensus.cc:740] T f73bbcaaf32949ab8f64850999edd9c0 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.867093 18709 raft_consensus.cc:515] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.868366 18768 consensus_queue.cc:260] T f73bbcaaf32949ab8f64850999edd9c0 P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.870719 18768 ts_tablet_manager.cc:1434] T f73bbcaaf32949ab8f64850999edd9c0 P ae5be77f387e48639ec76424d120a703: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:05:46.871711 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeaec4d719c41bfb7d127b9f2a94cec" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
I20260709 13:05:46.871719 18768 tablet_bootstrap.cc:492] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703: Bootstrap starting.
I20260709 13:05:46.873901 18770 ts_tablet_manager.cc:1434] T caa517a1211e4a4d8f2643968b4ccaf0 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.002s
W20260709 13:05:46.874254 18516 leader_election.cc:343] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:46.880451 18516 leader_election.cc:304] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae5be77f387e48639ec76424d120a703; no voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76
I20260709 13:05:46.880949 18770 tablet_bootstrap.cc:492] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f: Bootstrap starting.
W20260709 13:05:46.882122 18516 leader_election.cc:343] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:46.882727 18516 leader_election.cc:304] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae5be77f387e48639ec76424d120a703; no voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76
I20260709 13:05:46.884400 18756 raft_consensus.cc:2749] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:46.885419 18756 raft_consensus.cc:2749] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:46.888324 18770 tablet_bootstrap.cc:654] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.901233 18768 tablet_bootstrap.cc:654] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.900368 18373 catalog_manager.cc:5697] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae5be77f387e48639ec76424d120a703 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "ae5be77f387e48639ec76424d120a703" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.913611 18771 raft_consensus.cc:697] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Becoming Leader. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Running, Role: LEADER
I20260709 13:05:46.915053 18771 consensus_queue.cc:237] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.915568 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815b50d8b4ea4c6bb7ef7d28994ca164" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:46.916427 18475 raft_consensus.cc:3060] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:46.927013 18709 leader_election.cc:290] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:46.927304 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815b50d8b4ea4c6bb7ef7d28994ca164" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703"
W20260709 13:05:46.930949 18589 leader_election.cc:343] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:46.930666 18475 raft_consensus.cc:2468] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 1.
I20260709 13:05:46.936914 18772 ts_tablet_manager.cc:1434] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76: Time spent starting tablet: real 0.079s	user 0.017s	sys 0.053s
I20260709 13:05:46.937037 18587 leader_election.cc:304] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76; no voters: ae5be77f387e48639ec76424d120a703
I20260709 13:05:46.938182 18772 tablet_bootstrap.cc:492] T f73bbcaaf32949ab8f64850999edd9c0 P a81e9f90f26a4379b54fd57a6976af76: Bootstrap starting.
I20260709 13:05:46.939273 18709 raft_consensus.cc:2804] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:46.940099 18709 raft_consensus.cc:697] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Becoming Leader. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Running, Role: LEADER
I20260709 13:05:46.941066 18709 consensus_queue.cc:237] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.941190 18370 catalog_manager.cc:5697] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 reported cstate change: term changed from 0 to 1, leader changed from <none> to a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "a81e9f90f26a4379b54fd57a6976af76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.945932 18772 tablet_bootstrap.cc:654] T f73bbcaaf32949ab8f64850999edd9c0 P a81e9f90f26a4379b54fd57a6976af76: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.948143 18770 tablet_bootstrap.cc:492] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f: No bootstrap required, opened a new log
I20260709 13:05:46.954033 18770 ts_tablet_manager.cc:1403] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.022s
I20260709 13:05:46.960078 18768 tablet_bootstrap.cc:492] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703: No bootstrap required, opened a new log
I20260709 13:05:46.960012 18770 raft_consensus.cc:359] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.960807 18770 raft_consensus.cc:385] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.960903 18768 ts_tablet_manager.cc:1403] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703: Time spent bootstrapping tablet: real 0.089s	user 0.024s	sys 0.007s
I20260709 13:05:46.961194 18770 raft_consensus.cc:740] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.962049 18770 consensus_queue.cc:260] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.964427 18770 ts_tablet_manager.cc:1434] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:05:46.963829 18371 catalog_manager.cc:5697] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195). New cstate: current_term: 1 leader_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:46.965502 18770 tablet_bootstrap.cc:492] T 039abee1d8234488af162854ead95ba8 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Bootstrap starting.
I20260709 13:05:46.965628 18768 raft_consensus.cc:359] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.966620 18768 raft_consensus.cc:385] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.966985 18768 raft_consensus.cc:740] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.967868 18768 consensus_queue.cc:260] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.971690 18768 ts_tablet_manager.cc:1434] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:05:46.971553 18791 raft_consensus.cc:493] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.972287 18791 raft_consensus.cc:515] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.972903 18768 tablet_bootstrap.cc:492] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703: Bootstrap starting.
I20260709 13:05:46.976509 18770 tablet_bootstrap.cc:654] T 039abee1d8234488af162854ead95ba8 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.977334 18772 tablet_bootstrap.cc:492] T f73bbcaaf32949ab8f64850999edd9c0 P a81e9f90f26a4379b54fd57a6976af76: No bootstrap required, opened a new log
I20260709 13:05:46.977910 18772 ts_tablet_manager.cc:1403] T f73bbcaaf32949ab8f64850999edd9c0 P a81e9f90f26a4379b54fd57a6976af76: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.007s
I20260709 13:05:46.977774 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa517a1211e4a4d8f2643968b4ccaf0" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
I20260709 13:05:46.980511 18768 tablet_bootstrap.cc:654] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.980485 18624 raft_consensus.cc:2468] T caa517a1211e4a4d8f2643968b4ccaf0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 0.
I20260709 13:05:46.981564 18709 raft_consensus.cc:493] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.982100 18709 raft_consensus.cc:515] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.981899 18772 raft_consensus.cc:359] T f73bbcaaf32949ab8f64850999edd9c0 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.983110 18772 raft_consensus.cc:385] T f73bbcaaf32949ab8f64850999edd9c0 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.983508 18772 raft_consensus.cc:740] T f73bbcaaf32949ab8f64850999edd9c0 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.984555 18772 consensus_queue.cc:260] T f73bbcaaf32949ab8f64850999edd9c0 P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.986774 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6c421ea62442a694dd0a2b1cb57453" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703" is_pre_election: true
I20260709 13:05:46.988183 18772 ts_tablet_manager.cc:1434] T f73bbcaaf32949ab8f64850999edd9c0 P a81e9f90f26a4379b54fd57a6976af76: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:05:46.989487 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6c421ea62442a694dd0a2b1cb57453" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
I20260709 13:05:46.989802 18772 tablet_bootstrap.cc:492] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76: Bootstrap starting.
I20260709 13:05:46.991212 18790 raft_consensus.cc:493] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.992008 18768 tablet_bootstrap.cc:492] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703: No bootstrap required, opened a new log
I20260709 13:05:46.991715 18790 raft_consensus.cc:515] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.992524 18768 ts_tablet_manager.cc:1403] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.011s
I20260709 13:05:46.994017 18790 leader_election.cc:290] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:46.995481 18768 raft_consensus.cc:359] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.996213 18768 raft_consensus.cc:385] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.996490 18768 raft_consensus.cc:740] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Initialized, Role: FOLLOWER
I20260709 13:05:46.997232 18768 consensus_queue.cc:260] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:46.997720 18441 leader_election.cc:304] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76; no voters: 
I20260709 13:05:46.998677 18771 raft_consensus.cc:2804] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:46.999044 18771 raft_consensus.cc:493] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.999138 18772 tablet_bootstrap.cc:654] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:46.999773 18768 ts_tablet_manager.cc:1434] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:47.000553 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa517a1211e4a4d8f2643968b4ccaf0" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703" is_pre_election: true
I20260709 13:05:47.000782 18768 tablet_bootstrap.cc:492] T 9c6c421ea62442a694dd0a2b1cb57453 P ae5be77f387e48639ec76424d120a703: Bootstrap starting.
I20260709 13:05:47.001211 18549 raft_consensus.cc:2468] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 0.
I20260709 13:05:47.002974 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf9ea9968ef472481200296f720403c" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
W20260709 13:05:46.996019 18589 leader_election.cc:343] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:47.004715 18587 leader_election.cc:343] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:47.007081 18587 leader_election.cc:304] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f; no voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703
I20260709 13:05:47.007462 18768 tablet_bootstrap.cc:654] T 9c6c421ea62442a694dd0a2b1cb57453 P ae5be77f387e48639ec76424d120a703: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.008271 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf9ea9968ef472481200296f720403c" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703" is_pre_election: true
I20260709 13:05:47.008948 18550 raft_consensus.cc:2468] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 0.
I20260709 13:05:47.010475 18589 leader_election.cc:304] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:46.999415 18771 raft_consensus.cc:3060] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.012424 18804 raft_consensus.cc:2749] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:47.013644 18772 tablet_bootstrap.cc:492] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76: No bootstrap required, opened a new log
I20260709 13:05:47.013765 18804 raft_consensus.cc:2804] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:47.014475 18772 ts_tablet_manager.cc:1403] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.003s
I20260709 13:05:47.014482 18804 raft_consensus.cc:493] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.015427 18804 raft_consensus.cc:3060] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.017903 18791 leader_election.cc:290] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:47.018951 18772 raft_consensus.cc:359] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.020068 18772 raft_consensus.cc:385] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:46.988179 18709 leader_election.cc:290] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:47.020447 18772 raft_consensus.cc:740] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.021900 18772 consensus_queue.cc:260] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
W20260709 13:05:47.022526 18587 leader_election.cc:343] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:47.025631 18772 ts_tablet_manager.cc:1434] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.006s
I20260709 13:05:47.027168 18772 tablet_bootstrap.cc:492] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76: Bootstrap starting.
I20260709 13:05:47.027904 18768 tablet_bootstrap.cc:492] T 9c6c421ea62442a694dd0a2b1cb57453 P ae5be77f387e48639ec76424d120a703: No bootstrap required, opened a new log
I20260709 13:05:47.028503 18768 ts_tablet_manager.cc:1403] T 9c6c421ea62442a694dd0a2b1cb57453 P ae5be77f387e48639ec76424d120a703: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.007s
I20260709 13:05:47.029603 18709 raft_consensus.cc:493] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.030200 18709 raft_consensus.cc:515] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.031390 18768 raft_consensus.cc:359] T 9c6c421ea62442a694dd0a2b1cb57453 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.032255 18768 raft_consensus.cc:385] T 9c6c421ea62442a694dd0a2b1cb57453 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.032555 18768 raft_consensus.cc:740] T 9c6c421ea62442a694dd0a2b1cb57453 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.033262 18768 consensus_queue.cc:260] T 9c6c421ea62442a694dd0a2b1cb57453 P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.033844 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73bbcaaf32949ab8f64850999edd9c0" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
I20260709 13:05:47.034579 18475 raft_consensus.cc:2468] T f73bbcaaf32949ab8f64850999edd9c0 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 0.
I20260709 13:05:47.035995 18587 leader_election.cc:304] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76; no voters: 
I20260709 13:05:47.037554 18772 tablet_bootstrap.cc:654] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.039135 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73bbcaaf32949ab8f64850999edd9c0" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703" is_pre_election: true
I20260709 13:05:47.039827 18550 raft_consensus.cc:2468] T f73bbcaaf32949ab8f64850999edd9c0 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 0.
I20260709 13:05:47.040925 18804 raft_consensus.cc:515] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.041515 18790 raft_consensus.cc:2804] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:47.042035 18790 raft_consensus.cc:493] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.042363 18790 raft_consensus.cc:3060] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.045601 18768 ts_tablet_manager.cc:1434] T 9c6c421ea62442a694dd0a2b1cb57453 P ae5be77f387e48639ec76424d120a703: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 13:05:47.046321 18804 leader_election.cc:290] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:47.049511 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf9ea9968ef472481200296f720403c" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:47.050164 18550 raft_consensus.cc:3060] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.054422 18709 leader_election.cc:290] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:47.055289 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf9ea9968ef472481200296f720403c" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:47.055539 18772 tablet_bootstrap.cc:492] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76: No bootstrap required, opened a new log
I20260709 13:05:47.056269 18771 raft_consensus.cc:515] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.058528 18771 leader_election.cc:290] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Requested vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:47.060105 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa517a1211e4a4d8f2643968b4ccaf0" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:47.060689 18549 raft_consensus.cc:3060] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:47.061477 18587 leader_election.cc:343] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:47.056324 18772 ts_tablet_manager.cc:1403] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.014s
I20260709 13:05:47.067399 18790 raft_consensus.cc:515] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.068261 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa517a1211e4a4d8f2643968b4ccaf0" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:47.068917 18624 raft_consensus.cc:3060] T caa517a1211e4a4d8f2643968b4ccaf0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.071789 18790 leader_election.cc:290] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:47.072956 18548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73bbcaaf32949ab8f64850999edd9c0" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:47.073691 18548 raft_consensus.cc:3060] T f73bbcaaf32949ab8f64850999edd9c0 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.073619 18550 raft_consensus.cc:2468] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 1.
I20260709 13:05:47.074254 18772 raft_consensus.cc:359] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.075080 18589 leader_election.cc:304] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, ae5be77f387e48639ec76424d120a703; no voters: a81e9f90f26a4379b54fd57a6976af76
I20260709 13:05:47.075354 18772 raft_consensus.cc:385] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.076115 18772 raft_consensus.cc:740] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.077330 18790 raft_consensus.cc:2804] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:47.077291 18772 consensus_queue.cc:260] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.078554 18790 raft_consensus.cc:697] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Becoming Leader. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Running, Role: LEADER
I20260709 13:05:47.078856 18791 raft_consensus.cc:493] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.079391 18791 raft_consensus.cc:515] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.079576 18790 consensus_queue.cc:237] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.080247 18772 ts_tablet_manager.cc:1434] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:05:47.081394 18772 tablet_bootstrap.cc:492] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76: Bootstrap starting.
I20260709 13:05:47.081561 18791 leader_election.cc:290] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:47.083021 18621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6c421ea62442a694dd0a2b1cb57453" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
I20260709 13:05:47.083747 18621 raft_consensus.cc:2468] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 0.
I20260709 13:05:47.084328 18550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6c421ea62442a694dd0a2b1cb57453" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703" is_pre_election: true
I20260709 13:05:47.085004 18550 raft_consensus.cc:2468] T 9c6c421ea62442a694dd0a2b1cb57453 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 0.
I20260709 13:05:47.085497 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73bbcaaf32949ab8f64850999edd9c0" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:47.086153 18440 leader_election.cc:304] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:47.087278 18792 raft_consensus.cc:2804] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:47.087764 18792 raft_consensus.cc:493] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.088101 18792 raft_consensus.cc:3060] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.088668 18772 tablet_bootstrap.cc:654] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.089664 18770 tablet_bootstrap.cc:492] T 039abee1d8234488af162854ead95ba8 P 2cfdcc4bf28d40b59a436fc9d1a7995f: No bootstrap required, opened a new log
I20260709 13:05:47.090261 18770 ts_tablet_manager.cc:1403] T 039abee1d8234488af162854ead95ba8 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent bootstrapping tablet: real 0.125s	user 0.049s	sys 0.048s
I20260709 13:05:47.094125 18770 raft_consensus.cc:359] T 039abee1d8234488af162854ead95ba8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.095194 18770 raft_consensus.cc:385] T 039abee1d8234488af162854ead95ba8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.095585 18770 raft_consensus.cc:740] T 039abee1d8234488af162854ead95ba8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.096573 18770 consensus_queue.cc:260] T 039abee1d8234488af162854ead95ba8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.086335 18475 raft_consensus.cc:3060] T f73bbcaaf32949ab8f64850999edd9c0 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.100620 18624 raft_consensus.cc:2468] T caa517a1211e4a4d8f2643968b4ccaf0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 1.
I20260709 13:05:47.111624 18770 ts_tablet_manager.cc:1434] T 039abee1d8234488af162854ead95ba8 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent starting tablet: real 0.021s	user 0.011s	sys 0.000s
I20260709 13:05:47.112859 18770 tablet_bootstrap.cc:492] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Bootstrap starting.
I20260709 13:05:47.114295 18549 raft_consensus.cc:2468] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 1.
I20260709 13:05:47.113840 18441 leader_election.cc:304] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76; no voters: 
I20260709 13:05:47.112892 18792 raft_consensus.cc:515] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.113903 18475 raft_consensus.cc:2468] T f73bbcaaf32949ab8f64850999edd9c0 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 1.
I20260709 13:05:47.116310 18791 raft_consensus.cc:2804] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:47.116847 18791 raft_consensus.cc:697] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Becoming Leader. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Running, Role: LEADER
I20260709 13:05:47.117966 18791 consensus_queue.cc:237] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.119607 18587 leader_election.cc:304] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76; no voters: 
I20260709 13:05:47.121244 18771 raft_consensus.cc:493] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.121750 18771 raft_consensus.cc:515] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.122859 18772 tablet_bootstrap.cc:492] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76: No bootstrap required, opened a new log
I20260709 13:05:47.123399 18772 ts_tablet_manager.cc:1403] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.010s
I20260709 13:05:47.123827 18771 leader_election.cc:290] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:47.127677 18790 raft_consensus.cc:2804] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:47.132637 18790 raft_consensus.cc:697] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Becoming Leader. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Running, Role: LEADER
I20260709 13:05:47.133522 18790 consensus_queue.cc:237] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.133953 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeaec4d719c41bfb7d127b9f2a94cec" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
W20260709 13:05:47.135429 18441 leader_election.cc:343] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:47.137259 18792 leader_election.cc:290] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Requested vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:47.144665 18547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6c421ea62442a694dd0a2b1cb57453" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:47.145432 18547 raft_consensus.cc:3060] T 9c6c421ea62442a694dd0a2b1cb57453 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.146340 18772 raft_consensus.cc:359] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.146910 18772 raft_consensus.cc:385] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.147015 18770 tablet_bootstrap.cc:654] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.147150 18772 raft_consensus.cc:740] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.139986 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeaec4d719c41bfb7d127b9f2a94cec" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703" is_pre_election: true
I20260709 13:05:47.140537 18548 raft_consensus.cc:2468] T f73bbcaaf32949ab8f64850999edd9c0 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 1.
I20260709 13:05:47.150031 18549 raft_consensus.cc:2468] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 0.
I20260709 13:05:47.149868 18371 catalog_manager.cc:5697] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195). New cstate: current_term: 1 leader_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:47.148847 18772 consensus_queue.cc:260] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.153141 18772 ts_tablet_manager.cc:1434] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:05:47.154176 18772 tablet_bootstrap.cc:492] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76: Bootstrap starting.
I20260709 13:05:47.158070 18440 leader_election.cc:304] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 2cfdcc4bf28d40b59a436fc9d1a7995f
I20260709 13:05:47.159400 18791 raft_consensus.cc:2804] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:47.159875 18791 raft_consensus.cc:493] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.160203 18791 raft_consensus.cc:3060] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.166378 18772 tablet_bootstrap.cc:654] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.167565 18373 catalog_manager.cc:5697] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 reported cstate change: term changed from 0 to 1, leader changed from <none> to a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "a81e9f90f26a4379b54fd57a6976af76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.169486 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c6c421ea62442a694dd0a2b1cb57453" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:47.169989 18624 raft_consensus.cc:3060] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.173628 18772 tablet_bootstrap.cc:492] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76: No bootstrap required, opened a new log
I20260709 13:05:47.174387 18772 ts_tablet_manager.cc:1403] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.000s
I20260709 13:05:47.175809 18624 raft_consensus.cc:2468] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 1.
I20260709 13:05:47.179026 18441 leader_election.cc:304] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76; no voters: 
I20260709 13:05:47.185206 18791 raft_consensus.cc:515] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.187052 18791 leader_election.cc:290] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Requested vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:47.187626 18791 raft_consensus.cc:2804] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:47.187799 18548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeaec4d719c41bfb7d127b9f2a94cec" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:47.188098 18791 raft_consensus.cc:697] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Becoming Leader. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Running, Role: LEADER
I20260709 13:05:47.188472 18548 raft_consensus.cc:3060] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.190600 18547 raft_consensus.cc:2468] T 9c6c421ea62442a694dd0a2b1cb57453 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 1.
I20260709 13:05:47.188951 18791 consensus_queue.cc:237] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.193362 18371 catalog_manager.cc:5697] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195). New cstate: current_term: 1 leader_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:47.196849 18770 tablet_bootstrap.cc:492] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f: No bootstrap required, opened a new log
I20260709 13:05:47.197427 18770 ts_tablet_manager.cc:1403] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.036s
I20260709 13:05:47.199204 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeaec4d719c41bfb7d127b9f2a94cec" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:47.200369 18770 raft_consensus.cc:359] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.199954 18548 raft_consensus.cc:2468] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 1.
I20260709 13:05:47.201144 18770 raft_consensus.cc:385] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.201474 18770 raft_consensus.cc:740] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.202207 18770 consensus_queue.cc:260] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.202548 18440 leader_election.cc:304] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:47.204162 18792 raft_consensus.cc:2804] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:47.204577 18770 ts_tablet_manager.cc:1434] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:47.204916 18792 raft_consensus.cc:697] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Becoming Leader. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Running, Role: LEADER
I20260709 13:05:47.205591 18770 tablet_bootstrap.cc:492] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f: Bootstrap starting.
I20260709 13:05:47.206013 18792 consensus_queue.cc:237] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
W20260709 13:05:47.208058 18441 leader_election.cc:343] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:47.209478 18772 raft_consensus.cc:359] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.212097 18770 tablet_bootstrap.cc:654] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.213135 18772 raft_consensus.cc:385] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.213562 18772 raft_consensus.cc:740] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.214314 18772 consensus_queue.cc:260] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.216167 18772 ts_tablet_manager.cc:1434] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:05:47.217442 18772 tablet_bootstrap.cc:492] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76: Bootstrap starting.
I20260709 13:05:47.224285 18770 tablet_bootstrap.cc:492] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f: No bootstrap required, opened a new log
I20260709 13:05:47.224866 18770 ts_tablet_manager.cc:1403] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.002s
I20260709 13:05:47.225054 18772 tablet_bootstrap.cc:654] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:47.227771 18770 raft_consensus.cc:359] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.228658 18770 raft_consensus.cc:385] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.228895 18770 raft_consensus.cc:740] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.229305 18373 catalog_manager.cc:5697] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 reported cstate change: term changed from 0 to 1, leader changed from <none> to a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "a81e9f90f26a4379b54fd57a6976af76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.229617 18770 consensus_queue.cc:260] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.230500 18772 tablet_bootstrap.cc:492] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76: No bootstrap required, opened a new log
I20260709 13:05:47.231092 18772 ts_tablet_manager.cc:1403] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:05:47.231900 18770 ts_tablet_manager.cc:1434] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:47.232887 18373 catalog_manager.cc:5697] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 reported cstate change: term changed from 0 to 1, leader changed from <none> to a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "a81e9f90f26a4379b54fd57a6976af76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.233649 18772 raft_consensus.cc:359] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.234365 18772 raft_consensus.cc:385] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:47.234617 18772 raft_consensus.cc:740] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Initialized, Role: FOLLOWER
I20260709 13:05:47.235405 18772 consensus_queue.cc:260] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.237476 18772 ts_tablet_manager.cc:1434] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:47.252017 18767 raft_consensus.cc:493] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.252575 18767 raft_consensus.cc:515] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.254244 18767 leader_election.cc:290] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:47.255271 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815b50d8b4ea4c6bb7ef7d28994ca164" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
I20260709 13:05:47.255174 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815b50d8b4ea4c6bb7ef7d28994ca164" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
I20260709 13:05:47.256260 18475 raft_consensus.cc:2393] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae5be77f387e48639ec76424d120a703 in current term 1: Already voted for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in this term.
I20260709 13:05:47.257194 18513 leader_election.cc:304] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae5be77f387e48639ec76424d120a703; no voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76
I20260709 13:05:47.257871 18767 raft_consensus.cc:3060] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.262715 18767 raft_consensus.cc:2749] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:47.312827 18792 raft_consensus.cc:493] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.313462 18792 raft_consensus.cc:515] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.315423 18792 leader_election.cc:290] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:47.316200 18548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039abee1d8234488af162854ead95ba8" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703" is_pre_election: true
I20260709 13:05:47.316465 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039abee1d8234488af162854ead95ba8" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" is_pre_election: true
I20260709 13:05:47.316887 18548 raft_consensus.cc:2468] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 0.
I20260709 13:05:47.317065 18624 raft_consensus.cc:2468] T 039abee1d8234488af162854ead95ba8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 0.
I20260709 13:05:47.318043 18440 leader_election.cc:304] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:47.318733 18792 raft_consensus.cc:2804] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:47.319135 18792 raft_consensus.cc:493] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.319408 18792 raft_consensus.cc:3060] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.324645 18792 raft_consensus.cc:515] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.326401 18792 leader_election.cc:290] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Requested vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:47.327201 18548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039abee1d8234488af162854ead95ba8" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:47.327412 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039abee1d8234488af162854ead95ba8" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:47.327766 18548 raft_consensus.cc:3060] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.327981 18624 raft_consensus.cc:3060] T 039abee1d8234488af162854ead95ba8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.331912 18767 consensus_queue.cc:1048] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:47.334343 18548 raft_consensus.cc:2468] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 1.
I20260709 13:05:47.334406 18624 raft_consensus.cc:2468] T 039abee1d8234488af162854ead95ba8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 1.
I20260709 13:05:47.335618 18441 leader_election.cc:304] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76; no voters: 
I20260709 13:05:47.336932 18792 raft_consensus.cc:2804] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:47.337472 18792 raft_consensus.cc:697] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Becoming Leader. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Running, Role: LEADER
I20260709 13:05:47.338279 18792 consensus_queue.cc:237] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.346236 18475 raft_consensus.cc:3060] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.354139 18371 catalog_manager.cc:5697] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 reported cstate change: term changed from 0 to 1, leader changed from <none> to a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "a81e9f90f26a4379b54fd57a6976af76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.360694 18767 consensus_queue.cc:1048] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:47.366946 18790 raft_consensus.cc:493] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.367599 18790 raft_consensus.cc:515] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.371631 18548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cddeef7b03b4de2820561f1c176c996" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703" is_pre_election: true
I20260709 13:05:47.371807 18474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cddeef7b03b4de2820561f1c176c996" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
I20260709 13:05:47.372646 18548 raft_consensus.cc:2393] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in current term 1: Already voted for candidate a81e9f90f26a4379b54fd57a6976af76 in this term.
I20260709 13:05:47.374890 18587 leader_election.cc:304] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f; no voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703
I20260709 13:05:47.375013 18790 leader_election.cc:290] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:47.375665 18709 raft_consensus.cc:3060] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.381673 18709 raft_consensus.cc:2749] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:47.451349 18792 consensus_queue.cc:1048] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:47.460793 18709 raft_consensus.cc:493] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.461491 18709 raft_consensus.cc:515] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.462797 18771 consensus_queue.cc:1048] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:47.466672 18709 leader_election.cc:290] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:47.467617 18548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeaec4d719c41bfb7d127b9f2a94cec" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5be77f387e48639ec76424d120a703" is_pre_election: true
I20260709 13:05:47.468535 18548 raft_consensus.cc:2393] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in current term 1: Already voted for candidate a81e9f90f26a4379b54fd57a6976af76 in this term.
I20260709 13:05:47.470677 18475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeaec4d719c41bfb7d127b9f2a94cec" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a81e9f90f26a4379b54fd57a6976af76" is_pre_election: true
I20260709 13:05:47.473047 18587 leader_election.cc:304] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f; no voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703
I20260709 13:05:47.474242 18790 raft_consensus.cc:3060] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.477164 18709 consensus_queue.cc:1048] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:47.482161 18790 raft_consensus.cc:2749] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:47.485780 18549 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7a63d86bb544b899e15f04ea3515a5b"
dest_uuid: "ae5be77f387e48639ec76424d120a703"
mode: GRACEFUL
new_leader_uuid: "a81e9f90f26a4379b54fd57a6976af76"
 from {username='slave'} at 127.0.0.1:35438
I20260709 13:05:47.486496 18549 raft_consensus.cc:606] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 1 LEADER]: Received request to transfer leadership to TS a81e9f90f26a4379b54fd57a6976af76
I20260709 13:05:47.498466 18474 raft_consensus.cc:3060] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:47.503990 18624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cf9ea9968ef472481200296f720403c"
dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
mode: GRACEFUL
new_leader_uuid: "a81e9f90f26a4379b54fd57a6976af76"
 from {username='slave'} at 127.0.0.1:58590
I20260709 13:05:47.504667 18624 raft_consensus.cc:606] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Received request to transfer leadership to TS a81e9f90f26a4379b54fd57a6976af76
I20260709 13:05:47.504734 18709 consensus_queue.cc:1048] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:47.515179 18475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cddeef7b03b4de2820561f1c176c996"
dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
mode: GRACEFUL
new_leader_uuid: "ae5be77f387e48639ec76424d120a703"
 from {username='slave'} at 127.0.0.1:59858
I20260709 13:05:47.515987 18475 raft_consensus.cc:606] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Received request to transfer leadership to TS ae5be77f387e48639ec76424d120a703
I20260709 13:05:47.518955 18709 consensus_queue.cc:1048] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:47.527382 18790 consensus_queue.cc:1048] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:47.527561 18804 consensus_queue.cc:1048] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:47.528941 18475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "caa517a1211e4a4d8f2643968b4ccaf0"
dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
mode: GRACEFUL
new_leader_uuid: "ae5be77f387e48639ec76424d120a703"
 from {username='slave'} at 127.0.0.1:59858
I20260709 13:05:47.529588 18475 raft_consensus.cc:606] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Received request to transfer leadership to TS ae5be77f387e48639ec76424d120a703
I20260709 13:05:47.541321 18472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbeaec4d719c41bfb7d127b9f2a94cec"
dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
mode: GRACEFUL
new_leader_uuid: "ae5be77f387e48639ec76424d120a703"
 from {username='slave'} at 127.0.0.1:59858
I20260709 13:05:47.541958 18472 raft_consensus.cc:606] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Received request to transfer leadership to TS ae5be77f387e48639ec76424d120a703
I20260709 13:05:47.551334 18624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "815b50d8b4ea4c6bb7ef7d28994ca164"
dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
mode: GRACEFUL
new_leader_uuid: "ae5be77f387e48639ec76424d120a703"
 from {username='slave'} at 127.0.0.1:58590
I20260709 13:05:47.552124 18624 raft_consensus.cc:606] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Received request to transfer leadership to TS ae5be77f387e48639ec76424d120a703
I20260709 13:05:47.564071 18804 raft_consensus.cc:993] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f: : Instructing follower a81e9f90f26a4379b54fd57a6976af76 to start an election
I20260709 13:05:47.564637 18804 raft_consensus.cc:1081] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Signalling peer a81e9f90f26a4379b54fd57a6976af76 to start an election
I20260709 13:05:47.574036 18771 consensus_queue.cc:1048] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:47.581900 18790 consensus_queue.cc:1048] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:47.574261 18473 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cf9ea9968ef472481200296f720403c"
dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
 from {username='slave'} at 127.0.0.1:59842
I20260709 13:05:47.587303 18473 raft_consensus.cc:493] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:47.587743 18473 raft_consensus.cc:3060] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.596645 18771 consensus_queue.cc:1048] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:47.600055 18473 raft_consensus.cc:515] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.602377 18473 leader_election.cc:290] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 2 election: Requested vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:47.603381 18547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf9ea9968ef472481200296f720403c" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:47.603904 18621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cf9ea9968ef472481200296f720403c" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:47.604017 18547 raft_consensus.cc:3060] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.604637 18621 raft_consensus.cc:3055] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:47.605000 18621 raft_consensus.cc:740] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Running, Role: LEADER
I20260709 13:05:47.605829 18621 consensus_queue.cc:260] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.606679 18621 raft_consensus.cc:3060] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.612766 18791 raft_consensus.cc:993] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76: : Instructing follower ae5be77f387e48639ec76424d120a703 to start an election
I20260709 13:05:47.613340 18791 raft_consensus.cc:1081] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Signalling peer ae5be77f387e48639ec76424d120a703 to start an election
I20260709 13:05:47.614579 18621 raft_consensus.cc:2468] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 2.
I20260709 13:05:47.615428 18547 raft_consensus.cc:2468] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 2.
I20260709 13:05:47.616324 18441 leader_election.cc:304] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76; no voters: 
I20260709 13:05:47.617393 18792 raft_consensus.cc:2804] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:47.624526 18549 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "caa517a1211e4a4d8f2643968b4ccaf0"
dest_uuid: "ae5be77f387e48639ec76424d120a703"
 from {username='slave'} at 127.0.0.1:35408
I20260709 13:05:47.625224 18549 raft_consensus.cc:493] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:47.625250 18771 consensus_queue.cc:1048] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:47.625715 18549 raft_consensus.cc:3060] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.635401 18549 raft_consensus.cc:515] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.637629 18549 leader_election.cc:290] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 2 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:47.637755 18771 consensus_queue.cc:1048] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:47.639264 18474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa517a1211e4a4d8f2643968b4ccaf0" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:47.641028 18792 raft_consensus.cc:697] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76 [term 2 LEADER]: Becoming Leader. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Running, Role: LEADER
I20260709 13:05:47.642110 18622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa517a1211e4a4d8f2643968b4ccaf0" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:47.642134 18792 consensus_queue.cc:237] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.644353 18474 raft_consensus.cc:3055] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:47.644716 18474 raft_consensus.cc:740] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Running, Role: LEADER
I20260709 13:05:47.645531 18474 consensus_queue.cc:260] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.646626 18474 raft_consensus.cc:3060] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.654354 18370 catalog_manager.cc:5697] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76 reported cstate change: term changed from 1 to 2, leader changed from 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195) to a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "a81e9f90f26a4379b54fd57a6976af76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.660447 18474 raft_consensus.cc:2468] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 2.
I20260709 13:05:47.663219 18771 raft_consensus.cc:993] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76: : Instructing follower ae5be77f387e48639ec76424d120a703 to start an election
I20260709 13:05:47.663718 18771 raft_consensus.cc:1081] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Signalling peer ae5be77f387e48639ec76424d120a703 to start an election
I20260709 13:05:47.665499 18549 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbeaec4d719c41bfb7d127b9f2a94cec"
dest_uuid: "ae5be77f387e48639ec76424d120a703"
 from {username='slave'} at 127.0.0.1:35408
I20260709 13:05:47.666050 18549 raft_consensus.cc:493] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:47.666432 18549 raft_consensus.cc:3060] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.667732 18513 leader_election.cc:304] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a81e9f90f26a4379b54fd57a6976af76, ae5be77f387e48639ec76424d120a703; no voters: 2cfdcc4bf28d40b59a436fc9d1a7995f
I20260709 13:05:47.668813 18756 raft_consensus.cc:2804] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:47.669312 18756 raft_consensus.cc:697] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Becoming Leader. State: Replica: ae5be77f387e48639ec76424d120a703, State: Running, Role: LEADER
I20260709 13:05:47.670115 18756 consensus_queue.cc:237] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.675308 18549 raft_consensus.cc:515] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.677642 18549 leader_election.cc:290] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 2 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:47.680042 18474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeaec4d719c41bfb7d127b9f2a94cec" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:47.680409 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeaec4d719c41bfb7d127b9f2a94cec" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:47.680670 18474 raft_consensus.cc:3055] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:47.681008 18624 raft_consensus.cc:3060] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.681070 18474 raft_consensus.cc:740] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Running, Role: LEADER
I20260709 13:05:47.683010 18474 consensus_queue.cc:260] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.684274 18474 raft_consensus.cc:3060] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.687983 18624 raft_consensus.cc:2468] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 2.
I20260709 13:05:47.689325 18516 leader_election.cc:304] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:47.690110 18756 raft_consensus.cc:2804] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:47.690577 18756 raft_consensus.cc:697] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Becoming Leader. State: Replica: ae5be77f387e48639ec76424d120a703, State: Running, Role: LEADER
I20260709 13:05:47.691404 18756 consensus_queue.cc:237] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.692354 18474 raft_consensus.cc:2468] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 2.
I20260709 13:05:47.692126 18373 catalog_manager.cc:5697] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 reported cstate change: term changed from 1 to 2, leader changed from a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193) to ae5be77f387e48639ec76424d120a703 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "ae5be77f387e48639ec76424d120a703" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.705678 18373 catalog_manager.cc:5697] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 reported cstate change: term changed from 1 to 2, leader changed from a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193) to ae5be77f387e48639ec76424d120a703 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "ae5be77f387e48639ec76424d120a703" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.737562 18791 consensus_queue.cc:1048] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:47.747493 18791 consensus_queue.cc:1048] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:47.781569 18771 consensus_queue.cc:1048] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:47.792320 18834 consensus_queue.cc:1048] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:47.899001 18771 raft_consensus.cc:993] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76: : Instructing follower ae5be77f387e48639ec76424d120a703 to start an election
I20260709 13:05:47.899502 18771 raft_consensus.cc:1081] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Signalling peer ae5be77f387e48639ec76424d120a703 to start an election
I20260709 13:05:47.901054 18547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cddeef7b03b4de2820561f1c176c996"
dest_uuid: "ae5be77f387e48639ec76424d120a703"
 from {username='slave'} at 127.0.0.1:35408
I20260709 13:05:47.901620 18547 raft_consensus.cc:493] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:47.901899 18547 raft_consensus.cc:3060] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.907322 18547 raft_consensus.cc:515] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.909111 18547 leader_election.cc:290] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 2 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:47.910001 18474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cddeef7b03b4de2820561f1c176c996" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:47.910244 18624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cddeef7b03b4de2820561f1c176c996" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:47.910746 18474 raft_consensus.cc:3055] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:47.910821 18624 raft_consensus.cc:3060] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.911103 18474 raft_consensus.cc:740] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Running, Role: LEADER
I20260709 13:05:47.911978 18474 consensus_queue.cc:260] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.912845 18474 raft_consensus.cc:3060] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.915748 18624 raft_consensus.cc:2468] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 2.
I20260709 13:05:47.916913 18516 leader_election.cc:304] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:47.917577 18621 raft_consensus.cc:1240] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Rejecting Update request from peer a81e9f90f26a4379b54fd57a6976af76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:47.917846 18756 raft_consensus.cc:2804] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:47.918382 18756 raft_consensus.cc:697] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Becoming Leader. State: Replica: ae5be77f387e48639ec76424d120a703, State: Running, Role: LEADER
I20260709 13:05:47.918419 18474 raft_consensus.cc:2468] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 2.
I20260709 13:05:47.919333 18756 consensus_queue.cc:237] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.926162 18373 catalog_manager.cc:5697] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 reported cstate change: term changed from 1 to 2, leader changed from a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193) to ae5be77f387e48639ec76424d120a703 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "ae5be77f387e48639ec76424d120a703" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:47.949885 18767 raft_consensus.cc:993] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703: : Instructing follower a81e9f90f26a4379b54fd57a6976af76 to start an election
I20260709 13:05:47.950392 18767 raft_consensus.cc:1081] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 1 LEADER]: Signalling peer a81e9f90f26a4379b54fd57a6976af76 to start an election
I20260709 13:05:47.951982 18474 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7a63d86bb544b899e15f04ea3515a5b"
dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
 from {username='slave'} at 127.0.0.1:59826
I20260709 13:05:47.952559 18474 raft_consensus.cc:493] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:47.952913 18474 raft_consensus.cc:3060] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.958669 18474 raft_consensus.cc:515] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.960527 18474 leader_election.cc:290] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 2 election: Requested vote from peers ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:47.961344 18547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a63d86bb544b899e15f04ea3515a5b" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:47.961625 18621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a63d86bb544b899e15f04ea3515a5b" candidate_uuid: "a81e9f90f26a4379b54fd57a6976af76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:47.961987 18547 raft_consensus.cc:3055] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:47.962244 18621 raft_consensus.cc:3060] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.962348 18547 raft_consensus.cc:740] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Running, Role: LEADER
I20260709 13:05:47.963145 18547 consensus_queue.cc:260] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.964067 18547 raft_consensus.cc:3060] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.967383 18621 raft_consensus.cc:2468] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 2.
I20260709 13:05:47.968544 18441 leader_election.cc:304] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76; no voters: 
I20260709 13:05:47.969113 18547 raft_consensus.cc:2468] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81e9f90f26a4379b54fd57a6976af76 in term 2.
I20260709 13:05:47.969439 18834 raft_consensus.cc:2804] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:47.970009 18834 raft_consensus.cc:697] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [term 2 LEADER]: Becoming Leader. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Running, Role: LEADER
I20260709 13:05:47.970832 18834 consensus_queue.cc:237] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:47.977223 18373 catalog_manager.cc:5697] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 reported cstate change: term changed from 1 to 2, leader changed from ae5be77f387e48639ec76424d120a703 (127.7.25.194) to a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "a81e9f90f26a4379b54fd57a6976af76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.064284 18474 raft_consensus.cc:1275] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Refusing update from remote peer ae5be77f387e48639ec76424d120a703: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:48.065832 18767 consensus_queue.cc:1048] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.074762 18621 raft_consensus.cc:3060] T caa517a1211e4a4d8f2643968b4ccaf0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.082784 18621 raft_consensus.cc:1275] T caa517a1211e4a4d8f2643968b4ccaf0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Refusing update from remote peer ae5be77f387e48639ec76424d120a703: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:48.084108 18843 consensus_queue.cc:1048] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.090116 18547 raft_consensus.cc:1275] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Refusing update from remote peer a81e9f90f26a4379b54fd57a6976af76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:48.091451 18834 consensus_queue.cc:1048] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.102178 18790 raft_consensus.cc:993] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f: : Instructing follower ae5be77f387e48639ec76424d120a703 to start an election
I20260709 13:05:48.102739 18830 raft_consensus.cc:1081] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Signalling peer ae5be77f387e48639ec76424d120a703 to start an election
I20260709 13:05:48.106315 18547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "815b50d8b4ea4c6bb7ef7d28994ca164"
dest_uuid: "ae5be77f387e48639ec76424d120a703"
 from {username='slave'} at 127.0.0.1:35424
I20260709 13:05:48.105877 18621 raft_consensus.cc:1275] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Refusing update from remote peer a81e9f90f26a4379b54fd57a6976af76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:48.106995 18547 raft_consensus.cc:493] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.107578 18547 raft_consensus.cc:3060] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.108604 18792 consensus_queue.cc:1048] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.115398 18547 raft_consensus.cc:515] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:48.118011 18547 leader_election.cc:290] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 2 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169)
I20260709 13:05:48.118379 18474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815b50d8b4ea4c6bb7ef7d28994ca164" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:48.118547 18621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815b50d8b4ea4c6bb7ef7d28994ca164" candidate_uuid: "ae5be77f387e48639ec76424d120a703" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
I20260709 13:05:48.119151 18474 raft_consensus.cc:3060] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.119220 18621 raft_consensus.cc:3055] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:48.119674 18621 raft_consensus.cc:740] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Running, Role: LEADER
I20260709 13:05:48.120589 18621 consensus_queue.cc:260] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:48.121894 18621 raft_consensus.cc:3060] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.128283 18621 raft_consensus.cc:2468] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 2.
I20260709 13:05:48.128724 18474 raft_consensus.cc:2468] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5be77f387e48639ec76424d120a703 in term 2.
I20260709 13:05:48.129500 18516 leader_election.cc:304] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:48.131157 18843 raft_consensus.cc:2804] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:48.131719 18843 raft_consensus.cc:697] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Becoming Leader. State: Replica: ae5be77f387e48639ec76424d120a703, State: Running, Role: LEADER
I20260709 13:05:48.132679 18843 consensus_queue.cc:237] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:48.142091 18370 catalog_manager.cc:5697] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 reported cstate change: term changed from 1 to 2, leader changed from 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195) to ae5be77f387e48639ec76424d120a703 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "ae5be77f387e48639ec76424d120a703" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.228416 18474 raft_consensus.cc:1275] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Refusing update from remote peer ae5be77f387e48639ec76424d120a703: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:48.229769 18843 consensus_queue.cc:1048] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.237223 18621 raft_consensus.cc:1275] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Refusing update from remote peer ae5be77f387e48639ec76424d120a703: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:48.239702 18756 consensus_queue.cc:1048] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.377434 18474 raft_consensus.cc:1275] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Refusing update from remote peer ae5be77f387e48639ec76424d120a703: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:48.378773 18767 consensus_queue.cc:1048] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.386584 18624 raft_consensus.cc:1275] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Refusing update from remote peer ae5be77f387e48639ec76424d120a703: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:48.387925 18767 consensus_queue.cc:1048] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:48.430651 18621 raft_consensus.cc:1275] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Refusing update from remote peer a81e9f90f26a4379b54fd57a6976af76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:48.432019 18792 consensus_queue.cc:1048] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.440593 18547 raft_consensus.cc:1275] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Refusing update from remote peer a81e9f90f26a4379b54fd57a6976af76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:48.443539 18771 consensus_queue.cc:1048] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.538117 18474 raft_consensus.cc:1275] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Refusing update from remote peer ae5be77f387e48639ec76424d120a703: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:48.539327 18767 consensus_queue.cc:1048] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.547171 18621 raft_consensus.cc:1275] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Refusing update from remote peer ae5be77f387e48639ec76424d120a703: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:48.548689 18843 consensus_queue.cc:1048] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:50.563441 18373 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46160:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:05:50.588554 18373 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46160:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:05:50.620800  7271 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:05:50.726456 18516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:39169, user_credentials={real_user=slave}} blocked reactor thread for 114182us
W20260709 13:05:50.778282 18441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:39169, user_credentials={real_user=slave}} blocked reactor thread for 63513.4us
I20260709 13:05:50.826459 18548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "815b50d8b4ea4c6bb7ef7d28994ca164"
dest_uuid: "ae5be77f387e48639ec76424d120a703"
mode: GRACEFUL
new_leader_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
 from {username='slave'} at 127.0.0.1:35452
I20260709 13:05:50.827358 18548 raft_consensus.cc:606] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Received request to transfer leadership to TS 2cfdcc4bf28d40b59a436fc9d1a7995f
I20260709 13:05:50.836793 18898 tablet.cc:1724] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:50.883898 18516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:39169, user_credentials={real_user=slave}} blocked reactor thread for 70369.1us
I20260709 13:05:50.931942 18908 tablet.cc:1724] T f73bbcaaf32949ab8f64850999edd9c0 P a81e9f90f26a4379b54fd57a6976af76: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:50.903693 18894 tablet.cc:1724] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:50.895987 18893 tablet.cc:1724] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:50.823411 18890 tablet.cc:1724] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:51.018873 18650 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:9c6c421ea62442a694dd0a2b1cb57453)
I20260709 13:05:50.966087 18899 tablet.cc:1724] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.034178 18910 tablet.cc:1724] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.050874 18916 tablet.cc:1724] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:51.056318 18909 log.cc:927] Time spent T caa517a1211e4a4d8f2643968b4ccaf0 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
I20260709 13:05:51.049737 18470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7a63d86bb544b899e15f04ea3515a5b"
dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
mode: GRACEFUL
new_leader_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
 from {username='slave'} at 127.0.0.1:59862
W20260709 13:05:51.061757 18501 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:0cddeef7b03b4de2820561f1c176c996)
W20260709 13:05:51.062791 18501 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:0cddeef7b03b4de2820561f1c176c996)
I20260709 13:05:51.011112 18906 tablet.cc:1724] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.062394 18913 tablet.cc:1724] T 9c6c421ea62442a694dd0a2b1cb57453 P ae5be77f387e48639ec76424d120a703: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.066195 18470 raft_consensus.cc:606] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [term 2 LEADER]: Received request to transfer leadership to TS 2cfdcc4bf28d40b59a436fc9d1a7995f
I20260709 13:05:51.075075 18881 raft_consensus.cc:993] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76: : Instructing follower 2cfdcc4bf28d40b59a436fc9d1a7995f to start an election
I20260709 13:05:51.075615 18881 raft_consensus.cc:1081] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [term 2 LEADER]: Signalling peer 2cfdcc4bf28d40b59a436fc9d1a7995f to start an election
I20260709 13:05:51.075462  7271 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:05:51.078591  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:51.102421 18915 tablet.cc:1724] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.115334 18470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "051026925e764ccd9b7e0b6fe38e10e7"
dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
mode: GRACEFUL
new_leader_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
 from {username='slave'} at 127.0.0.1:59862
I20260709 13:05:51.118394 18622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7a63d86bb544b899e15f04ea3515a5b"
dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
 from {username='slave'} at 127.0.0.1:58580
I20260709 13:05:51.118605 18470 raft_consensus.cc:606] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Received request to transfer leadership to TS 2cfdcc4bf28d40b59a436fc9d1a7995f
I20260709 13:05:51.119128 18622 raft_consensus.cc:493] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:51.119630 18622 raft_consensus.cc:3060] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:51.120810 18912 log.cc:927] Time spent T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:05:51.122784 18898 tablet.cc:1724] T 039abee1d8234488af162854ead95ba8 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.131547 18546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "213f4e3e7d184b60ab88d2f134fccf46"
dest_uuid: "ae5be77f387e48639ec76424d120a703"
mode: GRACEFUL
new_leader_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
 from {username='slave'} at 127.0.0.1:35452
I20260709 13:05:51.152838 18898 tablet.cc:1724] T caa517a1211e4a4d8f2643968b4ccaf0 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.176604 18546 raft_consensus.cc:606] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Received request to transfer leadership to TS 2cfdcc4bf28d40b59a436fc9d1a7995f
I20260709 13:05:51.178614  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:51.179611  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:51.180605 18862 raft_consensus.cc:993] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703: : Instructing follower 2cfdcc4bf28d40b59a436fc9d1a7995f to start an election
I20260709 13:05:51.181141 18862 raft_consensus.cc:1081] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Signalling peer 2cfdcc4bf28d40b59a436fc9d1a7995f to start an election
I20260709 13:05:51.149318 18917 tablet.cc:1724] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.172760 18622 raft_consensus.cc:515] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:51.182606 18894 tablet.cc:1724] T f73bbcaaf32949ab8f64850999edd9c0 P ae5be77f387e48639ec76424d120a703: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.187343 18624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "815b50d8b4ea4c6bb7ef7d28994ca164"
dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
 from {username='slave'} at 127.0.0.1:58588
I20260709 13:05:51.187983 18624 raft_consensus.cc:493] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:51.188366 18624 raft_consensus.cc:3060] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:51.197623 18917 tablet.cc:1724] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.196483 18908 tablet.cc:1724] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.206239 18624 raft_consensus.cc:515] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:51.207957 18910 tablet.cc:1724] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.209112 18470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815b50d8b4ea4c6bb7ef7d28994ca164" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:51.209790 18470 raft_consensus.cc:3060] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:51.210837 18620 raft_consensus.cc:1240] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 3 FOLLOWER]: Rejecting Update request from peer ae5be77f387e48639ec76424d120a703 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:51.210431 18899 tablet.cc:1724] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.211830 18908 tablet.cc:1724] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.177968 18893 tablet.cc:1724] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.221438 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a63d86bb544b899e15f04ea3515a5b" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:51.222155 18549 raft_consensus.cc:3060] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:51.222035 18915 tablet.cc:1724] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.224061 18622 leader_election.cc:290] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 3 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:51.227458 18472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a63d86bb544b899e15f04ea3515a5b" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:51.228029 18472 raft_consensus.cc:3055] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:51.228334 18472 raft_consensus.cc:740] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Running, Role: LEADER
I20260709 13:05:51.229135 18472 consensus_queue.cc:260] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:51.230427 18472 raft_consensus.cc:3060] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:51.219527 18896 consensus_queue.cc:1059] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:05:51.231621 18896 raft_consensus.cc:3055] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:51.232249 18896 raft_consensus.cc:740] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Running, Role: LEADER
I20260709 13:05:51.233366 18896 consensus_queue.cc:260] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:51.234453 18896 raft_consensus.cc:3060] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:51.236428 18908 tablet.cc:1724] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.245697 18549 raft_consensus.cc:2468] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 3.
I20260709 13:05:51.245457 18906 tablet.cc:1724] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.248879 18917 tablet.cc:1724] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.249668 18589 leader_election.cc:304] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:51.250797 18883 raft_consensus.cc:2804] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:51.251276 18883 raft_consensus.cc:697] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 3 LEADER]: Becoming Leader. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Running, Role: LEADER
I20260709 13:05:51.252188 18883 consensus_queue.cc:237] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:51.258116 18472 raft_consensus.cc:2468] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 3.
I20260709 13:05:51.265959 18470 raft_consensus.cc:2468] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 3.
I20260709 13:05:51.274202 18913 tablet.cc:1724] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.275202 18587 leader_election.cc:304] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, a81e9f90f26a4379b54fd57a6976af76; no voters: 
I20260709 13:05:51.287277 18883 raft_consensus.cc:2804] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:51.287923 18883 raft_consensus.cc:697] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 3 LEADER]: Becoming Leader. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Running, Role: LEADER
I20260709 13:05:51.271613 18624 leader_election.cc:290] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 3 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:51.288730 18883 consensus_queue.cc:237] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:51.286192 18546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815b50d8b4ea4c6bb7ef7d28994ca164" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:51.293411 18370 catalog_manager.cc:5697] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f reported cstate change: term changed from 2 to 3, leader changed from a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193) to 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195). New cstate: current_term: 3 leader_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:51.306951 18546 raft_consensus.cc:2468] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 3.
I20260709 13:05:51.312279 18373 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d: soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1] alter complete (version 1)
I20260709 13:05:51.324031 18373 catalog_manager.cc:5697] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f reported cstate change: term changed from 2 to 3, leader changed from ae5be77f387e48639ec76424d120a703 (127.7.25.194) to 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195). New cstate: current_term: 3 leader_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:51.325400 18373 catalog_manager.cc:5789] TS 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195:39169) does not have the latest schema for tablet 815b50d8b4ea4c6bb7ef7d28994ca164 (table soft_deleted_table [id=2d58822cbfdc4f15838b70ba999d15d1]). Expected version 1 got 0
I20260709 13:05:51.381950 18767 raft_consensus.cc:993] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703: : Instructing follower 2cfdcc4bf28d40b59a436fc9d1a7995f to start an election
I20260709 13:05:51.382498 18896 raft_consensus.cc:1081] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Signalling peer 2cfdcc4bf28d40b59a436fc9d1a7995f to start an election
I20260709 13:05:51.383957 18624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "213f4e3e7d184b60ab88d2f134fccf46"
dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
 from {username='slave'} at 127.0.0.1:58588
I20260709 13:05:51.384539 18624 raft_consensus.cc:493] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:51.384887 18624 raft_consensus.cc:3060] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:51.390736 18624 raft_consensus.cc:515] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:51.392308 18624 leader_election.cc:290] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 3 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:51.393013 18470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213f4e3e7d184b60ab88d2f134fccf46" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:51.393395 18546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213f4e3e7d184b60ab88d2f134fccf46" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:51.393733 18470 raft_consensus.cc:3060] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:51.394073 18546 raft_consensus.cc:3055] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:51.394455 18546 raft_consensus.cc:740] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ae5be77f387e48639ec76424d120a703, State: Running, Role: LEADER
I20260709 13:05:51.395201 18546 consensus_queue.cc:260] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:51.396168 18546 raft_consensus.cc:3060] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:51.401296 18546 raft_consensus.cc:2468] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 3.
I20260709 13:05:51.401291 18470 raft_consensus.cc:2468] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 3.
I20260709 13:05:51.402508 18589 leader_election.cc:304] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:51.403216 18830 raft_consensus.cc:2804] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:51.403678 18830 raft_consensus.cc:697] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 3 LEADER]: Becoming Leader. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Running, Role: LEADER
I20260709 13:05:51.404309 18830 consensus_queue.cc:237] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:51.412820 18373 catalog_manager.cc:5697] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f reported cstate change: term changed from 2 to 3, leader changed from ae5be77f387e48639ec76424d120a703 (127.7.25.194) to 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195). New cstate: current_term: 3 leader_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:51.529712 18891 raft_consensus.cc:993] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76: : Instructing follower 2cfdcc4bf28d40b59a436fc9d1a7995f to start an election
I20260709 13:05:51.530298 18881 raft_consensus.cc:1081] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Signalling peer 2cfdcc4bf28d40b59a436fc9d1a7995f to start an election
I20260709 13:05:51.531872 18624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "051026925e764ccd9b7e0b6fe38e10e7"
dest_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f"
 from {username='slave'} at 127.0.0.1:58580
I20260709 13:05:51.532334 18624 raft_consensus.cc:493] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:51.532599 18624 raft_consensus.cc:3060] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.537572 18624 raft_consensus.cc:515] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:51.539064 18624 leader_election.cc:290] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 2 election: Requested vote from peers a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283), ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685)
I20260709 13:05:51.540058 18549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051026925e764ccd9b7e0b6fe38e10e7" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae5be77f387e48639ec76424d120a703"
I20260709 13:05:51.540069 18470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051026925e764ccd9b7e0b6fe38e10e7" candidate_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a81e9f90f26a4379b54fd57a6976af76"
I20260709 13:05:51.540834 18549 raft_consensus.cc:3060] T 051026925e764ccd9b7e0b6fe38e10e7 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.541006 18470 raft_consensus.cc:3055] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.541456 18470 raft_consensus.cc:740] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a81e9f90f26a4379b54fd57a6976af76, State: Running, Role: LEADER
I20260709 13:05:51.542131 18470 consensus_queue.cc:260] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:51.543467 18470 raft_consensus.cc:3060] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.545534 18549 raft_consensus.cc:2468] T 051026925e764ccd9b7e0b6fe38e10e7 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 2.
I20260709 13:05:51.546487 18589 leader_election.cc:304] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cfdcc4bf28d40b59a436fc9d1a7995f, ae5be77f387e48639ec76424d120a703; no voters: 
I20260709 13:05:51.547324 18830 raft_consensus.cc:2804] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:51.547811 18830 raft_consensus.cc:697] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 LEADER]: Becoming Leader. State: Replica: 2cfdcc4bf28d40b59a436fc9d1a7995f, State: Running, Role: LEADER
I20260709 13:05:51.548498 18830 consensus_queue.cc:237] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } }
I20260709 13:05:51.550647 18470 raft_consensus.cc:2468] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2cfdcc4bf28d40b59a436fc9d1a7995f in term 2.
I20260709 13:05:51.556620 18373 catalog_manager.cc:5697] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f reported cstate change: term changed from 1 to 2, leader changed from a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193) to 2cfdcc4bf28d40b59a436fc9d1a7995f (127.7.25.195). New cstate: current_term: 2 leader_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cfdcc4bf28d40b59a436fc9d1a7995f" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 39169 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:51.738765 18470 raft_consensus.cc:1275] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76 [term 3 FOLLOWER]: Refusing update from remote peer 2cfdcc4bf28d40b59a436fc9d1a7995f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:51.739959 18472 raft_consensus.cc:1275] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [term 3 FOLLOWER]: Refusing update from remote peer 2cfdcc4bf28d40b59a436fc9d1a7995f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:51.740171 18830 consensus_queue.cc:1048] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:51.741392 18883 consensus_queue.cc:1048] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:51.746390 18893 tablet.cc:1724] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:51.749300 18549 raft_consensus.cc:1275] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 3 FOLLOWER]: Refusing update from remote peer 2cfdcc4bf28d40b59a436fc9d1a7995f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:51.753893 18883 consensus_queue.cc:1048] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:51.764881 18546 raft_consensus.cc:1275] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 3 FOLLOWER]: Refusing update from remote peer 2cfdcc4bf28d40b59a436fc9d1a7995f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:51.769201 18929 consensus_queue.cc:1048] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:51.799269 18893 tablet.cc:1719] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f: Skipping requested alter to schema version 1, tablet already version 1
I20260709 13:05:51.800009 18913 tablet.cc:1719] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703: Skipping requested alter to schema version 1, tablet already version 1
I20260709 13:05:51.810402 18934 tablet.cc:1719] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76: Skipping requested alter to schema version 1, tablet already version 1
I20260709 13:05:51.887522 18549 raft_consensus.cc:1275] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [term 3 FOLLOWER]: Refusing update from remote peer 2cfdcc4bf28d40b59a436fc9d1a7995f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:51.888839 18930 consensus_queue.cc:1048] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:51.897785 18472 raft_consensus.cc:1275] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 3 FOLLOWER]: Refusing update from remote peer 2cfdcc4bf28d40b59a436fc9d1a7995f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:51.899483 18929 consensus_queue.cc:1048] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:51.961539 18549 raft_consensus.cc:1275] T 051026925e764ccd9b7e0b6fe38e10e7 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Refusing update from remote peer 2cfdcc4bf28d40b59a436fc9d1a7995f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:51.962684 18929 consensus_queue.cc:1048] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5be77f387e48639ec76424d120a703" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:51.971215 18472 raft_consensus.cc:1275] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Refusing update from remote peer 2cfdcc4bf28d40b59a436fc9d1a7995f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:51.972862 18930 consensus_queue.cc:1048] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a81e9f90f26a4379b54fd57a6976af76" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.238876  7271 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:05:52.244216  7271 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:05:52.244637  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:52.249606  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:05:52.249993  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:53.283548  7271 tablet_server.cc:179] TabletServer@127.7.25.193:0 shutting down...
I20260709 13:05:53.325882  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:05:53.326210 18587 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
I20260709 13:05:53.326921  7271 tablet_replica.cc:333] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76: stopping tablet replica
I20260709 13:05:53.328568  7271 raft_consensus.cc:2243] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.330181  7271 raft_consensus.cc:2272] T 0cf9ea9968ef472481200296f720403c P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:53.330364 18587 consensus_peers.cc:597] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f -> Peer a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283): Couldn't send request to peer a81e9f90f26a4379b54fd57a6976af76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:53.333717  7271 tablet_replica.cc:333] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76: stopping tablet replica
I20260709 13:05:53.334477  7271 raft_consensus.cc:2243] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.335430  7271 raft_consensus.cc:2272] T 9c6c421ea62442a694dd0a2b1cb57453 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.338024  7271 tablet_replica.cc:333] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76: stopping tablet replica
I20260709 13:05:53.338706  7271 raft_consensus.cc:2243] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.339296  7271 raft_consensus.cc:2272] T e7a63d86bb544b899e15f04ea3515a5b P a81e9f90f26a4379b54fd57a6976af76 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.342793  7271 tablet_replica.cc:333] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76: stopping tablet replica
I20260709 13:05:53.343602  7271 raft_consensus.cc:2243] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:53.344275 18587 consensus_peers.cc:597] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f -> Peer a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283): Couldn't send request to peer a81e9f90f26a4379b54fd57a6976af76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:53.344578  7271 raft_consensus.cc:2272] T bbeaec4d719c41bfb7d127b9f2a94cec P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.349284  7271 tablet_replica.cc:333] T f73bbcaaf32949ab8f64850999edd9c0 P a81e9f90f26a4379b54fd57a6976af76: stopping tablet replica
W20260709 13:05:53.349896 18513 consensus_peers.cc:597] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 -> Peer a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283): Couldn't send request to peer a81e9f90f26a4379b54fd57a6976af76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:53.350461  7271 raft_consensus.cc:2243] T f73bbcaaf32949ab8f64850999edd9c0 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.351122  7271 raft_consensus.cc:2272] T f73bbcaaf32949ab8f64850999edd9c0 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.353688  7271 tablet_replica.cc:333] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76: stopping tablet replica
I20260709 13:05:53.354318  7271 raft_consensus.cc:2243] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.355211  7271 raft_consensus.cc:2272] T 039abee1d8234488af162854ead95ba8 P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.357878  7271 tablet_replica.cc:333] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76: stopping tablet replica
I20260709 13:05:53.358439  7271 raft_consensus.cc:2243] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.359256  7271 raft_consensus.cc:2272] T caa517a1211e4a4d8f2643968b4ccaf0 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.362375  7271 tablet_replica.cc:333] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76: stopping tablet replica
I20260709 13:05:53.362908  7271 raft_consensus.cc:2243] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.363816  7271 raft_consensus.cc:2272] T b03ee79e498042c8b75d3fbcebb1effd P a81e9f90f26a4379b54fd57a6976af76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.366322  7271 tablet_replica.cc:333] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76: stopping tablet replica
I20260709 13:05:53.367028  7271 raft_consensus.cc:2243] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.367779  7271 raft_consensus.cc:2272] T 2f0f524f92b745e7a4ec40dfa0267295 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.371731  7271 tablet_replica.cc:333] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76: stopping tablet replica
I20260709 13:05:53.372591  7271 raft_consensus.cc:2243] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.373397  7271 raft_consensus.cc:2272] T 0cddeef7b03b4de2820561f1c176c996 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.376618  7271 tablet_replica.cc:333] T 764ec65bcdd54a2a966c4a8666bdc49f P a81e9f90f26a4379b54fd57a6976af76: stopping tablet replica
I20260709 13:05:53.377535  7271 raft_consensus.cc:2243] T 764ec65bcdd54a2a966c4a8666bdc49f P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.378311  7271 raft_consensus.cc:2272] T 764ec65bcdd54a2a966c4a8666bdc49f P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:53.379403 18513 consensus_peers.cc:597] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 -> Peer a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283): Couldn't send request to peer a81e9f90f26a4379b54fd57a6976af76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:53.381249  7271 tablet_replica.cc:333] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76: stopping tablet replica
I20260709 13:05:53.381979  7271 raft_consensus.cc:2243] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.382835  7271 raft_consensus.cc:2272] T 815b50d8b4ea4c6bb7ef7d28994ca164 P a81e9f90f26a4379b54fd57a6976af76 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.386404  7271 tablet_replica.cc:333] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76: stopping tablet replica
I20260709 13:05:53.387025  7271 raft_consensus.cc:2243] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.387633  7271 raft_consensus.cc:2272] T 213f4e3e7d184b60ab88d2f134fccf46 P a81e9f90f26a4379b54fd57a6976af76 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.390990  7271 tablet_replica.cc:333] T 109a4a99e5ac4b248028219843cf6ab8 P a81e9f90f26a4379b54fd57a6976af76: stopping tablet replica
I20260709 13:05:53.391628  7271 raft_consensus.cc:2243] T 109a4a99e5ac4b248028219843cf6ab8 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.392423  7271 raft_consensus.cc:2272] T 109a4a99e5ac4b248028219843cf6ab8 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.395056  7271 tablet_replica.cc:333] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76: stopping tablet replica
I20260709 13:05:53.395663  7271 raft_consensus.cc:2243] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.396627  7271 raft_consensus.cc:2272] T 536acabdfb254492867815cfbb3c77aa P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.399137  7271 tablet_replica.cc:333] T 7fbfcd9d2442462d8b4feb44a3649b27 P a81e9f90f26a4379b54fd57a6976af76: stopping tablet replica
I20260709 13:05:53.399705  7271 raft_consensus.cc:2243] T 7fbfcd9d2442462d8b4feb44a3649b27 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.400233  7271 raft_consensus.cc:2272] T 7fbfcd9d2442462d8b4feb44a3649b27 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.402655  7271 tablet_replica.cc:333] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76: stopping tablet replica
I20260709 13:05:53.403213  7271 raft_consensus.cc:2243] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.404243  7271 raft_consensus.cc:2272] T ad19ad4e2d824251af244da83f5e615a P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.406919  7271 tablet_replica.cc:333] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76: stopping tablet replica
I20260709 13:05:53.407511  7271 raft_consensus.cc:2243] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.407982  7271 raft_consensus.cc:2272] T 051026925e764ccd9b7e0b6fe38e10e7 P a81e9f90f26a4379b54fd57a6976af76 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:53.441058 18587 consensus_peers.cc:597] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f -> Peer a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283): Couldn't send request to peer a81e9f90f26a4379b54fd57a6976af76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:53.460283  7271 tablet_server.cc:196] TabletServer@127.7.25.193:0 shutdown complete.
W20260709 13:05:53.495847 18587 consensus_peers.cc:597] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f -> Peer a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283): Couldn't send request to peer a81e9f90f26a4379b54fd57a6976af76. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:35283: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:53.509768  7271 tablet_server.cc:179] TabletServer@127.7.25.194:0 shutting down...
W20260709 13:05:53.524622 18589 consensus_peers.cc:597] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f -> Peer ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685): Couldn't send request to peer ae5be77f387e48639ec76424d120a703. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:53.547132  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:53.547987  7271 tablet_replica.cc:333] T 9c6c421ea62442a694dd0a2b1cb57453 P ae5be77f387e48639ec76424d120a703: stopping tablet replica
I20260709 13:05:53.548759  7271 raft_consensus.cc:2243] T 9c6c421ea62442a694dd0a2b1cb57453 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.549428  7271 raft_consensus.cc:2272] T 9c6c421ea62442a694dd0a2b1cb57453 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.551856  7271 tablet_replica.cc:333] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703: stopping tablet replica
I20260709 13:05:53.552546  7271 raft_consensus.cc:2243] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.553157  7271 raft_consensus.cc:2272] T 0cf9ea9968ef472481200296f720403c P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.556412  7271 tablet_replica.cc:333] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703: stopping tablet replica
I20260709 13:05:53.557325  7271 raft_consensus.cc:2243] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:05:53.558466 18589 consensus_peers.cc:597] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f -> Peer ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685): Couldn't send request to peer ae5be77f387e48639ec76424d120a703. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:53.558594  7271 raft_consensus.cc:2272] T caa517a1211e4a4d8f2643968b4ccaf0 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.561395  7271 tablet_replica.cc:333] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703: stopping tablet replica
I20260709 13:05:53.562055  7271 raft_consensus.cc:2243] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.562598  7271 raft_consensus.cc:2272] T 039abee1d8234488af162854ead95ba8 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.565014  7271 tablet_replica.cc:333] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703: stopping tablet replica
I20260709 13:05:53.565665  7271 raft_consensus.cc:2243] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.566198  7271 raft_consensus.cc:2272] T 213f4e3e7d184b60ab88d2f134fccf46 P ae5be77f387e48639ec76424d120a703 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.568555  7271 tablet_replica.cc:333] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703: stopping tablet replica
I20260709 13:05:53.569214  7271 raft_consensus.cc:2243] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.570261  7271 raft_consensus.cc:2272] T 109a4a99e5ac4b248028219843cf6ab8 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.573247  7271 tablet_replica.cc:333] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703: stopping tablet replica
I20260709 13:05:53.574219  7271 raft_consensus.cc:2243] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.574973  7271 raft_consensus.cc:2272] T ad19ad4e2d824251af244da83f5e615a P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:53.577834 18513 consensus_peers.cc:597] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 -> Peer a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283): Couldn't send request to peer a81e9f90f26a4379b54fd57a6976af76. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:35283: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:53.578492  7271 tablet_replica.cc:333] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703: stopping tablet replica
I20260709 13:05:53.579334  7271 raft_consensus.cc:2243] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.579888  7271 raft_consensus.cc:2272] T 7fbfcd9d2442462d8b4feb44a3649b27 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.582338  7271 tablet_replica.cc:333] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703: stopping tablet replica
I20260709 13:05:53.582962  7271 raft_consensus.cc:2243] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.583511  7271 raft_consensus.cc:2272] T 815b50d8b4ea4c6bb7ef7d28994ca164 P ae5be77f387e48639ec76424d120a703 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.585855  7271 tablet_replica.cc:333] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703: stopping tablet replica
I20260709 13:05:53.586470  7271 raft_consensus.cc:2243] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.587347  7271 raft_consensus.cc:2272] T 764ec65bcdd54a2a966c4a8666bdc49f P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.589747  7271 tablet_replica.cc:333] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703: stopping tablet replica
I20260709 13:05:53.590320  7271 raft_consensus.cc:2243] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.591228  7271 raft_consensus.cc:2272] T 0cddeef7b03b4de2820561f1c176c996 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.594316  7271 tablet_replica.cc:333] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703: stopping tablet replica
I20260709 13:05:53.595060  7271 raft_consensus.cc:2243] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.596341  7271 raft_consensus.cc:2272] T 2f0f524f92b745e7a4ec40dfa0267295 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:53.598114 18587 consensus_peers.cc:597] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f -> Peer a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283): Couldn't send request to peer a81e9f90f26a4379b54fd57a6976af76. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:35283: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:53.599445  7271 tablet_replica.cc:333] T b03ee79e498042c8b75d3fbcebb1effd P ae5be77f387e48639ec76424d120a703: stopping tablet replica
I20260709 13:05:53.600075  7271 raft_consensus.cc:2243] T b03ee79e498042c8b75d3fbcebb1effd P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.600574  7271 raft_consensus.cc:2272] T b03ee79e498042c8b75d3fbcebb1effd P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.603041  7271 tablet_replica.cc:333] T 051026925e764ccd9b7e0b6fe38e10e7 P ae5be77f387e48639ec76424d120a703: stopping tablet replica
I20260709 13:05:53.603664  7271 raft_consensus.cc:2243] T 051026925e764ccd9b7e0b6fe38e10e7 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.604195  7271 raft_consensus.cc:2272] T 051026925e764ccd9b7e0b6fe38e10e7 P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.606498  7271 tablet_replica.cc:333] T f73bbcaaf32949ab8f64850999edd9c0 P ae5be77f387e48639ec76424d120a703: stopping tablet replica
I20260709 13:05:53.607069  7271 raft_consensus.cc:2243] T f73bbcaaf32949ab8f64850999edd9c0 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.607590  7271 raft_consensus.cc:2272] T f73bbcaaf32949ab8f64850999edd9c0 P ae5be77f387e48639ec76424d120a703 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.610011  7271 tablet_replica.cc:333] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703: stopping tablet replica
I20260709 13:05:53.610514  7271 raft_consensus.cc:2243] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.611534  7271 raft_consensus.cc:2272] T bbeaec4d719c41bfb7d127b9f2a94cec P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.613986  7271 tablet_replica.cc:333] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703: stopping tablet replica
I20260709 13:05:53.614603  7271 raft_consensus.cc:2243] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.615141  7271 raft_consensus.cc:2272] T e7a63d86bb544b899e15f04ea3515a5b P ae5be77f387e48639ec76424d120a703 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.617758  7271 tablet_replica.cc:333] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703: stopping tablet replica
I20260709 13:05:53.618280  7271 raft_consensus.cc:2243] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.618845  7271 raft_consensus.cc:2272] T 536acabdfb254492867815cfbb3c77aa P ae5be77f387e48639ec76424d120a703 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.668042  7271 tablet_server.cc:196] TabletServer@127.7.25.194:0 shutdown complete.
W20260709 13:05:53.693320 18587 consensus_peers.cc:597] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f -> Peer a81e9f90f26a4379b54fd57a6976af76 (127.7.25.193:35283): Couldn't send request to peer a81e9f90f26a4379b54fd57a6976af76. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:35283: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:53.714887  7271 tablet_server.cc:179] TabletServer@127.7.25.195:0 shutting down...
I20260709 13:05:53.744328  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:53.745128  7271 tablet_replica.cc:333] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f: stopping tablet replica
I20260709 13:05:53.745883  7271 raft_consensus.cc:2243] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.746496  7271 raft_consensus.cc:2272] T 0cf9ea9968ef472481200296f720403c P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.749037  7271 tablet_replica.cc:333] T 039abee1d8234488af162854ead95ba8 P 2cfdcc4bf28d40b59a436fc9d1a7995f: stopping tablet replica
I20260709 13:05:53.749773  7271 raft_consensus.cc:2243] T 039abee1d8234488af162854ead95ba8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.750314  7271 raft_consensus.cc:2272] T 039abee1d8234488af162854ead95ba8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.752521  7271 tablet_replica.cc:333] T caa517a1211e4a4d8f2643968b4ccaf0 P 2cfdcc4bf28d40b59a436fc9d1a7995f: stopping tablet replica
I20260709 13:05:53.753153  7271 raft_consensus.cc:2243] T caa517a1211e4a4d8f2643968b4ccaf0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.753707  7271 raft_consensus.cc:2272] T caa517a1211e4a4d8f2643968b4ccaf0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.756055  7271 tablet_replica.cc:333] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f: stopping tablet replica
I20260709 13:05:53.756695  7271 raft_consensus.cc:2243] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.757339  7271 raft_consensus.cc:2272] T bbeaec4d719c41bfb7d127b9f2a94cec P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.759473  7271 tablet_replica.cc:333] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f: stopping tablet replica
I20260709 13:05:53.760068  7271 raft_consensus.cc:2243] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.760978  7271 raft_consensus.cc:2272] T e7a63d86bb544b899e15f04ea3515a5b P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.763139  7271 tablet_replica.cc:333] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f: stopping tablet replica
I20260709 13:05:53.763712  7271 raft_consensus.cc:2243] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.764599  7271 raft_consensus.cc:2272] T f73bbcaaf32949ab8f64850999edd9c0 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.766881  7271 tablet_replica.cc:333] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f: stopping tablet replica
I20260709 13:05:53.767474  7271 raft_consensus.cc:2243] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.767975  7271 raft_consensus.cc:2272] T 109a4a99e5ac4b248028219843cf6ab8 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.770203  7271 tablet_replica.cc:333] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f: stopping tablet replica
I20260709 13:05:53.770781  7271 raft_consensus.cc:2243] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.771690  7271 raft_consensus.cc:2272] T 213f4e3e7d184b60ab88d2f134fccf46 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.773960  7271 tablet_replica.cc:333] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f: stopping tablet replica
I20260709 13:05:53.774659  7271 raft_consensus.cc:2243] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.775177  7271 raft_consensus.cc:2272] T 9c6c421ea62442a694dd0a2b1cb57453 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.777338  7271 tablet_replica.cc:333] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f: stopping tablet replica
I20260709 13:05:53.777961  7271 raft_consensus.cc:2243] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.779400  7271 raft_consensus.cc:2272] T 7fbfcd9d2442462d8b4feb44a3649b27 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.782544  7271 tablet_replica.cc:333] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f: stopping tablet replica
I20260709 13:05:53.783320  7271 raft_consensus.cc:2243] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.783921  7271 raft_consensus.cc:2272] T 0cddeef7b03b4de2820561f1c176c996 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.786070  7271 tablet_replica.cc:333] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f: stopping tablet replica
I20260709 13:05:53.786585  7271 raft_consensus.cc:2243] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.787012  7271 raft_consensus.cc:2272] T 2f0f524f92b745e7a4ec40dfa0267295 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.789000  7271 tablet_replica.cc:333] T b03ee79e498042c8b75d3fbcebb1effd P 2cfdcc4bf28d40b59a436fc9d1a7995f: stopping tablet replica
I20260709 13:05:53.789536  7271 raft_consensus.cc:2243] T b03ee79e498042c8b75d3fbcebb1effd P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.789929  7271 raft_consensus.cc:2272] T b03ee79e498042c8b75d3fbcebb1effd P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.791826  7271 tablet_replica.cc:333] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f: stopping tablet replica
I20260709 13:05:53.792317  7271 raft_consensus.cc:2243] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.792889  7271 raft_consensus.cc:2272] T ad19ad4e2d824251af244da83f5e615a P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.795497  7271 tablet_replica.cc:333] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f: stopping tablet replica
I20260709 13:05:53.796058  7271 raft_consensus.cc:2243] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.796979  7271 raft_consensus.cc:2272] T 815b50d8b4ea4c6bb7ef7d28994ca164 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:53.798631 18589 consensus_peers.cc:597] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f -> Peer ae5be77f387e48639ec76424d120a703 (127.7.25.194:40685): Couldn't send request to peer ae5be77f387e48639ec76424d120a703. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:40685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:53.799650  7271 tablet_replica.cc:333] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f: stopping tablet replica
I20260709 13:05:53.800310  7271 raft_consensus.cc:2243] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.800810  7271 raft_consensus.cc:2272] T 764ec65bcdd54a2a966c4a8666bdc49f P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.803171  7271 tablet_replica.cc:333] T 536acabdfb254492867815cfbb3c77aa P 2cfdcc4bf28d40b59a436fc9d1a7995f: stopping tablet replica
I20260709 13:05:53.803689  7271 raft_consensus.cc:2243] T 536acabdfb254492867815cfbb3c77aa P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:53.804177  7271 raft_consensus.cc:2272] T 536acabdfb254492867815cfbb3c77aa P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.806416  7271 tablet_replica.cc:333] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f: stopping tablet replica
I20260709 13:05:53.806917  7271 raft_consensus.cc:2243] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.807796  7271 raft_consensus.cc:2272] T 051026925e764ccd9b7e0b6fe38e10e7 P 2cfdcc4bf28d40b59a436fc9d1a7995f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.851497  7271 tablet_server.cc:196] TabletServer@127.7.25.195:0 shutdown complete.
I20260709 13:05:53.899808  7271 master.cc:562] Master@127.7.25.254:33809 shutting down...
I20260709 13:05:53.930540  7271 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:53.931213  7271 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:53.931568  7271 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8388925bb71444ce8b5891438b8a9e4d: stopping tablet replica
I20260709 13:05:53.953194  7271 master.cc:584] Master@127.7.25.254:33809 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12738 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:05:54.009960  7271 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.25.254:38915
I20260709 13:05:54.011157  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:54.017113 18947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:54.017680 18948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:54.017791 18950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:54.019273  7271 server_base.cc:1061] running on GCE node
I20260709 13:05:54.020210  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:54.020429  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:54.020591  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602354020576 us; error 0 us; skew 500 ppm
I20260709 13:05:54.021245  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:54.023766  7271 webserver.cc:533] Webserver started at http://127.7.25.254:42869/ using document root <none> and password file <none>
I20260709 13:05:54.024240  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:54.024428  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:54.024713  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:54.025928  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602011513864-7271-0/minicluster-data/master-0-root/instance:
uuid: "59b599a001ad458f9b73d76f7b3e880d"
format_stamp: "Formatted at 2026-07-09 13:05:54 on dist-test-slave-z1zn"
I20260709 13:05:54.030583  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:05:54.034226 18955 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:54.035337  7271 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 13:05:54.035624  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602011513864-7271-0/minicluster-data/master-0-root
uuid: "59b599a001ad458f9b73d76f7b3e880d"
format_stamp: "Formatted at 2026-07-09 13:05:54 on dist-test-slave-z1zn"
I20260709 13:05:54.035905  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602011513864-7271-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602011513864-7271-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602011513864-7271-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:54.054785  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:54.056080  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:54.097247  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.254:38915
I20260709 13:05:54.097388 19006 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.254:38915 every 8 connection(s)
I20260709 13:05:54.101384 19007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.112717 19007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d: Bootstrap starting.
I20260709 13:05:54.117873 19007 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.122447 19007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d: No bootstrap required, opened a new log
I20260709 13:05:54.124857 19007 raft_consensus.cc:359] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59b599a001ad458f9b73d76f7b3e880d" member_type: VOTER }
I20260709 13:05:54.125326 19007 raft_consensus.cc:385] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.125598 19007 raft_consensus.cc:740] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59b599a001ad458f9b73d76f7b3e880d, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.126271 19007 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59b599a001ad458f9b73d76f7b3e880d" member_type: VOTER }
I20260709 13:05:54.126792 19007 raft_consensus.cc:399] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:54.127012 19007 raft_consensus.cc:493] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:54.127288 19007 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.132222 19007 raft_consensus.cc:515] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59b599a001ad458f9b73d76f7b3e880d" member_type: VOTER }
I20260709 13:05:54.132779 19007 leader_election.cc:304] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59b599a001ad458f9b73d76f7b3e880d; no voters: 
I20260709 13:05:54.134250 19007 leader_election.cc:290] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:54.134789 19010 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.137524 19010 raft_consensus.cc:697] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d [term 1 LEADER]: Becoming Leader. State: Replica: 59b599a001ad458f9b73d76f7b3e880d, State: Running, Role: LEADER
I20260709 13:05:54.138343 19010 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59b599a001ad458f9b73d76f7b3e880d" member_type: VOTER }
I20260709 13:05:54.138895 19007 sys_catalog.cc:565] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:54.144037 19011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59b599a001ad458f9b73d76f7b3e880d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59b599a001ad458f9b73d76f7b3e880d" member_type: VOTER } }
I20260709 13:05:54.144752 19011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:54.145697 19012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59b599a001ad458f9b73d76f7b3e880d. Latest consensus state: current_term: 1 leader_uuid: "59b599a001ad458f9b73d76f7b3e880d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59b599a001ad458f9b73d76f7b3e880d" member_type: VOTER } }
I20260709 13:05:54.146548 19012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:54.146651 19017 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:54.153210 19017 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:54.156404  7271 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:54.163333 19017 catalog_manager.cc:1383] Generated new cluster ID: 02889013ddba43eeab5fde34b97ab0e5
I20260709 13:05:54.163648 19017 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:54.201785 19017 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:54.203187 19017 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:54.218523 19017 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d: Generated new TSK 0
I20260709 13:05:54.219194 19017 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:54.287469  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:54.294059 19028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:54.294806 19029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:54.297852 19031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:54.297910  7271 server_base.cc:1061] running on GCE node
I20260709 13:05:54.299191  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:54.299434  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:54.299603  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602354299582 us; error 0 us; skew 500 ppm
I20260709 13:05:54.300127  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:54.302524  7271 webserver.cc:533] Webserver started at http://127.7.25.193:42397/ using document root <none> and password file <none>
I20260709 13:05:54.303000  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:54.303206  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:54.303480  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:54.304589  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602011513864-7271-0/minicluster-data/ts-0-root/instance:
uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
format_stamp: "Formatted at 2026-07-09 13:05:54 on dist-test-slave-z1zn"
I20260709 13:05:54.309067  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:05:54.312922 19036 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:54.313885  7271 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:05:54.314270  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602011513864-7271-0/minicluster-data/ts-0-root
uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
format_stamp: "Formatted at 2026-07-09 13:05:54 on dist-test-slave-z1zn"
I20260709 13:05:54.314536  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602011513864-7271-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602011513864-7271-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602011513864-7271-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:54.328470  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:54.329779  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:54.331279  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:54.333565  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:54.333793  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:54.334035  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:54.334231  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:54.376940  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.193:38471
I20260709 13:05:54.377070 19098 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.193:38471 every 8 connection(s)
I20260709 13:05:54.382140  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:54.389533 19103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:54.391570 19104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:54.393863 19106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:54.394871  7271 server_base.cc:1061] running on GCE node
I20260709 13:05:54.396656  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:54.396956  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:54.397205  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602354397180 us; error 0 us; skew 500 ppm
I20260709 13:05:54.397217 19099 heartbeater.cc:344] Connected to a master server at 127.7.25.254:38915
I20260709 13:05:54.397861 19099 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:54.398051  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:54.398918 19099 heartbeater.cc:507] Master 127.7.25.254:38915 requested a full tablet report, sending...
I20260709 13:05:54.400923  7271 webserver.cc:533] Webserver started at http://127.7.25.194:38631/ using document root <none> and password file <none>
I20260709 13:05:54.401551  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:54.401783  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:54.401695 18972 ts_manager.cc:194] Registered new tserver with Master: 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471)
I20260709 13:05:54.402307  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:54.403565  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602011513864-7271-0/minicluster-data/ts-1-root/instance:
uuid: "fce2ba57741b420f854e3eb33962ddc9"
format_stamp: "Formatted at 2026-07-09 13:05:54 on dist-test-slave-z1zn"
I20260709 13:05:54.404072 18972 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50286
I20260709 13:05:54.408433  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:54.412576 19111 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:54.413630  7271 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:05:54.414011  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602011513864-7271-0/minicluster-data/ts-1-root
uuid: "fce2ba57741b420f854e3eb33962ddc9"
format_stamp: "Formatted at 2026-07-09 13:05:54 on dist-test-slave-z1zn"
I20260709 13:05:54.414352  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602011513864-7271-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602011513864-7271-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602011513864-7271-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:54.425843  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:54.427176  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:54.428915  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:54.431403  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:54.431663  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:54.431954  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:54.432156  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:54.477707  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.194:40213
I20260709 13:05:54.477833 19173 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.194:40213 every 8 connection(s)
I20260709 13:05:54.483352  7271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:54.492161 19177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:54.496182 19178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:54.496713  7271 server_base.cc:1061] running on GCE node
W20260709 13:05:54.497594 19180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:54.498754 19174 heartbeater.cc:344] Connected to a master server at 127.7.25.254:38915
I20260709 13:05:54.498890  7271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:05:54.499225 19174 heartbeater.cc:461] Registering TS with master...
W20260709 13:05:54.499266  7271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:54.499668  7271 hybrid_clock.cc:648] HybridClock initialized: now 1783602354499647 us; error 0 us; skew 500 ppm
I20260709 13:05:54.500229 19174 heartbeater.cc:507] Master 127.7.25.254:38915 requested a full tablet report, sending...
I20260709 13:05:54.500413  7271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:54.502928 18972 ts_manager.cc:194] Registered new tserver with Master: fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213)
I20260709 13:05:54.503873  7271 webserver.cc:533] Webserver started at http://127.7.25.195:35953/ using document root <none> and password file <none>
I20260709 13:05:54.504634  7271 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:54.504894  7271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:54.505048 18972 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50300
I20260709 13:05:54.505298  7271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:54.506845  7271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602011513864-7271-0/minicluster-data/ts-2-root/instance:
uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
format_stamp: "Formatted at 2026-07-09 13:05:54 on dist-test-slave-z1zn"
I20260709 13:05:54.511844  7271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:05:54.515744 19185 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:54.516753  7271 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:05:54.517243  7271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602011513864-7271-0/minicluster-data/ts-2-root
uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
format_stamp: "Formatted at 2026-07-09 13:05:54 on dist-test-slave-z1zn"
I20260709 13:05:54.517566  7271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602011513864-7271-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602011513864-7271-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskUUScvZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602011513864-7271-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:54.534956  7271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:54.536352  7271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:54.537922  7271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:54.540427  7271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:54.540711  7271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:54.540995  7271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:54.541217  7271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:05:54.587314  7271 rpc_server.cc:307] RPC server started. Bound to: 127.7.25.195:37691
I20260709 13:05:54.587479 19247 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.25.195:37691 every 8 connection(s)
I20260709 13:05:54.602516 19248 heartbeater.cc:344] Connected to a master server at 127.7.25.254:38915
I20260709 13:05:54.602977 19248 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:54.603754 19248 heartbeater.cc:507] Master 127.7.25.254:38915 requested a full tablet report, sending...
I20260709 13:05:54.605798 18972 ts_manager.cc:194] Registered new tserver with Master: 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:54.605947  7271 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015459672s
I20260709 13:05:54.607122 18972 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50302
I20260709 13:05:54.634963 18972 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50316:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:54.637936 18972 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:54.708884 19139 tablet_service.cc:1511] Processing CreateTablet for tablet f9ffcd4670984f89b76d55cc8a25153c (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:54.710449 19139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ffcd4670984f89b76d55cc8a25153c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.714470 19138 tablet_service.cc:1511] Processing CreateTablet for tablet 386c68f4c9474e8aa44e1036c0fb288c (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:54.716215 19138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 386c68f4c9474e8aa44e1036c0fb288c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.721799 19137 tablet_service.cc:1511] Processing CreateTablet for tablet d75aeb4a68564b43a09bbbac49d5c25c (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:54.723547 19137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d75aeb4a68564b43a09bbbac49d5c25c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.727455 19136 tablet_service.cc:1511] Processing CreateTablet for tablet 78b422a66cf84972b1264e123660bdff (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:54.728916 19136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b422a66cf84972b1264e123660bdff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.730279 19063 tablet_service.cc:1511] Processing CreateTablet for tablet 386c68f4c9474e8aa44e1036c0fb288c (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:54.730970 19058 tablet_service.cc:1511] Processing CreateTablet for tablet f434a1d5fe124b4c939438499baa7d21 (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:54.733072 19062 tablet_service.cc:1511] Processing CreateTablet for tablet d75aeb4a68564b43a09bbbac49d5c25c (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:54.734402 19059 tablet_service.cc:1511] Processing CreateTablet for tablet 4a7bf2a685364a819cfd315e9093161b (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:54.734777 19135 tablet_service.cc:1511] Processing CreateTablet for tablet 4a120f7c7df9457ea291625082cb28f7 (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:54.736809 19060 tablet_service.cc:1511] Processing CreateTablet for tablet 4a120f7c7df9457ea291625082cb28f7 (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:54.739144 19133 tablet_service.cc:1511] Processing CreateTablet for tablet f434a1d5fe124b4c939438499baa7d21 (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:54.739274 19061 tablet_service.cc:1511] Processing CreateTablet for tablet 78b422a66cf84972b1264e123660bdff (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:54.741720 19057 tablet_service.cc:1511] Processing CreateTablet for tablet fb7203b1470c41e794521ce68a3ce61d (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:54.742523 19132 tablet_service.cc:1511] Processing CreateTablet for tablet fb7203b1470c41e794521ce68a3ce61d (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:54.744104 19134 tablet_service.cc:1511] Processing CreateTablet for tablet 4a7bf2a685364a819cfd315e9093161b (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:54.745537 19131 tablet_service.cc:1511] Processing CreateTablet for tablet f2833d7a80874891b0fb741839ed2e7d (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:54.746274 19056 tablet_service.cc:1511] Processing CreateTablet for tablet f2833d7a80874891b0fb741839ed2e7d (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:54.728475 19064 tablet_service.cc:1511] Processing CreateTablet for tablet f9ffcd4670984f89b76d55cc8a25153c (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:54.731719 19063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 386c68f4c9474e8aa44e1036c0fb288c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.749003 19135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a120f7c7df9457ea291625082cb28f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.756108 19132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7203b1470c41e794521ce68a3ce61d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.757519 19131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2833d7a80874891b0fb741839ed2e7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.761276 19056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2833d7a80874891b0fb741839ed2e7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.761572 19133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f434a1d5fe124b4c939438499baa7d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.764294 19213 tablet_service.cc:1511] Processing CreateTablet for tablet f9ffcd4670984f89b76d55cc8a25153c (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:54.765422 19061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b422a66cf84972b1264e123660bdff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.765666 19213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ffcd4670984f89b76d55cc8a25153c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.765465 19134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a7bf2a685364a819cfd315e9093161b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.769454 19064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ffcd4670984f89b76d55cc8a25153c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.770310 19212 tablet_service.cc:1511] Processing CreateTablet for tablet 386c68f4c9474e8aa44e1036c0fb288c (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:54.771692 19212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 386c68f4c9474e8aa44e1036c0fb288c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.773550 19060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a120f7c7df9457ea291625082cb28f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.774550 19211 tablet_service.cc:1511] Processing CreateTablet for tablet d75aeb4a68564b43a09bbbac49d5c25c (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:54.775579 19059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a7bf2a685364a819cfd315e9093161b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.775944 19211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d75aeb4a68564b43a09bbbac49d5c25c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.777282 19057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7203b1470c41e794521ce68a3ce61d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.778067 19058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f434a1d5fe124b4c939438499baa7d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.778323 19210 tablet_service.cc:1511] Processing CreateTablet for tablet 78b422a66cf84972b1264e123660bdff (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:54.779690 19210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b422a66cf84972b1264e123660bdff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.780405 19207 tablet_service.cc:1511] Processing CreateTablet for tablet f434a1d5fe124b4c939438499baa7d21 (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:54.781817 19207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f434a1d5fe124b4c939438499baa7d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.786345 19208 tablet_service.cc:1511] Processing CreateTablet for tablet 4a7bf2a685364a819cfd315e9093161b (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:54.787875 19208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a7bf2a685364a819cfd315e9093161b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.790328 19209 tablet_service.cc:1511] Processing CreateTablet for tablet 4a120f7c7df9457ea291625082cb28f7 (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:54.791779 19209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a120f7c7df9457ea291625082cb28f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.795015 19206 tablet_service.cc:1511] Processing CreateTablet for tablet fb7203b1470c41e794521ce68a3ce61d (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:54.796538 19206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7203b1470c41e794521ce68a3ce61d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.799775 19205 tablet_service.cc:1511] Processing CreateTablet for tablet f2833d7a80874891b0fb741839ed2e7d (DEFAULT_TABLE table=test-workload [id=223d120eb0df4a379aa9ae76e7538ba2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:54.801275 19205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2833d7a80874891b0fb741839ed2e7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.825680 19062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d75aeb4a68564b43a09bbbac49d5c25c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.885579 19263 tablet_bootstrap.cc:492] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9: Bootstrap starting.
I20260709 13:05:54.889792 19264 tablet_bootstrap.cc:492] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55: Bootstrap starting.
I20260709 13:05:54.885592 19265 tablet_bootstrap.cc:492] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4: Bootstrap starting.
I20260709 13:05:54.897801 19263 tablet_bootstrap.cc:654] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.934767 19265 tablet_bootstrap.cc:654] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.936859 19264 tablet_bootstrap.cc:654] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.940183 19265 tablet_bootstrap.cc:492] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4: No bootstrap required, opened a new log
I20260709 13:05:54.940784 19265 ts_tablet_manager.cc:1403] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.004s
I20260709 13:05:54.941823 19263 tablet_bootstrap.cc:492] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9: No bootstrap required, opened a new log
I20260709 13:05:54.942291 19264 tablet_bootstrap.cc:492] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55: No bootstrap required, opened a new log
I20260709 13:05:54.942354 19263 ts_tablet_manager.cc:1403] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.010s
I20260709 13:05:54.942956 19264 ts_tablet_manager.cc:1403] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.000s
I20260709 13:05:54.943547 19265 raft_consensus.cc:359] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:54.944339 19265 raft_consensus.cc:385] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.944633 19265 raft_consensus.cc:740] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.945503 19265 consensus_queue.cc:260] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:54.945657 19263 raft_consensus.cc:359] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:54.945879 19264 raft_consensus.cc:359] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:54.946480 19263 raft_consensus.cc:385] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.946681 19264 raft_consensus.cc:385] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.946846 19263 raft_consensus.cc:740] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.947039 19264 raft_consensus.cc:740] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.947938 19099 heartbeater.cc:499] Master 127.7.25.254:38915 was elected leader, sending a full tablet report...
I20260709 13:05:54.947798 19263 consensus_queue.cc:260] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:54.948274 19265 ts_tablet_manager.cc:1434] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:05:54.949345 19265 tablet_bootstrap.cc:492] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4: Bootstrap starting.
I20260709 13:05:54.947932 19264 consensus_queue.cc:260] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:54.954499 19248 heartbeater.cc:499] Master 127.7.25.254:38915 was elected leader, sending a full tablet report...
I20260709 13:05:54.954814 19264 ts_tablet_manager.cc:1434] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.007s
I20260709 13:05:54.956152 19264 tablet_bootstrap.cc:492] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55: Bootstrap starting.
I20260709 13:05:54.957279 19263 ts_tablet_manager.cc:1434] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.003s
I20260709 13:05:54.958074 19174 heartbeater.cc:499] Master 127.7.25.254:38915 was elected leader, sending a full tablet report...
I20260709 13:05:54.963380 19264 tablet_bootstrap.cc:654] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.965806 19263 tablet_bootstrap.cc:492] T f9ffcd4670984f89b76d55cc8a25153c P fce2ba57741b420f854e3eb33962ddc9: Bootstrap starting.
I20260709 13:05:54.969600 19264 tablet_bootstrap.cc:492] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55: No bootstrap required, opened a new log
I20260709 13:05:54.970252 19264 ts_tablet_manager.cc:1403] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 13:05:54.971470 19263 tablet_bootstrap.cc:654] T f9ffcd4670984f89b76d55cc8a25153c P fce2ba57741b420f854e3eb33962ddc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.976128 19265 tablet_bootstrap.cc:654] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.973397 19264 raft_consensus.cc:359] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:54.977794 19264 raft_consensus.cc:385] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.978226 19264 raft_consensus.cc:740] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.979228 19264 consensus_queue.cc:260] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:54.981942 19264 ts_tablet_manager.cc:1434] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:05:54.982957 19264 tablet_bootstrap.cc:492] T 386c68f4c9474e8aa44e1036c0fb288c P 0d045c5ca0634c0fa98ac57c40a77d55: Bootstrap starting.
I20260709 13:05:54.985734 19263 tablet_bootstrap.cc:492] T f9ffcd4670984f89b76d55cc8a25153c P fce2ba57741b420f854e3eb33962ddc9: No bootstrap required, opened a new log
I20260709 13:05:54.986361 19263 ts_tablet_manager.cc:1403] T f9ffcd4670984f89b76d55cc8a25153c P fce2ba57741b420f854e3eb33962ddc9: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.007s
I20260709 13:05:54.988488 19264 tablet_bootstrap.cc:654] T 386c68f4c9474e8aa44e1036c0fb288c P 0d045c5ca0634c0fa98ac57c40a77d55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.989982 19263 raft_consensus.cc:359] T f9ffcd4670984f89b76d55cc8a25153c P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:54.990803 19263 raft_consensus.cc:385] T f9ffcd4670984f89b76d55cc8a25153c P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.991086 19263 raft_consensus.cc:740] T f9ffcd4670984f89b76d55cc8a25153c P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.991554 19265 tablet_bootstrap.cc:492] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4: No bootstrap required, opened a new log
I20260709 13:05:54.992244 19265 ts_tablet_manager.cc:1403] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.004s
I20260709 13:05:54.992218 19263 consensus_queue.cc:260] T f9ffcd4670984f89b76d55cc8a25153c P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:54.995112 19271 raft_consensus.cc:493] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.995558 19265 raft_consensus.cc:359] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:54.995734 19271 raft_consensus.cc:515] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:54.996417 19265 raft_consensus.cc:385] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.996749 19265 raft_consensus.cc:740] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.997232 19263 ts_tablet_manager.cc:1434] T f9ffcd4670984f89b76d55cc8a25153c P fce2ba57741b420f854e3eb33962ddc9: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:05:54.998276 19265 consensus_queue.cc:260] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:54.998981 19263 tablet_bootstrap.cc:492] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9: Bootstrap starting.
I20260709 13:05:55.000592 19265 ts_tablet_manager.cc:1434] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:55.001729 19265 tablet_bootstrap.cc:492] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4: Bootstrap starting.
I20260709 13:05:55.008023 19269 raft_consensus.cc:493] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.008571 19265 tablet_bootstrap.cc:654] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.008630 19269 raft_consensus.cc:515] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.010931 19263 tablet_bootstrap.cc:654] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.011533 19264 tablet_bootstrap.cc:492] T 386c68f4c9474e8aa44e1036c0fb288c P 0d045c5ca0634c0fa98ac57c40a77d55: No bootstrap required, opened a new log
I20260709 13:05:55.012131 19264 ts_tablet_manager.cc:1403] T 386c68f4c9474e8aa44e1036c0fb288c P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.017s
I20260709 13:05:55.021708 19264 raft_consensus.cc:359] T 386c68f4c9474e8aa44e1036c0fb288c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.022753 19264 raft_consensus.cc:385] T 386c68f4c9474e8aa44e1036c0fb288c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.023130 19264 raft_consensus.cc:740] T 386c68f4c9474e8aa44e1036c0fb288c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.024363 19264 consensus_queue.cc:260] T 386c68f4c9474e8aa44e1036c0fb288c P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.037945 19271 leader_election.cc:290] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471)
I20260709 13:05:55.038861 19270 raft_consensus.cc:493] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.042362 19270 raft_consensus.cc:515] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.045655 19270 leader_election.cc:290] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:55.039434 19263 tablet_bootstrap.cc:492] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9: No bootstrap required, opened a new log
I20260709 13:05:55.046470 19263 ts_tablet_manager.cc:1403] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.017s
I20260709 13:05:55.046314 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ffcd4670984f89b76d55cc8a25153c" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9" is_pre_election: true
I20260709 13:05:55.047250 19149 raft_consensus.cc:2468] T f9ffcd4670984f89b76d55cc8a25153c P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 0.
I20260709 13:05:55.037222 19269 leader_election.cc:290] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:55.048926 19269 raft_consensus.cc:493] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.049607 19269 raft_consensus.cc:515] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.050060 19263 raft_consensus.cc:359] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.050896 19263 raft_consensus.cc:385] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.051229 19263 raft_consensus.cc:740] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.052013 19263 consensus_queue.cc:260] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.052902 19269 leader_election.cc:290] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:55.065760 19074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ffcd4670984f89b76d55cc8a25153c" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" is_pre_election: true
I20260709 13:05:55.066429 19263 ts_tablet_manager.cc:1434] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:05:55.067631 19263 tablet_bootstrap.cc:492] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9: Bootstrap starting.
I20260709 13:05:55.070149 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7bf2a685364a819cfd315e9093161b" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9" is_pre_election: true
I20260709 13:05:55.072227 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b422a66cf84972b1264e123660bdff" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9" is_pre_election: true
I20260709 13:05:55.072889 19149 raft_consensus.cc:2468] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 0.
W20260709 13:05:55.074170 19187 leader_election.cc:343] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.074364 19263 tablet_bootstrap.cc:654] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:55.074543 19040 leader_election.cc:343] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.076092 19040 leader_election.cc:304] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:55.077163 19285 raft_consensus.cc:2804] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.077839 19285 raft_consensus.cc:493] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.078312 19285 raft_consensus.cc:3060] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.081214 19264 ts_tablet_manager.cc:1434] T 386c68f4c9474e8aa44e1036c0fb288c P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent starting tablet: real 0.069s	user 0.010s	sys 0.010s
I20260709 13:05:55.082435 19264 tablet_bootstrap.cc:492] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55: Bootstrap starting.
I20260709 13:05:55.087932 19265 tablet_bootstrap.cc:492] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4: No bootstrap required, opened a new log
I20260709 13:05:55.088781 19265 ts_tablet_manager.cc:1403] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent bootstrapping tablet: real 0.087s	user 0.006s	sys 0.011s
I20260709 13:05:55.093847 19189 leader_election.cc:304] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, fce2ba57741b420f854e3eb33962ddc9; no voters: 361b54b3bc6a4abcb0c82778f04f7ee4
I20260709 13:05:55.095604 19281 raft_consensus.cc:2804] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.096184 19281 raft_consensus.cc:493] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.096625 19281 raft_consensus.cc:3060] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.102994 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7bf2a685364a819cfd315e9093161b" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" is_pre_election: true
I20260709 13:05:55.104755 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b422a66cf84972b1264e123660bdff" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" is_pre_election: true
I20260709 13:05:55.105603 19222 raft_consensus.cc:2468] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 0.
W20260709 13:05:55.106920 19037 leader_election.cc:343] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.107380 19037 leader_election.cc:304] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4; no voters: 0d045c5ca0634c0fa98ac57c40a77d55, fce2ba57741b420f854e3eb33962ddc9
I20260709 13:05:55.108618 19269 raft_consensus.cc:2749] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.110687 19264 tablet_bootstrap.cc:654] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.110765 19265 raft_consensus.cc:359] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.113946 19265 raft_consensus.cc:385] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.114253 19265 raft_consensus.cc:740] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.115226 19265 consensus_queue.cc:260] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.118712 19265 ts_tablet_manager.cc:1434] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.002s
I20260709 13:05:55.119810 19265 tablet_bootstrap.cc:492] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4: Bootstrap starting.
I20260709 13:05:55.122133 19285 raft_consensus.cc:515] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.127882 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b422a66cf84972b1264e123660bdff" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:05:55.128906 19222 raft_consensus.cc:3060] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.125363 19281 raft_consensus.cc:515] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.131295 19074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b422a66cf84972b1264e123660bdff" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" is_pre_election: true
I20260709 13:05:55.131857 19265 tablet_bootstrap.cc:654] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.132175 19074 raft_consensus.cc:2393] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fce2ba57741b420f854e3eb33962ddc9 in current term 1: Already voted for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in this term.
I20260709 13:05:55.132428 19281 leader_election.cc:290] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 election: Requested vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471)
I20260709 13:05:55.126706 19285 leader_election.cc:290] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 election: Requested vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:55.126012 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b422a66cf84972b1264e123660bdff" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:05:55.137151 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ffcd4670984f89b76d55cc8a25153c" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:05:55.137861 19148 raft_consensus.cc:3060] T f9ffcd4670984f89b76d55cc8a25153c P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.138718 19263 tablet_bootstrap.cc:492] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9: No bootstrap required, opened a new log
I20260709 13:05:55.139441 19263 ts_tablet_manager.cc:1403] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9: Time spent bootstrapping tablet: real 0.072s	user 0.023s	sys 0.025s
I20260709 13:05:55.140988 19149 raft_consensus.cc:3060] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.143666 19263 raft_consensus.cc:359] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.144750 19263 raft_consensus.cc:385] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.145648 19074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ffcd4670984f89b76d55cc8a25153c" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
W20260709 13:05:55.147171 19187 leader_election.cc:343] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.150156 19149 raft_consensus.cc:2468] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 1.
I20260709 13:05:55.151615 19040 leader_election.cc:304] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:55.151855 19222 raft_consensus.cc:2468] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 1.
W20260709 13:05:55.151933 19020 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:55.145433 19263 raft_consensus.cc:740] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.152864 19285 raft_consensus.cc:2804] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.156778 19265 tablet_bootstrap.cc:492] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4: No bootstrap required, opened a new log
I20260709 13:05:55.153347 19148 raft_consensus.cc:2468] T f9ffcd4670984f89b76d55cc8a25153c P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 1.
I20260709 13:05:55.158609 19265 ts_tablet_manager.cc:1403] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.020s
I20260709 13:05:55.159175 19285 raft_consensus.cc:697] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Becoming Leader. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Running, Role: LEADER
I20260709 13:05:55.159423 19189 leader_election.cc:304] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, fce2ba57741b420f854e3eb33962ddc9; no voters: 361b54b3bc6a4abcb0c82778f04f7ee4
I20260709 13:05:55.160123 19285 consensus_queue.cc:237] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.160705 19281 raft_consensus.cc:2804] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.158679 19263 consensus_queue.cc:260] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.161283 19281 raft_consensus.cc:697] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Becoming Leader. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Running, Role: LEADER
I20260709 13:05:55.161828 19265 raft_consensus.cc:359] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.162190 19281 consensus_queue.cc:237] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.162627 19265 raft_consensus.cc:385] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.163048 19265 raft_consensus.cc:740] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.163810 19265 consensus_queue.cc:260] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.162662 19263 ts_tablet_manager.cc:1434] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9: Time spent starting tablet: real 0.023s	user 0.013s	sys 0.002s
I20260709 13:05:55.165856 19263 tablet_bootstrap.cc:492] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9: Bootstrap starting.
I20260709 13:05:55.157817 19264 tablet_bootstrap.cc:492] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55: No bootstrap required, opened a new log
I20260709 13:05:55.166663 19264 ts_tablet_manager.cc:1403] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.006s
I20260709 13:05:55.168215 19265 ts_tablet_manager.cc:1434] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 13:05:55.169415 19265 tablet_bootstrap.cc:492] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4: Bootstrap starting.
I20260709 13:05:55.157577 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b422a66cf84972b1264e123660bdff" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" is_pre_election: true
I20260709 13:05:55.171433 19222 raft_consensus.cc:2393] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fce2ba57741b420f854e3eb33962ddc9 in current term 1: Already voted for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in this term.
I20260709 13:05:55.172372 19263 tablet_bootstrap.cc:654] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.174499 19264 raft_consensus.cc:359] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.174953 19112 leader_election.cc:304] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fce2ba57741b420f854e3eb33962ddc9; no voters: 0d045c5ca0634c0fa98ac57c40a77d55, 361b54b3bc6a4abcb0c82778f04f7ee4
I20260709 13:05:55.176613 19270 raft_consensus.cc:2749] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.175369 19264 raft_consensus.cc:385] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.178926 19264 raft_consensus.cc:740] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.179838 19264 consensus_queue.cc:260] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.180756 19265 tablet_bootstrap.cc:654] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.182569 19264 ts_tablet_manager.cc:1434] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.005s
I20260709 13:05:55.183598 18971 catalog_manager.cc:5697] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:55.190717 18972 catalog_manager.cc:5697] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.192477 19265 tablet_bootstrap.cc:492] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4: No bootstrap required, opened a new log
I20260709 13:05:55.193149 19265 ts_tablet_manager.cc:1403] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent bootstrapping tablet: real 0.024s	user 0.020s	sys 0.000s
I20260709 13:05:55.193949 19264 tablet_bootstrap.cc:492] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55: Bootstrap starting.
I20260709 13:05:55.195700 19265 raft_consensus.cc:359] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.196354 19265 raft_consensus.cc:385] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.196604 19265 raft_consensus.cc:740] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.197396 19265 consensus_queue.cc:260] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.199126 19265 ts_tablet_manager.cc:1434] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:55.200182 19265 tablet_bootstrap.cc:492] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4: Bootstrap starting.
I20260709 13:05:55.200786 19263 tablet_bootstrap.cc:492] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9: No bootstrap required, opened a new log
I20260709 13:05:55.201464 19263 ts_tablet_manager.cc:1403] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9: Time spent bootstrapping tablet: real 0.036s	user 0.004s	sys 0.022s
I20260709 13:05:55.204731 19263 raft_consensus.cc:359] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.205574 19263 raft_consensus.cc:385] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.205583 19264 tablet_bootstrap.cc:654] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.205987 19263 raft_consensus.cc:740] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.206979 19263 consensus_queue.cc:260] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.209378 19263 ts_tablet_manager.cc:1434] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:05:55.210497 19263 tablet_bootstrap.cc:492] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9: Bootstrap starting.
I20260709 13:05:55.212267 19265 tablet_bootstrap.cc:654] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.218771 19265 tablet_bootstrap.cc:492] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4: No bootstrap required, opened a new log
I20260709 13:05:55.219444 19265 ts_tablet_manager.cc:1403] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.006s
I20260709 13:05:55.221081 19263 tablet_bootstrap.cc:654] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.223340 19265 raft_consensus.cc:359] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.224174 19265 raft_consensus.cc:385] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.224606 19265 raft_consensus.cc:740] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.225988 19264 tablet_bootstrap.cc:492] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55: No bootstrap required, opened a new log
I20260709 13:05:55.226619 19264 ts_tablet_manager.cc:1403] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.000s
I20260709 13:05:55.225720 19265 consensus_queue.cc:260] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.229285 19265 ts_tablet_manager.cc:1434] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:05:55.230429 19265 tablet_bootstrap.cc:492] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4: Bootstrap starting.
I20260709 13:05:55.230192 19264 raft_consensus.cc:359] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.231124 19264 raft_consensus.cc:385] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.231491 19264 raft_consensus.cc:740] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.232362 19264 consensus_queue.cc:260] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.237598 19264 ts_tablet_manager.cc:1434] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:05:55.237938 19265 tablet_bootstrap.cc:654] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.238837 19264 tablet_bootstrap.cc:492] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55: Bootstrap starting.
I20260709 13:05:55.247821 19264 tablet_bootstrap.cc:654] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.249605 19265 tablet_bootstrap.cc:492] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4: No bootstrap required, opened a new log
I20260709 13:05:55.250248 19265 ts_tablet_manager.cc:1403] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:05:55.254539 19265 raft_consensus.cc:359] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.255728 19265 raft_consensus.cc:385] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.256250 19265 raft_consensus.cc:740] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.257493 19265 consensus_queue.cc:260] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.259944 19265 ts_tablet_manager.cc:1434] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:55.260895 19263 tablet_bootstrap.cc:492] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9: No bootstrap required, opened a new log
I20260709 13:05:55.260972 19265 tablet_bootstrap.cc:492] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4: Bootstrap starting.
I20260709 13:05:55.261668 19263 ts_tablet_manager.cc:1403] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9: Time spent bootstrapping tablet: real 0.051s	user 0.021s	sys 0.024s
I20260709 13:05:55.264941 19263 raft_consensus.cc:359] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.265780 19263 raft_consensus.cc:385] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.266135 19263 raft_consensus.cc:740] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.267397 19263 consensus_queue.cc:260] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.269893 19264 tablet_bootstrap.cc:492] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55: No bootstrap required, opened a new log
I20260709 13:05:55.270080 19265 tablet_bootstrap.cc:654] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.270020 19263 ts_tablet_manager.cc:1434] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:55.271071 19264 ts_tablet_manager.cc:1403] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent bootstrapping tablet: real 0.032s	user 0.004s	sys 0.017s
I20260709 13:05:55.272013 19263 tablet_bootstrap.cc:492] T f2833d7a80874891b0fb741839ed2e7d P fce2ba57741b420f854e3eb33962ddc9: Bootstrap starting.
I20260709 13:05:55.274773 19264 raft_consensus.cc:359] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.275869 19264 raft_consensus.cc:385] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.276266 19264 raft_consensus.cc:740] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.277487 19264 consensus_queue.cc:260] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.279750 19263 tablet_bootstrap.cc:654] T f2833d7a80874891b0fb741839ed2e7d P fce2ba57741b420f854e3eb33962ddc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.291236 19264 ts_tablet_manager.cc:1434] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 13:05:55.292291 19263 tablet_bootstrap.cc:492] T f2833d7a80874891b0fb741839ed2e7d P fce2ba57741b420f854e3eb33962ddc9: No bootstrap required, opened a new log
I20260709 13:05:55.292984 19263 ts_tablet_manager.cc:1403] T f2833d7a80874891b0fb741839ed2e7d P fce2ba57741b420f854e3eb33962ddc9: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:05:55.293851 19264 tablet_bootstrap.cc:492] T fb7203b1470c41e794521ce68a3ce61d P 0d045c5ca0634c0fa98ac57c40a77d55: Bootstrap starting.
I20260709 13:05:55.295064 19265 tablet_bootstrap.cc:492] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4: No bootstrap required, opened a new log
I20260709 13:05:55.295622 19265 ts_tablet_manager.cc:1403] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.015s
I20260709 13:05:55.296378 19263 raft_consensus.cc:359] T f2833d7a80874891b0fb741839ed2e7d P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.297236 19263 raft_consensus.cc:385] T f2833d7a80874891b0fb741839ed2e7d P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.297580 19263 raft_consensus.cc:740] T f2833d7a80874891b0fb741839ed2e7d P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.298478 19265 raft_consensus.cc:359] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.298491 19263 consensus_queue.cc:260] T f2833d7a80874891b0fb741839ed2e7d P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.299324 19265 raft_consensus.cc:385] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.299629 19265 raft_consensus.cc:740] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.300338 19265 consensus_queue.cc:260] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.301019 19264 tablet_bootstrap.cc:654] T fb7203b1470c41e794521ce68a3ce61d P 0d045c5ca0634c0fa98ac57c40a77d55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.302393 19265 ts_tablet_manager.cc:1434] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:05:55.302809 19263 ts_tablet_manager.cc:1434] T f2833d7a80874891b0fb741839ed2e7d P fce2ba57741b420f854e3eb33962ddc9: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:05:55.303412 19265 tablet_bootstrap.cc:492] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4: Bootstrap starting.
I20260709 13:05:55.304100 19263 tablet_bootstrap.cc:492] T d75aeb4a68564b43a09bbbac49d5c25c P fce2ba57741b420f854e3eb33962ddc9: Bootstrap starting.
I20260709 13:05:55.309370 19265 tablet_bootstrap.cc:654] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.313722 19263 tablet_bootstrap.cc:654] T d75aeb4a68564b43a09bbbac49d5c25c P fce2ba57741b420f854e3eb33962ddc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.323686 19285 raft_consensus.cc:493] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.324297 19285 raft_consensus.cc:515] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.331511 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7203b1470c41e794521ce68a3ce61d" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9" is_pre_election: true
I20260709 13:05:55.332423 19148 raft_consensus.cc:2468] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 0.
I20260709 13:05:55.335296 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7203b1470c41e794521ce68a3ce61d" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" is_pre_election: true
W20260709 13:05:55.337365 19037 leader_election.cc:343] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.338107 19285 leader_election.cc:290] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:55.339689 19040 leader_election.cc:304] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 0d045c5ca0634c0fa98ac57c40a77d55
I20260709 13:05:55.345698 19285 raft_consensus.cc:2804] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.346278 19285 raft_consensus.cc:493] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.346756 19285 raft_consensus.cc:3060] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.363595 19285 raft_consensus.cc:515] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.367600 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7203b1470c41e794521ce68a3ce61d" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:05:55.368454 19148 raft_consensus.cc:3060] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.380302 19264 tablet_bootstrap.cc:492] T fb7203b1470c41e794521ce68a3ce61d P 0d045c5ca0634c0fa98ac57c40a77d55: No bootstrap required, opened a new log
I20260709 13:05:55.380815 19265 tablet_bootstrap.cc:492] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4: No bootstrap required, opened a new log
I20260709 13:05:55.380923 19264 ts_tablet_manager.cc:1403] T fb7203b1470c41e794521ce68a3ce61d P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent bootstrapping tablet: real 0.087s	user 0.027s	sys 0.052s
I20260709 13:05:55.381445 19265 ts_tablet_manager.cc:1403] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent bootstrapping tablet: real 0.078s	user 0.043s	sys 0.031s
I20260709 13:05:55.381893 19263 tablet_bootstrap.cc:492] T d75aeb4a68564b43a09bbbac49d5c25c P fce2ba57741b420f854e3eb33962ddc9: No bootstrap required, opened a new log
I20260709 13:05:55.381793 19148 raft_consensus.cc:2468] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 1.
I20260709 13:05:55.382552 19263 ts_tablet_manager.cc:1403] T d75aeb4a68564b43a09bbbac49d5c25c P fce2ba57741b420f854e3eb33962ddc9: Time spent bootstrapping tablet: real 0.079s	user 0.025s	sys 0.051s
I20260709 13:05:55.383277 19040 leader_election.cc:304] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:55.384233 19269 raft_consensus.cc:2804] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.384297 19265 raft_consensus.cc:359] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.385439 19265 raft_consensus.cc:385] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.385743 19265 raft_consensus.cc:740] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.385810 19263 raft_consensus.cc:359] T d75aeb4a68564b43a09bbbac49d5c25c P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.386556 19265 consensus_queue.cc:260] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.386962 19263 raft_consensus.cc:385] T d75aeb4a68564b43a09bbbac49d5c25c P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.387499 19263 raft_consensus.cc:740] T d75aeb4a68564b43a09bbbac49d5c25c P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.384203 19264 raft_consensus.cc:359] T fb7203b1470c41e794521ce68a3ce61d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.388890 19264 raft_consensus.cc:385] T fb7203b1470c41e794521ce68a3ce61d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.389326 19264 raft_consensus.cc:740] T fb7203b1470c41e794521ce68a3ce61d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.388633 19263 consensus_queue.cc:260] T d75aeb4a68564b43a09bbbac49d5c25c P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.390499 19264 consensus_queue.cc:260] T fb7203b1470c41e794521ce68a3ce61d P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.391919 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7203b1470c41e794521ce68a3ce61d" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:05:55.392644 19222 raft_consensus.cc:3060] T fb7203b1470c41e794521ce68a3ce61d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.394945 19264 ts_tablet_manager.cc:1434] T fb7203b1470c41e794521ce68a3ce61d P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:05:55.396486 19264 tablet_bootstrap.cc:492] T f434a1d5fe124b4c939438499baa7d21 P 0d045c5ca0634c0fa98ac57c40a77d55: Bootstrap starting.
I20260709 13:05:55.399075 19263 ts_tablet_manager.cc:1434] T d75aeb4a68564b43a09bbbac49d5c25c P fce2ba57741b420f854e3eb33962ddc9: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:05:55.400297 19222 raft_consensus.cc:2468] T fb7203b1470c41e794521ce68a3ce61d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 1.
I20260709 13:05:55.403961 19281 raft_consensus.cc:493] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.404476 19281 raft_consensus.cc:515] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.407100 19281 leader_election.cc:290] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213)
I20260709 13:05:55.408077 19263 tablet_bootstrap.cc:492] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9: Bootstrap starting.
I20260709 13:05:55.408746 19074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75aeb4a68564b43a09bbbac49d5c25c" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" is_pre_election: true
I20260709 13:05:55.409463 19074 raft_consensus.cc:2468] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 0.
I20260709 13:05:55.411356 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75aeb4a68564b43a09bbbac49d5c25c" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9" is_pre_election: true
I20260709 13:05:55.412142 19149 raft_consensus.cc:2468] T d75aeb4a68564b43a09bbbac49d5c25c P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 0.
I20260709 13:05:55.413780 19189 leader_election.cc:304] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:55.415309 19281 raft_consensus.cc:2804] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.415673 19281 raft_consensus.cc:493] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.415978 19281 raft_consensus.cc:3060] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.416848 19263 tablet_bootstrap.cc:654] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.421875 19264 tablet_bootstrap.cc:654] T f434a1d5fe124b4c939438499baa7d21 P 0d045c5ca0634c0fa98ac57c40a77d55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.431483 19281 raft_consensus.cc:515] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.429193 19285 leader_election.cc:290] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 election: Requested vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:55.435997 19309 raft_consensus.cc:493] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.436621 19309 raft_consensus.cc:515] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.440544 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f434a1d5fe124b4c939438499baa7d21" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9" is_pre_election: true
I20260709 13:05:55.441315 19148 raft_consensus.cc:2468] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 0.
I20260709 13:05:55.442801 19040 leader_election.cc:304] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:55.443966 19312 raft_consensus.cc:2804] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.444199 19269 raft_consensus.cc:697] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Becoming Leader. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Running, Role: LEADER
I20260709 13:05:55.444432 19312 raft_consensus.cc:493] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.444919 19312 raft_consensus.cc:3060] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.445282 19269 consensus_queue.cc:237] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.450644 19074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75aeb4a68564b43a09bbbac49d5c25c" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
I20260709 13:05:55.451371 19074 raft_consensus.cc:3060] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.452158 19271 raft_consensus.cc:493] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.452934 19270 raft_consensus.cc:493] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.452852 19271 raft_consensus.cc:515] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.453497 19270 raft_consensus.cc:515] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.455768 19270 leader_election.cc:290] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:55.457731 19073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386c68f4c9474e8aa44e1036c0fb288c" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" is_pre_election: true
I20260709 13:05:55.458462 19073 raft_consensus.cc:2468] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 0.
I20260709 13:05:55.459685 19074 raft_consensus.cc:2468] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 1.
I20260709 13:05:55.460376 19113 leader_election.cc:304] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:55.460610 19073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7bf2a685364a819cfd315e9093161b" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" is_pre_election: true
I20260709 13:05:55.460919 19187 leader_election.cc:304] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, 361b54b3bc6a4abcb0c82778f04f7ee4; no voters: 
I20260709 13:05:55.461668 19073 raft_consensus.cc:2468] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 0.
I20260709 13:05:55.461973 19270 raft_consensus.cc:2804] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.462419 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386c68f4c9474e8aa44e1036c0fb288c" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" is_pre_election: true
I20260709 13:05:55.462590 19270 raft_consensus.cc:493] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.462741 19271 leader_election.cc:290] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213)
I20260709 13:05:55.463162 19222 raft_consensus.cc:2468] T 386c68f4c9474e8aa44e1036c0fb288c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 0.
I20260709 13:05:55.463232 19270 raft_consensus.cc:3060] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.463661 19271 raft_consensus.cc:2804] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.464304 19271 raft_consensus.cc:697] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Becoming Leader. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Running, Role: LEADER
I20260709 13:05:55.465299 19285 raft_consensus.cc:493] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.465852 19285 raft_consensus.cc:515] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.465440 19271 consensus_queue.cc:237] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.469135 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7bf2a685364a819cfd315e9093161b" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9" is_pre_election: true
I20260709 13:05:55.469206 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a120f7c7df9457ea291625082cb28f7" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9" is_pre_election: true
I20260709 13:05:55.470046 19148 raft_consensus.cc:2468] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 0.
W20260709 13:05:55.470942 19040 leader_election.cc:343] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.470995 19264 tablet_bootstrap.cc:492] T f434a1d5fe124b4c939438499baa7d21 P 0d045c5ca0634c0fa98ac57c40a77d55: No bootstrap required, opened a new log
I20260709 13:05:55.473928 19264 ts_tablet_manager.cc:1403] T f434a1d5fe124b4c939438499baa7d21 P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent bootstrapping tablet: real 0.078s	user 0.022s	sys 0.011s
I20260709 13:05:55.474439 19189 leader_election.cc:304] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:55.485240 19281 leader_election.cc:290] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 election: Requested vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213)
I20260709 13:05:55.485954 19281 raft_consensus.cc:2804] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.486380 19281 raft_consensus.cc:493] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.486704 19281 raft_consensus.cc:3060] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.489233 19264 raft_consensus.cc:359] T f434a1d5fe124b4c939438499baa7d21 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.490006 19264 raft_consensus.cc:385] T f434a1d5fe124b4c939438499baa7d21 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.490294 19264 raft_consensus.cc:740] T f434a1d5fe124b4c939438499baa7d21 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.490993 19264 consensus_queue.cc:260] T f434a1d5fe124b4c939438499baa7d21 P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.491947 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a120f7c7df9457ea291625082cb28f7" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" is_pre_election: true
I20260709 13:05:55.492857 19222 raft_consensus.cc:2468] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 0.
I20260709 13:05:55.493036 19264 ts_tablet_manager.cc:1434] T f434a1d5fe124b4c939438499baa7d21 P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:05:55.498399 19264 tablet_bootstrap.cc:492] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55: Bootstrap starting.
I20260709 13:05:55.497661 18971 catalog_manager.cc:5697] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:55.498709 19265 ts_tablet_manager.cc:1434] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent starting tablet: real 0.117s	user 0.055s	sys 0.058s
I20260709 13:05:55.494397 19037 leader_election.cc:304] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, 361b54b3bc6a4abcb0c82778f04f7ee4; no voters: fce2ba57741b420f854e3eb33962ddc9
I20260709 13:05:55.502090 19269 raft_consensus.cc:2804] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.496248 19309 leader_election.cc:290] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:55.493252 19285 leader_election.cc:290] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:55.494860 18972 catalog_manager.cc:5697] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.502482 19269 raft_consensus.cc:493] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.504438 19269 raft_consensus.cc:3060] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.504365 19281 raft_consensus.cc:515] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.495028 19271 raft_consensus.cc:493] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.505679 19271 raft_consensus.cc:515] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.507009 19281 leader_election.cc:290] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 election: Requested vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213)
I20260709 13:05:55.507733 19271 leader_election.cc:290] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213)
I20260709 13:05:55.501030 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75aeb4a68564b43a09bbbac49d5c25c" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:05:55.509790 19148 raft_consensus.cc:3060] T d75aeb4a68564b43a09bbbac49d5c25c P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.511077 19074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7bf2a685364a819cfd315e9093161b" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
I20260709 13:05:55.511997 19074 raft_consensus.cc:3060] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.514711 19073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a120f7c7df9457ea291625082cb28f7" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" is_pre_election: true
I20260709 13:05:55.517882 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7bf2a685364a819cfd315e9093161b" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:05:55.518653 19149 raft_consensus.cc:3060] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.523648 19270 raft_consensus.cc:515] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.518466 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a120f7c7df9457ea291625082cb28f7" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9" is_pre_election: true
I20260709 13:05:55.526847 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386c68f4c9474e8aa44e1036c0fb288c" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
I20260709 13:05:55.518101 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f434a1d5fe124b4c939438499baa7d21" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" is_pre_election: true
I20260709 13:05:55.527433 19263 tablet_bootstrap.cc:492] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9: No bootstrap required, opened a new log
I20260709 13:05:55.527563 19072 raft_consensus.cc:3060] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.527840 19222 raft_consensus.cc:2468] T f434a1d5fe124b4c939438499baa7d21 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 0.
W20260709 13:05:55.528236 19189 leader_election.cc:343] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.527922 19149 raft_consensus.cc:2468] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 1.
I20260709 13:05:55.530668 19312 raft_consensus.cc:515] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.533206 19269 raft_consensus.cc:515] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.534497 19073 raft_consensus.cc:2393] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d045c5ca0634c0fa98ac57c40a77d55 in current term 1: Already voted for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in this term.
I20260709 13:05:55.534806 19264 tablet_bootstrap.cc:654] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.535315 19072 raft_consensus.cc:2468] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 1.
I20260709 13:05:55.530877 19189 leader_election.cc:304] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:55.528048 19263 ts_tablet_manager.cc:1403] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9: Time spent bootstrapping tablet: real 0.120s	user 0.017s	sys 0.015s
I20260709 13:05:55.536653 19113 leader_election.cc:304] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:55.537590 19187 leader_election.cc:304] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55; no voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9
I20260709 13:05:55.537838 19315 raft_consensus.cc:2804] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.538774 19269 leader_election.cc:290] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 election: Requested vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:55.538925 19271 raft_consensus.cc:3060] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.540608 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a120f7c7df9457ea291625082cb28f7" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:05:55.541218 19315 raft_consensus.cc:697] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Becoming Leader. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Running, Role: LEADER
I20260709 13:05:55.542418 19074 raft_consensus.cc:2468] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 1.
I20260709 13:05:55.542398 19315 consensus_queue.cc:237] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.549912 19263 raft_consensus.cc:359] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.555171 19263 raft_consensus.cc:385] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.555527 19263 raft_consensus.cc:740] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.550509 19318 raft_consensus.cc:2804] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:05:55.550518 19040 leader_election.cc:343] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.556130 19148 raft_consensus.cc:2468] T d75aeb4a68564b43a09bbbac49d5c25c P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 1.
I20260709 13:05:55.551074 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a120f7c7df9457ea291625082cb28f7" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:05:55.551921 19270 leader_election.cc:290] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 1 election: Requested vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:55.553058 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386c68f4c9474e8aa44e1036c0fb288c" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:05:55.557770 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f434a1d5fe124b4c939438499baa7d21" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:05:55.558027 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f434a1d5fe124b4c939438499baa7d21" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:05:55.554435 19271 raft_consensus.cc:2749] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.558540 19148 raft_consensus.cc:3060] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.558949 19221 raft_consensus.cc:3060] T f434a1d5fe124b4c939438499baa7d21 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.558379 19223 raft_consensus.cc:3060] T 386c68f4c9474e8aa44e1036c0fb288c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.565661 19269 raft_consensus.cc:493] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.566254 19269 raft_consensus.cc:515] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.569234 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ffcd4670984f89b76d55cc8a25153c" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9" is_pre_election: true
I20260709 13:05:55.570396 19221 raft_consensus.cc:2468] T f434a1d5fe124b4c939438499baa7d21 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 1.
I20260709 13:05:55.567854 18971 catalog_manager.cc:5697] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:55.554652 19264 tablet_bootstrap.cc:492] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55: No bootstrap required, opened a new log
I20260709 13:05:55.568473 19269 leader_election.cc:290] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:55.570708 19147 raft_consensus.cc:2393] T f9ffcd4670984f89b76d55cc8a25153c P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in current term 1: Already voted for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in this term.
I20260709 13:05:55.571072 19315 consensus_queue.cc:1048] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.571722 19148 raft_consensus.cc:2468] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 1.
I20260709 13:05:55.571346 19264 ts_tablet_manager.cc:1403] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.003s
I20260709 13:05:55.575310 19223 raft_consensus.cc:2468] T 386c68f4c9474e8aa44e1036c0fb288c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 1.
I20260709 13:05:55.572629 19037 leader_election.cc:304] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, 361b54b3bc6a4abcb0c82778f04f7ee4; no voters: 
I20260709 13:05:55.577203 19264 raft_consensus.cc:359] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.577922 19264 raft_consensus.cc:385] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.578222 19264 raft_consensus.cc:740] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.580173 19264 consensus_queue.cc:260] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.580809 19269 raft_consensus.cc:2804] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.581502 19269 raft_consensus.cc:697] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Becoming Leader. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Running, Role: LEADER
I20260709 13:05:55.581888 19318 raft_consensus.cc:697] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [term 1 LEADER]: Becoming Leader. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Running, Role: LEADER
I20260709 13:05:55.580862 19222 raft_consensus.cc:2468] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 1.
I20260709 13:05:55.582858 19318 consensus_queue.cc:237] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.582724 19269 consensus_queue.cc:237] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.573143 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ffcd4670984f89b76d55cc8a25153c" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" is_pre_election: true
I20260709 13:05:55.553668 19312 leader_election.cc:290] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 election: Requested vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:55.587322 19264 ts_tablet_manager.cc:1434] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:55.587082 19263 consensus_queue.cc:260] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.587494 19037 leader_election.cc:304] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, 361b54b3bc6a4abcb0c82778f04f7ee4; no voters: fce2ba57741b420f854e3eb33962ddc9
I20260709 13:05:55.588397 19312 raft_consensus.cc:2804] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.588994 19312 raft_consensus.cc:697] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Becoming Leader. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Running, Role: LEADER
I20260709 13:05:55.589641 19263 ts_tablet_manager.cc:1434] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.003s
I20260709 13:05:55.589673 19037 leader_election.cc:304] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4; no voters: 0d045c5ca0634c0fa98ac57c40a77d55, fce2ba57741b420f854e3eb33962ddc9
I20260709 13:05:55.589908 19312 consensus_queue.cc:237] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.591265 19310 raft_consensus.cc:3060] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.601307 19310 raft_consensus.cc:2749] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.602483 18972 catalog_manager.cc:5697] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "fce2ba57741b420f854e3eb33962ddc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.611501 19310 consensus_queue.cc:1048] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:05:55.619884 19310 raft_consensus.cc:493] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.618444 18968 catalog_manager.cc:5697] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.620309 19310 raft_consensus.cc:515] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.623207 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2833d7a80874891b0fb741839ed2e7d" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9" is_pre_election: true
I20260709 13:05:55.623906 19148 raft_consensus.cc:2468] T f2833d7a80874891b0fb741839ed2e7d P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 0.
I20260709 13:05:55.625520 19040 leader_election.cc:304] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:55.626739 19269 raft_consensus.cc:2804] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.627205 19269 raft_consensus.cc:493] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.627743 19269 raft_consensus.cc:3060] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.632836 19315 consensus_queue.cc:1048] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.636902 19269 raft_consensus.cc:515] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.640067 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2833d7a80874891b0fb741839ed2e7d" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:05:55.640700 19148 raft_consensus.cc:3060] T f2833d7a80874891b0fb741839ed2e7d P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.650856 19285 consensus_queue.cc:1048] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.661072 19148 raft_consensus.cc:2468] T f2833d7a80874891b0fb741839ed2e7d P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 1.
I20260709 13:05:55.665715 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2833d7a80874891b0fb741839ed2e7d" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" is_pre_election: true
I20260709 13:05:55.666465 19222 raft_consensus.cc:2468] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 0.
I20260709 13:05:55.666932 19040 leader_election.cc:304] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:55.667871 19310 leader_election.cc:290] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:55.669032 19310 raft_consensus.cc:2804] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.671048 19321 raft_consensus.cc:493] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.671774 19321 raft_consensus.cc:515] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.679538 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a120f7c7df9457ea291625082cb28f7" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" is_pre_election: true
I20260709 13:05:55.680711 18971 catalog_manager.cc:5697] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.683332 19321 leader_election.cc:290] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:55.683182 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a120f7c7df9457ea291625082cb28f7" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" is_pre_election: true
I20260709 13:05:55.695297 19223 raft_consensus.cc:2393] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fce2ba57741b420f854e3eb33962ddc9 in current term 1: Already voted for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in this term.
I20260709 13:05:55.678365 19269 leader_election.cc:290] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 election: Requested vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:55.697862 19113 leader_election.cc:304] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fce2ba57741b420f854e3eb33962ddc9; no voters: 0d045c5ca0634c0fa98ac57c40a77d55, 361b54b3bc6a4abcb0c82778f04f7ee4
I20260709 13:05:55.700186 19321 raft_consensus.cc:3060] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.679538 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2833d7a80874891b0fb741839ed2e7d" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:05:55.705260 19222 raft_consensus.cc:3060] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.690621 19310 raft_consensus.cc:697] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Becoming Leader. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Running, Role: LEADER
I20260709 13:05:55.708086 19310 consensus_queue.cc:237] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.711470 19321 raft_consensus.cc:2749] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.716523 19222 raft_consensus.cc:2468] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 1.
I20260709 13:05:55.721673 18968 catalog_manager.cc:5697] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.792284 19222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9ffcd4670984f89b76d55cc8a25153c"
dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
mode: GRACEFUL
new_leader_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
 from {username='slave'} at 127.0.0.1:60984
I20260709 13:05:55.792862 19222 raft_consensus.cc:606] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Received request to transfer leadership to TS 361b54b3bc6a4abcb0c82778f04f7ee4
I20260709 13:05:55.806501 19149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "386c68f4c9474e8aa44e1036c0fb288c"
dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
mode: GRACEFUL
new_leader_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
 from {username='slave'} at 127.0.0.1:46954
I20260709 13:05:55.807123 19149 raft_consensus.cc:606] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [term 1 LEADER]: Received request to transfer leadership to TS 361b54b3bc6a4abcb0c82778f04f7ee4
I20260709 13:05:55.812940 19222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d75aeb4a68564b43a09bbbac49d5c25c"
dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
mode: GRACEFUL
new_leader_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
 from {username='slave'} at 127.0.0.1:60984
I20260709 13:05:55.813725 19222 raft_consensus.cc:606] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Received request to transfer leadership to TS 361b54b3bc6a4abcb0c82778f04f7ee4
I20260709 13:05:55.830365 19072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a120f7c7df9457ea291625082cb28f7"
dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
mode: GRACEFUL
new_leader_uuid: "fce2ba57741b420f854e3eb33962ddc9"
 from {username='slave'} at 127.0.0.1:58482
I20260709 13:05:55.830883 19072 raft_consensus.cc:606] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Received request to transfer leadership to TS fce2ba57741b420f854e3eb33962ddc9
I20260709 13:05:55.836624 19222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a7bf2a685364a819cfd315e9093161b"
dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
mode: GRACEFUL
new_leader_uuid: "fce2ba57741b420f854e3eb33962ddc9"
 from {username='slave'} at 127.0.0.1:60984
I20260709 13:05:55.837278 19222 raft_consensus.cc:606] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Received request to transfer leadership to TS fce2ba57741b420f854e3eb33962ddc9
I20260709 13:05:55.842650 19072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f434a1d5fe124b4c939438499baa7d21"
dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
mode: GRACEFUL
new_leader_uuid: "fce2ba57741b420f854e3eb33962ddc9"
 from {username='slave'} at 127.0.0.1:58482
I20260709 13:05:55.843175 19072 raft_consensus.cc:606] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Received request to transfer leadership to TS fce2ba57741b420f854e3eb33962ddc9
I20260709 13:05:55.848165 19072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb7203b1470c41e794521ce68a3ce61d"
dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
mode: GRACEFUL
new_leader_uuid: "fce2ba57741b420f854e3eb33962ddc9"
 from {username='slave'} at 127.0.0.1:58482
I20260709 13:05:55.848728 19072 raft_consensus.cc:606] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Received request to transfer leadership to TS fce2ba57741b420f854e3eb33962ddc9
I20260709 13:05:55.853847 19072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2833d7a80874891b0fb741839ed2e7d"
dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
mode: GRACEFUL
new_leader_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
 from {username='slave'} at 127.0.0.1:58482
I20260709 13:05:55.854508 19072 raft_consensus.cc:606] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Received request to transfer leadership to TS 0d045c5ca0634c0fa98ac57c40a77d55
I20260709 13:05:55.857282 19271 consensus_queue.cc:1048] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.863962 19315 raft_consensus.cc:993] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55: : Instructing follower 361b54b3bc6a4abcb0c82778f04f7ee4 to start an election
I20260709 13:05:55.864612 19317 raft_consensus.cc:1081] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Signalling peer 361b54b3bc6a4abcb0c82778f04f7ee4 to start an election
I20260709 13:05:55.866911 19074 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d75aeb4a68564b43a09bbbac49d5c25c"
dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
 from {username='slave'} at 127.0.0.1:58462
I20260709 13:05:55.867592 19074 raft_consensus.cc:493] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:55.868012 19074 raft_consensus.cc:3060] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:55.872385 19317 consensus_queue.cc:1048] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.874948 19074 raft_consensus.cc:515] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.879392 19074 leader_election.cc:290] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 2 election: Requested vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:55.879858 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75aeb4a68564b43a09bbbac49d5c25c" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:05:55.881171 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75aeb4a68564b43a09bbbac49d5c25c" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:05:55.882368 19222 raft_consensus.cc:3055] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:55.882727 19222 raft_consensus.cc:740] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Running, Role: LEADER
I20260709 13:05:55.883554 19222 consensus_queue.cc:260] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.884918 19222 raft_consensus.cc:3060] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:55.892251 19222 raft_consensus.cc:2468] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 2.
I20260709 13:05:55.893384 19037 leader_election.cc:304] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, 361b54b3bc6a4abcb0c82778f04f7ee4; no voters: fce2ba57741b420f854e3eb33962ddc9
I20260709 13:05:55.894212 19310 raft_consensus.cc:2804] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:55.894642 19310 raft_consensus.cc:697] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 LEADER]: Becoming Leader. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Running, Role: LEADER
I20260709 13:05:55.895452 19310 consensus_queue.cc:237] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:55.901686 18971 catalog_manager.cc:5697] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4 reported cstate change: term changed from 1 to 2, leader changed from 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195) to 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.983178 19310 consensus_queue.cc:1048] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.985388 19310 consensus_queue.cc:1048] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.990988 19312 raft_consensus.cc:993] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4: : Instructing follower fce2ba57741b420f854e3eb33962ddc9 to start an election
I20260709 13:05:55.991469 19312 raft_consensus.cc:1081] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Signalling peer fce2ba57741b420f854e3eb33962ddc9 to start an election
I20260709 13:05:55.993376 19147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb7203b1470c41e794521ce68a3ce61d"
dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
 from {username='slave'} at 127.0.0.1:46950
I20260709 13:05:55.993964 19147 raft_consensus.cc:493] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:55.994344 19147 raft_consensus.cc:3060] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.002058 19285 consensus_queue.cc:1048] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.003126 19147 raft_consensus.cc:515] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.004328 19149 raft_consensus.cc:1240] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Rejecting Update request from peer 361b54b3bc6a4abcb0c82778f04f7ee4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:56.006799 19269 consensus_queue.cc:1048] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.008281 19269 consensus_queue.cc:1059] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.008798 19147 leader_election.cc:290] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 2 election: Requested vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:56.009582 19285 raft_consensus.cc:3055] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:56.010022 19285 raft_consensus.cc:740] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Running, Role: LEADER
I20260709 13:05:56.010300 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7203b1470c41e794521ce68a3ce61d" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:05:56.010905 19285 consensus_queue.cc:260] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.012531 19285 raft_consensus.cc:3060] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.018250 19074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7203b1470c41e794521ce68a3ce61d" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
I20260709 13:05:56.022985 19269 raft_consensus.cc:993] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4: : Instructing follower fce2ba57741b420f854e3eb33962ddc9 to start an election
I20260709 13:05:56.023579 19269 raft_consensus.cc:1081] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Signalling peer fce2ba57741b420f854e3eb33962ddc9 to start an election
I20260709 13:05:56.028725 19317 consensus_queue.cc:1048] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.029603 19147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f434a1d5fe124b4c939438499baa7d21"
dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
 from {username='slave'} at 127.0.0.1:46950
I20260709 13:05:56.030328 19147 raft_consensus.cc:493] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.030756 19147 raft_consensus.cc:3060] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.031078 19321 consensus_queue.cc:1048] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.039788 19317 consensus_queue.cc:1048] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.041565 19147 raft_consensus.cc:515] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.043848 19147 leader_election.cc:290] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 2 election: Requested vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:56.045913 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f434a1d5fe124b4c939438499baa7d21" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:05:56.046507 19221 raft_consensus.cc:3060] T f434a1d5fe124b4c939438499baa7d21 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.049860 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f434a1d5fe124b4c939438499baa7d21" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
I20260709 13:05:56.050603 19072 raft_consensus.cc:3055] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:56.051029 19072 raft_consensus.cc:740] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Running, Role: LEADER
I20260709 13:05:56.051975 19072 consensus_queue.cc:260] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.053373 19072 raft_consensus.cc:3060] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.033310 19074 raft_consensus.cc:2468] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 2.
I20260709 13:05:56.054683 19221 raft_consensus.cc:2468] T f434a1d5fe124b4c939438499baa7d21 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 2.
I20260709 13:05:56.055962 19112 leader_election.cc:304] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:56.061347 19113 leader_election.cc:304] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 0d045c5ca0634c0fa98ac57c40a77d55
I20260709 13:05:56.063102 19318 raft_consensus.cc:2804] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:56.057639 19321 raft_consensus.cc:2804] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:56.063809 19318 raft_consensus.cc:697] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 [term 2 LEADER]: Becoming Leader. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Running, Role: LEADER
I20260709 13:05:56.064682 19318 consensus_queue.cc:237] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.065424 19317 raft_consensus.cc:993] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55: : Instructing follower fce2ba57741b420f854e3eb33962ddc9 to start an election
I20260709 13:05:56.065905 19317 raft_consensus.cc:1081] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Signalling peer fce2ba57741b420f854e3eb33962ddc9 to start an election
I20260709 13:05:56.069692 19148 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a7bf2a685364a819cfd315e9093161b"
dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
 from {username='slave'} at 127.0.0.1:46944
I20260709 13:05:56.071218 19148 raft_consensus.cc:493] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.071794 19148 raft_consensus.cc:3060] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.076597 19072 raft_consensus.cc:2468] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 2.
I20260709 13:05:56.081693 19148 raft_consensus.cc:515] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.088083 19074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7bf2a685364a819cfd315e9093161b" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
I20260709 13:05:56.088788 19074 raft_consensus.cc:3060] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.091173 19148 leader_election.cc:290] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 2 election: Requested vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:56.092232 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7bf2a685364a819cfd315e9093161b" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:05:56.092904 19222 raft_consensus.cc:3055] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:56.092868 19347 consensus_queue.cc:1048] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.093497 19222 raft_consensus.cc:740] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Running, Role: LEADER
I20260709 13:05:56.094373 19222 consensus_queue.cc:260] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.095746 19222 raft_consensus.cc:3060] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.096719 19074 raft_consensus.cc:2468] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 2.
I20260709 13:05:56.098129 19113 leader_election.cc:304] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:56.099011 19347 raft_consensus.cc:2804] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:56.099686 19347 raft_consensus.cc:697] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9 [term 2 LEADER]: Becoming Leader. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Running, Role: LEADER
I20260709 13:05:56.100508 19347 consensus_queue.cc:237] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.103456 19321 raft_consensus.cc:697] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9 [term 2 LEADER]: Becoming Leader. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Running, Role: LEADER
I20260709 13:05:56.104372 19321 consensus_queue.cc:237] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.106609 19222 raft_consensus.cc:2468] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 2.
I20260709 13:05:56.109133 19309 consensus_queue.cc:1048] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.114099 19347 raft_consensus.cc:993] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9: : Instructing follower 361b54b3bc6a4abcb0c82778f04f7ee4 to start an election
I20260709 13:05:56.114705 19347 raft_consensus.cc:1081] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [term 1 LEADER]: Signalling peer 361b54b3bc6a4abcb0c82778f04f7ee4 to start an election
I20260709 13:05:56.118125 18968 catalog_manager.cc:5697] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9 reported cstate change: term changed from 1 to 2, leader changed from 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195) to fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "fce2ba57741b420f854e3eb33962ddc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.119990 19072 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "386c68f4c9474e8aa44e1036c0fb288c"
dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
 from {username='slave'} at 127.0.0.1:58476
I20260709 13:05:56.120656 19072 raft_consensus.cc:493] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.121410 19072 raft_consensus.cc:3060] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.120582 18968 catalog_manager.cc:5697] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9 reported cstate change: term changed from 1 to 2, leader changed from 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193) to fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "fce2ba57741b420f854e3eb33962ddc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.126724 19285 raft_consensus.cc:993] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4: : Instructing follower fce2ba57741b420f854e3eb33962ddc9 to start an election
I20260709 13:05:56.127401 19285 raft_consensus.cc:1081] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Signalling peer fce2ba57741b420f854e3eb33962ddc9 to start an election
I20260709 13:05:56.126798 18968 catalog_manager.cc:5697] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 reported cstate change: term changed from 1 to 2, leader changed from 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193) to fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "fce2ba57741b420f854e3eb33962ddc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.129654 19148 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a120f7c7df9457ea291625082cb28f7"
dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
 from {username='slave'} at 127.0.0.1:46950
I20260709 13:05:56.130250 19148 raft_consensus.cc:493] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.130645 19148 raft_consensus.cc:3060] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.130852 19072 raft_consensus.cc:515] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.133648 19072 leader_election.cc:290] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 2 election: Requested vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:56.133914 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386c68f4c9474e8aa44e1036c0fb288c" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:05:56.134567 19149 raft_consensus.cc:3055] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:56.134896 19149 raft_consensus.cc:740] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Running, Role: LEADER
I20260709 13:05:56.139602 19309 consensus_queue.cc:1048] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.142041 19148 raft_consensus.cc:515] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.144397 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386c68f4c9474e8aa44e1036c0fb288c" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:05:56.145119 19221 raft_consensus.cc:3060] T 386c68f4c9474e8aa44e1036c0fb288c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.146766 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a120f7c7df9457ea291625082cb28f7" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
I20260709 13:05:56.147401 19072 raft_consensus.cc:3055] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:56.147994 19072 raft_consensus.cc:740] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Running, Role: LEADER
I20260709 13:05:56.148792 19072 consensus_queue.cc:260] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.149224 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a120f7c7df9457ea291625082cb28f7" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:05:56.149755 19072 raft_consensus.cc:3060] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.151662 19148 leader_election.cc:290] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 2 election: Requested vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:56.153765 19149 consensus_queue.cc:260] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.155288 19149 raft_consensus.cc:3060] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.159418 19072 raft_consensus.cc:2468] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 2.
I20260709 13:05:56.160941 19113 leader_election.cc:304] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 0d045c5ca0634c0fa98ac57c40a77d55
I20260709 13:05:56.162196 19321 raft_consensus.cc:2804] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:56.162703 19321 raft_consensus.cc:697] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 2 LEADER]: Becoming Leader. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Running, Role: LEADER
I20260709 13:05:56.163501 19321 consensus_queue.cc:237] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.163854 19149 raft_consensus.cc:2468] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 2.
I20260709 13:05:56.155287 19221 raft_consensus.cc:2468] T 386c68f4c9474e8aa44e1036c0fb288c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 2.
I20260709 13:05:56.166779 19040 leader_election.cc:304] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:56.167799 19309 raft_consensus.cc:2804] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:56.168504 19309 raft_consensus.cc:697] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 LEADER]: Becoming Leader. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Running, Role: LEADER
I20260709 13:05:56.169400 19309 consensus_queue.cc:237] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.180588 19269 consensus_queue.cc:1048] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.182914 18971 catalog_manager.cc:5697] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 reported cstate change: term changed from 1 to 2, leader changed from 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193) to fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "fce2ba57741b420f854e3eb33962ddc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.191478 19285 raft_consensus.cc:993] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4: : Instructing follower 0d045c5ca0634c0fa98ac57c40a77d55 to start an election
I20260709 13:05:56.192072 19285 raft_consensus.cc:1081] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Signalling peer 0d045c5ca0634c0fa98ac57c40a77d55 to start an election
I20260709 13:05:56.195367 19222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2833d7a80874891b0fb741839ed2e7d"
dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
 from {username='slave'} at 127.0.0.1:60966
I20260709 13:05:56.195967 19222 raft_consensus.cc:493] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.196401 19222 raft_consensus.cc:3060] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.197907 18968 catalog_manager.cc:5697] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4 reported cstate change: term changed from 1 to 2, leader changed from fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194) to 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.203359 19269 consensus_queue.cc:1048] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.203763 19222 raft_consensus.cc:515] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.206415 19222 leader_election.cc:290] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 2 election: Requested vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213)
I20260709 13:05:56.206789 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2833d7a80874891b0fb741839ed2e7d" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
I20260709 13:05:56.207553 19072 raft_consensus.cc:3055] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:56.208030 19072 raft_consensus.cc:740] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Running, Role: LEADER
I20260709 13:05:56.208992 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2833d7a80874891b0fb741839ed2e7d" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:05:56.209128 19072 consensus_queue.cc:260] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.210551 19072 raft_consensus.cc:3060] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.217475 19072 raft_consensus.cc:2468] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 2.
I20260709 13:05:56.218725 19187 leader_election.cc:304] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, 361b54b3bc6a4abcb0c82778f04f7ee4; no voters: fce2ba57741b420f854e3eb33962ddc9
I20260709 13:05:56.219604 19281 raft_consensus.cc:2804] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:56.220109 19281 raft_consensus.cc:697] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 LEADER]: Becoming Leader. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Running, Role: LEADER
I20260709 13:05:56.220866 19281 consensus_queue.cc:237] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.228261 18968 catalog_manager.cc:5697] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 reported cstate change: term changed from 1 to 2, leader changed from 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193) to 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195). New cstate: current_term: 2 leader_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:56.235275 19315 raft_consensus.cc:993] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55: : Instructing follower 361b54b3bc6a4abcb0c82778f04f7ee4 to start an election
I20260709 13:05:56.235863 19315 raft_consensus.cc:1081] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Signalling peer 361b54b3bc6a4abcb0c82778f04f7ee4 to start an election
I20260709 13:05:56.237677 19072 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9ffcd4670984f89b76d55cc8a25153c"
dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
 from {username='slave'} at 127.0.0.1:58462
I20260709 13:05:56.238212 19072 raft_consensus.cc:493] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.238536 19072 raft_consensus.cc:3060] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.244083 19072 raft_consensus.cc:515] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.245973 19072 leader_election.cc:290] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 2 election: Requested vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:56.246812 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ffcd4670984f89b76d55cc8a25153c" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:05:56.247035 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ffcd4670984f89b76d55cc8a25153c" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:05:56.247546 19149 raft_consensus.cc:3060] T f9ffcd4670984f89b76d55cc8a25153c P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.247573 19222 raft_consensus.cc:3055] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:56.248096 19222 raft_consensus.cc:740] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Running, Role: LEADER
I20260709 13:05:56.248965 19222 consensus_queue.cc:260] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.250228 19222 raft_consensus.cc:3060] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.255342 19149 raft_consensus.cc:2468] T f9ffcd4670984f89b76d55cc8a25153c P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 2.
I20260709 13:05:56.256633 19040 leader_election.cc:304] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:56.257426 19269 raft_consensus.cc:2804] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:56.257623 19222 raft_consensus.cc:2468] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 2.
I20260709 13:05:56.257949 19269 raft_consensus.cc:697] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 LEADER]: Becoming Leader. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Running, Role: LEADER
I20260709 13:05:56.258859 19269 consensus_queue.cc:237] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:56.265698 18968 catalog_manager.cc:5697] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 reported cstate change: term changed from 1 to 2, leader changed from 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195) to 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.334792 19149 raft_consensus.cc:3060] T d75aeb4a68564b43a09bbbac49d5c25c P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.340011 19149 raft_consensus.cc:1275] T d75aeb4a68564b43a09bbbac49d5c25c P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Refusing update from remote peer 361b54b3bc6a4abcb0c82778f04f7ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.341624 19269 consensus_queue.cc:1048] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.349362 19222 raft_consensus.cc:1275] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Refusing update from remote peer 361b54b3bc6a4abcb0c82778f04f7ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.350835 19309 consensus_queue.cc:1048] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.478940 19072 raft_consensus.cc:1275] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Refusing update from remote peer fce2ba57741b420f854e3eb33962ddc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.480428 19321 consensus_queue.cc:1048] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.489171 19222 raft_consensus.cc:3060] T fb7203b1470c41e794521ce68a3ce61d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.495921 19222 raft_consensus.cc:1275] T fb7203b1470c41e794521ce68a3ce61d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Refusing update from remote peer fce2ba57741b420f854e3eb33962ddc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.497290 19321 consensus_queue.cc:1048] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.519946 19222 raft_consensus.cc:1275] T f434a1d5fe124b4c939438499baa7d21 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Refusing update from remote peer fce2ba57741b420f854e3eb33962ddc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.521252 19321 consensus_queue.cc:1048] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.528846 19072 raft_consensus.cc:1275] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Refusing update from remote peer fce2ba57741b420f854e3eb33962ddc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.530529 19318 consensus_queue.cc:1048] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.570662 19222 raft_consensus.cc:3060] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.575941 19222 raft_consensus.cc:1275] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Refusing update from remote peer fce2ba57741b420f854e3eb33962ddc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.577322 19318 consensus_queue.cc:1048] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.585426 19072 raft_consensus.cc:1275] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Refusing update from remote peer fce2ba57741b420f854e3eb33962ddc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.587448 19321 consensus_queue.cc:1048] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.628849 19222 raft_consensus.cc:1275] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Refusing update from remote peer fce2ba57741b420f854e3eb33962ddc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.630245 19321 consensus_queue.cc:1048] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.637694 19072 raft_consensus.cc:1275] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Refusing update from remote peer fce2ba57741b420f854e3eb33962ddc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.639627 19270 consensus_queue.cc:1048] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.655210 19149 raft_consensus.cc:3060] T f2833d7a80874891b0fb741839ed2e7d P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.660537 19149 raft_consensus.cc:1275] T f2833d7a80874891b0fb741839ed2e7d P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Refusing update from remote peer 0d045c5ca0634c0fa98ac57c40a77d55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.662086 19315 consensus_queue.cc:1048] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.669914 19072 raft_consensus.cc:1275] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Refusing update from remote peer 0d045c5ca0634c0fa98ac57c40a77d55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.671427 19353 consensus_queue.cc:1048] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.679711 19148 raft_consensus.cc:1275] T f9ffcd4670984f89b76d55cc8a25153c P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Refusing update from remote peer 361b54b3bc6a4abcb0c82778f04f7ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.679396 19149 raft_consensus.cc:1275] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Refusing update from remote peer 361b54b3bc6a4abcb0c82778f04f7ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.681180 19312 consensus_queue.cc:1048] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.681979 19309 consensus_queue.cc:1048] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.687772 19222 raft_consensus.cc:1275] T 386c68f4c9474e8aa44e1036c0fb288c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Refusing update from remote peer 361b54b3bc6a4abcb0c82778f04f7ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.689352 19310 consensus_queue.cc:1048] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.693837 19221 raft_consensus.cc:1275] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Refusing update from remote peer 361b54b3bc6a4abcb0c82778f04f7ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.695258 19310 consensus_queue.cc:1048] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:58.882133 18971 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50324:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:58.884449 18971 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:58.936578 19058 tablet_service.cc:1511] Processing CreateTablet for tablet 7887837532114dd4aa89a5e994326cf0 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:58.937994 19058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7887837532114dd4aa89a5e994326cf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:58.938127 19135 tablet_service.cc:1511] Processing CreateTablet for tablet 7887837532114dd4aa89a5e994326cf0 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:58.939483 19135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7887837532114dd4aa89a5e994326cf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:58.941789 19205 tablet_service.cc:1511] Processing CreateTablet for tablet 7887837532114dd4aa89a5e994326cf0 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:58.942443 19062 tablet_service.cc:1511] Processing CreateTablet for tablet 1da5acec4bbb419db0919ea6c8ce269e (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:58.942590 19137 tablet_service.cc:1511] Processing CreateTablet for tablet 1da5acec4bbb419db0919ea6c8ce269e (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:58.943110 19205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7887837532114dd4aa89a5e994326cf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:58.943749 19062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1da5acec4bbb419db0919ea6c8ce269e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:58.943898 19137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1da5acec4bbb419db0919ea6c8ce269e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:58.946899 19207 tablet_service.cc:1511] Processing CreateTablet for tablet 1da5acec4bbb419db0919ea6c8ce269e (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:58.947347 19063 tablet_service.cc:1511] Processing CreateTablet for tablet 68d0f5f848984b6f821e1e015dca5149 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:58.948248 19207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1da5acec4bbb419db0919ea6c8ce269e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:58.948611 19063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d0f5f848984b6f821e1e015dca5149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:58.949424 19131 tablet_service.cc:1511] Processing CreateTablet for tablet 68d0f5f848984b6f821e1e015dca5149 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:58.950731 19131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d0f5f848984b6f821e1e015dca5149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:58.951577 19206 tablet_service.cc:1511] Processing CreateTablet for tablet 68d0f5f848984b6f821e1e015dca5149 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:58.952903 19206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d0f5f848984b6f821e1e015dca5149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:58.953388 19059 tablet_service.cc:1511] Processing CreateTablet for tablet 03375ff453d54716b9d7f7d3e2791e43 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:58.954656 19059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03375ff453d54716b9d7f7d3e2791e43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:58.955668 19136 tablet_service.cc:1511] Processing CreateTablet for tablet 03375ff453d54716b9d7f7d3e2791e43 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:58.957002 19136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03375ff453d54716b9d7f7d3e2791e43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:58.960191 19057 tablet_service.cc:1511] Processing CreateTablet for tablet 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:58.961663 19057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:58.962380 19132 tablet_service.cc:1511] Processing CreateTablet for tablet 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:58.963701 19132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:58.966599 19209 tablet_service.cc:1511] Processing CreateTablet for tablet 03375ff453d54716b9d7f7d3e2791e43 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:58.967988 19209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03375ff453d54716b9d7f7d3e2791e43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:58.999704 19211 tablet_service.cc:1511] Processing CreateTablet for tablet 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:59.000901 19134 tablet_service.cc:1511] Processing CreateTablet for tablet c45bb123884f44d5b38a1b4eb0617e14 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:59.002324 19134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c45bb123884f44d5b38a1b4eb0617e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:59.004141 19211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:59.007722 19212 tablet_service.cc:1511] Processing CreateTablet for tablet c45bb123884f44d5b38a1b4eb0617e14 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:59.008565 19062 tablet_service.cc:1511] Processing CreateTablet for tablet c45bb123884f44d5b38a1b4eb0617e14 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:59.009166 19212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c45bb123884f44d5b38a1b4eb0617e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:59.009912 19062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c45bb123884f44d5b38a1b4eb0617e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:59.021142 19133 tablet_service.cc:1511] Processing CreateTablet for tablet 50b5b3adde6e4c1a99bdedef4c3ff8a3 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:59.022650 19133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50b5b3adde6e4c1a99bdedef4c3ff8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:59.023356 19056 tablet_service.cc:1511] Processing CreateTablet for tablet 5aed43197ae04b50b755bfa009cc75d1 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:59.023877 19063 tablet_service.cc:1511] Processing CreateTablet for tablet 50b5b3adde6e4c1a99bdedef4c3ff8a3 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:59.027000 19208 tablet_service.cc:1511] Processing CreateTablet for tablet 50b5b3adde6e4c1a99bdedef4c3ff8a3 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:59.028052 19056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aed43197ae04b50b755bfa009cc75d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:59.028362 19208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50b5b3adde6e4c1a99bdedef4c3ff8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:59.028820 19063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50b5b3adde6e4c1a99bdedef4c3ff8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:59.055375 19366 tablet_bootstrap.cc:492] T 1da5acec4bbb419db0919ea6c8ce269e P fce2ba57741b420f854e3eb33962ddc9: Bootstrap starting.
I20260709 13:05:59.057713 19060 tablet_service.cc:1511] Processing CreateTablet for tablet 2085978b74ea469b8ccfa4943661dc32 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:59.059122 19060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2085978b74ea469b8ccfa4943661dc32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:59.060158 19207 tablet_service.cc:1511] Processing CreateTablet for tablet 5aed43197ae04b50b755bfa009cc75d1 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:59.061535 19207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aed43197ae04b50b755bfa009cc75d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:59.065996 19211 tablet_service.cc:1511] Processing CreateTablet for tablet 2085978b74ea469b8ccfa4943661dc32 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:59.067389 19211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2085978b74ea469b8ccfa4943661dc32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:59.071676 19366 tablet_bootstrap.cc:654] T 1da5acec4bbb419db0919ea6c8ce269e P fce2ba57741b420f854e3eb33962ddc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.078475 19133 tablet_service.cc:1511] Processing CreateTablet for tablet 5aed43197ae04b50b755bfa009cc75d1 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:59.080233 19135 tablet_service.cc:1511] Processing CreateTablet for tablet 2085978b74ea469b8ccfa4943661dc32 (DEFAULT_TABLE table=soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:59.083724 19367 tablet_bootstrap.cc:492] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4: Bootstrap starting.
I20260709 13:05:59.083804 19133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aed43197ae04b50b755bfa009cc75d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:59.093562 19135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2085978b74ea469b8ccfa4943661dc32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:59.099876 19366 tablet_bootstrap.cc:492] T 1da5acec4bbb419db0919ea6c8ce269e P fce2ba57741b420f854e3eb33962ddc9: No bootstrap required, opened a new log
I20260709 13:05:59.100539 19366 ts_tablet_manager.cc:1403] T 1da5acec4bbb419db0919ea6c8ce269e P fce2ba57741b420f854e3eb33962ddc9: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.007s
I20260709 13:05:59.101861 19368 tablet_bootstrap.cc:492] T 03375ff453d54716b9d7f7d3e2791e43 P 0d045c5ca0634c0fa98ac57c40a77d55: Bootstrap starting.
I20260709 13:05:59.103574 19366 raft_consensus.cc:359] T 1da5acec4bbb419db0919ea6c8ce269e P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.104676 19366 raft_consensus.cc:385] T 1da5acec4bbb419db0919ea6c8ce269e P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.105034 19366 raft_consensus.cc:740] T 1da5acec4bbb419db0919ea6c8ce269e P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.106130 19367 tablet_bootstrap.cc:654] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.105839 19366 consensus_queue.cc:260] T 1da5acec4bbb419db0919ea6c8ce269e P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.108323 19366 ts_tablet_manager.cc:1434] T 1da5acec4bbb419db0919ea6c8ce269e P fce2ba57741b420f854e3eb33962ddc9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:59.109826 19366 tablet_bootstrap.cc:492] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9: Bootstrap starting.
I20260709 13:05:59.120340 19368 tablet_bootstrap.cc:654] T 03375ff453d54716b9d7f7d3e2791e43 P 0d045c5ca0634c0fa98ac57c40a77d55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.132680 19366 tablet_bootstrap.cc:654] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.139202 19367 tablet_bootstrap.cc:492] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4: No bootstrap required, opened a new log
I20260709 13:05:59.139650 19367 ts_tablet_manager.cc:1403] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent bootstrapping tablet: real 0.056s	user 0.005s	sys 0.006s
I20260709 13:05:59.141983 19367 raft_consensus.cc:359] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.142866 19367 raft_consensus.cc:385] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.143169 19367 raft_consensus.cc:740] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.143955 19368 tablet_bootstrap.cc:492] T 03375ff453d54716b9d7f7d3e2791e43 P 0d045c5ca0634c0fa98ac57c40a77d55: No bootstrap required, opened a new log
I20260709 13:05:59.144035 19367 consensus_queue.cc:260] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.144716 19368 ts_tablet_manager.cc:1403] T 03375ff453d54716b9d7f7d3e2791e43 P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.007s
I20260709 13:05:59.148001 19368 raft_consensus.cc:359] T 03375ff453d54716b9d7f7d3e2791e43 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.148718 19368 raft_consensus.cc:385] T 03375ff453d54716b9d7f7d3e2791e43 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.149015 19368 raft_consensus.cc:740] T 03375ff453d54716b9d7f7d3e2791e43 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.150018 19366 tablet_bootstrap.cc:492] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9: No bootstrap required, opened a new log
I20260709 13:05:59.149902 19368 consensus_queue.cc:260] T 03375ff453d54716b9d7f7d3e2791e43 P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.150458 19367 ts_tablet_manager.cc:1434] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:05:59.152109 19367 tablet_bootstrap.cc:492] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4: Bootstrap starting.
I20260709 13:05:59.152467 19368 ts_tablet_manager.cc:1434] T 03375ff453d54716b9d7f7d3e2791e43 P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:59.153518 19368 tablet_bootstrap.cc:492] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55: Bootstrap starting.
I20260709 13:05:59.159309 19367 tablet_bootstrap.cc:654] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.160285 19368 tablet_bootstrap.cc:654] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.150713 19366 ts_tablet_manager.cc:1403] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.005s
I20260709 13:05:59.165143 19367 tablet_bootstrap.cc:492] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4: No bootstrap required, opened a new log
I20260709 13:05:59.165692 19367 ts_tablet_manager.cc:1403] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:05:59.166968 19368 tablet_bootstrap.cc:492] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55: No bootstrap required, opened a new log
I20260709 13:05:59.167438 19368 ts_tablet_manager.cc:1403] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 13:05:59.168812 19367 raft_consensus.cc:359] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.168991 19366 raft_consensus.cc:359] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.169608 19368 raft_consensus.cc:359] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.169679 19367 raft_consensus.cc:385] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.169735 19366 raft_consensus.cc:385] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.170286 19368 raft_consensus.cc:385] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.170346 19367 raft_consensus.cc:740] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.170485 19366 raft_consensus.cc:740] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.170710 19368 raft_consensus.cc:740] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.171525 19366 consensus_queue.cc:260] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.171489 19367 consensus_queue.cc:260] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.171553 19368 consensus_queue.cc:260] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.174180 19366 ts_tablet_manager.cc:1434] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:05:59.174190 19367 ts_tablet_manager.cc:1434] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:59.175235 19366 tablet_bootstrap.cc:492] T 7887837532114dd4aa89a5e994326cf0 P fce2ba57741b420f854e3eb33962ddc9: Bootstrap starting.
I20260709 13:05:59.175354 19367 tablet_bootstrap.cc:492] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4: Bootstrap starting.
I20260709 13:05:59.177419 19368 ts_tablet_manager.cc:1434] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:05:59.178427 19368 tablet_bootstrap.cc:492] T 1da5acec4bbb419db0919ea6c8ce269e P 0d045c5ca0634c0fa98ac57c40a77d55: Bootstrap starting.
I20260709 13:05:59.182487 19367 tablet_bootstrap.cc:654] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.184890 19368 tablet_bootstrap.cc:654] T 1da5acec4bbb419db0919ea6c8ce269e P 0d045c5ca0634c0fa98ac57c40a77d55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.186650 19309 raft_consensus.cc:493] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.187145 19309 raft_consensus.cc:515] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.190176 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da5acec4bbb419db0919ea6c8ce269e" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9" is_pre_election: true
I20260709 13:05:59.190814 19149 raft_consensus.cc:2468] T 1da5acec4bbb419db0919ea6c8ce269e P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 0.
W20260709 13:05:59.191745 19100 tablet.cc:2406] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:59.195618 19366 tablet_bootstrap.cc:654] T 7887837532114dd4aa89a5e994326cf0 P fce2ba57741b420f854e3eb33962ddc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.197361 19040 leader_election.cc:304] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:59.206632 19309 leader_election.cc:290] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:59.207533 19309 raft_consensus.cc:2804] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.207981 19309 raft_consensus.cc:493] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.209982 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da5acec4bbb419db0919ea6c8ce269e" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" is_pre_election: true
W20260709 13:05:59.212035 19020 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:05:59.212275 19037 leader_election.cc:343] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.215723 19309 raft_consensus.cc:3060] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:59.242810 19040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.25.194:40213, user_credentials={real_user=slave}} blocked reactor thread for 45547.9us
I20260709 13:05:59.248021 19309 raft_consensus.cc:515] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.272372 19377 raft_consensus.cc:493] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.274744 19377 raft_consensus.cc:515] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.285590 19377 leader_election.cc:290] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:59.295727 19368 tablet_bootstrap.cc:492] T 1da5acec4bbb419db0919ea6c8ce269e P 0d045c5ca0634c0fa98ac57c40a77d55: No bootstrap required, opened a new log
I20260709 13:05:59.296358 19368 ts_tablet_manager.cc:1403] T 1da5acec4bbb419db0919ea6c8ce269e P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent bootstrapping tablet: real 0.118s	user 0.037s	sys 0.077s
I20260709 13:05:59.296722 19367 tablet_bootstrap.cc:492] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4: No bootstrap required, opened a new log
I20260709 13:05:59.297392 19367 ts_tablet_manager.cc:1403] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent bootstrapping tablet: real 0.122s	user 0.045s	sys 0.059s
I20260709 13:05:59.298009 19366 tablet_bootstrap.cc:492] T 7887837532114dd4aa89a5e994326cf0 P fce2ba57741b420f854e3eb33962ddc9: No bootstrap required, opened a new log
I20260709 13:05:59.298597 19366 ts_tablet_manager.cc:1403] T 7887837532114dd4aa89a5e994326cf0 P fce2ba57741b420f854e3eb33962ddc9: Time spent bootstrapping tablet: real 0.124s	user 0.048s	sys 0.057s
I20260709 13:05:59.299515 19368 raft_consensus.cc:359] T 1da5acec4bbb419db0919ea6c8ce269e P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.300280 19368 raft_consensus.cc:385] T 1da5acec4bbb419db0919ea6c8ce269e P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.300346 19367 raft_consensus.cc:359] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.300611 19368 raft_consensus.cc:740] T 1da5acec4bbb419db0919ea6c8ce269e P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.301162 19367 raft_consensus.cc:385] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.301496 19367 raft_consensus.cc:740] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.301719 19368 consensus_queue.cc:260] T 1da5acec4bbb419db0919ea6c8ce269e P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.296838 19309 leader_election.cc:290] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 election: Requested vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:59.302204 19367 consensus_queue.cc:260] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.302525 19366 raft_consensus.cc:359] T 7887837532114dd4aa89a5e994326cf0 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.303522 19366 raft_consensus.cc:385] T 7887837532114dd4aa89a5e994326cf0 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.303853 19366 raft_consensus.cc:740] T 7887837532114dd4aa89a5e994326cf0 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.304179 19368 ts_tablet_manager.cc:1434] T 1da5acec4bbb419db0919ea6c8ce269e P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:05:59.304466 19367 ts_tablet_manager.cc:1434] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:05:59.305316 19368 tablet_bootstrap.cc:492] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55: Bootstrap starting.
I20260709 13:05:59.305454 19367 tablet_bootstrap.cc:492] T 5aed43197ae04b50b755bfa009cc75d1 P 361b54b3bc6a4abcb0c82778f04f7ee4: Bootstrap starting.
I20260709 13:05:59.304836 19366 consensus_queue.cc:260] T 7887837532114dd4aa89a5e994326cf0 P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.309510 19366 ts_tablet_manager.cc:1434] T 7887837532114dd4aa89a5e994326cf0 P fce2ba57741b420f854e3eb33962ddc9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:05:59.310554 19366 tablet_bootstrap.cc:492] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9: Bootstrap starting.
I20260709 13:05:59.311762 19367 tablet_bootstrap.cc:654] T 5aed43197ae04b50b755bfa009cc75d1 P 361b54b3bc6a4abcb0c82778f04f7ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.312341 19368 tablet_bootstrap.cc:654] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.317215 19366 tablet_bootstrap.cc:654] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.324836 19367 tablet_bootstrap.cc:492] T 5aed43197ae04b50b755bfa009cc75d1 P 361b54b3bc6a4abcb0c82778f04f7ee4: No bootstrap required, opened a new log
I20260709 13:05:59.324811 19368 tablet_bootstrap.cc:492] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55: No bootstrap required, opened a new log
I20260709 13:05:59.325548 19367 ts_tablet_manager.cc:1403] T 5aed43197ae04b50b755bfa009cc75d1 P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.010s
I20260709 13:05:59.325567 19368 ts_tablet_manager.cc:1403] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 13:05:59.329737 19368 raft_consensus.cc:359] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.330008 19367 raft_consensus.cc:359] T 5aed43197ae04b50b755bfa009cc75d1 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.330487 19368 raft_consensus.cc:385] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.330736 19367 raft_consensus.cc:385] T 5aed43197ae04b50b755bfa009cc75d1 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.330856 19368 raft_consensus.cc:740] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.331162 19367 raft_consensus.cc:740] T 5aed43197ae04b50b755bfa009cc75d1 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.331717 19368 consensus_queue.cc:260] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.331928 19367 consensus_queue.cc:260] T 5aed43197ae04b50b755bfa009cc75d1 P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.334550 19368 ts_tablet_manager.cc:1434] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:59.337231 19368 tablet_bootstrap.cc:492] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55: Bootstrap starting.
I20260709 13:05:59.342442 19367 ts_tablet_manager.cc:1434] T 5aed43197ae04b50b755bfa009cc75d1 P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 13:05:59.343585 19367 tablet_bootstrap.cc:492] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 361b54b3bc6a4abcb0c82778f04f7ee4: Bootstrap starting.
I20260709 13:05:59.344617 19368 tablet_bootstrap.cc:654] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.355103 19367 tablet_bootstrap.cc:654] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 361b54b3bc6a4abcb0c82778f04f7ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.356659 19368 tablet_bootstrap.cc:492] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55: No bootstrap required, opened a new log
I20260709 13:05:59.357260 19368 ts_tablet_manager.cc:1403] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.010s
I20260709 13:05:59.361064 19368 raft_consensus.cc:359] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.362061 19368 raft_consensus.cc:385] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.362442 19368 raft_consensus.cc:740] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.363400 19368 consensus_queue.cc:260] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.366075 19368 ts_tablet_manager.cc:1434] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:05:59.366827 19367 tablet_bootstrap.cc:492] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 361b54b3bc6a4abcb0c82778f04f7ee4: No bootstrap required, opened a new log
I20260709 13:05:59.367105 19368 tablet_bootstrap.cc:492] T 7887837532114dd4aa89a5e994326cf0 P 0d045c5ca0634c0fa98ac57c40a77d55: Bootstrap starting.
I20260709 13:05:59.367393 19367 ts_tablet_manager.cc:1403] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.004s
I20260709 13:05:59.370873 19367 raft_consensus.cc:359] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.371636 19367 raft_consensus.cc:385] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.371946 19367 raft_consensus.cc:740] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.372602 19367 consensus_queue.cc:260] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.374173 19368 tablet_bootstrap.cc:654] T 7887837532114dd4aa89a5e994326cf0 P 0d045c5ca0634c0fa98ac57c40a77d55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.376150 19367 ts_tablet_manager.cc:1434] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:59.377707 19367 tablet_bootstrap.cc:492] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4: Bootstrap starting.
I20260709 13:05:59.381579 19353 raft_consensus.cc:493] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.382175 19353 raft_consensus.cc:515] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.385613 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c45bb123884f44d5b38a1b4eb0617e14" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9" is_pre_election: true
W20260709 13:05:59.387241 19189 leader_election.cc:343] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.387992 19353 leader_election.cc:290] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213)
W20260709 13:05:59.389000 19040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:40213, user_credentials={real_user=slave}} blocked reactor thread for 118303us
I20260709 13:05:59.389060 19367 tablet_bootstrap.cc:654] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.391072 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887837532114dd4aa89a5e994326cf0" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9" is_pre_election: true
I20260709 13:05:59.391784 19149 raft_consensus.cc:2468] T 7887837532114dd4aa89a5e994326cf0 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 0.
I20260709 13:05:59.392089 19368 tablet_bootstrap.cc:492] T 7887837532114dd4aa89a5e994326cf0 P 0d045c5ca0634c0fa98ac57c40a77d55: No bootstrap required, opened a new log
I20260709 13:05:59.391815 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da5acec4bbb419db0919ea6c8ce269e" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:05:59.392890 19368 ts_tablet_manager.cc:1403] T 7887837532114dd4aa89a5e994326cf0 P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.007s
I20260709 13:05:59.392882 19148 raft_consensus.cc:3060] T 1da5acec4bbb419db0919ea6c8ce269e P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.397183 19368 raft_consensus.cc:359] T 7887837532114dd4aa89a5e994326cf0 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.398432 19368 raft_consensus.cc:385] T 7887837532114dd4aa89a5e994326cf0 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.398898 19368 raft_consensus.cc:740] T 7887837532114dd4aa89a5e994326cf0 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.400130 19368 consensus_queue.cc:260] T 7887837532114dd4aa89a5e994326cf0 P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.402554 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887837532114dd4aa89a5e994326cf0" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" is_pre_election: true
I20260709 13:05:59.402930 19368 ts_tablet_manager.cc:1434] T 7887837532114dd4aa89a5e994326cf0 P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:05:59.403249 19222 raft_consensus.cc:2468] T 7887837532114dd4aa89a5e994326cf0 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 0.
I20260709 13:05:59.404373 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da5acec4bbb419db0919ea6c8ce269e" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:05:59.406278 19221 raft_consensus.cc:3060] T 1da5acec4bbb419db0919ea6c8ce269e P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.406661 19368 tablet_bootstrap.cc:492] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55: Bootstrap starting.
I20260709 13:05:59.407969 19148 raft_consensus.cc:2468] T 1da5acec4bbb419db0919ea6c8ce269e P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 1.
I20260709 13:05:59.409547 19040 leader_election.cc:304] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:59.411237 19377 raft_consensus.cc:2804] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.411608 19377 raft_consensus.cc:493] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.411948 19377 raft_consensus.cc:3060] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.414208 19368 tablet_bootstrap.cc:654] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.414444 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c45bb123884f44d5b38a1b4eb0617e14" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" is_pre_election: true
I20260709 13:05:59.414814 19367 tablet_bootstrap.cc:492] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4: No bootstrap required, opened a new log
I20260709 13:05:59.415436 19367 ts_tablet_manager.cc:1403] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.015s
I20260709 13:05:59.419080 19367 raft_consensus.cc:359] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
W20260709 13:05:59.419694 19187 leader_election.cc:343] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.419605 19377 raft_consensus.cc:515] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.420380 19187 leader_election.cc:304] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55; no voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9
I20260709 13:05:59.421428 19221 raft_consensus.cc:2468] T 1da5acec4bbb419db0919ea6c8ce269e P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 1.
I20260709 13:05:59.421622 19353 raft_consensus.cc:2749] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.421867 19377 leader_election.cc:290] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 election: Requested vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:59.422788 19040 leader_election.cc:304] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:59.426645 19368 tablet_bootstrap.cc:492] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55: No bootstrap required, opened a new log
I20260709 13:05:59.426522 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887837532114dd4aa89a5e994326cf0" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:05:59.427256 19368 ts_tablet_manager.cc:1403] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:05:59.427531 19148 raft_consensus.cc:3060] T 7887837532114dd4aa89a5e994326cf0 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.420075 19367 raft_consensus.cc:385] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.432732 19367 raft_consensus.cc:740] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.433449 19368 raft_consensus.cc:359] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.433599 19367 consensus_queue.cc:260] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.434350 19309 raft_consensus.cc:2804] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.434484 19368 raft_consensus.cc:385] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.434252 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887837532114dd4aa89a5e994326cf0" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:05:59.435228 19368 raft_consensus.cc:740] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.435838 19221 raft_consensus.cc:3060] T 7887837532114dd4aa89a5e994326cf0 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.436511 19368 consensus_queue.cc:260] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.439332 19368 ts_tablet_manager.cc:1434] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:05:59.439781 19367 ts_tablet_manager.cc:1434] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.005s
I20260709 13:05:59.440529 19368 tablet_bootstrap.cc:492] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55: Bootstrap starting.
I20260709 13:05:59.440888 19367 tablet_bootstrap.cc:492] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4: Bootstrap starting.
I20260709 13:05:59.442657 19148 raft_consensus.cc:2468] T 7887837532114dd4aa89a5e994326cf0 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 1.
I20260709 13:05:59.443882 19040 leader_election.cc:304] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:59.444800 19379 raft_consensus.cc:2804] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.445297 19379 raft_consensus.cc:697] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Becoming Leader. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Running, Role: LEADER
I20260709 13:05:59.449203 19368 tablet_bootstrap.cc:654] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.446070 19379 consensus_queue.cc:237] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.455534 19367 tablet_bootstrap.cc:654] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.469041 19366 tablet_bootstrap.cc:492] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9: No bootstrap required, opened a new log
I20260709 13:05:59.469591 19368 tablet_bootstrap.cc:492] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55: No bootstrap required, opened a new log
I20260709 13:05:59.469848 19270 raft_consensus.cc:493] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.470194 19368 ts_tablet_manager.cc:1403] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.016s
I20260709 13:05:59.470326 19366 ts_tablet_manager.cc:1403] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9: Time spent bootstrapping tablet: real 0.160s	user 0.035s	sys 0.053s
I20260709 13:05:59.470359 19270 raft_consensus.cc:515] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.472987 19368 raft_consensus.cc:359] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.473735 19368 raft_consensus.cc:385] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.473994 19368 raft_consensus.cc:740] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.474109 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03375ff453d54716b9d7f7d3e2791e43" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" is_pre_election: true
I20260709 13:05:59.474761 19222 raft_consensus.cc:2468] T 03375ff453d54716b9d7f7d3e2791e43 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 0.
I20260709 13:05:59.474654 19368 consensus_queue.cc:260] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.475488 19366 raft_consensus.cc:359] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.476395 19112 leader_election.cc:304] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:59.476459 19366 raft_consensus.cc:385] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.477294 19366 raft_consensus.cc:740] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.478158 19366 consensus_queue.cc:260] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.478374 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03375ff453d54716b9d7f7d3e2791e43" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" is_pre_election: true
I20260709 13:05:59.479240 19072 raft_consensus.cc:2468] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 0.
I20260709 13:05:59.480419 19367 tablet_bootstrap.cc:492] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4: No bootstrap required, opened a new log
I20260709 13:05:59.481148 19367 ts_tablet_manager.cc:1403] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.010s
I20260709 13:05:59.482040 19270 leader_election.cc:290] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:59.482622 19368 ts_tablet_manager.cc:1434] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:05:59.483561 19368 tablet_bootstrap.cc:492] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55: Bootstrap starting.
I20260709 13:05:59.485343 19270 raft_consensus.cc:2804] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.486467 19270 raft_consensus.cc:493] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.486912 19270 raft_consensus.cc:3060] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.489905 19368 tablet_bootstrap.cc:654] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.485041 19367 raft_consensus.cc:359] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.498939 19353 raft_consensus.cc:493] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.499610 19353 raft_consensus.cc:515] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.502398 19353 leader_election.cc:290] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213)
I20260709 13:05:59.498586 19367 raft_consensus.cc:385] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.503871 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6cf0ca4dd742d5a23bf8e2dc1ab3bd" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9" is_pre_election: true
I20260709 13:05:59.504421 19367 raft_consensus.cc:740] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.506458 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6cf0ca4dd742d5a23bf8e2dc1ab3bd" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" is_pre_election: true
I20260709 13:05:59.507383 19072 raft_consensus.cc:2468] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 0.
I20260709 13:05:59.509318 19187 leader_election.cc:304] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, 361b54b3bc6a4abcb0c82778f04f7ee4; no voters: 
I20260709 13:05:59.510440 19353 raft_consensus.cc:2804] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:05:59.510921 19189 leader_election.cc:343] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.510941 19353 raft_consensus.cc:493] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.511900 19353 raft_consensus.cc:3060] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.521176 19367 consensus_queue.cc:260] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.524786 19367 ts_tablet_manager.cc:1434] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:05:59.527133 19366 ts_tablet_manager.cc:1434] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9: Time spent starting tablet: real 0.056s	user 0.020s	sys 0.032s
I20260709 13:05:59.527908 19367 tablet_bootstrap.cc:492] T 2085978b74ea469b8ccfa4943661dc32 P 361b54b3bc6a4abcb0c82778f04f7ee4: Bootstrap starting.
I20260709 13:05:59.528379 19366 tablet_bootstrap.cc:492] T 68d0f5f848984b6f821e1e015dca5149 P fce2ba57741b420f854e3eb33962ddc9: Bootstrap starting.
I20260709 13:05:59.529381 19353 raft_consensus.cc:515] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.532413 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6cf0ca4dd742d5a23bf8e2dc1ab3bd" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
I20260709 13:05:59.533071 19072 raft_consensus.cc:3060] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.532888 19221 raft_consensus.cc:2468] T 7887837532114dd4aa89a5e994326cf0 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 1.
I20260709 13:05:59.535279 19309 raft_consensus.cc:697] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Becoming Leader. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Running, Role: LEADER
I20260709 13:05:59.536192 19366 tablet_bootstrap.cc:654] T 68d0f5f848984b6f821e1e015dca5149 P fce2ba57741b420f854e3eb33962ddc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.536679 19309 consensus_queue.cc:237] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.541278 19270 raft_consensus.cc:515] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.552764 19367 tablet_bootstrap.cc:654] T 2085978b74ea469b8ccfa4943661dc32 P 361b54b3bc6a4abcb0c82778f04f7ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.554186 19072 raft_consensus.cc:2468] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 1.
I20260709 13:05:59.554868 19368 tablet_bootstrap.cc:492] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55: No bootstrap required, opened a new log
I20260709 13:05:59.556941 19368 ts_tablet_manager.cc:1403] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent bootstrapping tablet: real 0.074s	user 0.034s	sys 0.033s
I20260709 13:05:59.559816 19074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03375ff453d54716b9d7f7d3e2791e43" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
I20260709 13:05:59.560143 19353 leader_election.cc:290] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 election: Requested vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213)
I20260709 13:05:59.560549 19074 raft_consensus.cc:3060] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.560822 19353 raft_consensus.cc:493] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.561350 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6cf0ca4dd742d5a23bf8e2dc1ab3bd" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:05:59.561591 19187 leader_election.cc:304] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, 361b54b3bc6a4abcb0c82778f04f7ee4; no voters: 
I20260709 13:05:59.561942 19270 leader_election.cc:290] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 1 election: Requested vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
W20260709 13:05:59.563163 19189 leader_election.cc:343] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.564610 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03375ff453d54716b9d7f7d3e2791e43" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:05:59.566247 19368 raft_consensus.cc:359] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.567173 19368 raft_consensus.cc:385] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.567493 19368 raft_consensus.cc:740] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.568331 19368 consensus_queue.cc:260] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.569734 19221 raft_consensus.cc:3060] T 03375ff453d54716b9d7f7d3e2791e43 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.578929 19074 raft_consensus.cc:2468] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 1.
I20260709 13:05:59.580310 19113 leader_election.cc:304] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:59.561369 19353 raft_consensus.cc:515] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.581187 19270 raft_consensus.cc:2804] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.581665 19270 raft_consensus.cc:697] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [term 1 LEADER]: Becoming Leader. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Running, Role: LEADER
I20260709 13:05:59.582501 19270 consensus_queue.cc:237] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.584220 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d0f5f848984b6f821e1e015dca5149" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9" is_pre_election: true
I20260709 13:05:59.585239 19353 leader_election.cc:290] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213)
I20260709 13:05:59.585819 19353 raft_consensus.cc:2804] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.586277 19353 raft_consensus.cc:697] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Becoming Leader. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Running, Role: LEADER
I20260709 13:05:59.586464 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d0f5f848984b6f821e1e015dca5149" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" is_pre_election: true
I20260709 13:05:59.587100 19072 raft_consensus.cc:2468] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 0.
I20260709 13:05:59.587095 19353 consensus_queue.cc:237] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.588729 19187 leader_election.cc:304] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, 361b54b3bc6a4abcb0c82778f04f7ee4; no voters: 
W20260709 13:05:59.591085 19189 leader_election.cc:343] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.592489 19221 raft_consensus.cc:2468] T 03375ff453d54716b9d7f7d3e2791e43 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 1.
I20260709 13:05:59.594137 18971 catalog_manager.cc:5697] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.597383 18971 catalog_manager.cc:5697] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.605707 19402 raft_consensus.cc:2804] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.606381 19402 raft_consensus.cc:493] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.606823 19402 raft_consensus.cc:3060] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.612191 19366 tablet_bootstrap.cc:492] T 68d0f5f848984b6f821e1e015dca5149 P fce2ba57741b420f854e3eb33962ddc9: No bootstrap required, opened a new log
I20260709 13:05:59.612680 19368 ts_tablet_manager.cc:1434] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55: Time spent starting tablet: real 0.055s	user 0.018s	sys 0.022s
I20260709 13:05:59.612478 19399 raft_consensus.cc:493] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.613308 19399 raft_consensus.cc:515] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.612818 19366 ts_tablet_manager.cc:1403] T 68d0f5f848984b6f821e1e015dca5149 P fce2ba57741b420f854e3eb33962ddc9: Time spent bootstrapping tablet: real 0.085s	user 0.014s	sys 0.014s
I20260709 13:05:59.615579 19399 leader_election.cc:290] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213)
I20260709 13:05:59.617274 19074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b5b3adde6e4c1a99bdedef4c3ff8a3" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" is_pre_election: true
I20260709 13:05:59.618453 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b5b3adde6e4c1a99bdedef4c3ff8a3" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9" is_pre_election: true
I20260709 13:05:59.618575 19366 raft_consensus.cc:359] T 68d0f5f848984b6f821e1e015dca5149 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
W20260709 13:05:59.618925 19187 leader_election.cc:343] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.619422 19366 raft_consensus.cc:385] T 68d0f5f848984b6f821e1e015dca5149 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.618958 19402 raft_consensus.cc:515] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.619163 19148 raft_consensus.cc:2468] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 0.
I20260709 13:05:59.619830 19366 raft_consensus.cc:740] T 68d0f5f848984b6f821e1e015dca5149 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.620939 19189 leader_election.cc:304] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, fce2ba57741b420f854e3eb33962ddc9; no voters: 361b54b3bc6a4abcb0c82778f04f7ee4
I20260709 13:05:59.621836 19400 raft_consensus.cc:2804] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.622226 19400 raft_consensus.cc:493] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.622541 19400 raft_consensus.cc:3060] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.634295 19367 tablet_bootstrap.cc:492] T 2085978b74ea469b8ccfa4943661dc32 P 361b54b3bc6a4abcb0c82778f04f7ee4: No bootstrap required, opened a new log
I20260709 13:05:59.633857 19366 consensus_queue.cc:260] T 68d0f5f848984b6f821e1e015dca5149 P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.634829 19367 ts_tablet_manager.cc:1403] T 2085978b74ea469b8ccfa4943661dc32 P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent bootstrapping tablet: real 0.107s	user 0.019s	sys 0.005s
I20260709 13:05:59.634687 19074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d0f5f848984b6f821e1e015dca5149" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
I20260709 13:05:59.635484 19074 raft_consensus.cc:3060] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.637490 19366 ts_tablet_manager.cc:1434] T 68d0f5f848984b6f821e1e015dca5149 P fce2ba57741b420f854e3eb33962ddc9: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.004s
I20260709 13:05:59.638568 19366 tablet_bootstrap.cc:492] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9: Bootstrap starting.
I20260709 13:05:59.637755 19367 raft_consensus.cc:359] T 2085978b74ea469b8ccfa4943661dc32 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.640664 19367 raft_consensus.cc:385] T 2085978b74ea469b8ccfa4943661dc32 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.640969 19367 raft_consensus.cc:740] T 2085978b74ea469b8ccfa4943661dc32 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.643561 19400 raft_consensus.cc:515] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.645797 19366 tablet_bootstrap.cc:654] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.646179 19402 leader_election.cc:290] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 election: Requested vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213)
I20260709 13:05:59.647830 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d0f5f848984b6f821e1e015dca5149" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:05:59.647902 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b5b3adde6e4c1a99bdedef4c3ff8a3" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
I20260709 13:05:59.648552 19148 raft_consensus.cc:3060] T 68d0f5f848984b6f821e1e015dca5149 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:59.649968 19187 leader_election.cc:343] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.651077 19074 raft_consensus.cc:2468] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 1.
I20260709 13:05:59.652729 19187 leader_election.cc:304] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, 361b54b3bc6a4abcb0c82778f04f7ee4; no voters: 
I20260709 13:05:59.654026 19402 raft_consensus.cc:2804] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.654573 19402 raft_consensus.cc:697] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Becoming Leader. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Running, Role: LEADER
I20260709 13:05:59.655612 19402 consensus_queue.cc:237] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.665719 18970 catalog_manager.cc:5697] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.641772 19367 consensus_queue.cc:260] T 2085978b74ea469b8ccfa4943661dc32 P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.671696 19148 raft_consensus.cc:2468] T 68d0f5f848984b6f821e1e015dca5149 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 1.
I20260709 13:05:59.672031 19367 ts_tablet_manager.cc:1434] T 2085978b74ea469b8ccfa4943661dc32 P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:05:59.673106 19367 tablet_bootstrap.cc:492] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 361b54b3bc6a4abcb0c82778f04f7ee4: Bootstrap starting.
I20260709 13:05:59.675159 19366 tablet_bootstrap.cc:492] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9: No bootstrap required, opened a new log
I20260709 13:05:59.675856 19366 ts_tablet_manager.cc:1403] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.020s
I20260709 13:05:59.677248 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b5b3adde6e4c1a99bdedef4c3ff8a3" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:05:59.678431 19148 raft_consensus.cc:3060] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.678013 19367 tablet_bootstrap.cc:654] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 361b54b3bc6a4abcb0c82778f04f7ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.677850 19400 leader_election.cc:290] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 election: Requested vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213)
I20260709 13:05:59.679906 19366 raft_consensus.cc:359] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.681439 19366 raft_consensus.cc:385] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.681872 19366 raft_consensus.cc:740] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.683029 19366 consensus_queue.cc:260] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.685784 19366 ts_tablet_manager.cc:1434] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.003s
I20260709 13:05:59.686610 19366 tablet_bootstrap.cc:492] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9: Bootstrap starting.
I20260709 13:05:59.687162 19148 raft_consensus.cc:2468] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 1.
I20260709 13:05:59.688475 19189 leader_election.cc:304] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, fce2ba57741b420f854e3eb33962ddc9; no voters: 361b54b3bc6a4abcb0c82778f04f7ee4
I20260709 13:05:59.689659 19400 raft_consensus.cc:2804] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.690136 19400 raft_consensus.cc:697] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Becoming Leader. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Running, Role: LEADER
I20260709 13:05:59.690980 19400 consensus_queue.cc:237] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.692778 18972 catalog_manager.cc:5697] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194). New cstate: current_term: 1 leader_uuid: "fce2ba57741b420f854e3eb33962ddc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.694471 19366 tablet_bootstrap.cc:654] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.707089 19367 tablet_bootstrap.cc:492] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 361b54b3bc6a4abcb0c82778f04f7ee4: No bootstrap required, opened a new log
I20260709 13:05:59.707603 19367 ts_tablet_manager.cc:1403] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.000s
I20260709 13:05:59.710351 19367 raft_consensus.cc:359] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.711144 19367 raft_consensus.cc:385] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.711508 19367 raft_consensus.cc:740] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.712340 19367 consensus_queue.cc:260] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.716792 19367 ts_tablet_manager.cc:1434] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 361b54b3bc6a4abcb0c82778f04f7ee4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:59.720698 19366 tablet_bootstrap.cc:492] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9: No bootstrap required, opened a new log
I20260709 13:05:59.721362 19366 ts_tablet_manager.cc:1403] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.014s
I20260709 13:05:59.724642 19366 raft_consensus.cc:359] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.725399 19366 raft_consensus.cc:385] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.725687 19366 raft_consensus.cc:740] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.726385 19366 consensus_queue.cc:260] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.728761 19366 ts_tablet_manager.cc:1434] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:59.729785 19366 tablet_bootstrap.cc:492] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9: Bootstrap starting.
I20260709 13:05:59.732280 18971 catalog_manager.cc:5697] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.733943 18971 catalog_manager.cc:5697] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.736196 19366 tablet_bootstrap.cc:654] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.743542 19366 tablet_bootstrap.cc:492] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9: No bootstrap required, opened a new log
I20260709 13:05:59.744029 19366 ts_tablet_manager.cc:1403] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 13:05:59.744975 19400 raft_consensus.cc:493] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.745515 19400 raft_consensus.cc:515] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.746634 19366 raft_consensus.cc:359] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.747121 19400 leader_election.cc:290] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213)
I20260709 13:05:59.747385 19366 raft_consensus.cc:385] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.747731 19366 raft_consensus.cc:740] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.748355 19366 consensus_queue.cc:260] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.748803 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aed43197ae04b50b755bfa009cc75d1" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9" is_pre_election: true
I20260709 13:05:59.749495 19149 raft_consensus.cc:2468] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 0.
I20260709 13:05:59.750523 19366 ts_tablet_manager.cc:1434] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:05:59.750535 19189 leader_election.cc:304] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:59.751569 19400 raft_consensus.cc:2804] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.751602 19366 tablet_bootstrap.cc:492] T 2085978b74ea469b8ccfa4943661dc32 P fce2ba57741b420f854e3eb33962ddc9: Bootstrap starting.
I20260709 13:05:59.751886 19400 raft_consensus.cc:493] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.752146 19400 raft_consensus.cc:3060] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.752003 19074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aed43197ae04b50b755bfa009cc75d1" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" is_pre_election: true
I20260709 13:05:59.752753 19074 raft_consensus.cc:2468] T 5aed43197ae04b50b755bfa009cc75d1 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 0.
I20260709 13:05:59.757241 19366 tablet_bootstrap.cc:654] T 2085978b74ea469b8ccfa4943661dc32 P fce2ba57741b420f854e3eb33962ddc9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.759532 19400 raft_consensus.cc:515] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.761535 19400 leader_election.cc:290] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 election: Requested vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213)
I20260709 13:05:59.762650 19074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aed43197ae04b50b755bfa009cc75d1" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
I20260709 13:05:59.762790 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aed43197ae04b50b755bfa009cc75d1" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:05:59.763314 19074 raft_consensus.cc:3060] T 5aed43197ae04b50b755bfa009cc75d1 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.763815 19149 raft_consensus.cc:3060] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.770371 19074 raft_consensus.cc:2468] T 5aed43197ae04b50b755bfa009cc75d1 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 1.
I20260709 13:05:59.771493 19187 leader_election.cc:304] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, 361b54b3bc6a4abcb0c82778f04f7ee4; no voters: 
I20260709 13:05:59.771687 19366 tablet_bootstrap.cc:492] T 2085978b74ea469b8ccfa4943661dc32 P fce2ba57741b420f854e3eb33962ddc9: No bootstrap required, opened a new log
I20260709 13:05:59.772228 19400 raft_consensus.cc:2804] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.772285 19366 ts_tablet_manager.cc:1403] T 2085978b74ea469b8ccfa4943661dc32 P fce2ba57741b420f854e3eb33962ddc9: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:05:59.772782 19400 raft_consensus.cc:697] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Becoming Leader. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Running, Role: LEADER
I20260709 13:05:59.773435 19149 raft_consensus.cc:2468] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 1.
I20260709 13:05:59.773645 19400 consensus_queue.cc:237] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.775066 19366 raft_consensus.cc:359] T 2085978b74ea469b8ccfa4943661dc32 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.775727 19366 raft_consensus.cc:385] T 2085978b74ea469b8ccfa4943661dc32 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.775951 19366 raft_consensus.cc:740] T 2085978b74ea469b8ccfa4943661dc32 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.776592 19366 consensus_queue.cc:260] T 2085978b74ea469b8ccfa4943661dc32 P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.778870 19366 ts_tablet_manager.cc:1434] T 2085978b74ea469b8ccfa4943661dc32 P fce2ba57741b420f854e3eb33962ddc9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:05:59.783174 18972 catalog_manager.cc:5697] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.798242 19309 raft_consensus.cc:493] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.798718 19309 raft_consensus.cc:515] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.800379 19309 leader_election.cc:290] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:59.801283 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c45bb123884f44d5b38a1b4eb0617e14" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9" is_pre_election: true
I20260709 13:05:59.801537 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c45bb123884f44d5b38a1b4eb0617e14" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" is_pre_election: true
I20260709 13:05:59.801889 19149 raft_consensus.cc:2468] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 0.
I20260709 13:05:59.802290 19221 raft_consensus.cc:2468] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 0.
I20260709 13:05:59.802906 19040 leader_election.cc:304] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:59.803771 19309 raft_consensus.cc:2804] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.804167 19309 raft_consensus.cc:493] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.804450 19309 raft_consensus.cc:3060] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.810065 19309 raft_consensus.cc:515] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.811888 19309 leader_election.cc:290] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 election: Requested vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:59.812629 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c45bb123884f44d5b38a1b4eb0617e14" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:05:59.812958 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c45bb123884f44d5b38a1b4eb0617e14" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:05:59.813233 19149 raft_consensus.cc:3060] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.813616 19221 raft_consensus.cc:3060] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.818917 19149 raft_consensus.cc:2468] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 1.
I20260709 13:05:59.818989 19221 raft_consensus.cc:2468] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 1.
I20260709 13:05:59.820216 19040 leader_election.cc:304] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:59.820921 19309 raft_consensus.cc:2804] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.821382 19309 raft_consensus.cc:697] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Becoming Leader. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Running, Role: LEADER
I20260709 13:05:59.822037 19309 consensus_queue.cc:237] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.830111 18970 catalog_manager.cc:5697] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193). New cstate: current_term: 1 leader_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.858542 19309 consensus_queue.cc:1048] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:59.866955 19400 raft_consensus.cc:493] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.867640 19400 raft_consensus.cc:515] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.871847 19074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2085978b74ea469b8ccfa4943661dc32" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" is_pre_election: true
I20260709 13:05:59.870095 19400 leader_election.cc:290] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213)
I20260709 13:05:59.872645 19074 raft_consensus.cc:2468] T 2085978b74ea469b8ccfa4943661dc32 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 0.
I20260709 13:05:59.874233 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2085978b74ea469b8ccfa4943661dc32" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9" is_pre_election: true
I20260709 13:05:59.874423 19187 leader_election.cc:304] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, 361b54b3bc6a4abcb0c82778f04f7ee4; no voters: 
I20260709 13:05:59.874967 19149 raft_consensus.cc:2468] T 2085978b74ea469b8ccfa4943661dc32 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 0.
I20260709 13:05:59.875561 19400 raft_consensus.cc:2804] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.876045 19400 raft_consensus.cc:493] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.876456 19400 raft_consensus.cc:3060] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.875878 19379 consensus_queue.cc:1048] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:59.883575 19400 raft_consensus.cc:515] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.885885 19400 leader_election.cc:290] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 election: Requested vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213)
I20260709 13:05:59.886780 19074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2085978b74ea469b8ccfa4943661dc32" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
I20260709 13:05:59.887395 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2085978b74ea469b8ccfa4943661dc32" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:05:59.887494 19074 raft_consensus.cc:3060] T 2085978b74ea469b8ccfa4943661dc32 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.888163 19149 raft_consensus.cc:3060] T 2085978b74ea469b8ccfa4943661dc32 P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.894311 19149 raft_consensus.cc:2468] T 2085978b74ea469b8ccfa4943661dc32 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 1.
I20260709 13:05:59.894833 19074 raft_consensus.cc:2468] T 2085978b74ea469b8ccfa4943661dc32 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 1.
I20260709 13:05:59.895364 19189 leader_election.cc:304] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:05:59.896301 19400 raft_consensus.cc:2804] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.896858 19400 raft_consensus.cc:697] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Becoming Leader. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Running, Role: LEADER
I20260709 13:05:59.897814 19400 consensus_queue.cc:237] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.902580 19395 raft_consensus.cc:493] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.903059 19395 raft_consensus.cc:515] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:05:59.904945 19395 leader_election.cc:290] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:05:59.905983 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6cf0ca4dd742d5a23bf8e2dc1ab3bd" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" is_pre_election: true
I20260709 13:05:59.906944 19074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6cf0ca4dd742d5a23bf8e2dc1ab3bd" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" is_pre_election: true
I20260709 13:05:59.908020 19074 raft_consensus.cc:2393] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fce2ba57741b420f854e3eb33962ddc9 in current term 1: Already voted for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in this term.
I20260709 13:05:59.908016 18970 catalog_manager.cc:5697] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195). New cstate: current_term: 1 leader_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.909518 19113 leader_election.cc:304] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fce2ba57741b420f854e3eb33962ddc9; no voters: 0d045c5ca0634c0fa98ac57c40a77d55, 361b54b3bc6a4abcb0c82778f04f7ee4
I20260709 13:05:59.910539 19395 raft_consensus.cc:3060] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.918428 19395 raft_consensus.cc:2749] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.977780 19379 consensus_queue.cc:1048] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:59.988131 19379 consensus_queue.cc:1048] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:59.997601 19395 consensus_queue.cc:1048] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.008863 19270 consensus_queue.cc:1048] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.092401 19074 raft_consensus.cc:3060] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.098690 19400 consensus_queue.cc:1048] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.109030 19353 consensus_queue.cc:1048] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.128726 19221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68d0f5f848984b6f821e1e015dca5149"
dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
mode: GRACEFUL
new_leader_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
 from {username='slave'} at 127.0.0.1:60984
I20260709 13:06:00.129302 19221 raft_consensus.cc:606] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Received request to transfer leadership to TS 361b54b3bc6a4abcb0c82778f04f7ee4
I20260709 13:06:00.135962 19149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03375ff453d54716b9d7f7d3e2791e43"
dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
mode: GRACEFUL
new_leader_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
 from {username='slave'} at 127.0.0.1:46954
I20260709 13:06:00.136498 19149 raft_consensus.cc:606] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [term 1 LEADER]: Received request to transfer leadership to TS 361b54b3bc6a4abcb0c82778f04f7ee4
I20260709 13:06:00.142269 19221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e6cf0ca4dd742d5a23bf8e2dc1ab3bd"
dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
mode: GRACEFUL
new_leader_uuid: "fce2ba57741b420f854e3eb33962ddc9"
 from {username='slave'} at 127.0.0.1:60984
I20260709 13:06:00.142834 19221 raft_consensus.cc:606] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Received request to transfer leadership to TS fce2ba57741b420f854e3eb33962ddc9
I20260709 13:06:00.148217 19074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c45bb123884f44d5b38a1b4eb0617e14"
dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
mode: GRACEFUL
new_leader_uuid: "fce2ba57741b420f854e3eb33962ddc9"
 from {username='slave'} at 127.0.0.1:58482
I20260709 13:06:00.148767 19074 raft_consensus.cc:606] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Received request to transfer leadership to TS fce2ba57741b420f854e3eb33962ddc9
I20260709 13:06:00.154031 19221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50b5b3adde6e4c1a99bdedef4c3ff8a3"
dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
mode: GRACEFUL
new_leader_uuid: "fce2ba57741b420f854e3eb33962ddc9"
 from {username='slave'} at 127.0.0.1:60984
I20260709 13:06:00.154521 19221 raft_consensus.cc:606] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Received request to transfer leadership to TS fce2ba57741b420f854e3eb33962ddc9
I20260709 13:06:00.159626 19221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5aed43197ae04b50b755bfa009cc75d1"
dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
mode: GRACEFUL
new_leader_uuid: "fce2ba57741b420f854e3eb33962ddc9"
 from {username='slave'} at 127.0.0.1:60984
I20260709 13:06:00.160166 19221 raft_consensus.cc:606] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Received request to transfer leadership to TS fce2ba57741b420f854e3eb33962ddc9
I20260709 13:06:00.185323 19353 consensus_queue.cc:1048] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.195979 19400 consensus_queue.cc:1048] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.204761 19353 raft_consensus.cc:993] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55: : Instructing follower fce2ba57741b420f854e3eb33962ddc9 to start an election
I20260709 13:06:00.205770 19402 raft_consensus.cc:1081] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Signalling peer fce2ba57741b420f854e3eb33962ddc9 to start an election
I20260709 13:06:00.208117 19353 consensus_queue.cc:1048] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.207465 19149 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e6cf0ca4dd742d5a23bf8e2dc1ab3bd"
dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
 from {username='slave'} at 127.0.0.1:46944
I20260709 13:06:00.209117 19149 raft_consensus.cc:493] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.209486 19149 raft_consensus.cc:3060] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.209920 19402 consensus_queue.cc:1048] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.217427 19149 raft_consensus.cc:515] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:00.220968 19149 leader_election.cc:290] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 2 election: Requested vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:06:00.223219 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6cf0ca4dd742d5a23bf8e2dc1ab3bd" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:06:00.223875 19221 raft_consensus.cc:3055] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:00.224212 19221 raft_consensus.cc:740] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Running, Role: LEADER
I20260709 13:06:00.225055 19221 consensus_queue.cc:260] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:00.226543 19221 raft_consensus.cc:3060] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.229955 19073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6cf0ca4dd742d5a23bf8e2dc1ab3bd" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
I20260709 13:06:00.230643 19073 raft_consensus.cc:3060] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.232411 19400 consensus_queue.cc:1048] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.234519 19402 consensus_queue.cc:1048] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.245884 19221 raft_consensus.cc:2468] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 2.
I20260709 13:06:00.247391 19112 leader_election.cc:304] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:06:00.248582 19270 raft_consensus.cc:2804] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.249249 19270 raft_consensus.cc:697] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [term 2 LEADER]: Becoming Leader. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Running, Role: LEADER
I20260709 13:06:00.244835 19073 raft_consensus.cc:2468] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 2.
I20260709 13:06:00.250309 19270 consensus_queue.cc:237] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:00.255100 19379 consensus_queue.cc:1048] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:00.294025 19431 raft_consensus.cc:993] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55: : Instructing follower fce2ba57741b420f854e3eb33962ddc9 to start an election
I20260709 13:06:00.294570 19431 raft_consensus.cc:1081] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Signalling peer fce2ba57741b420f854e3eb33962ddc9 to start an election
I20260709 13:06:00.296407 19147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5aed43197ae04b50b755bfa009cc75d1"
dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
 from {username='slave'} at 127.0.0.1:46944
I20260709 13:06:00.300963 19147 raft_consensus.cc:493] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.301398 19147 raft_consensus.cc:3060] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.302189 18972 catalog_manager.cc:5697] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 reported cstate change: term changed from 1 to 2, leader changed from 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195) to fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "fce2ba57741b420f854e3eb33962ddc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.308583 19147 raft_consensus.cc:515] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:00.308655 19390 consensus_queue.cc:1048] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:00.309329 19435 raft_consensus.cc:993] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55: : Instructing follower 361b54b3bc6a4abcb0c82778f04f7ee4 to start an election
I20260709 13:06:00.310185 19435 raft_consensus.cc:1081] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Signalling peer 361b54b3bc6a4abcb0c82778f04f7ee4 to start an election
I20260709 13:06:00.312055 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aed43197ae04b50b755bfa009cc75d1" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:06:00.312690 19221 raft_consensus.cc:3055] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:00.313001 19221 raft_consensus.cc:740] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Running, Role: LEADER
I20260709 13:06:00.313982 19221 consensus_queue.cc:260] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:00.314692 19073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68d0f5f848984b6f821e1e015dca5149"
dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
 from {username='slave'} at 127.0.0.1:58462
I20260709 13:06:00.315188 19221 raft_consensus.cc:3060] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.315351 19073 raft_consensus.cc:493] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.315843 19073 raft_consensus.cc:3060] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.318926 19147 leader_election.cc:290] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 2 election: Requested vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:06:00.324440 19221 raft_consensus.cc:2468] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 2.
I20260709 13:06:00.324275 19073 raft_consensus.cc:515] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:00.325245 19074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aed43197ae04b50b755bfa009cc75d1" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
I20260709 13:06:00.325891 19074 raft_consensus.cc:3060] T 5aed43197ae04b50b755bfa009cc75d1 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.325999 19112 leader_election.cc:304] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:06:00.326956 19394 raft_consensus.cc:2804] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.327423 19394 raft_consensus.cc:697] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 [term 2 LEADER]: Becoming Leader. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Running, Role: LEADER
I20260709 13:06:00.328203 19394 consensus_queue.cc:237] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:00.328691 19073 leader_election.cc:290] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 2 election: Requested vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:06:00.330287 19431 consensus_queue.cc:1048] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.331943 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d0f5f848984b6f821e1e015dca5149" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:06:00.332686 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d0f5f848984b6f821e1e015dca5149" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:06:00.333206 19074 raft_consensus.cc:2468] T 5aed43197ae04b50b755bfa009cc75d1 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 2.
I20260709 13:06:00.333356 19147 raft_consensus.cc:3060] T 68d0f5f848984b6f821e1e015dca5149 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.332592 19221 raft_consensus.cc:3055] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:00.336306 19221 raft_consensus.cc:740] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Running, Role: LEADER
I20260709 13:06:00.332120 19390 raft_consensus.cc:993] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4: : Instructing follower fce2ba57741b420f854e3eb33962ddc9 to start an election
I20260709 13:06:00.337339 19390 raft_consensus.cc:1081] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Signalling peer fce2ba57741b420f854e3eb33962ddc9 to start an election
I20260709 13:06:00.337349 19221 consensus_queue.cc:260] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:00.340992 19149 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c45bb123884f44d5b38a1b4eb0617e14"
dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
 from {username='slave'} at 127.0.0.1:46950
I20260709 13:06:00.341601 19149 raft_consensus.cc:493] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.341955 19149 raft_consensus.cc:3060] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.345809 19147 raft_consensus.cc:2468] T 68d0f5f848984b6f821e1e015dca5149 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 2.
I20260709 13:06:00.346436 19402 consensus_queue.cc:1048] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.346910 19040 leader_election.cc:304] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:06:00.347824 19380 raft_consensus.cc:2804] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.348275 19380 raft_consensus.cc:697] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 LEADER]: Becoming Leader. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Running, Role: LEADER
I20260709 13:06:00.349095 19380 consensus_queue.cc:237] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:00.340245 19221 raft_consensus.cc:3060] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.356132 19149 raft_consensus.cc:515] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:00.357282 18970 catalog_manager.cc:5697] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 reported cstate change: term changed from 1 to 2, leader changed from 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195) to fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "fce2ba57741b420f854e3eb33962ddc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.359143 19149 leader_election.cc:290] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 2 election: Requested vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:06:00.359717 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c45bb123884f44d5b38a1b4eb0617e14" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:06:00.360277 19222 raft_consensus.cc:3060] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.360440 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c45bb123884f44d5b38a1b4eb0617e14" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
I20260709 13:06:00.360993 19072 raft_consensus.cc:3055] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:00.361312 19072 raft_consensus.cc:740] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Running, Role: LEADER
I20260709 13:06:00.362039 19072 consensus_queue.cc:260] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:00.363171 19072 raft_consensus.cc:3060] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.364692 18971 catalog_manager.cc:5697] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4 reported cstate change: term changed from 1 to 2, leader changed from 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195) to 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.366921 19222 raft_consensus.cc:2468] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 2.
I20260709 13:06:00.371732 19112 leader_election.cc:304] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:06:00.373791 19072 raft_consensus.cc:2468] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 2.
I20260709 13:06:00.375052 19221 raft_consensus.cc:2468] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 2.
I20260709 13:06:00.376292 19394 raft_consensus.cc:2804] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.378515 19394 raft_consensus.cc:697] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9 [term 2 LEADER]: Becoming Leader. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Running, Role: LEADER
I20260709 13:06:00.379446 19394 consensus_queue.cc:237] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:00.385847 18971 catalog_manager.cc:5697] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9 reported cstate change: term changed from 1 to 2, leader changed from 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193) to fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "fce2ba57741b420f854e3eb33962ddc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.573974 19435 raft_consensus.cc:993] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55: : Instructing follower fce2ba57741b420f854e3eb33962ddc9 to start an election
I20260709 13:06:00.574489 19431 raft_consensus.cc:1081] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Signalling peer fce2ba57741b420f854e3eb33962ddc9 to start an election
I20260709 13:06:00.576239 19148 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50b5b3adde6e4c1a99bdedef4c3ff8a3"
dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
 from {username='slave'} at 127.0.0.1:46944
I20260709 13:06:00.576815 19148 raft_consensus.cc:493] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.577203 19148 raft_consensus.cc:3060] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.582430 19148 raft_consensus.cc:515] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:00.584002 19148 leader_election.cc:290] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 2 election: Requested vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:06:00.584944 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b5b3adde6e4c1a99bdedef4c3ff8a3" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
I20260709 13:06:00.585139 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b5b3adde6e4c1a99bdedef4c3ff8a3" candidate_uuid: "fce2ba57741b420f854e3eb33962ddc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:06:00.585609 19072 raft_consensus.cc:3060] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.585721 19222 raft_consensus.cc:3055] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:00.586094 19222 raft_consensus.cc:740] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Running, Role: LEADER
I20260709 13:06:00.586709 19222 consensus_queue.cc:260] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:00.587545 19222 raft_consensus.cc:3060] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.590488 19072 raft_consensus.cc:2468] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 2.
I20260709 13:06:00.591653 19113 leader_election.cc:304] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361b54b3bc6a4abcb0c82778f04f7ee4, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:06:00.592300 19222 raft_consensus.cc:2468] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fce2ba57741b420f854e3eb33962ddc9 in term 2.
I20260709 13:06:00.592489 19394 raft_consensus.cc:2804] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.593117 19394 raft_consensus.cc:697] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9 [term 2 LEADER]: Becoming Leader. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Running, Role: LEADER
I20260709 13:06:00.593856 19394 consensus_queue.cc:237] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:00.601577 18971 catalog_manager.cc:5697] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9 reported cstate change: term changed from 1 to 2, leader changed from 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195) to fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194). New cstate: current_term: 2 leader_uuid: "fce2ba57741b420f854e3eb33962ddc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.618813 19270 raft_consensus.cc:993] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9: : Instructing follower 361b54b3bc6a4abcb0c82778f04f7ee4 to start an election
I20260709 13:06:00.619280 19394 raft_consensus.cc:1081] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [term 1 LEADER]: Signalling peer 361b54b3bc6a4abcb0c82778f04f7ee4 to start an election
I20260709 13:06:00.620695 19072 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03375ff453d54716b9d7f7d3e2791e43"
dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
 from {username='slave'} at 127.0.0.1:58476
I20260709 13:06:00.621170 19072 raft_consensus.cc:493] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.621457 19072 raft_consensus.cc:3060] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.625689 19072 raft_consensus.cc:515] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:00.627135 19072 leader_election.cc:290] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 2 election: Requested vote from peers fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213), 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195:37691)
I20260709 13:06:00.628180 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03375ff453d54716b9d7f7d3e2791e43" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:06:00.628180 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03375ff453d54716b9d7f7d3e2791e43" candidate_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
I20260709 13:06:00.628927 19148 raft_consensus.cc:3055] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:00.629351 19148 raft_consensus.cc:740] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Running, Role: LEADER
I20260709 13:06:00.629182 19222 raft_consensus.cc:3060] T 03375ff453d54716b9d7f7d3e2791e43 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.630190 19148 consensus_queue.cc:260] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:00.631412 19148 raft_consensus.cc:3060] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.635026 19222 raft_consensus.cc:2468] T 03375ff453d54716b9d7f7d3e2791e43 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 2.
I20260709 13:06:00.636178 19037 leader_election.cc:304] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, 361b54b3bc6a4abcb0c82778f04f7ee4; no voters: 
I20260709 13:06:00.637259 19379 raft_consensus.cc:2804] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:00.637315 19148 raft_consensus.cc:2468] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361b54b3bc6a4abcb0c82778f04f7ee4 in term 2.
I20260709 13:06:00.637893 19379 raft_consensus.cc:697] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 LEADER]: Becoming Leader. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Running, Role: LEADER
I20260709 13:06:00.639328 19379 consensus_queue.cc:237] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:00.646075 18971 catalog_manager.cc:5697] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4 reported cstate change: term changed from 1 to 2, leader changed from fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194) to 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193). New cstate: current_term: 2 leader_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.727499 19072 raft_consensus.cc:1275] T 5aed43197ae04b50b755bfa009cc75d1 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Refusing update from remote peer fce2ba57741b420f854e3eb33962ddc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.728751 19394 consensus_queue.cc:1048] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:00.738514 19222 raft_consensus.cc:1275] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Refusing update from remote peer fce2ba57741b420f854e3eb33962ddc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.739809 19270 consensus_queue.cc:1048] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:00.765832 19072 raft_consensus.cc:1275] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Refusing update from remote peer fce2ba57741b420f854e3eb33962ddc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.767115 19270 consensus_queue.cc:1048] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:00.774633 19222 raft_consensus.cc:1275] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Refusing update from remote peer fce2ba57741b420f854e3eb33962ddc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.776557 19395 consensus_queue.cc:1048] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:00.810614 19222 raft_consensus.cc:1275] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Refusing update from remote peer fce2ba57741b420f854e3eb33962ddc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.811934 19395 consensus_queue.cc:1048] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:00.821583 19072 raft_consensus.cc:1275] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Refusing update from remote peer fce2ba57741b420f854e3eb33962ddc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.822991 19270 consensus_queue.cc:1048] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:00.834263 19149 raft_consensus.cc:1275] T 68d0f5f848984b6f821e1e015dca5149 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Refusing update from remote peer 361b54b3bc6a4abcb0c82778f04f7ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.835651 19379 consensus_queue.cc:1048] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:00.843502 19222 raft_consensus.cc:1275] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Refusing update from remote peer 361b54b3bc6a4abcb0c82778f04f7ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.845207 19380 consensus_queue.cc:1048] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:01.018908 19148 raft_consensus.cc:1275] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Refusing update from remote peer 361b54b3bc6a4abcb0c82778f04f7ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:01.020347 19390 consensus_queue.cc:1048] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:01.032063 19222 raft_consensus.cc:1275] T 03375ff453d54716b9d7f7d3e2791e43 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Refusing update from remote peer 361b54b3bc6a4abcb0c82778f04f7ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:01.033433 19390 consensus_queue.cc:1048] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:01.112980 19072 raft_consensus.cc:1275] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Refusing update from remote peer fce2ba57741b420f854e3eb33962ddc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:01.114179 19270 consensus_queue.cc:1048] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:01.122851 19222 raft_consensus.cc:1275] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Refusing update from remote peer fce2ba57741b420f854e3eb33962ddc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:01.124413 19442 consensus_queue.cc:1048] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:03.166236 18971 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50324:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:06:03.191140 18971 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:50324:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:06:03.227387  7271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:03.436240 19465 log.cc:927] Time spent T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:06:03.468144 19483 log.cc:927] Time spent T 2085978b74ea469b8ccfa4943661dc32 P 361b54b3bc6a4abcb0c82778f04f7ee4: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:06:03.499577 19495 tablet.cc:1724] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:06:03.513314 19040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.194:40213, user_credentials={real_user=slave}} blocked reactor thread for 69747.9us
W20260709 13:06:03.516877 19037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:37691, user_credentials={real_user=slave}} blocked reactor thread for 80828.2us
I20260709 13:06:03.517771 19494 tablet.cc:1724] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.521209 19492 tablet.cc:1724] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.573776 19508 tablet.cc:1724] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.545679 19497 tablet.cc:1724] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:06:03.599920 19037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.195:37691, user_credentials={real_user=slave}} blocked reactor thread for 76027.3us
I20260709 13:06:03.605664 19149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a120f7c7df9457ea291625082cb28f7"
dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
mode: GRACEFUL
new_leader_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
 from {username='slave'} at 127.0.0.1:52296
I20260709 13:06:03.624784 19514 tablet.cc:1724] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.631397 19492 tablet.cc:1724] T 1da5acec4bbb419db0919ea6c8ce269e P fce2ba57741b420f854e3eb33962ddc9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.616786 19506 tablet.cc:1724] T 2085978b74ea469b8ccfa4943661dc32 P fce2ba57741b420f854e3eb33962ddc9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.614814 19502 tablet.cc:1724] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.650895 19516 tablet.cc:1724] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 361b54b3bc6a4abcb0c82778f04f7ee4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.614434 19149 raft_consensus.cc:606] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 2 LEADER]: Received request to transfer leadership to TS 0d045c5ca0634c0fa98ac57c40a77d55
I20260709 13:06:03.667994 19495 tablet.cc:1724] T 2085978b74ea469b8ccfa4943661dc32 P 361b54b3bc6a4abcb0c82778f04f7ee4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.669719 19515 tablet.cc:1724] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:06:03.669601 19504 log.cc:927] Time spent T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55: Append to log took a long time: real 0.095s	user 0.000s	sys 0.003s
W20260709 13:06:03.665061 19484 log.cc:927] Time spent T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:06:03.692742 19497 tablet.cc:1724] T 7887837532114dd4aa89a5e994326cf0 P 0d045c5ca0634c0fa98ac57c40a77d55: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.694010 19492 tablet.cc:1724] T 68d0f5f848984b6f821e1e015dca5149 P fce2ba57741b420f854e3eb33962ddc9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.702003 19506 tablet.cc:1724] T 7887837532114dd4aa89a5e994326cf0 P fce2ba57741b420f854e3eb33962ddc9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.750769 19502 tablet.cc:1724] T 1da5acec4bbb419db0919ea6c8ce269e P 0d045c5ca0634c0fa98ac57c40a77d55: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.755757 19495 tablet.cc:1724] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.697403 19494 tablet.cc:1724] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 361b54b3bc6a4abcb0c82778f04f7ee4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.712571 19508 tablet.cc:1724] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.774830 19492 tablet.cc:1724] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.775355 19517 tablet.cc:1724] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.787437 19492 tablet.cc:1724] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.799454 19508 tablet.cc:1724] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.784502 19497 tablet.cc:1724] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:06:03.810652 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.25.193:38471, user_credentials={real_user=slave}} blocked reactor thread for 97368us
I20260709 13:06:03.811902 19521 tablet.cc:1724] T 03375ff453d54716b9d7f7d3e2791e43 P 0d045c5ca0634c0fa98ac57c40a77d55: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.821765 19520 raft_consensus.cc:993] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9: : Instructing follower 0d045c5ca0634c0fa98ac57c40a77d55 to start an election
I20260709 13:06:03.822470 19520 raft_consensus.cc:1081] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 2 LEADER]: Signalling peer 0d045c5ca0634c0fa98ac57c40a77d55 to start an election
I20260709 13:06:03.826116 19220 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a120f7c7df9457ea291625082cb28f7"
dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
 from {username='slave'} at 127.0.0.1:60968
I20260709 13:06:03.826790 19220 raft_consensus.cc:493] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:03.827095 19220 raft_consensus.cc:3060] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.835489 19220 raft_consensus.cc:515] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:03.837735 19220 leader_election.cc:290] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 3 election: Requested vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213)
I20260709 13:06:03.838260 19495 tablet.cc:1724] T 5aed43197ae04b50b755bfa009cc75d1 P 361b54b3bc6a4abcb0c82778f04f7ee4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.839651 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a120f7c7df9457ea291625082cb28f7" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
I20260709 13:06:03.840454 19068 raft_consensus.cc:3060] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.840646 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a120f7c7df9457ea291625082cb28f7" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:06:03.841284 19148 raft_consensus.cc:3055] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:03.841583 19148 raft_consensus.cc:740] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fce2ba57741b420f854e3eb33962ddc9, State: Running, Role: LEADER
I20260709 13:06:03.842463 19148 consensus_queue.cc:260] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:03.843819 19148 raft_consensus.cc:3060] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.848861 19068 raft_consensus.cc:2468] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 3.
I20260709 13:06:03.850581 19187 leader_election.cc:304] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, 361b54b3bc6a4abcb0c82778f04f7ee4; no voters: 
I20260709 13:06:03.851612 19400 raft_consensus.cc:2804] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:03.852110 19400 raft_consensus.cc:697] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 3 LEADER]: Becoming Leader. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Running, Role: LEADER
I20260709 13:06:03.839582 19494 tablet.cc:1724] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:03.853303 19400 consensus_queue.cc:237] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:03.864787 19148 raft_consensus.cc:2468] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 3.
I20260709 13:06:03.876358 19068 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78b422a66cf84972b1264e123660bdff"
dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
mode: GRACEFUL
new_leader_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
 from {username='slave'} at 127.0.0.1:60014
I20260709 13:06:03.877200 19068 raft_consensus.cc:606] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Received request to transfer leadership to TS 0d045c5ca0634c0fa98ac57c40a77d55
I20260709 13:06:03.878947  7271 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:03.879607  7271 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:03.876360 18970 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d: soft_deleted_table [id=e8db5d77936d4b45833bca14e97a6567] alter complete (version 1)
I20260709 13:06:03.885890 18970 catalog_manager.cc:5697] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 reported cstate change: term changed from 2 to 3, leader changed from fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194) to 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195). New cstate: current_term: 3 leader_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.004482 19449 raft_consensus.cc:993] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4: : Instructing follower 0d045c5ca0634c0fa98ac57c40a77d55 to start an election
I20260709 13:06:04.005041 19505 raft_consensus.cc:1081] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Signalling peer 0d045c5ca0634c0fa98ac57c40a77d55 to start an election
I20260709 13:06:04.006666 19220 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78b422a66cf84972b1264e123660bdff"
dest_uuid: "0d045c5ca0634c0fa98ac57c40a77d55"
 from {username='slave'} at 127.0.0.1:60966
I20260709 13:06:04.007234 19220 raft_consensus.cc:493] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:04.007539 19220 raft_consensus.cc:3060] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.012995 19220 raft_consensus.cc:515] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:04.014940 19220 leader_election.cc:290] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 2 election: Requested vote from peers 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471), fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213)
I20260709 13:06:04.015779 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b422a66cf84972b1264e123660bdff" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4"
I20260709 13:06:04.015966 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b422a66cf84972b1264e123660bdff" candidate_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fce2ba57741b420f854e3eb33962ddc9"
I20260709 13:06:04.016623 19148 raft_consensus.cc:3060] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.016585 19068 raft_consensus.cc:3055] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:04.017390 19068 raft_consensus.cc:740] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 361b54b3bc6a4abcb0c82778f04f7ee4, State: Running, Role: LEADER
I20260709 13:06:04.018404 19068 consensus_queue.cc:260] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:04.019917 19068 raft_consensus.cc:3060] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.025030 19148 raft_consensus.cc:2468] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 2.
I20260709 13:06:04.026274 19189 leader_election.cc:304] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d045c5ca0634c0fa98ac57c40a77d55, fce2ba57741b420f854e3eb33962ddc9; no voters: 
I20260709 13:06:04.027016 19400 raft_consensus.cc:2804] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.027113 19068 raft_consensus.cc:2468] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d045c5ca0634c0fa98ac57c40a77d55 in term 2.
I20260709 13:06:04.027595 19400 raft_consensus.cc:697] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 LEADER]: Becoming Leader. State: Replica: 0d045c5ca0634c0fa98ac57c40a77d55, State: Running, Role: LEADER
I20260709 13:06:04.028630 19400 consensus_queue.cc:237] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } }
I20260709 13:06:04.038697 18970 catalog_manager.cc:5697] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 reported cstate change: term changed from 1 to 2, leader changed from 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193) to 0d045c5ca0634c0fa98ac57c40a77d55 (127.7.25.195). New cstate: current_term: 2 leader_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d045c5ca0634c0fa98ac57c40a77d55" member_type: VOTER last_known_addr { host: "127.7.25.195" port: 37691 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.359366 19068 raft_consensus.cc:1275] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 3 FOLLOWER]: Refusing update from remote peer 0d045c5ca0634c0fa98ac57c40a77d55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:04.360745 19400 consensus_queue.cc:1048] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.376130 19148 raft_consensus.cc:1275] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 3 FOLLOWER]: Refusing update from remote peer 0d045c5ca0634c0fa98ac57c40a77d55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:04.378244 19474 consensus_queue.cc:1048] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.552799 19148 raft_consensus.cc:1275] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Refusing update from remote peer 0d045c5ca0634c0fa98ac57c40a77d55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.554075 19400 consensus_queue.cc:1048] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce2ba57741b420f854e3eb33962ddc9" member_type: VOTER last_known_addr { host: "127.7.25.194" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.566192 19068 raft_consensus.cc:1275] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Refusing update from remote peer 0d045c5ca0634c0fa98ac57c40a77d55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.568154 19537 consensus_queue.cc:1048] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "361b54b3bc6a4abcb0c82778f04f7ee4" member_type: VOTER last_known_addr { host: "127.7.25.193" port: 38471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.938624  7271 tablet_server.cc:179] TabletServer@127.7.25.193:0 shutting down...
W20260709 13:06:04.960873 19187 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
W20260709 13:06:04.965525 19187 consensus_peers.cc:597] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 -> Peer 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471): Couldn't send request to peer 361b54b3bc6a4abcb0c82778f04f7ee4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:04.976046  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:04.976955  7271 tablet_replica.cc:333] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4: stopping tablet replica
I20260709 13:06:04.977861  7271 raft_consensus.cc:2243] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.978442  7271 raft_consensus.cc:2272] T c45bb123884f44d5b38a1b4eb0617e14 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.981246  7271 tablet_replica.cc:333] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4: stopping tablet replica
I20260709 13:06:04.982100  7271 raft_consensus.cc:2243] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:04.982990  7271 raft_consensus.cc:2272] T 68d0f5f848984b6f821e1e015dca5149 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.985486  7271 tablet_replica.cc:333] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4: stopping tablet replica
I20260709 13:06:04.986124  7271 raft_consensus.cc:2243] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:04.986922  7271 raft_consensus.cc:2272] T 1da5acec4bbb419db0919ea6c8ce269e P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.989359  7271 tablet_replica.cc:333] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4: stopping tablet replica
I20260709 13:06:04.990064  7271 raft_consensus.cc:2243] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:04.990932  7271 raft_consensus.cc:2272] T 7887837532114dd4aa89a5e994326cf0 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.993139  7271 tablet_replica.cc:333] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 361b54b3bc6a4abcb0c82778f04f7ee4: stopping tablet replica
I20260709 13:06:04.993716  7271 raft_consensus.cc:2243] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.994112  7271 raft_consensus.cc:2272] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.996307  7271 tablet_replica.cc:333] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4: stopping tablet replica
I20260709 13:06:04.996930  7271 raft_consensus.cc:2243] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:04.997838  7271 raft_consensus.cc:2272] T d75aeb4a68564b43a09bbbac49d5c25c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.000064  7271 tablet_replica.cc:333] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 361b54b3bc6a4abcb0c82778f04f7ee4: stopping tablet replica
I20260709 13:06:05.000648  7271 raft_consensus.cc:2243] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.001029  7271 raft_consensus.cc:2272] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.003176  7271 tablet_replica.cc:333] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4: stopping tablet replica
I20260709 13:06:05.003890  7271 raft_consensus.cc:2243] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.004364  7271 raft_consensus.cc:2272] T f434a1d5fe124b4c939438499baa7d21 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.006603  7271 tablet_replica.cc:333] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4: stopping tablet replica
I20260709 13:06:05.007252  7271 raft_consensus.cc:2243] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.007745  7271 raft_consensus.cc:2272] T 4a120f7c7df9457ea291625082cb28f7 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.010529  7271 tablet_replica.cc:333] T 5aed43197ae04b50b755bfa009cc75d1 P 361b54b3bc6a4abcb0c82778f04f7ee4: stopping tablet replica
I20260709 13:06:05.011121  7271 raft_consensus.cc:2243] T 5aed43197ae04b50b755bfa009cc75d1 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.011579  7271 raft_consensus.cc:2272] T 5aed43197ae04b50b755bfa009cc75d1 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.013633  7271 tablet_replica.cc:333] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4: stopping tablet replica
I20260709 13:06:05.014222  7271 raft_consensus.cc:2243] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.014680  7271 raft_consensus.cc:2272] T 4a7bf2a685364a819cfd315e9093161b P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.017643  7271 tablet_replica.cc:333] T 2085978b74ea469b8ccfa4943661dc32 P 361b54b3bc6a4abcb0c82778f04f7ee4: stopping tablet replica
I20260709 13:06:05.018249  7271 raft_consensus.cc:2243] T 2085978b74ea469b8ccfa4943661dc32 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.018743  7271 raft_consensus.cc:2272] T 2085978b74ea469b8ccfa4943661dc32 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:05.020398 19187 consensus_peers.cc:597] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 -> Peer 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471): Couldn't send request to peer 361b54b3bc6a4abcb0c82778f04f7ee4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:05.021339  7271 tablet_replica.cc:333] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4: stopping tablet replica
I20260709 13:06:05.021997  7271 raft_consensus.cc:2243] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.022464  7271 raft_consensus.cc:2272] T fb7203b1470c41e794521ce68a3ce61d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.024873  7271 tablet_replica.cc:333] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4: stopping tablet replica
I20260709 13:06:05.025527  7271 raft_consensus.cc:2243] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:05.026379  7271 raft_consensus.cc:2272] T 386c68f4c9474e8aa44e1036c0fb288c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.028538  7271 tablet_replica.cc:333] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4: stopping tablet replica
I20260709 13:06:05.029052  7271 raft_consensus.cc:2243] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.029568  7271 raft_consensus.cc:2272] T f2833d7a80874891b0fb741839ed2e7d P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.031704  7271 tablet_replica.cc:333] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4: stopping tablet replica
I20260709 13:06:05.032213  7271 raft_consensus.cc:2243] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:05.033130  7271 raft_consensus.cc:2272] T f9ffcd4670984f89b76d55cc8a25153c P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.035876  7271 tablet_replica.cc:333] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4: stopping tablet replica
I20260709 13:06:05.036427  7271 raft_consensus.cc:2243] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:05.037274  7271 raft_consensus.cc:2272] T 03375ff453d54716b9d7f7d3e2791e43 P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.039803  7271 tablet_replica.cc:333] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4: stopping tablet replica
I20260709 13:06:05.040338  7271 raft_consensus.cc:2243] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.040841  7271 raft_consensus.cc:2272] T 78b422a66cf84972b1264e123660bdff P 361b54b3bc6a4abcb0c82778f04f7ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.085850  7271 tablet_server.cc:196] TabletServer@127.7.25.193:0 shutdown complete.
W20260709 13:06:05.110532 19113 consensus_peers.cc:597] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 -> Peer 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471): Couldn't send request to peer 361b54b3bc6a4abcb0c82778f04f7ee4. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:38471: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:05.126279  7271 tablet_server.cc:179] TabletServer@127.7.25.194:0 shutting down...
W20260709 13:06:05.149260 19113 consensus_peers.cc:597] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 -> Peer 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471): Couldn't send request to peer 361b54b3bc6a4abcb0c82778f04f7ee4. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:38471: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:05.159678  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:05.160563  7271 tablet_replica.cc:333] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9: stopping tablet replica
I20260709 13:06:05.161613  7271 raft_consensus.cc:2243] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:05.162413  7271 raft_consensus.cc:2272] T c45bb123884f44d5b38a1b4eb0617e14 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.164426  7271 tablet_replica.cc:333] T 68d0f5f848984b6f821e1e015dca5149 P fce2ba57741b420f854e3eb33962ddc9: stopping tablet replica
I20260709 13:06:05.164996  7271 raft_consensus.cc:2243] T 68d0f5f848984b6f821e1e015dca5149 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.165491  7271 raft_consensus.cc:2272] T 68d0f5f848984b6f821e1e015dca5149 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.167426  7271 tablet_replica.cc:333] T 7887837532114dd4aa89a5e994326cf0 P fce2ba57741b420f854e3eb33962ddc9: stopping tablet replica
I20260709 13:06:05.167886  7271 raft_consensus.cc:2243] T 7887837532114dd4aa89a5e994326cf0 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.168268  7271 raft_consensus.cc:2272] T 7887837532114dd4aa89a5e994326cf0 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.170761  7271 tablet_replica.cc:333] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9: stopping tablet replica
I20260709 13:06:05.171522  7271 raft_consensus.cc:2243] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.172050  7271 raft_consensus.cc:2272] T 78b422a66cf84972b1264e123660bdff P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.175822  7271 tablet_replica.cc:333] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9: stopping tablet replica
I20260709 13:06:05.176718  7271 raft_consensus.cc:2243] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.177307  7271 raft_consensus.cc:2272] T 03375ff453d54716b9d7f7d3e2791e43 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:05.177690 19187 consensus_peers.cc:597] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 -> Peer 361b54b3bc6a4abcb0c82778f04f7ee4 (127.7.25.193:38471): Couldn't send request to peer 361b54b3bc6a4abcb0c82778f04f7ee4. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.193:38471: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:05.179409  7271 tablet_replica.cc:333] T 1da5acec4bbb419db0919ea6c8ce269e P fce2ba57741b420f854e3eb33962ddc9: stopping tablet replica
I20260709 13:06:05.180114  7271 raft_consensus.cc:2243] T 1da5acec4bbb419db0919ea6c8ce269e P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.180559  7271 raft_consensus.cc:2272] T 1da5acec4bbb419db0919ea6c8ce269e P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.182546  7271 tablet_replica.cc:333] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9: stopping tablet replica
I20260709 13:06:05.183089  7271 raft_consensus.cc:2243] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:05.183849  7271 raft_consensus.cc:2272] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.185873  7271 tablet_replica.cc:333] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9: stopping tablet replica
I20260709 13:06:05.186463  7271 raft_consensus.cc:2243] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:05.187229  7271 raft_consensus.cc:2272] T f434a1d5fe124b4c939438499baa7d21 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.189265  7271 tablet_replica.cc:333] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9: stopping tablet replica
I20260709 13:06:05.189807  7271 raft_consensus.cc:2243] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.190201  7271 raft_consensus.cc:2272] T 4a120f7c7df9457ea291625082cb28f7 P fce2ba57741b420f854e3eb33962ddc9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.192796  7271 tablet_replica.cc:333] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9: stopping tablet replica
I20260709 13:06:05.193423  7271 raft_consensus.cc:2243] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:05.194183  7271 raft_consensus.cc:2272] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.196071  7271 tablet_replica.cc:333] T d75aeb4a68564b43a09bbbac49d5c25c P fce2ba57741b420f854e3eb33962ddc9: stopping tablet replica
I20260709 13:06:05.196589  7271 raft_consensus.cc:2243] T d75aeb4a68564b43a09bbbac49d5c25c P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.197063  7271 raft_consensus.cc:2272] T d75aeb4a68564b43a09bbbac49d5c25c P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.199111  7271 tablet_replica.cc:333] T 2085978b74ea469b8ccfa4943661dc32 P fce2ba57741b420f854e3eb33962ddc9: stopping tablet replica
I20260709 13:06:05.199633  7271 raft_consensus.cc:2243] T 2085978b74ea469b8ccfa4943661dc32 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.200131  7271 raft_consensus.cc:2272] T 2085978b74ea469b8ccfa4943661dc32 P fce2ba57741b420f854e3eb33962ddc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.202111  7271 tablet_replica.cc:333] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9: stopping tablet replica
I20260709 13:06:05.202644  7271 raft_consensus.cc:2243] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:05.203442  7271 raft_consensus.cc:2272] T fb7203b1470c41e794521ce68a3ce61d P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.205526  7271 tablet_replica.cc:333] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9: stopping tablet replica
I20260709 13:06:05.206043  7271 raft_consensus.cc:2243] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:05.206830  7271 raft_consensus.cc:2272] T 5aed43197ae04b50b755bfa009cc75d1 P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.208815  7271 tablet_replica.cc:333] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9: stopping tablet replica
I20260709 13:06:05.209376  7271 raft_consensus.cc:2243] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:05.210210  7271 raft_consensus.cc:2272] T 4a7bf2a685364a819cfd315e9093161b P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.212149  7271 tablet_replica.cc:333] T f9ffcd4670984f89b76d55cc8a25153c P fce2ba57741b420f854e3eb33962ddc9: stopping tablet replica
I20260709 13:06:05.212684  7271 raft_consensus.cc:2243] T f9ffcd4670984f89b76d55cc8a25153c P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.213186  7271 raft_consensus.cc:2272] T f9ffcd4670984f89b76d55cc8a25153c P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.215188  7271 tablet_replica.cc:333] T f2833d7a80874891b0fb741839ed2e7d P fce2ba57741b420f854e3eb33962ddc9: stopping tablet replica
I20260709 13:06:05.215744  7271 raft_consensus.cc:2243] T f2833d7a80874891b0fb741839ed2e7d P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.216246  7271 raft_consensus.cc:2272] T f2833d7a80874891b0fb741839ed2e7d P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.218356  7271 tablet_replica.cc:333] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9: stopping tablet replica
I20260709 13:06:05.218832  7271 raft_consensus.cc:2243] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.219286  7271 raft_consensus.cc:2272] T 386c68f4c9474e8aa44e1036c0fb288c P fce2ba57741b420f854e3eb33962ddc9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.258708  7271 tablet_server.cc:196] TabletServer@127.7.25.194:0 shutdown complete.
W20260709 13:06:05.272357 19189 consensus_peers.cc:597] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 -> Peer fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213): Couldn't send request to peer fce2ba57741b420f854e3eb33962ddc9. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:40213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:05.295199  7271 tablet_server.cc:179] TabletServer@127.7.25.195:0 shutting down...
W20260709 13:06:05.321015 19189 consensus_peers.cc:597] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 -> Peer fce2ba57741b420f854e3eb33962ddc9 (127.7.25.194:40213): Couldn't send request to peer fce2ba57741b420f854e3eb33962ddc9. Status: Network error: Client connection negotiation failed: client connection to 127.7.25.194:40213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:05.329879  7271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:05.330679  7271 tablet_replica.cc:333] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55: stopping tablet replica
I20260709 13:06:05.331367  7271 raft_consensus.cc:2243] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.331914  7271 raft_consensus.cc:2272] T 68d0f5f848984b6f821e1e015dca5149 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.334199  7271 tablet_replica.cc:333] T 7887837532114dd4aa89a5e994326cf0 P 0d045c5ca0634c0fa98ac57c40a77d55: stopping tablet replica
I20260709 13:06:05.334760  7271 raft_consensus.cc:2243] T 7887837532114dd4aa89a5e994326cf0 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.335224  7271 raft_consensus.cc:2272] T 7887837532114dd4aa89a5e994326cf0 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.337170  7271 tablet_replica.cc:333] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55: stopping tablet replica
I20260709 13:06:05.337742  7271 raft_consensus.cc:2243] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.338186  7271 raft_consensus.cc:2272] T c45bb123884f44d5b38a1b4eb0617e14 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.340449  7271 tablet_replica.cc:333] T 1da5acec4bbb419db0919ea6c8ce269e P 0d045c5ca0634c0fa98ac57c40a77d55: stopping tablet replica
I20260709 13:06:05.341128  7271 raft_consensus.cc:2243] T 1da5acec4bbb419db0919ea6c8ce269e P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.341619  7271 raft_consensus.cc:2272] T 1da5acec4bbb419db0919ea6c8ce269e P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.343782  7271 tablet_replica.cc:333] T f434a1d5fe124b4c939438499baa7d21 P 0d045c5ca0634c0fa98ac57c40a77d55: stopping tablet replica
I20260709 13:06:05.344359  7271 raft_consensus.cc:2243] T f434a1d5fe124b4c939438499baa7d21 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.344817  7271 raft_consensus.cc:2272] T f434a1d5fe124b4c939438499baa7d21 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.346827  7271 tablet_replica.cc:333] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55: stopping tablet replica
I20260709 13:06:05.347421  7271 raft_consensus.cc:2243] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:05.348181  7271 raft_consensus.cc:2272] T 4a120f7c7df9457ea291625082cb28f7 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.350703  7271 tablet_replica.cc:333] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55: stopping tablet replica
I20260709 13:06:05.351399  7271 raft_consensus.cc:2243] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.351833  7271 raft_consensus.cc:2272] T 8e6cf0ca4dd742d5a23bf8e2dc1ab3bd P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.353760  7271 tablet_replica.cc:333] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55: stopping tablet replica
I20260709 13:06:05.354236  7271 raft_consensus.cc:2243] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:05.354967  7271 raft_consensus.cc:2272] T 78b422a66cf84972b1264e123660bdff P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.357378  7271 tablet_replica.cc:333] T 03375ff453d54716b9d7f7d3e2791e43 P 0d045c5ca0634c0fa98ac57c40a77d55: stopping tablet replica
I20260709 13:06:05.357909  7271 raft_consensus.cc:2243] T 03375ff453d54716b9d7f7d3e2791e43 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.358378  7271 raft_consensus.cc:2272] T 03375ff453d54716b9d7f7d3e2791e43 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.360332  7271 tablet_replica.cc:333] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55: stopping tablet replica
I20260709 13:06:05.360786  7271 raft_consensus.cc:2243] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:05.361546  7271 raft_consensus.cc:2272] T 2085978b74ea469b8ccfa4943661dc32 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.363443  7271 tablet_replica.cc:333] T fb7203b1470c41e794521ce68a3ce61d P 0d045c5ca0634c0fa98ac57c40a77d55: stopping tablet replica
I20260709 13:06:05.363879  7271 raft_consensus.cc:2243] T fb7203b1470c41e794521ce68a3ce61d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.364249  7271 raft_consensus.cc:2272] T fb7203b1470c41e794521ce68a3ce61d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.366281  7271 tablet_replica.cc:333] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55: stopping tablet replica
I20260709 13:06:05.366742  7271 raft_consensus.cc:2243] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.367148  7271 raft_consensus.cc:2272] T 5aed43197ae04b50b755bfa009cc75d1 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.369019  7271 tablet_replica.cc:333] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55: stopping tablet replica
I20260709 13:06:05.369557  7271 raft_consensus.cc:2243] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.369920  7271 raft_consensus.cc:2272] T 4a7bf2a685364a819cfd315e9093161b P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.371853  7271 tablet_replica.cc:333] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55: stopping tablet replica
I20260709 13:06:05.372303  7271 raft_consensus.cc:2243] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.372690  7271 raft_consensus.cc:2272] T 50b5b3adde6e4c1a99bdedef4c3ff8a3 P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.374737  7271 tablet_replica.cc:333] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55: stopping tablet replica
I20260709 13:06:05.375204  7271 raft_consensus.cc:2243] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.375597  7271 raft_consensus.cc:2272] T d75aeb4a68564b43a09bbbac49d5c25c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.377964  7271 tablet_replica.cc:333] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55: stopping tablet replica
I20260709 13:06:05.378388  7271 raft_consensus.cc:2243] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:05.379101  7271 raft_consensus.cc:2272] T f2833d7a80874891b0fb741839ed2e7d P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.381141  7271 tablet_replica.cc:333] T 386c68f4c9474e8aa44e1036c0fb288c P 0d045c5ca0634c0fa98ac57c40a77d55: stopping tablet replica
I20260709 13:06:05.381633  7271 raft_consensus.cc:2243] T 386c68f4c9474e8aa44e1036c0fb288c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.382055  7271 raft_consensus.cc:2272] T 386c68f4c9474e8aa44e1036c0fb288c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.384039  7271 tablet_replica.cc:333] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55: stopping tablet replica
I20260709 13:06:05.384495  7271 raft_consensus.cc:2243] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.384917  7271 raft_consensus.cc:2272] T f9ffcd4670984f89b76d55cc8a25153c P 0d045c5ca0634c0fa98ac57c40a77d55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.424636  7271 tablet_server.cc:196] TabletServer@127.7.25.195:0 shutdown complete.
I20260709 13:06:05.458372  7271 master.cc:562] Master@127.7.25.254:38915 shutting down...
I20260709 13:06:05.479813  7271 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:05.480407  7271 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.480752  7271 tablet_replica.cc:333] T 00000000000000000000000000000000 P 59b599a001ad458f9b73d76f7b3e880d: stopping tablet replica
I20260709 13:06:05.500891  7271 master.cc:584] Master@127.7.25.254:38915 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11544 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24282 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (353871 ms total)
[  PASSED  ] 8 tests.
I20260709 13:06:05.556965  7271 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 410 messages since previous log ~14 seconds ago
I20260709 13:06:05.557192  7271 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 410 messages since previous log ~14 seconds ago
I20260709 13:06:05.557345  7271 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 408 messages since previous log ~14 seconds ago
I20260709 13:06:05.557493  7271 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:06:05.557637  7271 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:06:05.557778  7271 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~79 seconds ago
I20260709 13:06:05.557922  7271 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 1 messages since previous log ~119 seconds ago
I20260709 13:06:05.558125  7271 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 6 messages since previous log ~0 seconds ago
I20260709 13:06:05.558375  7271 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
